Senior Lead Data Engineer

1 month ago


PuneHyderabadBangalore, IN Huquo Full time

Job Description :


Must-Have :

- 10+ years of experience in software development and delivery.

- 5 to 7 years of relevant work experience on large-scale Data applications

- Good aptitude, strong problem-solving abilities, and analytical skills

- Should have team handling experience , leading team of 6-7 members OR handle 2-3 smaller teams

- Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.

Should have good working experience on :

- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet

- Spark - Batch Processing

- Setting ETL pipelines

- Python or Java programming language is mandatory.

- Worked in data Lake , Data warehousing Domain in Cloud Environment

- Exposure to Snowflake , Redshift or other Distributed Data Warehousing System

- Experience working in Agile Methodology

- Ability to learn and help the team learn new technologies quickly

- Take up the complete of the project with strong sense of owenership.

- Excellent communication and coordination skills

- Knowledgeable (and preferred hands-on) - UNIX environments, different CICD tools, Scheduling tools like Autosys , Airflow etc.

- Must be able to integrate quickly into the team and work independently towards team goals.

Nice to Have :

- Experience in any of the cloud (AWS/Azure/GCP) , preferred is AWS

- Good to have experience in Snowflake

Role & Responsibilities :

- Take the complete responsibility for the project execution

- Be accountable for the delivery of the project in the defined timelines with good quality

- Define and follow the processes for project execution and delivery.

- Drive and motivate the team to be agile and follow agile methodology

- Guide the team technically and give the team a direction on how to plan, design, implement and deliver the projects.

- Define the architecture and discuss the pros-cons of the same with the team

- Involve the team during the brainstorming sessions as appropriate.

- Work with other team leads to get the architecture reviewed.

- Work with the clients and counterparts (in the US) to drive the project execution.

- Keep all the stakeholders updated about the project status/risks/issues if there are any.

- Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.

- Should be comfortable travel to Pune as and when required

Key Skills : Java / Python , Spark, Snowflake, AWS

Education : BE/B.Tech from a reputed institute.

(ref:hirist.tech)
  • Lead Data Engineer

    1 month ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...


  • Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Lead Data Engineer

    7 hours ago


    Hyderabad/Bangalore/Pune, IN SKANDHA IT SERVICES PRIVATE LIMITED Full time

    Lead Data Engineer Locations : Hyderabad, Bengaluru, Pune. Skills :- Programming : Python , Pyspark/Scala, Flask.- API Microservices , ECS Fargate.- Bigdata AWS : EMR, Glue, Athena, Redshift, Lambda.- Analytics : AWS Quicksight.- Database : Postgres RDS,Mongo (SQL/NoSQL).- Orchestration : preferably Airflow.About the Role : We are searching for a talented...

  • Senior Data Engineer

    1 month ago


    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...


  • Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • AWS Data Engineer

    3 weeks ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...


  • Bangalore/Pune, IN Squareroot Consulting Pvt Ltd Full time

    We are hiring Senior/Lead DevOps Engineer for the team of world-class engineers who have very good practice in building high-quality enterprise platform for globe.Role : Senior/Lead DevOps EngineerExperience : 5 to 15 YrsEducation : BE/BTech or ME/MTech from any of the premium institute.Salary Budget : 40 to 65 Lacks Per AnnumLooking for a someone who is...


  • Noida/Bangalore, IN Programming.com Full time

    Senior Data Scientist/ Lead data ScientistOverview :We are seeking an experienced Senior Data Scientist to join our team with a focus on leveraging data-driven insights to solve complex business problems. The ideal candidate should have a strong background in SQL and Python, with a minimum of 5 years of relevant experience. Additionally, proficiency in...

  • Senior Data Engineer

    1 month ago


    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Data Engineer

    7 hours ago


    Bangalore/Hyderabad/Pune/Gurgaon/Gurugram/Noida/Greater Noida, IN Publicis Sapient Full time

    Publicis Sapient Overview : We at Publicis Sapient, enable our clients to thrive in Next and to create business value through expert strategies, customer-centric experience design, and world-class product engineering.The future of business is disruptive, transformative and becoming digital to the core.In our 20 + years in IT, never before have we seen such a...

  • Lead Data Engineer

    3 weeks ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Senior Data Engineer

    2 weeks ago


    Pune/Mysore, IN IT Full time

    We are seeking a talented Senior Data Engineer with a strong background in developing ETLs and data pipelines using Apache Spark with the PySpark library. The ideal candidate will have proven experience in data modeling for data warehousing use cases, designing patterns, and building highly scalable and secure solutions. Additionally, experience with Azure...

  • Lead Data Engineer

    1 month ago


    Pune/Hyderabad/Gurgaon/Gurugram, IN LnS Infotech Full time

    Position : Lead Data EngineerLocation : : 8+ YearsRoles & Responsibilities : This role is a hybrid across Data Engineering skill sets and DBA. Ideally someone with a background in Oracle DBA roles who has branched into data engineering.- 8+ years of hands-on experience in SQL, Py Spark & Python, should be experienced in shell scriptingJob Description :-...

  • Lead Data Engineer

    2 weeks ago


    Chennai/Cochin/Kochi/Coimbatore/Hyderabad, IN DigiMoksha Solutions Full time

    Position : Lead Data EngineerExperience : 10-15 YearsLocation : Period : Immediate Description :As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal...

  • Senior Data Engineer

    1 month ago


    Bangalore/Chennai/Madurai, IN Resourcetree Full time

    Job Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...

  • AWS Data Engineer

    4 weeks ago


    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • Data Lead Engineer

    1 month ago


    Bangalore/Delhi, IN Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...


  • Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Senior Data Engineer

    1 month ago


    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...