Lead Data Engineer

3 weeks ago

PuneHyderabadGurgaonGurugram, India LnS Infotech Full time

Position : Lead Data Engineer

Location : : 8+ Years

Roles & Responsibilities :

This role is a hybrid across Data Engineering skill sets and DBA.


Ideally someone with a background in Oracle DBA roles who has branched into data engineering.

- 8+ years of hands-on experience in SQL, Py Spark & Python, should be experienced in shell scripting


Job Description :

- Experienced with AWS services (S3, Glue, Lambda, EMR, Boto3, etc.), ETL, Data Warehousing


- Experience using Git, Jenkins, Terraform

- Experienced implementing ETL pipelines & and migration requirements

- Sound knowledge of Data Engineering concepts and tools for Data Ingestion, Integration, and workflow orchestration

- Ability to handle augmentation of both structured, unstructured, and real-time data, and provide best practices for pipeline operations

- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability

- Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers.


- Implement Data Governance best practices.

- Create and maintain clear documentation on data models/schemas as well as transformation /validation rules

- Implement tools that help data consumers extract, analyze, and visualize data faster through data pipelines

- Led the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for batch ETLs.

- Migrate current on-premises data applications and pipelines to the Cloud leveraging technologies in the future

- One of Oracle, Postgres, Teradata, and Starburst (Trino) DBA experience, preferably in an AWS environment

- Wider AWS experience is welcome in S3, Lambda, VPC, and Security Groups

What we provide :

- Opportunities to develop and grow as an engineer.


- We are at the forefront of our industry, always expanding into new areas, and working with open-source and new technologies.

- A set of hardworking and dedicated peers.

- Growth and mentorship.


- We believe in growing engineers through ownership and leadership opportunities.


- We also believe mentors help both sides of the equation.

Education : Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience

(ref:hirist.tech)

  • Lead Data Engineer

    3 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN LnS Infotech Full time

    Position : Lead Data EngineerLocation : : 8+ YearsRoles & Responsibilities : This role is a hybrid across Data Engineering skill sets and DBA. Ideally someone with a background in Oracle DBA roles who has branched into data engineering.- 8+ years of hands-on experience in SQL, Py Spark & Python, should be experienced in shell scriptingJob Description :-...

  • Lead Data Engineer

    1 month ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Senior Data Engineer

    4 days ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Senior Data Engineer

    1 month ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Azure Data Engineer

    4 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    1 month ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    1 month ago

    hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead/Senior Azure Data Engineer

    2 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Lead/Senior Azure Data Engineer

    2 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, India Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Lead Engineer

    4 weeks ago

    Hyderabad, India Inspire Brands Hyderabad Support Center Full time

    Job SummaryWe are looking for a Lead Data Engineer for the Enterprise Data Organization to design, build and manage data pipelines (Data ingestion, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong technical, analytical, programming and critical thinking...

  • Lead Engineer

    4 weeks ago

    Hyderabad, India Inspire Brands Hyderabad Support Center Full time

    Job Summary:We are looking for a Lead Data Engineer for the Enterprise Data Organization to design, build and manage data pipelines (Data ingestion, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong technical, analytical, programming and critical...

  • Lead Engineer

    1 month ago

    Hyderabad, India Inspire Brands Hyderabad Support Center Full time

    Job Summary We are looking for a Lead Data Engineer for the Enterprise Data Organization to design, build and manage data pipelines (Data ingestion, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong technical, analytical, programming and critical...

  • Lead Data Engineer

    1 month ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    1 month ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower...

  • Lead Data Engineer

    1 month ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Engineer

    4 weeks ago

    Hyderabad, India Inspire Brands Hyderabad Support Center Full time

    We are looking for a Lead Data Engineer for the Enterprise Data Organization to design, build and manage data pipelines (Data ingestion, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong technical, analytical, programming and critical thinking...

  • Lead Engineer

    1 month ago

    Hyderabad, India Inspire Brands Hyderabad Support Center Full time

    We are looking for a Lead Data Engineer for the Enterprise Data Organization to design, build and manage data pipelines (Data ingestion, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong technical, analytical, programming and critical thinking...

  • Azure Lead Data Engineer

    9 hours ago

    Pune, India IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...