Data Engineering Lead

1 month ago


Noida, Uttar Pradesh, India YD Talent Solutions Full time
Job Title: Data Engineering Lead

About the Role:

We are seeking a highly skilled Data Engineering Lead to join our team at YD Talent Solutions. As a Data Engineering Lead, you will be responsible for designing and building production data pipelines from ingestion to consumption within a Data Platform like Databricks. You will also be responsible for ensuring seamless integration with Data Lake and implementing complex projects dealing with considerable data size (TB/PB) and high complexity in the production environment.

Key Responsibilities:

* Design and build production data pipelines from ingestion to consumption within a Data Platform like Databricks
* Ensure seamless integration with Data Lake
* Implement complex projects dealing with considerable data size (TB/PB) and high complexity in the production environment
* Collaborate with cross-functional teams to design and implement data solutions
* Develop and maintain data pipelines, data warehouses, and data marts

Requirements:

* 6-15 years of experience in data engineering
* Strong experience in AWS Cloud Computing with knowledge of services like AWS Lambda, EC2, S3, EMR, Redshift, Glue, Step Functions
* Experience in designing and building production data pipelines from ingestion to consumption within a Data Platform like Databricks
* Strong experience in data modeling, ETL development
* Experience in designing and implementing an enterprise Data Lake and Data Mart/Warehouse
* Experience in implementing complex projects dealing with considerable data size (TB/PB) and high complexity in the production environment
* Hands-on experience with CI/CD
* Excellent analytical, problem-solving, communication, and ability to communicate efficiently with individuals, and business and can work as part of a team as well as independently
* Hands-on experience with Spark with Python
* Good knowledge and development experience in Oracle/PostgreSQL/Snowflake/Redshift

Qualifications:

* BE/B.Tech/MCA
* Good expertise in Data warehousing/Dimensional Modeling

Good to have:

* Knowledge of Data Processing/Transformation using DBT
* Knowledge of Data Orchestration tools like Apache Airflow

Preferred:

* Data Engineering with Pharmacovigilance background

Requirements:

Pharmacovigilance, Safety Systems, Lambda, EC2, S3, EMR, Redshift, Glue, Databricks, CI/CD, Spark, Python, ETL, Datawarehousing, Data warehousing, Reporting, UAT, Functional Testing, User Acceptance Testing, ARISg, Argus, CRO, Life Sciences, Oracle, PostgreSQL, Snowflake, Redshift

  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: Cloud Engineering LeadJob Summary:We are seeking a highly skilled Cloud Engineering Lead to join our team at NTT DATA Services. As a Cloud Engineering Lead, you will be responsible for leading the design, implementation, and maintenance of cloud-based infrastructure and applications.Key Responsibilities:Lead the development and implementation of...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job OverviewNTT DATA Services is a global leader in business and technology services, striving to hire exceptional individuals who can drive innovation and growth. We are committed to creating a diverse and inclusive environment for all employees.We are seeking an experienced Data and Analytics Strategy Lead to join our team in Noida, India. As a key member...

  • Data Engineering Lead

    4 weeks ago


    Noida, Uttar Pradesh, India YD Talent Solutions Full time

    About YD Talent SolutionsWe are seeking a highly skilled Data Engineer Lead to join our team. As a Data Engineer Lead, you will be responsible for designing and building production data pipelines from ingestion to consumption within a Data Platform like Databricks.Key Responsibilities:Design and implement data pipelines to ensure seamless integration with...

  • Data Engineering Lead

    4 weeks ago


    Noida, Uttar Pradesh, India RateGain Full time

    About Us: RateGain is a leading provider of SaaS products that empower travel and hospitality companies to make data-driven decisions. Our cutting-edge solutions help clients optimize revenue, improve distribution, and enhance guest experiences. As a pioneer in the industry, we're proud to support 250,000+ hotel properties globally, providing 240 billion...

  • Data Engineering Lead

    2 weeks ago


    Noida, Uttar Pradesh, India BirlaSoft Full time

    Job SummaryWe are seeking a highly skilled Data Engineering Lead to join our team at BirlaSoft.Required Skills & ExperienceTechnical Lead with strong SQL and analytical abilities.Experience in a visual ETL tool such as SQL Server Integration Services.Understanding of data reconciliation between multiple data sources.Ability to write stored procedures and...

  • Data Engineer Lead

    1 month ago


    Noida, Uttar Pradesh, India YD Talent Solutions Full time

    About our clientOur client is a leading provider of Pharmacovigilance solutions, leveraging advanced technologies to develop agile, flexible, and scalable solutions for Medical Affairs, Regulatory, and Safety functions. Their expertise enables Pharma companies to execute their responsibilities while maintaining compliance and managing business risks.Their...

  • Data Engineering Lead

    2 weeks ago


    Noida, Uttar Pradesh, India DMI Full time

    DMI is seeking a highly skilled Director of Data Engineering to support our manufacturing clients' large-scale digital transformation. The ideal candidate will have a proven track record of leading data engineering teams and driving successful project delivery.Key Responsibilities:Lead a distributed team of data engineers, focusing on resource management,...


  • Noida, Uttar Pradesh, India Particle Black India Private Limited Full time

    Job Title: Lead Azure Data EngineerJob Summary: We are seeking an experienced Lead Azure Data Engineer to lead our team in delivering high-quality data engineering solutions on the Microsoft Azure platform.About the Role:Lead a team of data engineers in designing, building, and maintaining robust data pipelines on Azure Synapse Spark.Develop accurate project...

  • Data Engineer Lead

    3 weeks ago


    Noida, Uttar Pradesh, India YD Talent Solutions Full time

    Job Summary:We are seeking a highly skilled Data Engineer Lead to join our team at YD Talent Solutions. As a key member of our team, you will be responsible for designing and building production data pipelines from ingestion to consumption within a Data Platform like Databricks. Your expertise in data modeling, ETL development, and data warehousing will be...

  • Data Engineering Lead

    4 weeks ago


    Noida, Uttar Pradesh, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Data Engineering Lead, you'll play a critical role in delivering care and improving health outcomes by connecting people with the care, pharmacy benefits, data, and resources they need to feel their best.Key...

  • Data Engineering Lead

    4 weeks ago


    Noida, Uttar Pradesh, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Data Engineering Lead, you'll play a critical role in delivering care and improving health outcomes by connecting people with the care, pharmacy benefits, data, and resources they need to feel their best.Key...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Key Responsibilities:Develop and maintain scalable web applicationsDesign and implement robust software solutions using full-stack development expertiseCollaborate with cross-functional teams to deliver high-quality projectsFoster a culture of innovation and continuous learning within the teamDevelop and maintain technical documentation and knowledge...


  • Noida, Uttar Pradesh, India UnitedHealth Group Full time

    Job Title: Senior Data Engineering LeadJob Summary:We are seeking a Senior Data Engineering Lead to join our team at UnitedHealth Group. As a Senior Data Engineering Lead, you will be responsible for designing and implementing data solutions that meet business requirements. You will work closely with cross-functional teams to ensure successful implementation...


  • Noida, Uttar Pradesh, India UnitedHealth Group Full time

    Optum Data Engineering Lead Job DescriptionAt UnitedHealth Group, we strive to create a culture that promotes diversity, equity, and inclusion. Our mission is to help people live healthier lives and make the health system work better for everyone. We believe that everyone deserves the opportunity to live their healthiest life, regardless of their background...


  • Noida, Uttar Pradesh, India RateGain Full time

    About UsRateGain is a leading provider of software solutions that help travel and hospitality companies make data-driven decisions to increase revenue.We are proud to support 250,000+ hotel properties globally, providing 240 billion rate and availability updates & powering over 30 Million bookings.Our clients trust us because we offer end-to-end smart...


  • Noida, Uttar Pradesh, India Appsierra Full time

    Appsierra, a dynamic leader in the technology industry, is seeking an IICS Lead / IICS Lead Data Engineer to spearhead innovative projects driving data integration and transformation initiatives using Informatica Intelligent Cloud Services (IICS). The successful candidate will collaborate with cross-functional teams to design, implement, and optimize...


  • Noida, Uttar Pradesh, India Data Resolve Technologies Full time

    About Data Resolve TechnologiesData Resolve Technologies is a cutting-edge Cyber Security and intelligence solutions provider for Enterprises.Our focus is on addressing insider data theft and data loss through advanced security analytics via end points, from in-premise and on-cloud platforms, with our flagship product inDefend - Solution for Insider...

  • Data Engineering Lead

    3 weeks ago


    Noida, Uttar Pradesh, India Brightly Software India Private Limited Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Brightly Software India Private Limited. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key Responsibilities:Data Integration: Develop and maintain data integration pipelines using ETL/ELT tools and...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: AI Product Development LeadAbout the Role:We are seeking a seasoned AI Delivery Lead to spearhead the development of our next-generation AI products. This role demands a strong analytical mindset and a deep understanding of AI technologies, coupled with excellent leadership skills.Key Responsibilities:Develop and implement product strategies...

  • Data Engineering Lead

    4 weeks ago


    Noida, Uttar Pradesh, India UnitedHealth Group Full time

    Transforming Healthcare through Data EngineeringAt UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Data Engineering Lead, you'll play a critical role in driving this mission forward by designing, developing, and maintaining data management solutions that improve health...