Data Engineering Lead for Databricks and Teradata Solutions

4 days ago


Hyderabad, India Evernorth Full time
About Evernorth

Elevate your career with Evernorth, a division of The Cigna Group (NYSE: CI), dedicated to crafting innovative pharmacy, care, and benefits solutions that boost health and vitality. Our relentless pursuit of excellence makes quality healthcare more accessible to millions.

Job Summary:

We are seeking an experienced Data Engineer to join our Data Integration team. As a key member, you will work closely with business and technical leaders to deliver high-quality data solutions.

Key Responsibilities:

  • Collaborate with stakeholders to understand requirements and design effective solutions
  • Develop performant code for data extraction, transformation, and loading using Spark, Py-Spark, Teradata SQL, Hive SQL, and Spark SQL
  • Design and implement data models to meet business needs
  • Implement dev-ops pipelines for code deployment on AWS platforms
  • Troubleshoot issues, provide effective solutions, and monitor production environments
  • Participate in agile development processes, including sprint planning, refinement, daily scrums, demos, and retrospectives

Requirements:

  • A minimum of 3-6 years of experience in software development, data engineering, or a related field

D Desired Skills:

  • Strong experience with Spark, Py-Spark, Shell scripting, and Teradata SQL
  • Expertise in writing complex SQL queries and stored procedures using Teradata SQL, Hive SQL, and Spark SQL
  • Healthcare domain knowledge is beneficial

Primary Skills:

  • Hands-on experience with Databricks, especially Delta Lake, notebooks, pipelines, cluster management, and Azure/AWS integration
  • Proficiency in Agile methodologies and DevOps tools, such as Git, Jenkins, Artifactory
  • Experience with AWS services, including S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch

Additional Skills:

  • Familiarity with Jira and Confluence
  • Exercises creativity, foresight, and judgment in conceiving, planning, and delivering initiatives

Estimated Salary:

$120,000 - $180,000 per year, depending on experience and location. This estimate is based on industry standards and the level of expertise required for this role.


  • Data Engineer

    4 days ago


    Hyderabad, India AIDEN AI PRIVATE LIMITED Full time

    Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud). Position Overview : We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with...


  • Hyderabad, Telangana, India Teradata Full time

    What You’ll Do Manage Production/Development databases performance. Review Teradata system reports and provide “performance assessment” report with recommendations to optimize system. Investigate and quantify opportunities from “performance assessment” reports and Monitor using Viewpoint tool for Teradata system performance using different...

  • Data engineer

    2 days ago


    Hyderabad, India AidenAI Full time

    Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud)Position Overview:We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with minimal...

  • Data Engineer

    5 days ago


    Hyderabad, India AidenAI Full time

    Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud) Position Overview: We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with...

  • Data Engineer

    6 days ago


    Hyderabad, India AidenAI Full time

    Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud)Position Overview:We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with minimal...

  • Data Engineer

    5 days ago


    Hyderabad, India AidenAI Full time

    Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud)Position Overview:We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with minimal...

  • Azure data engineer

    2 days ago


    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....


  • hyderabad, India AidenAI Full time

    Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud)Position Overview:We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with minimal...

  • Teradata

    7 months ago


    Hyderabad, India NTT DATA Full time

    **Teradata | 3 - 6 Yrs** Work Mode - Hybrid Location - HYD/BLR Shift Timing - 12 PM to 9 PM Description: Skillset: Teradata, Informatica, UNIX (Hadoop/AWS will be addon) **Job Description**: Lights On development/enhancement role requires associate to work on enhancements in agile model and based on the need, need to involve incident management...

  • Azure Data Engineer

    5 days ago


    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration) Position Overview: We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based...

  • Azure Data Engineer

    6 days ago


    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....

  • Azure Data Engineer

    5 days ago


    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....


  • hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....


  • Hyderabad, Telangana, India Recro Full time

    Transformative Leadership Opportunity in Databricks Data EngineeringWe are seeking a visionary and dynamic Databricks Data Engineering Practice Lead to drive innovation and growth in our data engineering practice. As a key member of our team, you will be responsible for building and growing our Databricks practice, delivering cutting-edge data solutions, and...


  • Hyderabad, India Evernorth Full time

    About Evernorth: A Leading Health Services ProviderWe create innovative pharmacy, care, and benefits solutions to improve health and increase vitality for millions of people.Job Title: Data Engineer on the Integration TeamPosition Overview:As a key member of our Data Integration team, you will work closely with business and technical leaders to design and...

  • Data Engineer

    1 month ago


    Hyderabad, India Evernorth Full time

    About Evernorth:We are a leading health services company dedicated to improving health and increasing vitality through innovative solutions.**Job Summary:**Data engineer on the Data integration team responsible for designing, developing, and deploying scalable data pipelines using Spark, Py-Spark, and Teradata SQL.**Key Responsibilities:**Collaborate with...


  • Hyderabad, Telangana, India Recro Full time

    Data Engineering Practice Lead - Databricks We are seeking a visionary leader to drive innovation and growth in our Databricks practice. As the Data Engineering Practice Lead, you will be responsible for developing and expanding our Databricks capabilities, delivering cutting-edge data solutions, and driving impactful customer engagements.About the RoleThis...


  • Hyderabad, Telangana, India Acunor Full time

    Cloud Data Engineer - Lead PositionAt Acunor, we are seeking a skilled Cloud Data Engineer to lead our data migration efforts from Teradata to Snowflake and Databricks on Azure Cloud. This key leadership role will drive the migration strategy, ensuring a seamless transition of data systems and pipelines to cloud-based platforms.As a Cloud Data Engineer at...


  • Hyderabad, Telangana, India Recro Full time

    At Recro, we are seeking a visionary Data Engineering Practice Lead to drive innovation and excellence in our Databricks practice.About the RoleThis is an exceptional opportunity for a seasoned data engineering leader to take ownership of our growing Databricks practice and set industry benchmarks. As the Practice Lead - Databricks Strategist, you will be...


  • Hyderabad, Telangana, India AIonOS Full time

    We are seeking an experienced Databricks expert to lead our data engineering practice and drive business growth. As a key member of our team, you will be responsible for developing and implementing large-scale data processing solutions using Databricks technologies.Key Responsibilities:Lead the development of service offerings and methodologies tailored to...