Data Engineer

2 days ago

Hyderabad, India AidenAI Full time
  • Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud)

Position Overview:

  • We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with minimal disruption. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines that support seamless migration, as well as ensuring the quality, scalability, and reliability of the data environment post-migration.

Responsibilities:

  • Lead Data Migration Efforts: Take the lead in migrating data systems from Teradata to Snowflake and Databricks on Azure Cloud, ensuring the integrity, quality, and security of data throughout the migration process.
  • ETL Migration and Optimization: Design, build, and optimize ETL pipelines to facilitate the migration of large datasets from Teradata to cloud-based systems, ensuring high performance and data consistency.
  • Cloud Data Architecture: Architect cloud data solutions using Azure, including Azure Databricks, Snowflake, and Azure Data Lake, for optimized data storage and processing in the cloud.
  • Data Modeling and Schema Migration: Manage and oversee the migration of data models, schemas, and data structures from Teradata to Snowflake and Databricks, ensuring efficient performance in the cloud environment.
  • Post-Migration Data Integrity: Ensure the accuracy and completeness of data after migration by performing thorough validation, testing, and troubleshooting to resolve any issues in data flows.
  • Performance Tuning: Focus on optimizing the performance of data pipelines and ensuring the efficient use of cloud resources post-migration.
  • Collaboration: Work closely with cross-functional teams (e.g., data scientists, analysts, and business stakeholders) to ensure data systems are properly integrated into the cloud environment and align with business needs.
  • Governance and Compliance: Implement and monitor data governance best practices, including security, privacy, and compliance policies, to ensure the integrity and protection of data throughout and after the migration.
  • Automation and Scalability: Automate and scale migration processes to ensure that data migration efforts are repeatable, efficient, and cost-effective.


Required Skills:


  • 4-12 years of experience in data engineering, with specific expertise in data migration from Teradata to Snowflake and Databricks.
  • Proficient in Azure Cloud tools, including Azure Databricks, Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
  • Strong experience with migrating and integrating data systems to cloud-based platforms, specifically Snowflake and Databricks on Azure.
  • Proficient in building and optimizing ETL pipelines for cloud environments using tools like Azure Data Factory, Databricks, and Apache Spark.
  • Expertise in SQL and Python for data migration, transformation, and automation tasks.
  • Solid understanding of data modeling and experience migrating complex data schemas to cloud environments.
  • Familiarity with cloud security protocols, encryption, and data privacy concerns in cloud-based data systems.
  • Ability to troubleshoot and resolve complex migration issues and ensure seamless integration across platforms.
  • Preferred Skills:
  • Azure certifications (Azure Data Engineer, Azure Solutions Architect) or other relevant cloud certifications.
  • Experience with CI/CD pipelines for automating and deploying data migration processes.
  • Knowledge of data governance and regulatory requirements for data migration to cloud environments.
  • Familiarity with Delta Lake and Lakehouse architecture for data storage and management.

  • Data Warehouse Engineer

    10 hours ago

    Hyderabad, Telangana, India NTT DATA North America Full time

    Company Overview:NTT DATA is a leader in digital transformation, serving 75% of the Fortune Global 100 and operating in over 50 countries worldwide. With a focus on innovation, optimization, and transformation, we help clients achieve long-term success through our expertise in business and technology consulting, data and artificial intelligence, industry...

  • ▷ [High Salary] Lead Azure Data Engineer | Immediate Joiner | Remote

    1 day ago

    Hyderabad, India Enable Data Full time

    Job Description Role Name: Lead Azure Data Engineer Experience: 8+ Years Location: Hyderabad, IN (100% Remote) Mandate Skills: Azure with Databricks, Pyspark, ETL Pipeline, Python scripting , SQL knowledge, Individual Contributor Full Time Requirement: - Bachelor's or master's degree in computer science, engineering, or a related field. - 10+ years of...

  • Data Modeler

    1 day ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time

    Company OverviewNTT DATA, Inc. is a trusted global innovator of business and technology services, serving 75% of the Fortune Global 100. We help clients innovate, optimize and transform for long-term success.Job DescriptionWe are seeking a skilled Enterprise Data Architect to join our team. As a key member of our data engineering team, you will be...

  • Data Steward Engineer

    2 days ago

    Hyderabad, India Vision Data Analytics Full time

    Position : Data Operations Steward. Experience : 6+ Years. Location : Hyderabad (WFO Hybrid). Full-time employee. Required Skills :- Proper Data, Warehousing, Salesforce expertise, steward. WHAT YOU'LL NEED :- Bachelor's degree in Information Technology, Data Management, or a related field.- 6+ years of experience in data management, governance, or...

  • Data engineer

    5 days ago

    Hyderabad, India Prismos Beauty Full time

    Company Description Prismos is a premium beauty brand located in Hyderabad, dedicated to providing luxurious skin and hair care solutions that blend nature and science. Our products are crafted with the finest ingredients to nourish and rejuvenate, transforming your beauty routine with quality formulations. Role Description This is a contract role...

  • Data Engineer

    4 days ago

    Hyderabad, India Prismos beauty Full time

    Company Description Prismos is a premium beauty brand located in Hyderabad, dedicated to providing luxurious skin and hair care solutions that blend nature and science. Our products are crafted with the finest ingredients to nourish and rejuvenate, transforming your beauty routine with quality formulations. Role Description This is a contract role for a Data...

  • Data engineer

    20 hours ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services Join the Walk-in Drive on 18th JAN 2025 and Pave your path to value with TCS AI Cloud Team We are Hiring for Below Skills Exp : 4 yrs to 12 yrs Azure Data Engineer Azure Dev Ops Engineer ( CI/CD Pipeline build and release , Kubernetes and Terraform ) Azure Data Bricks Azure/AWS Devops,...

  • Data Engineer

    19 hours ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services Join the Walk-in Drive on 18th JAN 2025 and Pave your path to value with TCS AI Cloud Team We are Hiring for Below Skills Exp : 4 yrs to 12 yrs Azure Data Engineer Azure DevOps Engineer ( CI/CD Pipeline build and release , Kubernetes and Terraform ) Azure Data Bricks Azure/AWS Devops, Kubernetes, Terraform, Security...

  • iHub-Data, IIIT Hyderabad | Computer Vision Engineer

    2 days ago

    hyderabad, India iHub-Data, IIIT Hyderabad Full time

    Job Title : Computer Vision Engineer Position: Onsite Location: Inside the IIIT University Gachibowli Hyderabad Primary Skills: Computer Vision, Machine Learning, Artificial Intelligence, Python, Deep Learning Degree: B.Tech/B.E. Job Description: iHub-Data is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our...

  • iHub-Data, IIIT Hyderabad | Computer Vision Engineer

    2 days ago

    hyderabad, India iHub-Data, IIIT Hyderabad Full time

    Job Title : Computer Vision EngineerPosition: OnsiteLocation: Inside the IIIT University Gachibowli HyderabadPrimary Skills:Computer Vision, Machine Learning, Artificial Intelligence, Python, Deep LearningDegree:B.Tech/B.E.Job Description:iHub-Data is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our dynamic and...

  • Data Engineer

    3 days ago

    Hyderabad, India NexusIQ Solutions Full time

    Job Title : Data Engineer Job Summary We are seeking two experienced Data Engineers to join our team, responsible for designing, building, and maintaining large-scale data pipelines and architectures on Azure. The ideal candidates will have expertise in Azure Data Engineering, Databricks, and experience with Fabric is a plus. Responsibilities 1. Design...

  • Data Engineer

    1 day ago

    hyderabad, India NexusIQ Solutions Full time

    Job Title : Data Engineer Job Summary We are seeking two experienced Data Engineers to join our team, responsible for designing, building, and maintaining large-scale data pipelines and architectures on Azure. The ideal candidates will have expertise in Azure Data Engineering, Databricks, and experience with Fabric is a plus. Responsibilities 1.⁠ ⁠Design...

  • Data Engineer

    20 hours ago

    Hyderabad, India NexusIQ Solutions Full time

    Job Title : Data Engineer Job Summary We are seeking two experienced Data Engineers to join our team, responsible for designing, building, and maintaining large-scale data pipelines and architectures on Azure. The ideal candidates will have expertise in Azure Data Engineering, Databricks, and experience with Fabric is a plus. Responsibilities 1.⁠ ⁠Design...

  • Data Engineer

    1 week ago

    Hyderabad, India Prismos beauty Full time

    Company DescriptionPrismos is a premium beauty brand located in Hyderabad, dedicated to providing luxurious skin and hair care solutions that blend nature and science. Our products are crafted with the finest ingredients to nourish and rejuvenate, transforming your beauty routine with quality formulations.Role DescriptionThis is a contract role for a Data...

  • Data engineer

    5 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy ServicesJob Openings at TCSSkill : DATABRICSExp range :5-8 YEARSRole : Permanent RoleJob location : HYDERABADCurrent location : HYDERABADInterview date :18 TH JAN 25(SATURDAY) WALKIN INTERVIEWInterview mode : FACE TO FACE AT HYDERABAD (KOHINOOR PARK)Pls find the Job Description below.D· Minimum of 8 years of experience in...

  • Data Engineer

    1 week ago

    Hyderabad, India Prismos beauty Full time

    Company DescriptionPrismos is a premium beauty brand located in Hyderabad, dedicated to providing luxurious skin and hair care solutions that blend nature and science. Our products are crafted with the finest ingredients to nourish and rejuvenate, transforming your beauty routine with quality formulations.Role DescriptionThis is a contract role for a Data...

  • Data Engineer

    1 week ago

    Hyderabad, India Prismos beauty Full time

    Company Description Prismos is a premium beauty brand located in Hyderabad, dedicated to providing luxurious skin and hair care solutions that blend nature and science. Our products are crafted with the finest ingredients to nourish and rejuvenate, transforming your beauty routine with quality formulations. Role Description This is a contract role for a...

  • Data Engineer

    1 week ago

    Hyderabad, India Prismos beauty Full time

    Company DescriptionPrismos is a premium beauty brand located in Hyderabad, dedicated to providing luxurious skin and hair care solutions that blend nature and science. Our products are crafted with the finest ingredients to nourish and rejuvenate, transforming your beauty routine with quality formulations.Role DescriptionThis is a contract role for a Data...

  • Immediate Start! Data designer

    2 days ago

    Hyderabad, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion it's a place where you can grow, belong and thrive. Your day at NTT...

  • Data engineer

    21 hours ago

    Hyderabad, India Circuitry.ai Full time

    Data Engineer Location: Hyderabad, India - Hybrid Remote (3 days a week in office preferred) Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our...