Azure Data Engineer

3 days ago

Hyderabad, India Acunor Full time

Job Description: Lead Data Engineer (Migration)


Position Overview:


We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms. The Lead Engineer will oversee a team of data engineers, ensuring that the migration process is seamless, efficient, and optimized for long-term scalability and performance in the cloud.


Responsibilities:

  1. Lead and Oversee Data Migration: Take charge of migrating large and complex datasets from Teradata to Snowflake and Databricks on Azure Cloud, ensuring a smooth and effective transition with minimal disruption to business operations.
  2. Migration Strategy and Planning: Define and implement the overall data migration strategy, ensuring the timely and efficient migration of data systems to Snowflake and Databricks while maintaining data quality and integrity.
  3. Data Architecture Leadership: Architect scalable and secure cloud-based data solutions using Azure technologies such as Azure Databricks, Snowflake, Azure Data Lake, and Azure Synapse to support post-migration analytics and business intelligence.
  4. Team Leadership and Mentorship: Lead a team of data engineers, providing guidance, mentorship, and technical expertise to ensure high-quality migration and integration of data solutions.
  5. ETL Migration and Optimization: Oversee the design and implementation of ETL pipelines for migrating data from Teradata to Snowflake and Databricks, ensuring efficient data processing, transformation, and validation.
  6. Performance Monitoring and Tuning: Ensure optimal performance of data pipelines and storage solutions post-migration by implementing monitoring tools and performance tuning strategies.
  7. Collaboration with Stakeholders: Work with business stakeholders, data scientists, analysts, and IT teams to understand requirements and ensure that the migration meets both technical and business needs.
  8. Data Governance and Security: Enforce best practices for data governance, security, and compliance during the migration process, ensuring data privacy and regulatory compliance.
  9. Troubleshooting and Problem Solving: Resolve any data migration-related issues, leveraging deep technical expertise to quickly identify and fix issues that arise during the migration process.
  10. Documentation and Knowledge Sharing: Document the migration process, including data flow, architecture, and troubleshooting steps, ensuring that best practices are shared across the team.


Required Skills:

  1. 8-12 years of experience in data engineering, with a focus on data migration from Teradata to Snowflake and Databricks in Azure Cloud.
  2. Proven track record of leading data migration projects, including complex migrations to Snowflake and Databricks.
  3. In-depth knowledge of Azure Cloud services, such as Azure Databricks, Azure Data Lake, Azure Synapse, and Azure Data Factory.
  4. Strong expertise in ETL pipeline design and optimization, particularly for cloud environments and large-scale data migration.
  5. Proficient in SQL, Python, and other languages used for automation and data transformation during migration.
  6. Hands-on experience with cloud security best practices, ensuring data is protected during migration.
  7. Strong leadership and mentoring skills, with the ability to guide a team through complex migration challenges.
  8. Excellent communication and collaboration skills to work with cross-functional teams and stakeholders.


Preferred Skills:

  1. Azure certifications (Azure Data Engineer, Azure Solutions Architect Expert).
  2. Experience with automating data migration through CI/CD pipelines.
  3. Familiarity with Delta Lake, Lakehouse architecture, and cloud data security practices.
  4. Deep understanding of data governance frameworks and regulatory compliance requirements for cloud data migrations.

  • Azure data engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    7 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Data Engineer

    1 month ago

    Hyderabad, India Madhees Techno Full time

    Job Title : Azure Data EngineerExperience : 5+ years as Azure Data EngineerLocation : HyderabadAt our company, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. This role involves working with various data storage options offered by...

  • Azure Data Engineer

    7 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    6 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    7 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure data engineer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!! **TCS is Hiring for Azure Databricks Data Engineer ** Role: Azure Databricks Data Engineer Desired Experience: 5- 10 Years Job Location: Hyderabad/Bengaluru Job Description: Technical Requirements Gathering and Development of Functional Specifications. Design, develop, and maintain scalable data pipelines and...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Role: Azure Databricks Data EngineerDesired Experience: 5- 10 YearsJob Location: Hyderabad/BengaluruJob Description:Technical Requirements Gathering and Development of Functional Specifications.Design, develop, and maintain scalable data pipelines and ETL processes using Azure...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Madhees Techno Full time

    Job Description :- Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India Madhees Techno Full time

    Job Description : - Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner. - Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements. - Develop and implement data integration processes, frequently using Azure Data Factory,...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, India Madhees Techno Consulting Pvt. Ltd. Full time

    Job Description : - Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Azure Data Engineer

    2 days ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....

  • Azure Data Engineer

    2 days ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration) Position Overview: We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based...

  • Azure data engineer

    3 weeks ago

    Hyderabad, India ValueLabs Full time

    Experience: 5-10 yearsLocation: Hyderabad OR IndoreJD :Proficiency in designing, implementing, and maintaining Azure Data Engineering solutions using Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.Experience with data warehousing, ETL, and data governance. Strong understanding of data modelling, data architecture, and data...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, India ValueLabs Full time

    Experience: 5-10 yearsLocation: Hyderabad OR IndoreJD :Proficiency in designing, implementing, and maintaining Azure Data Engineering solutions using Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.Experience with data warehousing, ETL, and data governance. Strong understanding of data modelling, data architecture, and data...