Data engineer/ Migration Specialist-Databricks

1 week ago

Bengaluru Jaipur Pune, India Celebal Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Job Title: Teradata Migration Specialist

Company: Celebal Technologies

Location: Bangalore, Hyderabad, Pune, Noida, Jaipur

Experience Required: 5+ Years

Employment Type: Full-time

About Us

Celebal Technologies is a leading Solution Services company providing expertise in Data Science, Big Data, Enterprise Cloud, and Automation.

We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance business processes.

As part of our growth strategy, we are looking for a Teradata Migration Specialist with strong Databricks and SQL/Python expertise to join our dynamic team.

Job Summary

We are seeking a highly skilled Data Engineer experienced in Teradata-to-Databricks migrations, ETL development, and large-scale data validation.

The role requires hands-on expertise in SQL, Python, Databricks, and orchestration frameworks, along with the ability to troubleshoot migration challenges and work with cross-functional enterprise teams.

Key Responsibilities

  • Convert Teradata ETL workloads into Databricks SQL.
  • Refactor ingestion pipelines using SQL and/or Python.
  • Design and implement data validation scripts for side-by-side comparisons.
  • Configure orchestration and job scheduling within the Databricks environment.
  • Perform unit, integration, UAT, and performance testing for migrated code.
  • Validate data consistency between Teradata and Databricks environments.
  • Deploy workloads in Unity Catalog-enabled workspaces and ensure governance best practices.
  • Implement job monitoring using Databricks-native tools (system tables, workflows).
  • Collaborate with Databricks teams and customers for code fixes, optimization, and best practices.

Required Technical Skills

  • Strong expertise in Teradata ETL development & migration.
  • Proficiency in Azure Databricks, SQL, and Python.
  • Deep understanding of orchestration, scheduling, and data validation techniques.
  • Hands-on knowledge of Unity Catalog for permissions and governance.
  • Experience in data testing: unit, integration, UAT, and performance.
  • Excellent debugging, troubleshooting, and optimization skills.
  • Familiarity with cloud environments: Azure / AWS / GCP.

Proven Experience In

  • Migrating large-scale Teradata workloads to Databricks.
  • Implementing data validation frameworks and resolving data drift.
  • Performing side-by-side data comparisons between legacy and modern systems.
  • Applying performance tuning for query and job optimization.
  • Collaborating with cross-functional stakeholders on enterprise-scale projects.
  • Working in retail, telecom, semiconductor, or manufacturing domains (preferred).

Why Join Us?

  • Opportunity to work on cutting-edge technologies.
  • Exposure to large-scale migration projects and cloud-first architectures.
  • Collaborative and innovation-driven work culture.
  • Continuous learning and career growth opportunities.

How to Apply

Interested candidates can share their updated resumes

  • Senior Data Engineer

    3 days ago

    Pune, India Celebal Technologies Full time

    Job Description- Senior Data Engineer (Teradata Migration Specialist)About Us Celebal Technologies is a leading Solution Service company that provides services in the fields of Data Science, Big Data, Enterprise Cloud, and Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    P-375At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical...

  • Data Migration Engineer

    2 weeks ago

    Pune, Maharashtra, India Delivery Centric Full time US$ 1,00,000 - US$ 1,50,000 per year

    Role: Data Migration EngineerLocation - Bangalore, Mumbai and PuneJob Summary:We are seeking a skilled Data Migration Engineer with expertise in AWS, Databricks, Python, PySpark, and SQL to lead and execute complex data migration projects. The ideal candidate will design, develop, and implement data migration solutions to move large volumes of data from...

  • Data Engineer-databricks

    2 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Location- Mumbai, Pune, Bangalore and Chennai Senior Data Engineer Databricks (Azure/AWS)Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms.The role will focus on implementing batch and streaming pipelines, applying the...

  • Data Engineer-Databricks

    4 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Location- Mumbai, Pune, Bangalore and Chennai Senior Data Engineer Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the...

  • Data Migration Expert

    1 week ago

    Bengaluru, Karnataka, India beBeeAzureMigration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Azure Data Migration SpecialistAbout the Role:We are seeking a highly skilled Azure Data Migration Specialist to lead the migration of large-scale SQL workloads from on-premise environments to Azure. As a key member of our team, you will be responsible for designing and developing end-to-end data pipelines using Azure Data Factory or Synapse Data...

  • Databricks Data Engineering Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title:Databricks Data Engineering SpecialistJob Description:As a Databricks Data Engineering Specialist, you will be responsible for designing and building scalable data pipelines using Apache Spark and Databricks. You will work with relational databases and CDC, capturing change events using Debezium or native CDC tools and transforming them for...

  • Data Migration Expert

    1 week ago

    Pune, Maharashtra, India beBeeDataMigration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleCelestial Data Migration Expert - Senior Data EngineerWe are seeking a skilled and experienced Data Migration Specialist to join our team.Key Responsibilities:Convert Teradata ETL workloads into Databricks SQL.Refactor ingestion pipelines using SQL and/or Python.Design and implement data validation scripts for side-by-side comparisons.Configure...

  • Cloud Data Migration Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataMigration Full time US$ 1,04,400 - US$ 1,64,700

    We are seeking an experienced Data Migration Specialist to lead the migration of large-scale SQL workloads from on-premise environments to Azure.Key ResponsibilitiesDesign, develop, and manage end-to-end data pipelines using Azure Data Factory or Synapse Data Factory.Build and administer scalable, secure Azure Data Lakes to store and manage structured and...

  • Databricks Engineer

    2 weeks ago

    Bengaluru, Karnataka, India BLJ TECH GEEKS Full time

    Azure Databricks EngineerWe are looking for a skilled Azure Databricks Engineer with 5-10 years of experience in Azure Data Services, including Azure Data Factory (ADF), Synapse Analytics, and Databricks.The candidate will play a key role in developing and maintaining data solutions on Azure.Responsibilities : - Develop and implement data pipelines using...