Data engineer/ Migration Specialist-Databricks

2 weeks ago

Bengaluru Jaipur Pune, India Celebal Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Job Title: Teradata Migration Specialist

Company: Celebal Technologies

Location: Bangalore, Hyderabad, Pune, Noida, Jaipur

Experience Required: 5+ Years

Employment Type: Full-time

About Us

Celebal Technologies is a leading Solution Services company providing expertise in Data Science, Big Data, Enterprise Cloud, and Automation.

We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance business processes.

As part of our growth strategy, we are looking for a Teradata Migration Specialist with strong Databricks and SQL/Python expertise to join our dynamic team.

Job Summary

We are seeking a highly skilled Data Engineer experienced in Teradata-to-Databricks migrations, ETL development, and large-scale data validation.

The role requires hands-on expertise in SQL, Python, Databricks, and orchestration frameworks, along with the ability to troubleshoot migration challenges and work with cross-functional enterprise teams.

Key Responsibilities

  • Convert Teradata ETL workloads into Databricks SQL.
  • Refactor ingestion pipelines using SQL and/or Python.
  • Design and implement data validation scripts for side-by-side comparisons.
  • Configure orchestration and job scheduling within the Databricks environment.
  • Perform unit, integration, UAT, and performance testing for migrated code.
  • Validate data consistency between Teradata and Databricks environments.
  • Deploy workloads in Unity Catalog-enabled workspaces and ensure governance best practices.
  • Implement job monitoring using Databricks-native tools (system tables, workflows).
  • Collaborate with Databricks teams and customers for code fixes, optimization, and best practices.

Required Technical Skills

  • Strong expertise in Teradata ETL development & migration.
  • Proficiency in Azure Databricks, SQL, and Python.
  • Deep understanding of orchestration, scheduling, and data validation techniques.
  • Hands-on knowledge of Unity Catalog for permissions and governance.
  • Experience in data testing: unit, integration, UAT, and performance.
  • Excellent debugging, troubleshooting, and optimization skills.
  • Familiarity with cloud environments: Azure / AWS / GCP.

Proven Experience In

  • Migrating large-scale Teradata workloads to Databricks.
  • Implementing data validation frameworks and resolving data drift.
  • Performing side-by-side data comparisons between legacy and modern systems.
  • Applying performance tuning for query and job optimization.
  • Collaborating with cross-functional stakeholders on enterprise-scale projects.
  • Working in retail, telecom, semiconductor, or manufacturing domains (preferred).

Why Join Us?

  • Opportunity to work on cutting-edge technologies.
  • Exposure to large-scale migration projects and cloud-first architectures.
  • Collaborative and innovation-driven work culture.
  • Continuous learning and career growth opportunities.

How to Apply

Interested candidates can share their updated resumes

  • Field Engineering, Cloud Platform Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ326R18As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region.You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted advisor for senior executives and your in-depth technical...

  • Field Engineering, Cloud Platform Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ326R18As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted advisor for senior executives and your in-depth...

  • Cloud Platform Specialist

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Field Engineering, Cloud Platform Specialist FEQ326R18 As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-375At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical...

  • Staff Software Engineer

    1 week ago

    Bengaluru, India Databricks Full time

    P-375 At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical...

  • Staff Software Engineer

    1 week ago

    Bengaluru, India Databricks Full time

    P-375 At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical...

  • Field Engineering, Cloud Platform Specialist

    2 weeks ago

    Bengaluru, India Databricks Full time

    FEQ326R18 As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted advisor for senior executives and your in-depth...

  • Field Engineering, Cloud Platform Specialist

    1 week ago

    Bengaluru, India Databricks Full time

    FEQ326R18 As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region.  You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted advisor for senior executives and your in-depth...

  • Databricks Specialist

    2 weeks ago

    Bengaluru, Hyderabad, Pune, India KPI Partners Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    KPI Partners is seeking a skilled Databricks Specialist to join our team. The ideal candidate will possess a strong background in data engineering, analytics, and machine learning with substantial experience in the Databricks platform. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and ETL processes on Databricks. -...

  • Resident Solutions Architect

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time

    **FEQ225R141** **Resident Solutions Architect - Migrations Architect L5** As a Migrations Architect (Resident Solutions Architect) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud...