Data engineer/ Migration Specialist-Databricks

2 weeks ago

Bengaluru Jaipur Pune, India Celebal Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Job Title: Teradata Migration Specialist

Company: Celebal Technologies

Location: Bangalore, Hyderabad, Pune, Noida, Jaipur

Experience Required: 5+ Years

Employment Type: Full-time

About Us

Celebal Technologies is a leading Solution Services company providing expertise in Data Science, Big Data, Enterprise Cloud, and Automation.

We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance business processes.

As part of our growth strategy, we are looking for a Teradata Migration Specialist with strong Databricks and SQL/Python expertise to join our dynamic team.

Job Summary

We are seeking a highly skilled Data Engineer experienced in Teradata-to-Databricks migrations, ETL development, and large-scale data validation.

The role requires hands-on expertise in SQL, Python, Databricks, and orchestration frameworks, along with the ability to troubleshoot migration challenges and work with cross-functional enterprise teams.

Key Responsibilities

  • Convert Teradata ETL workloads into Databricks SQL.
  • Refactor ingestion pipelines using SQL and/or Python.
  • Design and implement data validation scripts for side-by-side comparisons.
  • Configure orchestration and job scheduling within the Databricks environment.
  • Perform unit, integration, UAT, and performance testing for migrated code.
  • Validate data consistency between Teradata and Databricks environments.
  • Deploy workloads in Unity Catalog-enabled workspaces and ensure governance best practices.
  • Implement job monitoring using Databricks-native tools (system tables, workflows).
  • Collaborate with Databricks teams and customers for code fixes, optimization, and best practices.

Required Technical Skills

  • Strong expertise in Teradata ETL development & migration.
  • Proficiency in Azure Databricks, SQL, and Python.
  • Deep understanding of orchestration, scheduling, and data validation techniques.
  • Hands-on knowledge of Unity Catalog for permissions and governance.
  • Experience in data testing: unit, integration, UAT, and performance.
  • Excellent debugging, troubleshooting, and optimization skills.
  • Familiarity with cloud environments: Azure / AWS / GCP.

Proven Experience In

  • Migrating large-scale Teradata workloads to Databricks.
  • Implementing data validation frameworks and resolving data drift.
  • Performing side-by-side data comparisons between legacy and modern systems.
  • Applying performance tuning for query and job optimization.
  • Collaborating with cross-functional stakeholders on enterprise-scale projects.
  • Working in retail, telecom, semiconductor, or manufacturing domains (preferred).

Why Join Us?

  • Opportunity to work on cutting-edge technologies.
  • Exposure to large-scale migration projects and cloud-first architectures.
  • Collaborative and innovation-driven work culture.
  • Continuous learning and career growth opportunities.

How to Apply

Interested candidates can share their updated resumes

  • Field Engineering, Cloud Platform Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ326R18As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region.You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted advisor for senior executives and your in-depth technical...

  • Field Engineering, Cloud Platform Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ326R18As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted advisor for senior executives and your in-depth...

  • Cloud Platform Specialist

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Field Engineering, Cloud Platform Specialist FEQ326R18 As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-375At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical...

  • Technical Enablement Specialist

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Sr. Technical Enablement Specialist FEQ426R542 As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in...

  • Senior Data Migration Engineer

    7 days ago

    Chennai, Pune, India Oracle Full time

    Job Description Job Summary: We are seeking a skilled Senior Data Migration Engineer with expertise in AWS, Databricks, Python, PySpark, and SQL to lead and execute complex data migration projects. The ideal candidate will design, develop, and implement data migration solutions to move large volumes of data from legacy systems to modern cloud-based...

  • Databricks Specialist

    2 weeks ago

    Bengaluru, Hyderabad, Pune, India KPI Partners Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    KPI Partners is seeking a skilled Databricks Specialist to join our team. The ideal candidate will possess a strong background in data engineering, analytics, and machine learning with substantial experience in the Databricks platform. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and ETL processes on Databricks. -...

  • Hiring For Data Migration Specialist

    6 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesWe are seeking a skilled Database Migration Specialist with expertise in migrating databases from Sybase to Amazon Aurora. The role involves planning, executing, and optimizing database migration strategies to support cloud transformation initiatives.Key Responsibilities:Lead and manage Sybase to Aurora database migration...

  • Databricks Data Engineer

    1 week ago

    Bengaluru, Chennai, Pune, India Tredence Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a highly skilled Data Engineer to join our team at Tredence Inc. in Pune, India. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Role & responsibilitiesDesign and develop ETL/ELT solutions using Azure services and toolsCollaborate with business stakeholders to identify...

  • Data Migration Engineer

    1 week ago

    Bengaluru, Mumbai, Pune, India E4 Software Services Full time

    Job Description Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards....