Senior Data Engineer

1 week ago

Solapur, Maharashtra, India Celebal Technologies Full time

Job Description- Senior Data Engineer (Teradata Migration Specialist)

About Us Celebal Technologies is a leading Solution Service company that provides services in the fields of Data Science, Big Data, Enterprise Cloud, and Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As part of our commitment to staying ahead in the industry, we are seeking a talented and experienced Teradata Migration Specialist with strong Databricks and SQL/Python expertise to join our dynamic team.

Job Summary

We are looking for a highly skilled Data Engineer with hands-on experience in Teradata-to-Databricks migrations, ETL development, and large-scale data validation. The ideal candidate will have a strong background in SQL, Python, orchestration frameworks, and performance optimization within Databricks. This role requires in-depth technical expertise, the ability to troubleshoot complex migration challenges, and experience collaborating with multiple stakeholders in enterprise environments.

Key Responsibilities


• Convert Teradata ETL workloads into Databricks SQL.


• Refactor ingestion pipelines using SQL and/or Python.


• Design and implement data validation scripts for side-by-side comparisons.


• Configure orchestration and job scheduling within the Databricks environment.


• Perform unit, integration, UAT, and performance testing for migrated code.


• Validate data consistency between Teradata and Databricks environments.


• Execute jobs in UAT/QA, analyze data discrepancies, and provide timely resolutions.


• Deploy workloads in Unity Catalog enabled workspaces and ensure governance best practices.


• Implement job monitoring using Databricks-native tools (system tables, workflows).


• Collaborate with Databricks and customer teams for code fixes, optimizations, and best practices.

Required Technical Skills


• Strong expertise in Teradata ETL development & migration.


• Proficiency in Azure Databricks, SQL, and Python.


• Deep understanding of orchestration, scheduling, and data validation techniques.


• Hands-on knowledge of Unity Catalog for permissions and governance.


• Solid experience in data testing: unit, integration, UAT, and performance.


• Strong troubleshooting, debugging, and optimization skills.


• Familiarity with cloud environments (Azure/AWS/GCP).

Proven Experience in


• Migrating large-scale Teradata workloads to Databricks.


• Implementing data validation frameworks and resolving data drift.


• Executing side-by-side data comparisons between legacy and modern systems.


• Applying performance tuning techniques for query and job optimization.


• Collaborating with cross-functional stakeholders in enterprise-scale projects.


• Working in retail, telecom, semiconductor, or manufacturing industry domains (preferred)

  • Senior Lead Data Engineer

    1 week ago

    Solapur, Maharashtra, India beBeeDataLeader Full time US$ 1,80,000 - US$ 2,50,000

    Job Title: Senior Lead EngineerWe are seeking a seasoned Senior Lead Engineer to join our team. This is an exceptional opportunity to leverage your technical expertise and leadership skills to drive innovation and growth in our Commercial Data team.The ideal candidate will have experience with SQL, Python, ETL/ELT pipelines, data modeling, data pipelines,...

  • Senior Cloud Data Engineer

    7 days ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 14,00,000

    Job Title: Senior Cloud Data EngineerWe are seeking a highly skilled Senior Cloud Data Engineer to design and implement large-scale data systems on AWS.Key Responsibilities:Design and implement scalable data architectures using AWS services.Develop high-quality code in Python, PySpark, and Databricks.Collaborate with cross-functional teams to integrate data...

  • Senior Data Engineer

    6 days ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About the PositionWe are seeking a Senior Data Engineer with exceptional SQL expertise to drive data solutions and optimize database performance.This role is ideal for professionals who excel at analyzing complex data issues and collaborating with cross-functional teams.Develop and implement data quality improvement plans across multiple related...

  • Senior Data Engineer

    1 week ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Opportunity: Senior Data ArchitectAbout the Role:We are seeking an experienced Data Architect to lead our Big Data initiatives. As a key member of our team, you will be responsible for designing and implementing scalable data solutions.This is a fantastic opportunity to work on high-profile projects, collaborating with cross-functional teams to drive...

  • Data Engineer Leader

    1 week ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer OpportunityWe are seeking a highly skilled Senior Data Engineer to lead the design and implementation of scalable, high-performance data solutions. As a technical leader and mentor, you will drive best practices in data engineering, architecture, and governance.The ideal candidate will have hands-on experience with Databricks, a degree...

  • Chief Data Engineering Specialist

    1 week ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Senior Data EngineerJob Summary:We are seeking an experienced Senior Data Engineer to join our team. As a senior-level data engineer, you will design, build, and optimize scalable data pipelines on AWS.Key Responsibilities:Design and develop efficient data processing systems using Apache Spark and AWS services.Implement data ingestion, transformation, and...

  • Data Analyst

    3 weeks ago

    Solapur, Maharashtra, India Quant-data Full time

    We're Hiring: Data Analyst (Credit Analytics | Remote | Full-Time) Leverage financial and credit data to power AI-driven lending solutionsWe are seeking a skilled Data Analyst (Credit Analytics) with 4+ years of experience to join our AI-driven lending platform team. In this role, you will analyze financial, customer, and transaction datasets, generate...

  • Senior Data Engineering Project Coordinator

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking an experienced Senior Data Engineering Project Coordinator to join our team. As a key member of our Agile development team, you will play a pivotal role in ensuring the successful implementation of data engineering projects.About the Role:This is a full-time position with a 5-day work-from-office schedule. The shift timings are...

  • Senior Data Engineering Leadership Position

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000

    **Senior Data Engineering Leadership Role**This position requires a highly skilled engineer to lead the development and operation of production-grade data pipelines.The successful candidate will be responsible for providing technical direction, designing and building reliable batch and change-driven pipelines, and handling schema evolution and failures...

  • Strategic Data Engineering Leadership

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our organization. As a key member of the team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in Python programming and experience working with cloud-based technologies such...