Senior Data Engineer

3 days ago

Pune, India Celebal Technologies Full time

Job Description- Senior Data Engineer (Teradata Migration Specialist)About Us Celebal Technologies is a leading Solution Service company that provides services in the fields of Data Science, Big Data, Enterprise Cloud, and Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As part of our commitment to staying ahead in the industry, we are seeking a talented and experienced Teradata Migration Specialist with strong Databricks and SQL/Python expertise to join our dynamic team.Job SummaryWe are looking for a highly skilled Data Engineer with hands-on experience in Teradata-to-Databricks migrations, ETL development, and large-scale data validation. The ideal candidate will have a strong background in SQL, Python, orchestration frameworks, and performance optimization within Databricks. This role requires in-depth technical expertise, the ability to troubleshoot complex migration challenges, and experience collaborating with multiple stakeholders in enterprise environments.Key Responsibilities• Convert Teradata ETL workloads into Databricks SQL.• Refactor ingestion pipelines using SQL and/or Python.• Design and implement data validation scripts for side-by-side comparisons.• Configure orchestration and job scheduling within the Databricks environment.• Perform unit, integration, UAT, and performance testing for migrated code.• Validate data consistency between Teradata and Databricks environments.• Execute jobs in UAT/QA, analyze data discrepancies, and provide timely resolutions.• Deploy workloads in Unity Catalog enabled workspaces and ensure governance best practices.• Implement job monitoring using Databricks-native tools (system tables, workflows).• Collaborate with Databricks and customer teams for code fixes, optimizations, and best practices.Required Technical Skills• Strong expertise in Teradata ETL development & migration.• Proficiency in Azure Databricks, SQL, and Python.• Deep understanding of orchestration, scheduling, and data validation techniques.• Hands-on knowledge of Unity Catalog for permissions and governance.• Solid experience in data testing: unit, integration, UAT, and performance.• Strong troubleshooting, debugging, and optimization skills.• Familiarity with cloud environments (Azure/AWS/GCP).Proven Experience in• Migrating large-scale Teradata workloads to Databricks.• Implementing data validation frameworks and resolving data drift.• Executing side-by-side data comparisons between legacy and modern systems.• Applying performance tuning techniques for query and job optimization.• Collaborating with cross-functional stakeholders in enterprise-scale projects.• Working in retail, telecom, semiconductor, or manufacturing industry domains (preferred)

  • Data Engineer

    7 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Dynamics

    2 days ago

    Pune, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...

  • Senior Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time US$ 1,20,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Senior GenAI Engineers

    2 days ago

    Pune, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 8+...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Senior Data Engineer">Job Description:As a senior data engineer, you will be responsible for designing and building robust data pipelines that process and transform data from diverse sources.Key Responsibilities:Design and build efficient data pipelines that ensure data quality, reliability, and availability across the pipeline...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionAbout the Role:We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing and maintaining large-scale data warehouses that support our analytics and intelligence platform.Design and develop advanced SQL queries, stored...

  • Senior Data Quality Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Quality Engineer PositionWe are seeking a skilled Senior Data Quality Engineer with expertise in data testing automation, Python, PySpark, and SQL. The ideal candidate will be instrumental in ensuring the quality and reliability of our data pipelines through robust testing.