
Senior Data Engineer
14 hours ago
Job Description- Senior Data Engineer (Teradata Migration Specialist)
About Us Celebal Technologies is a leading Solution Service company that provides services in the fields of Data Science, Big Data, Enterprise Cloud, and Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As part of our commitment to staying ahead in the industry, we are seeking a talented and experienced Teradata Migration Specialist with strong Databricks and SQL/Python expertise to join our dynamic team.
Job Summary
We are looking for a highly skilled Data Engineer with hands-on experience in Teradata-to-Databricks migrations, ETL development, and large-scale data validation. The ideal candidate will have a strong background in SQL, Python, orchestration frameworks, and performance optimization within Databricks. This role requires in-depth technical expertise, the ability to troubleshoot complex migration challenges, and experience collaborating with multiple stakeholders in enterprise environments.
Key Responsibilities
• Convert Teradata ETL workloads into Databricks SQL.
• Refactor ingestion pipelines using SQL and/or Python.
• Design and implement data validation scripts for side-by-side comparisons.
• Configure orchestration and job scheduling within the Databricks environment.
• Perform unit, integration, UAT, and performance testing for migrated code.
• Validate data consistency between Teradata and Databricks environments.
• Execute jobs in UAT/QA, analyze data discrepancies, and provide timely resolutions.
• Deploy workloads in Unity Catalog enabled workspaces and ensure governance best practices.
• Implement job monitoring using Databricks-native tools (system tables, workflows).
• Collaborate with Databricks and customer teams for code fixes, optimizations, and best practices.
Required Technical Skills
• Strong expertise in Teradata ETL development & migration.
• Proficiency in Azure Databricks, SQL, and Python.
• Deep understanding of orchestration, scheduling, and data validation techniques.
• Hands-on knowledge of Unity Catalog for permissions and governance.
• Solid experience in data testing: unit, integration, UAT, and performance.
• Strong troubleshooting, debugging, and optimization skills.
• Familiarity with cloud environments (Azure/AWS/GCP).
Proven Experience in
• Migrating large-scale Teradata workloads to Databricks.
• Implementing data validation frameworks and resolving data drift.
• Executing side-by-side data comparisons between legacy and modern systems.
• Applying performance tuning techniques for query and job optimization.
• Collaborating with cross-functional stakeholders in enterprise-scale projects.
• Working in retail, telecom, semiconductor, or manufacturing industry domains (preferred)
-
Data Engineer
20 hours ago
Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...
-
Senior QE Engineer
6 days ago
Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per yearReq ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...
-
Data Engineer
4 days ago
Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDo you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...
-
Senior Software Engineer
6 days ago
Pune, Maharashtra, India Data Dynamics Full time US$ 1,20,000 - US$ 2,00,000 per yearAbout The RoleWe are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...
-
Senior Data Engineer
4 days ago
Pune, Maharashtra, India NCSI Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: Senior Data Engineer Company Name: NCSi Job Description: NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to...
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India BlueCloud Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesWe are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience withDBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing...
-
Senior Data Engineer
4 days ago
Pune, Maharashtra, India Vanderlande Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob TitleSenior Data EngineerJob DescriptionIf you are passionate about unlocking the power to gain next level insights into a great variety of data, powering data driven decision making through advanced analytics and data science practises, you might have just found your perfect next career step.In this job you will have versatile responsibilities,...
-
Senior Data Analyst
2 weeks ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo:Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India True Talents Full timeJob Title : Senior Data EngineerLocation : Pune / NoidaExperience : 4 - 8 YearsEmployment Type : Full-timeNotice Period : Up to 30 DaysAbout the Role :We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate should have strong expertise in modern data...
-
Senior Data Engineer
4 days ago
Pune, Maharashtra, India True Talents Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title :Senior Data EngineerLocation :Pune / NoidaExperience :4 - 8 YearsEmployment Type :Full-timeNotice Period :Up to 30 DaysAbout The RoleWe are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate should have strong expertise in modern data engineering tools,...