Data Engineering Transformation Specialist

2 weeks ago

Kollam, Kerala, India beBeeTeradata Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

Drive innovation and enhance business processes by leveraging cutting-edge technologies.

Seek a talented Teradata Migration Specialist with strong Databricks and SQL/Python expertise to join our dynamic team.

The ideal candidate will have a strong background in SQL, Python, orchestration frameworks, and performance optimization within Databricks.

This role requires in-depth technical expertise, the ability to troubleshoot complex migration challenges, and experience collaborating with multiple stakeholders in enterprise environments.

Key Responsibilities:

  • Convert Teradata ETL workloads into Databricks SQL
  • Refactor ingestion pipelines using SQL and/or Python
  • Design and implement data validation scripts for side-by-side comparisons
  • Configure orchestration and job scheduling within the Databricks environment
  • Perform unit, integration, UAT, and performance testing for migrated code
  • Validate data consistency between Teradata and Databricks environments
  • Execute jobs in UAT/QA, analyze data discrepancies, and provide timely resolutions
  • Deploy workloads in Unity Catalog enabled workspaces and ensure governance best practices
  • Implement job monitoring using Databricks-native tools (system tables, workflows)
  • Collaborate with Databricks and customer teams for code fixes, optimizations, and best practices

Required Technical Skills:

  • Strong expertise in Teradata ETL development & migration
  • Proficiency in Azure Databricks, SQL, and Python
  • Deep understanding of orchestration, scheduling, and data validation techniques
  • Hands-on knowledge of Unity Catalog for permissions and governance
  • Solid experience in data testing: unit, integration, UAT, and performance
  • Strong troubleshooting, debugging, and optimization skills
  • Familiarity with cloud environments (Azure/AWS/GCP)

Proven Experience:

  • Migrate large-scale Teradata workloads to Databricks
  • Implement data validation frameworks and resolve data drift
  • Execute side-by-side data comparisons between legacy and modern systems
  • Apply performance tuning techniques for query and job optimization
  • Collaborate with cross-functional stakeholders in enterprise-scale projects
  • Work in retail, telecom, semiconductor, or manufacturing industry domains (preferred)

  • Transformative Data Scientist Role

    2 weeks ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Unlock the full potential of data by joining our innovative team as a Data Engineer and Azure AI Specialist.This is an exciting opportunity to work at the intersection of software development, machine learning, and financial data—delivering real-world impact from day one.You'll design, build, and deploy robust, maintainable systems that transform raw data...

  • Transformative Data Engineering Leader

    2 weeks ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled and experienced data engineer to lead the design and implementation of scalable, high-performance data pipelines. You will define architectural best practices and drive data transformation at scale.You'll work closely with clients to translate business needs into robust data...

  • Transformation Expert

    2 weeks ago

    Kollam, Kerala, India beBeeMigrationspecialist Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Migration SpecialistWe are seeking an experienced Migration Specialist to join our team in support of a Fortune 500 client on a large-scale database migration initiative.The project involves transitioning from Fivetran to Nexla, with Snowflake as the target data platform. This role is critical for ensuring a smooth migration, maintaining data quality, and...

  • Data Transformation Expert

    2 weeks ago

    Kollam, Kerala, India beBeeData Full time ₹ 25,00,000 - ₹ 40,00,000

    Transforming Retail Intelligence with Advanced AI SolutionsWe empower businesses to drive product-level profitability and grow margins using real-time competitive insights. Our cutting-edge technology leverages AI to aggregate and analyze billions of data points across retail categories.Our platform's patented product matching engine and proprietary AI offer...

  • Transformation Specialist

    2 weeks ago

    Kollam, Kerala, India beBeeProcurement Full time ₹ 8,00,000 - ₹ 12,00,000

    Job OverviewWe seek a seasoned Transformation Specialist to lead projects from inception to delivery, overseeing procurement, sourcing, and accounts payable management.About the Role

  • SAP Data Transformation Specialist

    2 weeks ago

    Kollam, Kerala, India beBeeExpert Full time ₹ 20,00,000 - ₹ 25,00,000

    Transforming SAP data is a key aspect of our organization. We require an experienced professional with expertise in Talend ETL processes to integrate and transform SAP master & transactional data.Key Responsibilities:We need you to design, develop, and implement Talend ETL processes to extract, transform, and load data from SAP systemsCollaborate with...

  • Data Engineering Specialist

    2 weeks ago

    Kollam, Kerala, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job OpportunityWe seek a seasoned professional to fill the role of Data Engineering Specialist.This position involves designing and developing scalable enterprise data analytics solutions, from source system through ingestion and reporting.Data Pipeline Development:Data engineers are responsible for crafting robust, scalable, and high-quality data pipelines...

  • Data Scientist/ML Engineer

    3 weeks ago

    Kollam, Kerala, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Data Engineering Specialist

    2 weeks ago

    Kollam, Kerala, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock a data engineering opportunityBased in Bangalore, Hyderabad, or PuneJoin our team immediately or within 15 daysKey Responsibilities:Design and develop a scalable data lakehouse solution using Apache Iceberg and SparkEnable high-performance Treasury analytics by integrating financial datasets and reporting enginesCollaborate with AWS services to create...

  • Data Engineer Specialist

    2 weeks ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Key Responsibilities:">">Develop and maintain scalable data pipelines using GCP services to meet business needs.">Collaborate with stakeholders to understand data requirements and deliver high-quality data solutions that drive organizational success.">Implement data integration solutions for large volumes of structured and unstructured data from various...