Senior Data Pipeline Architect

1 day ago


Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000
Data Engineer Role Summary

We are seeking a highly skilled data engineer to spearhead our ETL development and data warehousing initiatives. The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines using IBM DataStage, coupled with strong SQL skills (Teradata).

The successful candidate will collaborate with data analysts and business stakeholders to implement integration solutions, perform manual and automated data validation and reconciliation, conduct root cause analysis for data discrepancies and ETL failures, and develop reusable DataStage job components following data modeling best practices.

  • Design, Develop, and Maintain ETL Workflows:
  • Compose Optimized SQL Queries for Data Extraction, Transformation, and Validation.
  • Collaborate with Data Analysts and Business Stakeholders to Implement Integration Solutions.
  • Perform Manual and Automated Data Validation and Reconciliation.
  • Conduct Root Cause Analysis for Data Discrepancies and ETL Failures.
  • Develop Reusable DataStage Job Components and Follow Data Modeling Best Practices.
  • Monitor ETL Workflows and Manage Dependencies via Job Sequencers or Airflow.
  • Document Workflows, Mappings, and Data Dictionaries.
  • Support Cloud Migration and Integration Initiatives.

Required Skills:

IBM DataStage, Teradata, SQL, Oracle

Desirable Skills:

Python, Shell Scripting, Unix/Linux, Apache Airflow, Cloud Platforms, Agile, CI/CD



  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support...

  • Data Engineer

    3 days ago


    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title:Data Engineer - Pipeline Architect\About the Role:\We are seeking a highly skilled Data Engineer to design, implement and manage data pipelines. Key responsibilities include building CI/CD pipelines using GitHub Actions or equivalent tools, configuring and maintaining branch protection rules and workflows, automating Databricks deployments using...


  • Thrissur, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    Unlock the Power of Data EngineeringAs a Senior Data Engineer, you will play a vital role in building and maintaining scalable data pipelines that integrate healthcare data. This is a critical position where you will create high-performance pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated...


  • Thrissur, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000

    As a highly skilled ETL specialist, you will be responsible for designing and deploying efficient data pipelines that drive business growth.The ideal candidate will have hands-on experience with ETL development using Informatica and a strong understanding of data warehousing concepts. Additionally, proficiency in Python programming for data processing and...


  • Thrissur, Kerala, India beBeeDataSpecialist Full time ₹ 15,00,000 - ₹ 30,00,000

    Senior Snowflake DeveloperWe are seeking a seasoned professional to lead full lifecycle implementations of secure cloud data platforms, including setup, integration, and high-performance data pipeline development.This role is ideal for individuals who thrive at the intersection of data engineering, infrastructure, and DevOps, and want to contribute to...


  • Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Data EngineerWe are seeking a skilled professional to join our team as a Data Engineer.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Integrate data from various sources, ensuring data quality and consistency.Optimize data processing workflows for...

  • Data Architect

    1 week ago


    Thrissur, Kerala, India beBeeData Full time US$ 2,00,000 - US$ 2,50,000

    Transforming the Future of Healthy Food AccessJob Description:    The Senior Data Engineer is a pivotal role in constructing and optimizing our data pipeline architecture. Collaborating closely with cross-functional teams, they will design, build, and maintain highly scalable data pipelines to support advanced analytics and machine learning.    As a...


  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Role – Data Engineer With FabricJob Location – JaipurJob Type – PermanentExperience Required: 2-4 YearsWe are seeking a skilled Data Engineer to join our team. As a key member of the team, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure.Main Responsibilities:Data Pipeline Development:...


  • Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Data EngineerWe are seeking a Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Job Description:Data Engineering is a key component of our organization's ability to drive business outcomes through data-driven decision making. We are...


  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Key Data Engineer PositionWe are seeking a highly skilled data professional with 4+ years of experience in designing, building, and optimizing ETL pipelines for large-scale data processing workflows. The ideal candidate will have hands-on experience working with Azure Cloud services including Azure Data Factory, Databricks, and related...