Senior Data Pipeline Specialist

2 days ago

Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

We are looking for a highly skilled Data Engineer to join our team.

This is a remote opportunity for someone with 10+ years of experience in building robust data pipelines on the Google Cloud Platform.

As a GCP Data Engineer, you will be responsible for:

  • Designing and developing scalable data pipelines for batch and real-time processing using GCP tools.
  • Constructing large datasets to meet diverse business needs.
  • Leveraging GCP services such as Big Query, Cloud Dataflow, Cloud Run, Pub/Sub, and Cloud Composer to build integrated systems.

Key responsibilities include:

  • Designing, developing, and maintaining complex data pipelines
  • Working with SAP SLT to replicate data to Google Cloud
  • Implementing DevOps and CI/CD practices to ensure pipeline reliability and scalability
  • Ensuring data security and governance using IAM roles and policies
  • Monitoring pipelines using logs and alerts

To be successful in this role, you will need:

Technical Skills

  • Proficiency in Python and SQL
  • Experience with structured ERP solutions like SAP and Oracle EBS
  • A strong understanding of different file formats
  • Knowledge of Data Lake concepts

Data Security & Governance

  • Proven ability to implement IAM best practices
  • Familiarity with data masking and anonymization techniques

About the Job

This is a unique opportunity to work on challenging projects for industries such as Energy, Oil & Gas, Healthcare, and Finance.

We are looking for someone who is passionate about building robust data pipelines and has a deep understanding of GCP services and technical skills.

  • Senior Data Pipeline Specialist

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeTestEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About NovintiX, a leading engineering consultancy in the Life Sciences, MedTech, and Healthcare sectorsWe specialize in delivering high-impact digital programs, engineering services, and talent solutions that accelerate innovation and efficiency.A fast-growing company with clients across the US, Ireland, and EuropeDelivering digital transformation and...

  • Data Pipeline Specialist

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 30,00,000 - ₹ 40,00,000

    Key Data Pipeline SpecialistThe role entails designing, developing, and maintaining high-capacity data pipelines that efficiently handle structured and unstructured data.ResponsibilitiesDesign and Build Complex Pipelines: You will be responsible for designing and building complex production-level data pipelines utilizing AWS services such as S3, EC2, RDS,...

  • Unlock Your Potential as a Senior Data Pipeline Specialist

    1 week ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Data Pipeline Specialist PositionAt our organization, we are seeking an experienced Senior Data Pipeline Specialist with a strong background in data engineering practices. The ideal candidate will have hands-on expertise in building and automating large-scale data pipelines, managing multi-environment deployments, and working with modern...

  • Senior Data Pipeline Engineer

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    About This RoleWe're seeking an experienced Data Pipeline Specialist to join our data engineering team.As a Data Pipeline Specialist, you will design and develop scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Main Responsibilities:Design, build, and maintain ETL pipelines using IBM DataStage (CP4D)...

  • Senior Data Pipeline Developer

    1 week ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,20,000

    Data EngineerWe are seeking a highly skilled Data Engineer to join our dynamic data team. As a key member of the infrastructure team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital marketing product development.You will collaborate with cross-functional teams...

  • Senior Data Pipeline Specialist

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    **Data Engineer Job Summary**We are seeking a talented Data Engineer to join our team and help us build scalable data pipelines and modern cloud & big data platforms.**Key Responsibilities**Develop and maintain large-scale data systems using Python, SQL, PySpark, and Bash scripting.Design and implement ETL processes, data pipelines, and...

  • Senior Data Pipeline Specialist

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines using Microsoft Fabric.We are seeking a skilled professional to fill this critical position. This individual will be responsible for developing ETL/ELT solutions using PySpark, T-SQL and Spark Notebooks within Fabric and Azure Synapse.Key...

  • Data Pipeline Specialist

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeAbInitio Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Ab Initio Developer RoleAs a seasoned Ab Initio developer, you will play a pivotal role in designing and implementing data pipelines that drive business outcomes. Your expertise in ETL/ELT methodologies, data quality strategies, and database concepts (SQL) will be instrumental in ensuring data integrity and efficiency.Responsibilities:Design and...

  • Data Pipeline Engineer

    1 week ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:We are seeking a skilled Data Pipeline Specialist to design, build, and optimize scalable data pipelines using Azure Data Factory.The ideal candidate will have hands-on experience with ADF pipelines, data integration, and transformations for smooth, secure, and efficient data flows.Design and implement Azure Data Factory pipelines for ETL and...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Database Engineer OpportunityWe are seeking a skilled ETL/Database Tester to join our team with 5+ years of experience in testing, monitoring, and improving data pipelines.Key Responsibilities:Design, implement, and execute comprehensive test plans for ETL processes and databases.Collaborate with cross-functional teams to identify and prioritize testing...