Senior Data Pipeline Architect

2 days ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

We are seeking a seasoned Data Engineer with expertise in building scalable data pipelines on the Google Cloud Platform.

This is an exciting opportunity for a specialist to work on challenging projects across various industries, including Energy, Oil & Gas, Healthcare, and Finance.

As a GCP Data Engineer, you will be responsible for:

  • Designing, developing, and maintaining large-scale data pipelines for both batch and real-time processing using GCP tools.
  • Constructing complex datasets to meet diverse business needs.
  • Leveraging a variety of GCP services, including Big Query, Cloud Dataflow (Apache Beam), Cloud Run, Cloud Functions, and Pub/Sub to build integrated systems.
  • Orchestrating workflows using Cloud Composer (Apache Airflow).
  • Implementing DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines.

The ideal candidate should have deep expertise in the following areas:

  • GCP Services: Big Query, Cloud Dataflow (Apache Beam), Cloud Run, Cloud Functions, Pub/Sub, Cloud Composer (Apache Airflow)
  • Technical Skills: Proficiency in Python and SQL, experience with structured ERP solutions like SAP, Oracle EBS, and Salesforce

About this role:

This is a remote opportunity for a specialist with 10+ years of experience to work on challenging projects. If you're passionate about building robust data pipelines and have a strong understanding of data lake concepts, we'd love to hear from you.

  • Senior Data Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data ArchitectAbout the Role:We are seeking an experienced Senior Data Architect to lead our efforts in designing, building, and optimizing data pipelines for large-scale structured and unstructured datasets.Key Responsibilities:Design and implement a unified data architecture to support business growth and innovation.Create ETL/ELT...

  • Lead Data Pipeline Tester

    5 days ago

    Madurai, Tamil Nadu, India beBeeTesting Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Test Lead JobWe are seeking an experienced Senior Test Engineer to drive the testing strategy and execution for a project.The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management.Drive testing strategy and execution for data pipeline projectsTest data pipelines using...

  • Senior Cloud Data Solutions Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Role Overview:The Senior Data Engineer will collaborate with data scientists and architects to develop scalable data solutions. This role requires the ability to design and build robust data pipelines, as well as operationalize data on cloud platforms.Key Responsibilities Include:Designing and building high-quality data pipelines that support analytics and...

  • Chief Data Pipeline Architect

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,40,00,000

    Job Opportunity: Data Platform Engineering LeadershipWe are seeking a seasoned professional to spearhead the development and operation of our data pipelines. This role is perfect for an experienced leader with 9+ years of background in Data Engineering, Backend Engineering, and DevOps.The ideal candidate will have hands-on expertise in building and operating...

  • Cloud Data Architect Position

    2 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Cloud Data ArchitectWe are seeking a highly experienced Senior Cloud Data Architect to lead the design and implementation of scalable data solutions on Amazon Web Services (AWS).Key Responsibilities:Design and implement efficient data pipelines, warehouses, and data lakes on AWS platforms such as S3, Redshift, Glue, EMR, and Lambda.Collaborate with...

  • Senior Data Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Lead Cloud Data ArchitectWe are seeking a seasoned expert to lead our data architecture team in developing and implementing cutting-edge cloud solutions. The ideal candidate will have 12+ years of experience in platform engineering, data architect, data engineering, or solution architecture.Job Description:Platform & Data Solution ArchitectureDevelop and...

  • Data Systems Architect

    5 days ago

    Madurai, Tamil Nadu, India beBeeBackend Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Systems ArchitectRole Summary:A senior data engineer with hands-on experience in Python and Pyspark is required to lead the implementation of a large-scale application for a leading retailer. The ideal candidate will have expertise in telemetry, big data, and backend engineering.Key Responsibilities:Design, develop, and deploy scalable data pipelines...

  • Senior Cloud Data Architect

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Solutions ArchitectJob Overview:We are seeking a skilled and motivated professional with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. As a key member of our team, you will be responsible for designing, developing, and optimizing robust data ingestion pipelines using GCP...

  • Senior Data Pipeline Developer

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataStrategist Full time ₹ 12,00,000 - ₹ 15,00,000

    Key Roles and Responsibilities:We are seeking a highly skilled Data Strategist to develop and implement data pipelines using IBM StreamSets.Main Accountabilities:Design, build and maintain complex data pipelines with IBM StreamSets to integrate new AI tools and hybrid cloud environments.Collaborate with cross-functional teams to ensure seamless data...

  • Senior Data Pipeline Specialist

    5 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a highly skilled Data Engineer to design, develop and maintain scalable data pipelines and ETL processes using GCP services.Data Pipeline Design and Development: Utilize GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer, Cloud Function, and Cloud Run to create efficient and scalable data...