Senior Data Pipeline Architect

5 days ago

Nagpur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Senior Data Pipeline Architect

We are seeking an experienced data professional to lead the design and development of our scalable data pipelines using GCP tools.

  • 10+ years of experience in designing, developing, and maintaining complex data pipelines for both batch and real-time processing.
  • Strong understanding of GCP services including Big Query, Cloud Dataflow, Cloud Run, Cloud Functions, Pub/Sub, and Cloud Composer.
  • Proficiency in Python and SQL with experience working with structured ERP solutions like SAP, Oracle EBS, and Salesforce.
  • Ability to translate business requirements into clear technical specifications and ensure data security and governance using IAM roles, policies, and data masking techniques.
  • Experience with API development and consumption (REST, SOAP) and a strong understanding of different file formats (CSV, JSON, XML, Parquet, ORC, Avro).
  • Knowledge of Data Lake concepts and ability to implement DevOps and CI/CD practices using GitHub and Terraform.

Responsibilities

  • Designing and developing scalable data pipelines using GCP tools.
  • Constructing large, complex datasets to meet diverse business needs.
  • Translating business requirements into clear technical specifications.
  • Leveraging GCP services to build integrated systems.
  • Ensuring data security and governance.
  • Monitoring pipelines using logs and alerts to proactively manage performance.

Requirements

  • 10+ years of experience in data engineering.
  • Strong understanding of GCP services.
  • Proficiency in Python and SQL.
  • Experience working with structured ERP solutions.
  • Ability to ensure data security and governance.

What We Offer

  • Competitive salary.
  • Opportunities for career growth and professional development.
  • A dynamic and supportive work environment.

  • Senior Data Architect Role

    6 days ago

    Nagpur, Maharashtra, India beBeeData Architect Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Architecture PositionWe are seeking a skilled data architect to design and implement data architectures that support business growth. This individual will work with cross-functional teams to build reliable datasets.

  • Mastering Data Pipelines

    2 weeks ago

    Nagpur, Maharashtra, India beBeeDataEngineering Full time ₹ 1,98,96,000 - ₹ 2,59,20,000

    At the heart of our success lies a robust data pipeline architecture, and we're looking for a Senior Data Engineer to construct and optimize it.As a key member of our team, you will lead the optimization and scalability of data delivery pipelines, architect, build, and maintain high-throughput data pipelines and infrastructure.You will collaborate with data...

  • Data Pipeline Specialist

    5 days ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    AWS Data Architect PositionWe are seeking a highly skilled Senior AWS Data Engineer to join our team. The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.Key Responsibilities:Data Engineering Pipeline DevelopmentOptimizing...

  • Big Data Pipeline Architect

    3 days ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerJob Description:We are seeking a highly skilled Senior Data Engineer to develop, construct, test and maintain data acquisition pipelines for large volumes of structured and unstructured data.The ideal candidate will have experience in building large and complex datasets based on business requirements, as well as constructing 'big data'...

  • Data Pipeline Architect

    6 days ago

    Nagpur, Maharashtra, India beBeeDatastage Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior ETL Developer OpportunityWe are seeking an experienced senior DataStage developer with expertise in ETL development, data warehousing concepts, and Teradata SQL skills to design, build, and optimize data pipelines using IBM DataStage. This is a great opportunity for a skilled professional to join our team and contribute to the success of our...

  • Chief Data Pipeline Architect

    1 week ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Role Overview:We are seeking a highly skilled Data Engineer with expertise in designing, developing, and maintaining large-scale data pipelines and infrastructure.Your key responsibilities will include architecting and implementing data pipelines using Azure Data Factory and Databricks to support the ingestion, transformation, and movement of data.You will...

  • Senior Data Architect

    2 weeks ago

    Nagpur, Maharashtra, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000

    Job DescriptionWe are seeking a highly skilled Data Architect to join our team. This is a senior technical role with high expectations.The ideal candidate will be responsible for designing and developing data pipelines using Azure and Databricks.Design, develop, and optimize data pipelines using Azure and Databricks.Hands-on work with Databricks Asset...

  • Data Pipeline Architect

    4 days ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 14,00,000

    Key Data Engineering PositionWe are seeking a skilled Data Engineer to join our team. The ideal candidate will have experience working with large datasets and be proficient in designing and implementing data pipelines.Responsibilities:Design and implement scalable data pipelines using AWS services such as S3, Glue, and Redshift.Develop and maintain data...

  • Data Pipeline Architect

    1 week ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data SpecialistAs a Snowflake Big Data Specialist, you will be designing and developing data pipelines, models, and transformations using Snowflake's scalable cloud-based platform. You will work on building ETL/ELT pipelines, optimizing micro-partitioning, implementing real-time ingestion, and integrating data lakes.Develop complex SQL queries with...

  • Senior Data Systems Specialist

    2 weeks ago

    Nagpur, Maharashtra, India beBeeData Architect Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a talented individual to design, develop, and govern our data architecture and pipelines.The ideal candidate will be collaborative, organized, think outside the box, and be ready to pursue new opportunities. Most importantly, this role is for an individual who is passionate about making a difference through healthcare.Key...