Chief Data Pipeline Architect

2 days ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title:

Senior Data Engineer

Job Description:

 

  • Develop and maintain large-scale data pipelines for diverse datasets.
  • Build complex datasets based on business needs.
  • Design a robust data pipeline architecture.
  • Identify opportunities for data acquisition through stakeholder collaboration.
  • Prioritize business requirements to technical specifications.

 

Key Responsibilities:

 

  • Utilize Google Cloud Ecosystem tools such as Python, DataFlow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage to integrate systems and data pipelines.
  • Implement log monitoring and alerting for effective pipeline tracking.
  • Apply SAP SLT to replicate SAP tables to Google Cloud using SLT.
  • Develop JSON messaging structure for integrating with various applications.
  • Implement DevOps and CI/CD practices (GitHub, Terraform) for reliable and scalable data pipelines.
  • Partition and cluster content in BigQuery, applying IAM roles and Policy Tags for secure data access.
  • Use authorized views to share data between projects while securing dataset access via roles.
  • Design an ingestion pipeline using REST APIs.
  • Offer recommendations to improve data quality, reliability, and efficiency.

 

Requirements:

 

  • Junior Data Engineer: 2-3 years of experience in GCP data engineering role.
  • Senior Data Engineer: 4+ years of experience in GCP data engineering role.
  • At least 1 year of hands-on experience with GCP tools (Python, SQL, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage).

  • Chief Data Pipeline Architect

    6 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    As a key member of our team, you will play a pivotal role in designing, developing and maintaining data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform.The successful candidate will have deep expertise in data integration, ETL/ELT, APIs and Databricks. You will work closely with business...

  • Chief Data Pipeline Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Solutions ArchitectThe Role:This Senior Data Engineer position plays a pivotal role in the design, development, and maintenance of large-scale data pipelines using Azure services such as Databricks and Data Factory. The ideal candidate will possess proficiency in programming languages like SQL, Python, R, or Scala to create efficient data...

  • Chief Data Architect

    6 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a highly skilled Chief Data Architect to join our team.The ideal candidate will have a strong background in data engineering and a proven track record of designing and implementing large-scale data systems.Main Responsibilities:Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow,...

  • Chief Data Architect

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title: Chief Data ArchitectWe are seeking a highly skilled and experienced Chief Data Architect to join our team. As a key member of our organization, you will be responsible for designing, building, and maintaining efficient, reusable, and reliable code.Key Responsibilities:Design and implement data architectures that meet business requirementsDevelop...

  • Data Pipeline Architect

    2 days ago

    Pune, Maharashtra, India beBeeDataScience Full time ₹ 19,62,000 - ₹ 23,49,000

    Job Description:We are seeking a highly skilled Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires strong expertise in CI/CD and Kubernetes to ensure seamless integration and scalability.Required Skills & Qualifications:Proven experience in designing and...

  • Chief Data Pipeline Architect

    1 week ago

    Pune, Maharashtra, India beBeeSnowflake Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Snowflake Data Engineer Job SummaryWe are seeking a highly skilled Snowflake data engineer with at least 5 years of experience in building and optimizing data pipelines, transforming data, and enabling advanced analytics solutions.

  • Chief Data Pipeline Architect

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Key Data Engineering RoleWe are seeking a skilled Data Engineer to lead the design and implementation of data pipelines, ensuring data quality and integrity.Design and implement data pipelines using Postgres SQL, including advanced query writing, CTEs, window functions, indexing, and optimization.Develop and maintain data models, including star schema,...

  • Chief Data Pipeline Architect

    6 days ago

    Pune, Maharashtra, India beBeeDataengineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    About This RoleWe are seeking a seasoned Data Engineer to drive the design and development of scalable data pipelines using Spark. The ideal candidate will leverage Azure Databricks and Datalake for efficient data processing and storage.Main Responsibilities

  • Data Pipeline Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Big Data Engineer">This role will oversee a team of employees and contractors in their professional development. Key responsibilities include mentoring, problem resolution, and team building to ensure success. The position will also lead software engineering projects in developing high-quality, secure, scalable applications and pipelines based on...

  • Chief Data Pipeline Architect

    4 days ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    About the RoleThis is a Data Engineer position that requires 3 to 7 years of experience in designing, building, and managing robust data pipelines.The role focuses on developing efficient ETL/ELT workflows, ensuring data quality, security, and scalability to support AI/ML model training, inference, and intelligent decision-making processes in a cloud-native...