Data Pipeline Architect

2 days ago

Anantapur, Andhra Pradesh, India beBeeDataPipeline Full time ₹ 80,00,000 - ₹ 1,50,00,000

Job Title: Data Pipeline Architect

Description:

We are seeking an experienced professional to architect and develop scalable data pipelines that integrate data from various sources.

Responsibilities:

  • Design, develop, and maintain data pipelines using Informatica and other tools to process and transform large datasets.
  • Work extensively with SQL to query, optimize, and manage data across systems.
  • Implement and optimize data models following data warehousing concepts (Star Schema, Snowflake Schema, Slowly Changing Dimensions, etc.).
  • Develop automation scripts using Python.
  • Leverage GCP services (BigQuery, Cloud Storage, Dataflow, Pub/Sub, etc.) for data ingestion, transformation, and storage.
  • Collaborate with data analysts, data scientists, and stakeholders to deliver reliable datasets and insights.
  • Monitor and troubleshoot data pipelines to ensure performance and data quality.

Requirements:

  • 3–5 years of hands-on experience as a Data Engineer or in a similar role.
  • Strong proficiency in SQL (query optimization, stored procedures, performance tuning).
  • Solid experience with ETL development using Informatica and strong knowledge of data warehousing concepts.
  • Proficient in Python programming for data processing and automation.
  • Practical experience working with GCP services, especially BigQuery.
  • Understanding of data governance, data quality, and performance best practices.
  • Strong problem-solving skills and the ability to work in a collaborative team environment.

Benefits:

Achieve expert-level efficiency by utilizing cutting-edge technology stacks.

Pursue innovative solutions to complex problems.

Learn and grow with a dynamic team of experts.

Gain real-world experience with industry-leading platforms.

Cultivate expertise in cloud-based data engineering services.

Expand your professional network within the field.

Stay up-to-date with the latest industry trends and technologies.

  • Data Pipeline Architect

    2 days ago

    Anantapur, Andhra Pradesh, India beBeePipeline Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a skilled Data Pipeline Architect to design and develop scalable data pipelines using Databricks.This role involves collaborating with stakeholders to understand data requirements and translating them into technical solutions.You will be responsible for designing, developing, and deploying data pipelines and ETL processes that meet...

  • Software Architect

    6 days ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title:Software Architect - Data Pipelines SpecialistWe are seeking an experienced Software Architect - Data Pipelines Specialist to join our team. In this role, you will be responsible for designing and implementing scalable data pipelines using Google Cloud Platform, developing REST APIs, and collaborating with cross-functional teams.About the...

  • Chief Data Pipeline Architect

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Overview:Client is seeking a Data and Analytics Executive to develop StreamSets pipeline in a remote position from India.Key Responsibilities:Develop data pipelines with IBM StreamSets to facilitate data integrations of new AI tools and hybrid cloud environments.Qualifications and Skills:Effective client management skills.Strong technical expertise in...

  • Chief Data Pipeline Architect

    2 hours ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, building, and operating scalable data pipelines that support real-time clinical workflows.The ideal candidate will have a strong background in workflow orchestration and event-driven systems, with experience working...

  • Lead Data Architect

    4 days ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to lead our data engineering team in developing and optimizing complex data pipelines. As a key member of this team, you will be responsible for designing, implementing, and maintaining large-scale data architectures that meet business requirements.Key Responsibilities:Design and...

  • Data Architect

    1 week ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectAbout the Role:We are seeking a skilled and experienced Data Architect to design, develop, and maintain scalable data infrastructure that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, and will...

  • Data Pipeline Specialist

    6 days ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,80,00,000

    Job Title:Data Pipeline SpecialistWe are seeking a highly skilled Data Pipeline Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining production-level data pipelines that handle large datasets.Key Responsibilities:Design and develop scalable data pipelines using Python and...

  • Senior Data Architecture Specialist

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeData Architect Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job DescriptionAs a seasoned data architect, you will be responsible for designing and implementing robust data architectures that meet the organization's reporting and analytics needs. This is a full-time role requiring a minimum of 15 years of experience in the field.Key Responsibilities:Develop and implement comprehensive data architectures that integrate...

  • Cloud Data Architect

    4 days ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Cloud Data Architect to design and build scalable data pipelines in the cloud. This key role involves collaborating with data analysts, data scientists, and other engineering teams to drive business outcomes.Key Requirements:5+ years of experience in data engineering or related roles, preferably with exposure to large-scale...

  • Chief Pipeline Architect

    1 week ago

    Anantapur, Andhra Pradesh, India beBeePipeline Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Key Expert in Pipeline EngineeringThe role involves overseeing the development and maintenance of high-performance pipelines, with a focus on scalability, reliability, and efficiency. The right candidate will have extensive experience in Python, with a strong background in performance and concurrency, as well as proficiency in Apache Beam and Databricks.Key...