Advanced Data Pipeline Architect

3 days ago

Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Job Title: Data Systems Developer

We are seeking a skilled Data Systems Developer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing efficient data pipelines that drive business insights and decision-making.

This is a mid-level role ideal for someone with 3-5 years of experience in data engineering and backend development. You will work closely with cross-functional teams to define data requirements, models, and metrics, and ensure data quality, validation, and governance across all pipelines.

The successful candidate will have hands-on experience with ETL frameworks, such as Airbyte, Airflow, dbt, or Luigi, and proficiency in SQL and Python programming languages. You will also have good understanding of data warehousing concepts, schema design, and optimization, as well as exposure to cloud platforms or open-source alternatives.

In this role, you will build and maintain data pipelines to move data from multiple sources into data stores/warehouses, collaborate with cross-functional teams to define data requirements, models, and metrics, manage and optimize data storage solutions, and implement automation, monitoring, and alerting for data workflows.

Key Responsibilities:
  • Design and implement efficient data pipelines using ETL frameworks.
  • Collaborate with cross-functional teams to define data requirements, models, and metrics.
  • Manage and optimize data storage solutions (Postgres, BigQuery, Redshift, or cost-effective alternatives).
  • Ensure data quality, validation, and governance across all pipelines.
  • Implement automation, monitoring, and alerting for data workflows.


Requirements:
  • 3-5 years of experience in data engineering / backend development.
  • Proficiency in SQL and Python programming languages.
  • Hands-on experience with ETL frameworks (Airbyte, Airflow, dbt, or similar).
  • Good understanding of data warehousing concepts, schema design, and optimization.
  • Exposure to cloud platforms (AWS/GCP/Azure) or open-source alternatives.


Benefits:
  • Opportunity to own and grow the data function.
  • A chance to work on impactful projects that directly influence product and business strategy.
  • Collaborative culture with designers, engineers, and product thinkers.
  • Flexibility, autonomy, and career growth in a fast-moving setup.

  • Data Pipeline Architect

    3 days ago

    Kanpur, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design and build scalable data pipelines for processing channel activity data from multiple sources.The ideal candidate will possess strong knowledge of AWS cloud infrastructure, particularly services like Pyspark, Glue, EMR, lambda, Redshift, Athena, and other tools like...

  • Data Pipeline Architect

    2 weeks ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role:The ideal candidate will have a solid foundation in data engineering with a minimum of 7 years of experience in development on data-centric projects.Mandatory Skills:Expertise in working with real-time data and Kafka framework, including kSQL/Mirror Maker etc.Proficiency in at least one programming language: Groovy or Java.Thorough...

  • Senior Data Pipeline Architect

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeEngineeringManager Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleWe are seeking an experienced Engineering Manager to lead a team of data engineers in designing and delivering scalable data pipelines and analytics platforms using Big Data platforms, Microsoft Azure, and Databricks.Main ResponsibilitiesLead, mentor, and grow a team of data engineers working on large-scale distributed data systems.Architect...

  • Data Pipeline Specialist

    3 days ago

    Kanpur, Uttar Pradesh, India beBeeBusiness Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Business Intelligence Developer","Role Summary:","We are seeking an experienced professional to design and implement scalable data pipelines using industry-standard tools.","Key Responsibilities:","Design and implement scalable data pipelines.","Develop ETL/ELT solutions within a cloud-based environment.","Manage and optimize data storage and...

  • Data Pipeline Architect

    5 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time US$ 1,11,111 - US$ 1,53,333

    **Job Title:** Lead Data Platform Engineer**Job Description:The role of the Lead Data Platform Engineer is to oversee the design, development, and operation of data pipelines. As a technical leader, you will be responsible for defining technical direction, running design reviews, coaching engineers, and coordinating work across time zones.Key...

  • Lead Data Architect

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Lead Data ArchitectJob Description:We are seeking an experienced professional to spearhead the design and implementation of scalable, high-performance data pipelines.This role involves collaborating with cross-functional teams to develop and maintain large-scale data architectures using AWS and Databricks. Key responsibilities include designing,...

  • Data Pipeline Engineer

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeETL Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior ETL DeveloperWe are seeking an accomplished Senior ETL Developer to join our Data Engineering team. The ideal candidate will have a proven track record of designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The role involves collaborating with architects, business analysts, and data...

  • Advanced Data Architect

    3 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Snowflake Data EngineerJob Summary:We are seeking a highly skilled Snowflake Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing data warehouses on the Snowflake platform.Required Skills and Qualifications:Proven experience as a Data Engineer with a strong emphasis...

  • CV Pipeline Architect

    14 hours ago

    Kanpur, Uttar Pradesh, India beBeeComputerVision Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Computer Vision Expert WantedWe are seeking a skilled Computer Vision Expert to lead the design and implementation of complex pipelines. The ideal candidate will have expertise in multi-object tracking, object detection, and semi/unsupervised learning.Key Responsibilities:Design and implement complex CV pipelines (object detection, instance segmentation,...

  • Data Pipeline Specialist

    3 days ago

    Kanpur, Uttar Pradesh, India beBeeMachine Full time ₹ 25,00,000 - ₹ 28,00,000

    Senior Machine Learning EngineerKey Responsibilities:Develop and optimize complex data pipelines, applying machine learning engineering principles to enhance efficiency and scalability.Integrate and optimize data and model pipelines within production environments, diagnosing data inconsistencies and documenting assumptions.Employ experimental methodologies,...