Senior Data Pipeline Architect

2 days ago

Kanpur, Uttar Pradesh, India beBeeEngineeringManager Full time ₹ 20,00,000 - ₹ 25,00,000

About the Role

We are seeking an experienced Engineering Manager to lead a team of data engineers in designing and delivering scalable data pipelines and analytics platforms using Big Data platforms, Microsoft Azure, and Databricks.

Main Responsibilities

  • Lead, mentor, and grow a team of data engineers working on large-scale distributed data systems.
  • Architect and oversee the development of end-to-end data solutions using Azure Data Services and Databricks.
  • Collaborate with cross-functional teams to understand requirements and deliver impactful data products.
  • Drive best practices in data engineering, coding standards, version control, CI/CD, and monitoring.
  • Ensure high data quality, governance, and compliance with internal and external policies.
  • Optimize performance and cost efficiency of data infrastructure in the cloud.
  • Stay current with industry trends and emerging technologies.

Required Skills & Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 8+ years of experience in software/data engineering with at least 3 years in a leadership or managerial role.
  • Proven hands-on experience with:
  • Big Data ecosystems (Spark, Hive, Hadoop)
  • Azure Cloud Services (Data Lake, Data Factory, Synapse Analytics, Blob Storage)
  • Databricks (including Delta Lake, MLFlow, Unity Catalog)
  • Strong programming experience in Python, Scala, or Java.
  • Deep understanding of data modeling, ETL/ELT processes, and performance tuning.
  • Experience managing Agile teams and delivering complex projects on time.
  • Excellent problem-solving, leadership, and communication skills.

  • Data Pipeline Architect

    5 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role:The ideal candidate will have a solid foundation in data engineering with a minimum of 7 years of experience in development on data-centric projects.Mandatory Skills:Expertise in working with real-time data and Kafka framework, including kSQL/Mirror Maker etc.Proficiency in at least one programming language: Groovy or Java.Thorough...

  • Strategic Data Architect

    2 hours ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data SpecialistWe are seeking a skilled Senior Data Specialist to design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that power our digital marketing platform. As a key member of our data infrastructure team, you will transform raw marketing data into actionable insights that drive business growth.Key...

  • Senior Data Engineering Lead

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe seek an experienced data engineer to lead the design and development of large-scale data processing systems that enable advanced analytics and business intelligence.As a senior data engineer, you will be responsible for architecting and implementing scalable and robust data pipelines that collect, process, and store large volumes of...

  • Data Pipeline Specialist

    15 hours ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 17,50,000

    About the RoleWe're seeking a highly skilled Data Engineer to build robust pipelines that transform large, messy technical datasets into high-quality structured data.

  • High-Performance Data Pipelines Expert

    19 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Are you a data engineering expert looking for a new challenge? This is an excellent opportunity to leverage your skills and experience in designing, developing, and maintaining scalable and high-performance data pipelines using Databricks and PySpark.About the RoleThis is a Senior Data Engineer position where you will be working on the design, development,...

  • Lead Data Architect

    22 hours ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,54,00,000

    Job Opportunity: Lead Data ArchitectWe seek an experienced data leader to create robust and scalable data solutions that support our analytics and reporting initiatives.This role is ideal for a seasoned professional with expertise in designing, implementing, and maintaining large-scale data systems, particularly within financial institutions.Develop and...

  • Data Architect

    22 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataExpert Full time US$ 90,000 - US$ 1,20,000

    Job Title: Data ArchitectThis is a key role for an experienced data professional to design, develop and maintain our company's data systems.Key Responsibilities:Apply data engineering expertise to build scalable and efficient data pipelinesCollaborate with cross-functional teams to drive business outcomesRequired Skills and Technologies:Palantir...

  • Senior Data Architect

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to design, build and optimize scalable data pipelines using Snowflake, AWS, DBT and SQL. Our ideal candidate has hands-on experience with data modeling, query optimization and performance tuning.Key Responsibilities:Design, build and maintain ETL/ELT pipelines using AWS Glue, Lambda and...

  • Lead Data Architect

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    A Senior Data Engineer is responsible for developing and maintaining efficient data pipelines using FiveTran, DBT Cloud, and custom frameworks. The ideal candidate will have experience in ETL development, Snowflake, and data pipeline tools.Key ResponsibilitiesDeveloping and Maintaining ETL Pipelines: Design, develop, and maintain efficient ETL pipelines to...

  • Cloud Data Solutions Architect

    15 hours ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryWe're seeking a skilled Cloud Data Solutions Architect to design, develop, and implement complete end-to-end data pipelines on Azure.This role involves handling data validation, transformation, and warehousing, collaborating with stakeholders to deliver business insights and visualization solutions. The ideal candidate will work in Agile teams to...