Senior Data Pipeline Architect

1 week ago

Bengaluru, Karnataka, India beBeeDataPlatformEngineer Full time ₹ 18,00,000 - ₹ 24,00,000
Data Platform Engineer Role

Our company is seeking a skilled Data Platform Engineer to join our team. As a Data Platform Engineer, you will be responsible for designing, developing, and maintaining data pipelines to extract, transform, and load data from various sources into our data warehouse or data lake environment.

We take pride in building innovative solutions that improve the reliability and performance of our data platforms. Our ideal candidate has hands-on experience with ETL tools and technologies, cloud platforms, Big Data tools, and object-oriented/object function scripting languages.

The successful candidate will collaborate closely with cross-functional teams to gather requirements and translate business needs into robust technical solutions. Strong analytical and problem-solving skills are essential for this role, as well as excellent communication and interpersonal skills.

  • Design, develop, and maintain data pipelines to extract, transform, and load data from various sources into our data warehouse or data lake environment.
  • Automate, manage, and scale the underlying infrastructure for our data platforms (e.g., Airflow, Spark clusters), applying SRE and DevOps best practices for performance, reliability, and observability.
  • Collaborate with stakeholders to gather requirements and translate business needs into robust technical solutions.
  • Optimize and tune existing data pipelines and infrastructure for performance, cost, and scalability.
  • Implement and enforce data quality and governance processes to ensure data accuracy, consistency, and compliance with regulatory standards.
  • Work closely with the BI team to design and develop dashboards, reports, and analytical tools that provide actionable insights to stakeholders.
  • Mentor junior members of the team and provide guidance on best practices for data engineering, platform development, and DevOps.

This is an exciting opportunity for experienced professionals to grow their careers while making meaningful contributions to our organization. If you have the necessary skills, experience, and passion for innovation, we encourage you to apply for this role.

Required Skills and Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in data engineering, platform engineering, or a similar role, with a strong focus on building and maintaining data pipelines and the underlying infrastructure.
  • Must have proven experience in a DevOps, SRE, or System Engineering role, with hands-on expertise in infrastructure as code (e.g., Terraform, Ansible), CI/CD pipelines, and monitoring/observability tools.
  • Expertise in SQL programming and database management systems (e.g., BigQuery).
  • Hands-on experience with ETL tools and technologies (e.g., Apache Spark, Apache Airflow).
  • Experience with cloud platforms such as Google Cloud Platform (GCP), and experience with relevant services (e.g., GCP Dataflow, GCP DataProc, BigQuery, Cloud Composer, GKE).
  • Experience with Big Data tools like Spark, Kafka, etc.
  • Experience with object-oriented/object function scripting languages: Python/Scala, etc.
Benefits
  • Career growth opportunities.
  • Meaningful contributions to the organization.
  • Competitive salary and benefits package.
Others
  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.

  • Senior Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a senior data pipeline architect, you will be responsible for designing, developing, and deploying scalable data architectures using big data technologies.You will collaborate with stakeholders to understand data requirements and translate them into technical solutions. Your expertise in writing complex SQL queries and knowledge of advanced...

  • Chief Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Data Engineering LeadWe are seeking an experienced Senior Data Engineering Lead to join our team. In this role, you will lead and mentor data engineering teams to ensure alignment with technical and business objectives.You will be responsible for architecting, designing, and implementing scalable and high-performance data pipelines that meet the needs...

  • Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleData Engineering ManagerRole OverviewThe Senior Data Engineer will design, develop, and maintain scalable data pipelines and infrastructure to support data-driven decision-making and advanced analytics. They must have deep expertise in data engineering, strong problem-solving skills, and the ability to collaborate with cross-functional teams to...

  • Senior Data Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataLeader Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionAs a seasoned data professional, you will be responsible for leading cross-functional teams in the development and maintenance of large-scale data pipelines. Your expertise will be essential in architecting and implementing scalable data solutions that drive business growth.Required Skills and QualificationsMinimum 5 years of experience...

  • Chief Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Data Engineer Position OverviewAs a Senior Data Engineer, you will play a key role in designing and implementing data engineering solutions for our organization.Key Responsibilities:Design and develop complex data pipelines using Snowflake, Apache Beam, or similar technologies.Collaborate with cross-functional teams to identify business requirements...

  • Senior Data Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,60,00,000

    Snowflake and dbt Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the design and implementation of scalable data pipelines using Snowflake and dbt.This is an exciting opportunity for experienced engineers to drive data transformation at scale, define architectural best practices, and architect modular, test-driven ELT pipelines.Key...

  • Strategic Data Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 19,96,000 - ₹ 24,64,700

    Job DescriptionWe are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM (Enterprise Performance Management).This role requires deep expertise in data integration, ETL/ELT, APIs,...

  • Data Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data EngineerWe are seeking a skilled Data Engineer to build, optimize, and maintain data pipelines and architectures.Key Responsibilities:Design, develop, and optimize scalable data pipelines and workflows using Azure Data Factory, Synapse Pipelines, and Microsoft Fabric.Transform and migrate existing Alteryx workflows into scalable Azure Databricks...

  • Expert Data Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000

    Senior Data Engineer PositionA senior data engineer with expertise in Airflow, Python, and Snowflake to design and develop scalable data pipelines.Key Responsibilities:Develop and maintain complex data workflows using AirflowCollaborate with cross-functional teams to identify business requirements and implement data solutionsDesign and optimize data...

  • Chief Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Data Engineering LeadershipWe seek an experienced Senior Data Engineering Leader to spearhead the development of scalable data pipelines and ETL processes.