Current jobs related to Senior Data Pipeline Architect - Kolkata, West Bengal - beBeePlatformEngineer

  • Senior Data Pipeline Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled professional to lead the design and optimization of our distributed data pipelines, infrastructure, and tools that power insights across our business.You will collaborate closely with software developers, architects, analysts, and data scientists to ensure smooth, secure, and efficient data delivery across multiple...

  • Senior Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Are you a data visionary looking to shape the future of our organization?Data Architect Job DescriptionWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have in-depth knowledge of building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.

  • Data Solutions Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 14,62,500 - ₹ 19,30,000

    Job Title: Data Solutions ArchitectJob Description:We are seeking an experienced Senior Data Engineer to lead the development of large-scale data processing systems.As a Senior Data Engineer, you will design, develop, and maintain complex data pipelines using Airflow.You will work closely with cross-functional teams to identify business requirements and...

  • Chief Data Pipeline Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 10,00,000

    Job DescriptionAs a skilled Data Engineer, you will be responsible for designing and implementing data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Key Responsibilities:Develop and manage continuous integration/continuous deployment (CI/CD) pipelines using GitHub Actions or equivalent...

  • Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Senior Data Engineering LeadWe are seeking a highly experienced leader to oversee our data engineering team. The ideal candidate will have a strong focus on cloud-based data engineering, specifically with Databricks.This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and...

  • Senior Data Architect Position

    7 days ago

    Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe're seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions.This role involves building robust data pipelines, cloud-native data architectures, and high-performance data warehouses using cutting-edge technologies like Google Cloud Platform (GCP).

  • Senior Data Pipeline Specialist

    7 days ago

    Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 8,50,000

    Data Systems EngineerWe are seeking a skilled data professional with hands-on experience in designing, building, and optimizing scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL. This is an exciting opportunity to join our organization as a Data Systems Engineer.Key Responsibilities:Design and build ETL/ELT pipelines using AWS Glue,...

  • Senior Data Pipeline Developer

    1 week ago

    Kolkata, West Bengal, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a seasoned Data Pipeline Specialist to join our team for an in-house project.">Key ResponsibilitiesDevelop and execute advanced SQL queries for data validation, reconciliation, and transformation checks across complex data pipelines and enterprise-grade data systems.Design and maintain data validation automation frameworks using Python, with...

  • Senior Data Architect

    7 days ago

    Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly experienced Data Architect with expertise in data warehousing, data modeling and data engineering.Lead and manage data warehousing projects, ensuring timely delivery and execution of scalable and efficient data solutions.Collaborate with clients to gather requirements, analyze needs and provide technical guidance on data engineering...

  • Big Data Pipeline Specialist

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer for Real-Time & Big QueryWe're seeking an experienced Senior Data Engineer to join our team in India. This is a remote opportunity for a specialist with 10+ years of experience to work on challenging projects for industries like Energy, Oil & Gas, Healthcare, and Finance.This role will be at the forefront of our data solutions,...

Senior Data Pipeline Architect

3 weeks ago

Kolkata, West Bengal, India beBeePlatformEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

About this Role:

Lead Python Platform Engineer

We are seeking a highly skilled Lead Python Platform Engineer to join our team. This individual will be responsible for designing and implementing scalable and efficient data pipelines using Apache Beam and Databricks.

This role requires strong expertise in Python, with at least 7 years of experience in performance and concurrency optimization. The ideal candidate will also have hands-on experience with observability tools such as Elastic APM and Splunk.

The successful candidate will work closely with our team to develop and maintain a shared component library/SDK for pipelines, including ingestion, parsing, extraction, validation, enrichment, and publishing.

Key Responsibilities:
  • Design and implement high-performance data pipelines using Apache Beam and Databricks
  • Develop and maintain a shared component library/SDK for pipelines
  • Implement robust LLM API rate limiting/governance
  • Mentor junior engineers and lead design reviews
  • Partner with ML engineers on the future LLM/SLM path
Requirements:

To succeed in this role, you will need:

  • At least 7 years of experience in Python programming
  • Strong expertise in performance and concurrency optimization
  • Hands-on experience with observability tools such as Elastic APM and Splunk
  • Experience with Apache Beam and Databricks
  • Strong architecture/design skills
  • Excellent communication and teamwork skills
Benefits:

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development.

Our team is passionate about creating a culture that values diversity, inclusion, and employee engagement. We believe in fostering a workplace that supports flexibility, creativity, and innovation.

We welcome applicants from diverse backgrounds and perspectives. If you're excited about working with cutting-edge technologies and making a meaningful impact, we encourage you to apply.