Data Pipeline Architect

2 days ago


Pune, Maharashtra, India beBeeDataScience Full time ₹ 19,62,000 - ₹ 23,49,000
Job Description:

We are seeking a highly skilled Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.

This role requires strong expertise in CI/CD and Kubernetes to ensure seamless integration and scalability.

Required Skills & Qualifications:
  • Proven experience in designing and developing data ingestion pipelines.
  • Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins or Azure DevOps.
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark and data lake architectures.
  • Proficiency in Python, Scala or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure or GCP.
  • Strong problem-solving and analytical skills.
Benefits:
  • Opportunity to work on cutting-edge data engineering projects.
  • Collaborative team environment.
  • Ongoing training and professional development.


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    As a key member of our team, you will play a pivotal role in designing, developing and maintaining data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform.The successful candidate will have deep expertise in data integration, ETL/ELT, APIs and Databricks. You will work closely with business...


  • Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Solutions ArchitectThe Role:This Senior Data Engineer position plays a pivotal role in the design, development, and maintenance of large-scale data pipelines using Azure services such as Databricks and Data Factory. The ideal candidate will possess proficiency in programming languages like SQL, Python, R, or Scala to create efficient data...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Big Data Engineer">This role will oversee a team of employees and contractors in their professional development. Key responsibilities include mentoring, problem resolution, and team building to ensure success. The position will also lead software engineering projects in developing high-quality, secure, scalable applications and pipelines based on...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data Architect SpecialistDescription:We are looking for a skilled Data Architect Specialist to craft and maintain robust data pipelines, utilizing Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data. This role involves building and optimizing data pipelines to facilitate seamless data flow across systems and...


  • Pune, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    PySpark Developer Job Description We are seeking a highly skilled PySpark developer to join our team in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. Main Responsibilities: Develop and manage data pipelines using PySpark on...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a seasoned Data Engineer to join our team. This role involves crafting and maintaining robust data pipelines using Python and SQL to ensure efficient extraction, transformation, and loading (ETL) of data.The ideal candidate will have expertise in building and optimizing data pipelines to facilitate seamless data flow across systems...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:Senior Data Engineer Job Description: Develop and maintain large-scale data pipelines for diverse datasets.Build complex datasets based on business needs.Design a robust data pipeline architecture.Identify opportunities for data acquisition through stakeholder collaboration.Prioritize business requirements to technical specifications. Key...


  • Pune, Maharashtra, India beBeeData Full time US$ 1,80,000 - US$ 2,20,000

    Senior Data Engineer RoleWe are seeking a talented and passionate Senior Data Engineer to join our team.This role involves building and scaling our data infrastructure, enabling business-driven decision-making across the organization.The ideal candidate will design, develop, and maintain efficient and reliable data pipelines for both ELT (Extract, Load,...

  • Data Architect

    2 weeks ago


    Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Solutions ArchitectWe are seeking a highly skilled and experienced Senior Data Solutions Architect to design, build, and maintain robust data pipelines using Azure cloud services.The ideal candidate will have 9-12 years of experience in designing, building, and maintaining scalable data solutions for large-scale organizations.Key...