Principal Data Pipeline Architect

1 week ago


Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000
Data Engineer Job Description

We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable data pipelines using various technologies such as Apache Airflow, Apache Spark, and Azure data services.

The ideal candidate will have hands-on experience with Python programming and emerging technologies like IoT and AR/VR/MR. You will work collaboratively with cross-functional teams to gather requirements, optimize pipelines, and ensure high data quality.

The role requires strong SQL skills and experience with data modeling. Proficiency in distributed data processing frameworks is also necessary. Experience working in Microsoft Azure cloud environments is highly desirable.

Key Responsibilities:

  • Design and develop scalable ETL/ELT pipelines using Apache Airflow, Apache Spark, and Azure Data Factory.
  • Integrate and manage structured and unstructured data from diverse sources, including Azure Cosmos DB, Azure Data Lake, and Azure Synapse Analytics.
  • Implement IoT data ingestion, processing, and analytics solutions using Azure IoT services.
  • Develop and deploy Python scripts for automation, data transformation, and analytics workflows.
  • Create dashboards, visualizations, and reports to support data-driven decision-making.

Mandatory Skills:

  • Apache Airflow
  • Apache Spark
  • Python
  • Azure Cosmos DB
  • Azure Data Factory
  • Azure IoT
  • Azure Synapse Analytics
  • Azure Data Lake
  • Data bricks
  • AR/VR/MR

Required Experience & Qualifications:

  • 5+ years of experience in data engineering, cloud analytics, or BI development.
  • Strong SQL skills and experience with data modeling.
  • Proficiency in distributed data processing frameworks.
  • Experience working in Microsoft Azure cloud environments.

Preferred Skills:

  • Experience with AI/ML integrations into analytics pipelines.
  • Familiarity with real-time data streaming solutions (Kafka, Event Hubs).
  • Exposure to immersive analytics using AR/VR/MR.


  • Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerAbout the Role:Our company seeks a skilled data engineer to create robust data pipelines and drive business strategy.Key Responsibilities:Develop and refine complex ETL pipelines for processing high volumes of data.Ensure data precision, coherence, and system performance.Collaborate with architects, analysts, and stakeholders...


  • Thāne, Maharashtra, India beBeeInteriorArchitect Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: Principal Interior ArchitectPosition Overview:A principal interior architect oversees the development of inspiring designs, translating client conversations into visual concepts and managing projects from conception to completion.Client ExperienceEnsure client satisfaction by delivering exceptional results and maintaining effective communication...

  • Principal Architect

    7 days ago


    Thāne, Maharashtra, India Realm Consulting Services Pvt Ltd. Full time

    Create detailed technical drawings using CAD software. Interpret and modify designs as per specifications and feedback. Ensure compliance with standards and regulations. Collaborate with architects and engineers to finalize plans. Maintain and organize design documentation. Experience 2 - 6 Years No. of Openings 1 Education B.Arch Role ...

  • Data Engineer

    2 weeks ago


    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock a career in data engineering and join the movement towards informed decision-making.About this roleWe are seeking an experienced data engineer to design and build efficient data pipelines that drive business outcomes. This is a hands-on role that requires problem-solving skills, collaboration with cross-functional teams, and a passion for building...


  • Thāne, Maharashtra, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team of consultants.Key Responsibilities:Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage...


  • Thāne, Maharashtra, India beBeeDatastage Full time ₹ 10,00,000 - ₹ 15,00,000

    Job SummaryWe are seeking a highly skilled ETL developer with expertise in data warehousing concepts, ETL development, and experience designing, building, and optimizing data pipelines using IBM DataStage.


  • Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title">Data Engineer Leader - Azure SolutionsWe are seeking an experienced Data Engineer with a strong background in designing, developing and managing data pipelines and transformation frameworks.The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics and Apache Kafka. They will also...


  • Thāne, Maharashtra, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Build Data Infrastructure from ScratchAs a seasoned data engineer, you will design and implement end-to-end ETL pipelines for diverse datasets.Collaborate with cross-functional teams to drive model development and experimentation forwardDevelop scalable APIs or backend logic to power dynamic pricing algorithmsCreate intuitive internal dashboards or tools...


  • Thāne, Maharashtra, India beBeeDatabaseEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Database Engineer RoleWe seek a highly skilled and motivated professional with 6+ years of experience in database development. If you're passionate about coding, problem-solving, and innovation, we'd love to hear from you.About the PositionThis is an exciting opportunity to join our team as a Database Developer. You will be responsible for designing,...

  • Data Pipeline Lead

    2 weeks ago


    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job OverviewWe are seeking a seasoned data engineer to lead our team in designing and developing scalable data pipelines. This role requires expertise in cloud computing, data engineering, and ETL/ELT processes.Key ResponsibilitiesDesign, develop, and optimize complex data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Collaborate with...