Senior Data Pipeline Architect

4 days ago


Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 10,54,290 - ₹ 20,28,578

Job Overview

Our organization seeks a highly skilled Data Engineer with 4–7 years of experience to build and optimize scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.

The role involves collaborating with cross-functional teams to develop innovative data solutions, ensure robust data governance, and support real-time and batch processing requirements.

Key Responsibilities:

  • Design and implement quality database architecture for sprints
  • Create and deploy efficient ETL/ELT pipelines with Azure Databricks
  • Develop and maintain Delta Lake tables for real-time and batch processing
  • Ensure data security and access control through Unity Catalog
  • Analyze, troubleshoot, and resolve complex issues in real-time
  • Develop unit tests and maintain data integrity

Requirements:

  • 4-7 years of experience as a Data Engineer
  • Expertise in T-SQL programming and Azure Databricks experience
  • Strong analytical and problem-solving skills


  • Amrāvati, Maharashtra, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:">Lead Azure Data Engineer"> ">Job Description">">As a highly skilled and experienced Lead Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines using Azure and Databricks.">Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management is also required.">Additionally, you will...


  • Amrāvati, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title: Data EngineerRole Overview:We are seeking a skilled professional to design, develop, and maintain scalable data pipelines that process large volumes of structured and unstructured data.The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, collaborating closely with cross-functional teams...

  • Big Data Architect

    4 days ago


    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Big Data ArchitectWe are seeking a highly skilled Big Data Architect to design, develop, and optimize large-scale data pipelines and distributed data processing systems.The ideal candidate will have a proven track record in building scalable cloud-based data architectures using Scala, Spark, Python, Apache Kafka, and NiFi.


  • Amrāvati, Maharashtra, India beBeeArchitect Full time ₹ 1,70,00,000 - ₹ 2,10,00,000

    Job Overview:">We are seeking a skilled architect to design and develop cutting-edge generative AI solutions.Primary Responsibilities:">">Design and implement scalable GenAI pipelines using Retrieval-Augmented Generation (RAG) and LLM orchestration engines">Develop RESTful APIs and backend services using FastAPI/Flask integrated with OpenAI or open-source...


  • Amrāvati, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title Senior Data Engineer Location: Remote (India) – Occasional travel to Riyadh, KSA We are seeking a Senior Data Engineer to join our product development and delivery team. This is a key role in building the intelligence infrastructure that powers enterprise transformation in complex telecommunications and IT Asset Management environments. You will...


  • Amrāvati, Maharashtra, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000

    About Us:We are a leading provider of innovative telenutrition and foodcare solutions. Our platform is guided by a robust network of Registered Dietitians, empowering members to make informed decisions about their diet and lifestyle.Our mission is to make nutritious food accessible and affordable for everyone, regardless of economic status. We achieve this...


  • Amrāvati, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data EngineerWe are looking for an experienced professional to design and implement a scalable data warehouse and manage a data lake on cloud infrastructure.Key Responsibilities:Design, build, and maintain a data warehouse for analytics and reporting using relational databases.Develop and manage data pipelines for ingestion, transformation, and...


  • Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Cloud Data ArchitectJob Description: As a seasoned data professional, you will be responsible for designing and implementing end-to-end data pipelines on AWS cloud infrastructure. This includes developing and deploying scalable data processing workflows using Apache Spark, SQL, and cloud-native technologies.Responsibilities:Design and develop...


  • Amrāvati, Maharashtra, India beBeeDataArchitect Full time ₹ 60,00,000 - ₹ 1,25,00,000

    Key Data PositionWe are seeking an expert data architect to develop, govern and scale our data architecture and pipelines.Responsibilities:Design logical and physical data models with collaboration from stakeholders.Develop robust data architectures for warehousing and enterprise platforms.Create scalable workflows using Fivetran and Cloud Composer.Essential...


  • Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Delivering Modern Data SolutionsJob DescriptionThe role of Senior Data Engineer is crucial in developing modern data warehouse solutions using Snowflake and ADF. The ideal candidate will have a strong background in data warehousing and ETL processes, with expertise in Snowflake security, Snowflake SQL, and designing/implementing other Snowflake objects.A...