Data Pipeline Architect

2 days ago

Amrāvati, Maharashtra, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title:

">

Lead Azure Data Engineer

">

 

">

Job Description

">
  • ">
  • As a highly skilled and experienced Lead Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines using Azure and Databricks.">
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management is also required.">
  • Additionally, you will build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.">
  • You must continuously adopt and apply new Databricks features to accelerate delivery.">
  • Ongoing optimization of Spark, SQL, and Python code for performance and scalability is a critical task.">
  • Finally, you will ensure that software engineering best practices are applied, such as TDD, CI/CD, modular design, and code reviews.">
">

 

">

Required Skills & Qualifications

">
  • ">
  • A minimum of 8 years' experience in Data Engineering with at least 5 years hands-on in Azure and Databricks is required.">
  • Strong expertise in the following areas is also necessary:">
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics)">
  • Azure Data Services (ADF, Azure Synapse, Azure Data Lake, Azure SQL)">
  • Python, SQL, and Spark with proven performance optimization skills">
  • Modern data architectures including Lakehouse and governance principles">
  • A track record of efficient delivery and helping teams accelerate execution is essential.">
">

 

">

Benefits

">
  • ">
  • The ideal candidate will have an efficiency-driven mindset focused on speeding up both personal and team delivery.">
  • Strong communication skills with the ability to share knowledge and mentor effectively is also required.">
  • Highly motivated, proactive, and results-oriented individuals are encouraged to apply.">
  • Able to work in a fast-paced environment with quick turnarounds is essential.">
  • A team-first approach driving collective improvement and efficiency is also necessary.">
">

 

">

Preferred Skills

">
  • ">
  • Experience with AI-driven development tools such as Cursor.ai or GitHub Copilot is desired but not required.">
  • Exposure to Generative AI in Databricks is also a plus but not necessary.">
">

 

">

Work Hours

">
  • ">
  • Must have 5–6 hours daily overlap with the USA team (EST time zone) for collaboration.">
"],

  • Senior Enterprise Data Architect

    2 days ago

    Amrāvati, Maharashtra, India beBeeDataArchitect Full time ₹ 60,00,000 - ₹ 1,25,00,000

    Key Data PositionWe are seeking an expert data architect to develop, govern and scale our data architecture and pipelines.Responsibilities:Design logical and physical data models with collaboration from stakeholders.Develop robust data architectures for warehousing and enterprise platforms.Create scalable workflows using Fivetran and Cloud Composer.Essential...

  • Senior Big Data Solutions Architect Position

    11 hours ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,30,00,000

    Big Data Architect Job OpportunityThis role is for an experienced Big Data Architect to lead multiple data engagements on cloud platforms.The ideal candidate will have more than 8 years of experience in technical roles, with a strong background in architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied...

  • Chief Data Solutions Architect

    10 hours ago

    Amrāvati, Maharashtra, India beBeeDataArchitect Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    About the Data Architect RoleWe are seeking a seasoned data professional to spearhead our end-to-end data architecture strategy and collaborate closely with cross-functional teams to create a robust and scalable data ecosystem.The ideal candidate will have deep technical expertise in data modeling, databases, cloud platforms, and integration frameworks, as...

  • Data Engineer

    10 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,50,000

    Job OverviewWe are seeking a seasoned data professional with expertise in designing and building scalable, event-driven data pipelines that support real-time clinical workflows.This critical role involves creating systems that process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems...

  • Chief Data Architect

    10 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000

    Job Title: Data EngineerWe are seeking a skilled data engineer to develop, optimize and maintain automated data pipelines supporting data governance and analytics initiatives.This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking and...

  • Senior Data Solutions Architect

    2 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000

    Job DescriptionAs a Technical Lead at datae2e-technologies, you will be responsible for leading a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms.The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks. You will oversee the development of end-to-end data...

  • Data Architect

    11 hours ago

    Amrāvati, Maharashtra, India beBeeDatabase Full time ₹ 20,00,000

    Job Title: Data ArchitectAs a highly skilled data architect, you will play a key role in designing and implementing scalable and efficient data systems that support business growth. Your expertise will be instrumental in developing robust database solutions, integrating disparate data sources, and optimizing data flow to meet the evolving needs of our...

  • Chief Data Architect

    6 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Roles and ResponsibilitiesDesign, develop, and execute end-to-end data pipelines on Azure. Create scalable data solutions that cater to business needs.Utilize expertise in PySpark, SQL, Azure Data Factory (ADF), Databricks (ADB), Data Lake (ADLS Gen2), and Python for data processing to deliver high-quality outputs.Work collaboratively with stakeholders...

  • Principal Data Engineering Professional

    2 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Business Data ArchitectWe are seeking a skilled Business Data Architect to design, build, and optimize scalable data platforms. The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design, build, and maintain ETL/ELT pipelines using...

  • Data Solutions Architect

    13 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,50,000

    Job OverviewWe are seeking an experienced Data Engineer to design and implement data solutions.Key ResponsibilitiesBenchmark, optimize, and debug Spark jobs in Databricks for large-scale data processing.Develop robust data pipelines using Python and SQL.Implement unit testing, validation, and quality checks for data workflows.Manage multi-environment...