Azure Databricks Developer for Data Ingestion

7 days ago


Anand, Gujarat, India beBeeExpertise Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title

Azure Databricks Developer Needed for Data Ingestion Expertise

About the Role:

We are seeking a skilled Azure Databricks engineer to lead data ingestion efforts, design, develop, and optimize pipelines for integrating multiple sources into Databricks. The ideal candidate will have expertise in CI/CD and Kubernetes.

Key Responsibilities:

  • Data Ingestion Pipeline Design: Design and develop efficient data ingestion pipelines for integrating multiple sources into Databricks.
  • CICD Implementation: Implement and maintain Continuous Integration/Continuous Deployment (CICD) pipelines for data workflows.
  • Kubernetes Management: Deploy and manage containerized applications using Kubernetes.
  • Data Integrity Assurance: Ensure data integrity, security, and compliance throughout the ingestion process.
  • Team Collaboration: Collaborate with data engineers and other stakeholders to streamline data ingestion strategies.
  • Pipeline Optimization: Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Data Ingestion Experience: Proven experience in data ingestion and pipeline development.
  • CICD Tools Expertise: Hands-on experience with CICD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Kubernetes Knowledge: Strong knowledge of Kubernetes and container orchestration.
  • Databricks Expertise: Experience with Databricks, Spark, and data lake architectures.
  • Programming Skills: Proficiency in Python, Scala, or SQL for data processing.
  • Cloud Platforms Familiarity: Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Problem-Solving Skills: Strong problem-solving and analytical skills.


  • Anand, Gujarat, India beBeeDataIngestion Full time US$ 1,00,000 - US$ 1,25,000

    Job Title: Data Ingestion SpecialistDescription: We are seeking an experienced professional to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000

    Job OverviewData engineers play a pivotal role in designing, building, and maintaining automated data pipelines that support organizational data governance and analytics initiatives. This position involves creating production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention...


  • Anand, Gujarat, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000

    Azure Data Engineer RoleHello and welcome to our job description. We are currently hiring for an experienced Azure Data Engineer.This role is perfect for professionals with a strong background in data engineering and cloud services. As an Azure Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines to curate and...


  • Anand, Gujarat, India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologiesIf you're passionate about building robust applications and thrive in a dynamic environment,...


  • Anand, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Lead Data EngineerWe're seeking a skilled Lead Data Engineer to join our team. This role involves designing, developing, and optimizing data pipelines using Azure and Databricks.Key Responsibilities:Design, develop, and optimize data pipelines using Azure and Databricks.Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment...


  • Anand, Gujarat, India beBeeDataEngineer Full time

    Job Summary">We are seeking a highly skilled Data Engineer with 4+ years of experience in designing, building, and optimizing ETL pipelines using Azure Cloud technologies. The ideal candidate will have hands-on experience working with Databricks, managing large-scale data processing workflows, and implementing data transformation workflows for...


  • Anand, Gujarat, India beBeeDataScientist Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a technical lead to drive the development of our training content on Azure's modern data and AI stack. As a Subject Matter Expert (SME) in this field, you will lead the definition and review of presentations, labs, and real-world scenarios.The successful candidate will have deep hands-on experience in data and AI technologies...


  • Anand, Gujarat, India beBeedataengineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Software EngineerJob Description:Develop and optimize data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.Design scalable data architectures following best practices.Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.Key Responsibilities:Develop and maintain data lake solutions...

  • Big Data Developer

    7 days ago


    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title: Azure Data EngineerLocation: RemoteNotice Period: Immediate Joiners OnlyExperience: 4–6 YearsWe are seeking a seasoned data professional to join our team as an Azure Data Engineer.This role involves building, maintaining and supporting data & analytics solutions using Azure Data Engineering technologies with a strong focus on performance,...

  • Chief Data Architect

    18 hours ago


    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Job DescriptionThis is a critical role in designing, developing, and maintaining data pipelines and infrastructure. As a key member of our team, you will work closely with data scientists, analysts, and other stakeholders to ensure timely and accurate data delivery.Key Responsibilities:Data Pipeline Development: Design, develop, and implement efficient data...