Azure Databricks Developer with ETL Expertise

1 day ago

India beBeeDataIngestion Full time US$ 90,000 - US$ 1,20,000

Job Title: Azure Databricks Engineer with Injection experience

Description: We are seeking an experienced Data Ingestion Engineer to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.

About the Role:

The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows. They will be responsible for designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.

Key Responsibilities:

Implement and maintain CI/CD pipelines for data workflows.

Deploy and manage containerized applications using Kubernetes.

Ensure data integrity, security, and compliance throughout the ingestion process.

Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.

Troubleshoot and optimize ingestion pipelines for performance and scalability.

Requirements:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.

Preferred Qualifications:

  • Experience with Infrastructure as Code (Terraform, Helm, etc.).
  • Background in streaming data ingestion (Kafka, Kinesis, etc.).
  • Knowledge of data governance and security best practices.

  • Senior Azure Databricks Engineer

    4 weeks ago

    India Quant-data Full time

    We're Hiring: Senior Azure Databricks Engineer (Remote | Full-Time) Join us to build scalable, cloud-native data solutions using cutting-edge technologiesWe're looking for an experienced and driven Senior Azure Databricks Engineer to join our growing team. This role is ideal for professionals with 6–10 years of experience in the data engineering space,...

  • Azure Databricks

    1 day ago

    India Zensar Technologies Full time

    **Data Architect (Azure, ADF, Databricks) - 14+ Years Experience** **About the Role**: **Responsibilities**: - **Data Platform Architecture**: - Design and architect a comprehensive data platform on Azure, leveraging best practices for scalability, performance, security, and cost optimization. - Define the overall data architecture framework, including...

  • Azure Databricks Engineer

    4 days ago

    India Proso Full time

    Proso AI is Hiring – Azure Databricks Engineer (Contract Role) We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months). Experience Required: 7+ years Key Skills & Responsibilities: Create/modify Azure Data Factory pipelines Develop and optimize Databricks notebooks using SQL & Python Work with file formats:...

  • Azure Databricks Engineer

    2 days ago

    India Proso Full time

    Proso AI is Hiring – Azure Databricks Engineer (Contract Role)We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months). Experience Required: 7+ years Key Skills & Responsibilities:- Create/modify Azure Data Factory pipelines- Develop and optimize Databricks notebooks using SQL & Python- Work with file formats:...

  • Databricks Engineer

    3 weeks ago

    India DataE2E Technologies Full time

    Key Responsibilities- Design, develop, and maintain data pipelines and ETL processes on Databricks.- Lead the architecture and implementation of scalable, secure, and high-performance data solutions.- Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.- Optimize data workflows...

  • Databricks Engineer

    3 weeks ago

    India DataE2E Technologies Full time

    Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.Optimize data workflows for...

  • Azure Databricks Lead Engineer

    4 weeks ago

    India Alcor Solutions, Inc. Full time

    Alcor Solutions is a leading digital transformation and cloud consulting firm, enabling enterprises to leverage modern data platforms, cloud-native solutions, and emerging technologies to drive innovation and business outcomes.We are seeking an Azure Databricks Lead Engineer to architect, administer, and scale our enterprise Databricks environment while...

  • Databricks Architect

    3 days ago

    India Tredence Full time

    About Tredence- Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey, focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Databricks SME

    4 weeks ago

    India DataE2E Technologies Full time

    Job Title: Senior Databricks EngineerLocation: 100% RemoteJob Type: Full-TimeAbout the Role:We are looking for an experienced Senior Databricks SME with a strong background in data engineering to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep...

  • Azure Databricks Engineer with Injection experience

    1 day ago

    India Nexify Infosystems Full time

    Title: Azure Databricks Engineer with Injection experienceLocation: Remote (India)Duration: 6 Month, (if the candidate is good with work, it can be extended to 1+ year )Time: 10.00 AM- 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesfor clarity : We are seeking an Ingestion Engineer with expertise in CI/CD and...