Azure Databricks Engineer with Injection experience

5 days ago

Kurnool, Andhra Pradesh, India Nexify Infosystems Full time

Title: Azure Databricks Engineer with Injection experience

Location: Remote (India)

Duration: 6 Month, (if the candidate is good with work, it can be extended to 1+ year )

Time: 10.00 AM- 7.00 PM IST

Need good comm skills – they will be coordinating with Americans on daily bases

for clarity : We are seeking an Ingestion Engineer with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

Key Responsibilities:

Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.

Implement and maintain CI/CD pipelines for data workflows.

Deploy and manage containerized applications using Kubernetes.

Ensure data integrity, security, and compliance throughout the ingestion process.

Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.

Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

Proven experience in data ingestion and pipeline development.

Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).

Strong knowledge of Kubernetes and container orchestration.

Experience with Databricks, Spark, and data lake architectures.

Proficiency in Python, Scala, or SQL for data processing.

Familiarity with cloud platforms such as AWS, Azure, or GCP.

Strong problem-solving and analytical skills.

Preferred Qualifications:

Experience with Infrastructure as Code (Terraform, Helm, etc.).

Background in streaming data ingestion (Kafka, Kinesis, etc.).

Knowledge of data governance and security best practices.

  • Senior Azure Data Engineer

    13 hours ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Job TitleWe're seeking an experienced Data Engineer to lead our Azure initiatives. This is a senior technical role with high expectations, requiring strong hands-on experience with Azure and Databricks.This position involves designing, developing, and optimizing data pipelines using Azure and Databricks. You will work with Databricks Asset Bundles (DABs) for...

  • Databricks Pipeline Developer

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title:Azure Databricks EngineerOverview:We are seeking a seasoned Azure Databricks professional to collaborate on a short-term contract basis. The ideal candidate will possess in-depth expertise in designing, developing, and optimizing data pipelines using Azure Data Factory and Databricks notebooks.Key Responsibilities:Create and modify complex data...

  • Databricks Solutions Engineer

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    We're seeking a highly skilled Data Solutions Architect to lead the design, development, and implementation of scalable, secure, and high-performance data solutions on Databricks.Key Responsibilities:Design and develop data pipelines and ETL processes on Databricks.Lead architecture and implementation of data solutions.Collaborate with business stakeholders,...

  • Senior Databricks Sme

    4 weeks ago

    Kurnool, Andhra Pradesh, India DataE2E Technologies Full time

    Job Title: Senior Databricks EngineerLocation: 100% Remote Job Type: Full-Time About the Role:We are looking for an experienced Senior Databricks SME with a strong background in data engineering to help build and optimize scalable, high-performance data solutions.The ideal candidate has hands-on experience in Databricks production environments and a deep...

  • Databricks Engineer Role Summary

    3 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Databricks Engineer Role SummaryKey Responsibilities:Big Data Pipeline Development: Design, develop and maintain scalable, secure and high-performance data pipelines.Architecture and Implementation: Lead the architecture and implementation of data solutions, collaborating with stakeholders to deliver actionable insights.Data Governance and...

  • Advanced Azure AI ML Engineer

    5 days ago

    Kurnool, Andhra Pradesh, India beBeeAzure Full time ₹ 2,16,00,000 - ₹ 2,59,20,000

    As a skilled Azure AI ML engineer, you will play a critical role in designing and implementing highly available and scalable systems.With expertise in DevOps pipelines and experience with Azure infrastructure, storage, networking, security, and IAM, you will be responsible for developing and maintaining CI/CD pipelines.Additionally, you will analyze system...

  • Senior Databricks Engineer

    4 weeks ago

    Kurnool, Andhra Pradesh, India Celebal Technologies Full time

    Senior Databricks Engineer (Unity Catalog) Experience: 8-10 yearsImmediate Joiners OnlyMust-Have Skills: Strong expertise in Databricks with Unity Catalog Experience in data governance, security, and access control Hands-on in ETL, data pipelines, and performance tuning Ability to work on enterprise-scale data platforms

  • Azure Solutions Architect

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job OverviewWe are seeking a seasoned Azure Data Engineer to work in a hybrid development and support role.You will be responsible for designing, building, and maintaining data and analytics solutions using Azure Data Engineering technologies with a focus on performance, scalability, and reliability.Develop and maintain data pipelines using Azure Data...

  • Data Engineer

    15 hours ago

    Kurnool, Andhra Pradesh, India Exult Global Full time

    Role: Data EngineerExperience: 3-5 yrsNotice Period: ImmediateWork Mode: Hybrid Job DescriptionRequirements:• Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL• Strong background in distributed data processing and storage (e.g. Apache, Spark, Hadoop)• Large scale (TBs of data) data engineering skills - Model data,...

  • Cloud Data Engineering Specialist

    5 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerAbout the Role:We are seeking a data engineering professional with 4-7 years of experience to design and optimize scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.The ideal candidate will have strong analytical skills, expertise in T-SQL programming, and hands-on experience with Azure cloud tools. Experience...