Azure Data Engineer(Terraform)

16 hours ago

Bengaluru, Karnataka, India MV Outsourcing Pvt Ltd Full time ₹ 9,00,000 - ₹ 18,00,000 per year

Job Title: Data Engineer

Experience: 6+ Yrs

Location: Bengaluru

Job Description:

We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable. You'll be instrumental in automating workflows, monitoring system health, and enforcing security best practices across our data ecosystem.

Key Responsibilities:

· Maintain and monitor Databricks-based data pipelines and Azure data services (e.g., Data Lake, Synapse, Key Vault).

· Implement CI/CD pipelines using Azure DevOps for data engineering workflows.

· Conduct regular system health checks and performance tuning of clusters and jobs.

· Automate infrastructure provisioning using tools like Terraform or ARM templates.

· Use monitoring tools (e.g., Azure Monitor, Log Analytics, Prometheus) to track system metrics and alert on anomalies.

· Perform security audits using tools like Databricks Security Analysis Tool (SAT) to ensure compliance with best practices.

· Manage secrets and credentials securely using Azure Key Vault and Databricks secret scopes.

· Collaborate with security teams to enforce network security, access control, and data encryption policies.

· Maintain operational runbooks and incident response

Qualifications:

· Bachelor's degree in computer science, Engineering, or related field.

· 5+ years of experience in DevOps, cloud operations, or data platform support.

· Proficiency in Azure services, Databricks, and scripting languages (Python, Bash).

· Experience with CI/CD tools (Azure DevOps, GitHub Actions) and infrastructure-as-code.

· Familiarity with security frameworks and auditing tools in cloud environments.

· Strong troubleshooting skills and a proactive approach to system reliability.

Preferred Skills:

· Experience with Databricks SAT for security posture assessments.

· Knowledge of Unity Catalog, RBAC, and data governance in Azure Databricks.

· Exposure to MLOps and operationalizing machine learning pipelines.

· Understanding of cost optimization strategies in Azure.

call @

Job Types: Full-time, Permanent

Pay: Up to ₹1,800,000.00 per year

Work Location: In person

  • Azure Data Engineer + Terraform + DevOps

    2 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    TECHNICAL SKILLS AND EXPERIENCEMost important:7+ years professional experience as a data engineer, with at least 4 utilizing cloud technologies.Proven experience building ETL or ETL data pipelines with Databricks either in Azure or AWS using PySpark language.Strong experience with the Microsoft Azure Data Stack (Databricks, Data Lake Gen2, ADF etc.)Strong...

  • Terraform with Azure

    1 day ago

    Bengaluru, Karnataka, India PureSoftware Pvt Ltd Full time US$ 1,04,000 - US$ 1,30,878 per year

    JD Role 1 is: (who should be very good at Terraform script for Azure resources infra & network for Databricks, Databricks workspace and Databricks UC DAB, and build CI/CD pipelineRequired Skills & Qualifications:Good hands-on experience in Terraform with a focus on Azure infrastructure provisioning.Strong understanding of Azure networking, security groups,...

  • Azure Data Engineer

    4 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    As a seasoned data engineer, you will join our organization to craft and maintain scalable and secure data processing systems.Key Responsibilities:We are seeking someone with hands-on experience in designing and implementing data pipelines using Azure Data Factory (ADF) and Azure Data Bricks (ADBS)Develop and maintain Infrastructure-as-Code (IaC) using...

  • Azure Data Engineer- FTF

    1 week ago

    Bengaluru, Karnataka, India Orcapod Full time

    Face to Face Drive - Azure Data Engineer - 25th AugustLocation - BangaloreRole: Azure Data EngineerOpenings: 5Level: Senior Consultant (6–7 years experience)Skills Required: ADF, ADB, PythonAvailability: Ready to join immediatelyWork from OfficeJob Description:We are looking for a skilled and proactive Data Platform Engineer to join our data platform...

  • Azure Data Engineer

    17 hours ago

    Bengaluru, Karnataka, India Peoplefy Full time

    Job DescriptionJob Title: Azure Data EngineerLocation: Bengaluru - OnsiteJob Description:We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable....

  • Azure Data Engineer- FTF

    7 days ago

    Bengaluru, Karnataka, India Orcapod Full time

    Face to Face Drive - Azure Data Engineer - 25th AugustLocation - Bangalore- Role: Azure Data Engineer- Openings: 5- Level: Senior Consultant (6–7 years experience)- Skills Required: ADF, ADB, Python- Availability: Ready to join immediately- Work from OfficeJob Description:We are looking for a skilled and proactive Data Platform Engineer to join our data...

  • DevOps Engineer – Terraform

    4 weeks ago

    Bengaluru, Karnataka, India Celstream Technologies Full time

    Job DescriptionTitle: DevOps Engineer TerraformQualification: BE / MCAExperience: 6+Yrs to 8 YrsNotice period: Immediate joiners only.Location: BangaloreMode of work - Part time / FreelancerResponsibilities:- Design, develop, and manage scalable infrastructure using Terraform.- Collaborate with cloud architects and developers to define infrastructure...

  • Azure Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Peoplefy Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: Azure Data EngineerLocation: Bengaluru - OnsiteJob Description:We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable. You'll be...

  • Azure Data Engineer- FTF

    4 days ago

    Bengaluru, Karnataka, India Orcapod Full time

    Face to Face Drive - Azure Data Engineer - 25th August Location - Bangalore Role: Azure Data Engineer Openings: 5 Level: Senior Consultant (6–7 years experience) Skills Required: ADF, ADB, Python Availability: Ready to join immediately Work from Office Job Description: We are looking for a skilled and proactive Data Platform Engineer to join our data...

  • Azure Data Engineer- FTF

    4 days ago

    Bengaluru, Karnataka, India Orcapod Full time

    Face to Face Drive - Azure Data Engineer - 25th AugustLocation - BangaloreRole: Azure Data EngineerOpenings: 5Level: Senior Consultant (6–7 years experience)Skills Required: ADF, ADB, PythonAvailability: Ready to join immediatelyWork from OfficeJob Description:We are looking for a skilled and proactive Data Platform Engineer to join our data platform team....