Azure Data Engineer(Terraform)
2 days ago
Job Title: Data Engineer
Experience: 6+ Yrs
Location: Bengaluru
Job Description:
We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable. You'll be instrumental in automating workflows, monitoring system health, and enforcing security best practices across our data ecosystem.
Key Responsibilities:
· Maintain and monitor Databricks-based data pipelines and Azure data services (e.g., Data Lake, Synapse, Key Vault).
· Implement CI/CD pipelines using Azure DevOps for data engineering workflows.
· Conduct regular system health checks and performance tuning of clusters and jobs.
· Automate infrastructure provisioning using tools like Terraform or ARM templates.
· Use monitoring tools (e.g., Azure Monitor, Log Analytics, Prometheus) to track system metrics and alert on anomalies.
· Perform security audits using tools like Databricks Security Analysis Tool (SAT) to ensure compliance with best practices.
· Manage secrets and credentials securely using Azure Key Vault and Databricks secret scopes.
· Collaborate with security teams to enforce network security, access control, and data encryption policies.
· Maintain operational runbooks and incident response
Qualifications:
· Bachelor's degree in computer science, Engineering, or related field.
· 5+ years of experience in DevOps, cloud operations, or data platform support.
· Proficiency in Azure services, Databricks, and scripting languages (Python, Bash).
· Experience with CI/CD tools (Azure DevOps, GitHub Actions) and infrastructure-as-code.
· Familiarity with security frameworks and auditing tools in cloud environments.
· Strong troubleshooting skills and a proactive approach to system reliability.
Preferred Skills:
· Experience with Databricks SAT for security posture assessments.
· Knowledge of Unity Catalog, RBAC, and data governance in Azure Databricks.
· Exposure to MLOps and operationalizing machine learning pipelines.
· Understanding of cost optimization strategies in Azure.
call @
Job Types: Full-time, Permanent
Pay: Up to ₹1,800,000.00 per year
Work Location: In person
-
Azure Data Engineer + Terraform + DevOps
2 days ago
Bengaluru, Karnataka, India Wipro Full time ₹ 15,00,000 - ₹ 20,00,000 per yearTECHNICAL SKILLS AND EXPERIENCEMost important:7+ years professional experience as a data engineer, with at least 4 utilizing cloud technologies.Proven experience building ETL or ETL data pipelines with Databricks either in Azure or AWS using PySpark language.Strong experience with the Microsoft Azure Data Stack (Databricks, Data Lake Gen2, ADF etc.)Strong...
-
Terraform with Azure
2 days ago
Bengaluru, Karnataka, India PureSoftware Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJD Role 1 is: (who should be very good at Terraform script for Azure resources infra & network for Databricks, Databricks workspace and Databricks UC DAB, and build CI/CD pipelineRequired Skills & Qualifications:Good hands-on experience in Terraform with a focus on Azure infrastructure provisioning.Strong understanding of Azure networking, security groups,...
-
Data Engineer with Azure Cloud and Terraform
2 days ago
Bengaluru, Karnataka, India Unisys Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWhat Success Looks Like In This RoleGood knowledge and skill set on Azure CloudOps and Azure Infra.Design, develop, and maintain infrastructure as code (IaC) using tools such as Terraform, Bicep, or ARM templates.Design, implement, and manage CI/CD pipelines using Azure DevOps.Collaborate with development, operations, and security teams to define and...
-
Azure Devops + Terraform Professional
7 days ago
Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 15,00,000 per year:Senior Devops Engineer Candidate should have good Platform experience on Azure with Terraform. The devops engineer needs to help developers, create the Pipelines and K8s Deployment Manifests. Good to have experience on migration and upgrade activities (DBs, OS, AKS, etc)To manage/automate infrastructure automatically using Terraforms. Jenkins is the key...
-
Azure Data Engineer
2 days ago
Bengaluru, Karnataka, India Peoplefy Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title: Azure Data EngineerLocation: Bengaluru - OnsiteJob Description:We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable. You'll be...
-
Azure Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Meritude Skills Development Full time ₹ 70,000 - ₹ 17,00,000 per yearRole: Azure data engineerWork Mode: 5 daysLocation: Bengaluru (WFO)Experience: 5+ yearsPrimary skills:Candidate should have experience in 80% in azure data engineering and 20% in azure devops ci/cdJob Description:Key Responsibilities:Maintain and monitor Databricks-based data pipelines and Azure data services (e.g., Data Lake, Synapse, Key Vault).Implement...
-
Cloud Data Engineer GCP&Azure
2 weeks ago
Bengaluru, Karnataka, India Innova ESI Full time ₹ 8,00,000 - ₹ 24,00,000 per yearRole: Cloud Data Engineer [GCP&Azure]Experience: 5+ yearsLocation: BangaloreImmediate joiners onlyMandatory Skills Sets- Pub sub, gcs, big query, data flow , GCP, TerraformKey Responsibilities:Design, develop, and maintain robust data pipelines using Azure Data Factory, and related services.Build and optimize scalable data models in BigQuery, ensuring...
-
Terraform Developer
5 hours ago
Bengaluru, Karnataka, India Talent21 Management Shared Services Pvt. ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearThe Product team forms the crux of our powerful platforms and connects millions of customers to the product magic.This team of innovative problem solvers develop and build products that help Epsilon be a market differentiator.They map the future and set new standards for our products, empowered with industry standard processes, ML and AI capabilities.The...
-
Azure AI_ML SRE
2 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearReq ID: 338862NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure AI_ML SRE to join our team in Bengaluru, Karnātaka (IN-KA), India (IN). Job Description: Provide Azure...
-
Azure DevOps Terraform-C1-Majumder Kuntal
1 week ago
Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year- Must have Terraform, terragrunt , Kubernetes , DevOps , Azure Good to have Azure Monitoring , Cloud Operation , Design cloud solution 1. In-depth understanding of the Azure DevOps Engineering. 2.Significant experience with the Scripting(Python/Bash/shell 3. Experience in Terraform as IaaC 4.must to have hands on Docker Kubernetes using Helm 5. Experience...