Azure Data Engineer

2 days ago

Bengaluru, Karnataka, India Peoplefy Full time
Job Description

Job Title: Azure Data Engineer

Location: Bengaluru - Onsite

Job Description:

We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable. You&aposll be instrumental in automating workflows, monitoring system health, and enforcing security best practices across our data ecosystem.

Key Responsibilities:

- Maintain and monitor Databricks-based data pipelines and Azure data services (e.g., Data Lake, Synapse, Key Vault).
- Implement CI/CD pipelines using Azure DevOps for data engineering workflows.
- Conduct regular system health checks and performance tuning of clusters and jobs.
- Automate infrastructure provisioning using tools like Terraform or ARM templates.
- Use monitoring tools (e.g., Azure Monitor, Log Analytics, Prometheus) to track system metrics and alert on anomalies.
- Perform security audits using tools like Databricks Security Analysis Tool (SAT) to ensure compliance with best practices.
- Manage secrets and credentials securely using Azure Key Vault and Databricks secret scopes.
- Collaborate with security teams to enforce network security, access control, and data encryption policies.
- Maintain operational runbooks and incident response

Qualifications:

- Bachelor&aposs degree in computer science, Engineering, or related field.
- 5+ years of experience in DevOps, cloud operations, or data platform support.
- Proficiency in Azure services, Databricks, and scripting languages (Python, Bash).
- Experience with CI/CD tools (Azure DevOps, GitHub Actions) and infrastructure-as-code.
- Familiarity with security frameworks and auditing tools in cloud environments.
- Strong troubleshooting skills and a proactive approach to system reliability.

  • Azure Lead Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 248733NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Azure Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Preferred Experience ...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Azure Data Engineer

    2 days ago

    Bengaluru, Karnataka, India 3K SOFTECH PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Technical Skills :Azure Data Services : In-depth experience with Azure Data Factory, Azure Databricks, and other Azure data solutions like Azure Synapse, Azure Blob Storage, Azure SQL Database, etc. Big Data Technologies : Strong proficiency in Apache Spark and PySpark for processing large datasets, with hands-on experience in optimizing Spark jobs. ...

  • Azure Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Infogain Full time

    Posted on October 24 2024ROLES RESPONSIBILITIESCore Skills- Mastery of Azure data services such as Azure SQL Database Azure Cosmos DB and Azure Data Lake Storage - Deep expertise in ETL Extract Transform Load processes and data integration - Advanced SQL and database querying optimization skills - Experience in leading and managing data...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are looking for an experienced Azure Data Engineer - Senior Consultant .This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience: 7 to 8 years Location: Bangalore RequirementsKey...

  • Azure Data Engineer

    18 hours ago

    Bengaluru, Karnataka, India Talent Worx Full time US$ 90,000 - US$ 1,20,000 per year

    We are looking for an experienced Azure Data Engineer Senior Consultant . This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience : 7 to 8 years.Location : Bangalore.RequirementsKey Responsibilities...

  • Azure Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Reporting Engineer (Azure Data Engineer)Experience Required : 5+ yearsLocation : BangaloreJob Description :We are looking for a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a robust background in developing and maintaining data solutions in Azure Cloud, with expertise in Azure Data Factory (ADF), SSIS,...

  • Machine Learning Engineer with Azure Databricks

    2 days ago

    Bengaluru, Karnataka, India Enable Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Design, implement, and maintain data infrastructure to process and store large-scale vision data setsBuild automated workflows for data ingestion, transformation, and validation within the Azure ML ecosystemDevelop monitoring systems and data quality controls for AML pipeline operationsCreate and maintain data asset management strategies within Azure ML...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time

    We are looking for an experienced Azure Data Engineer Senior Consultant . This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem. Experience : 7 to 8 years. Location : Bangalore.Requirements : Key...

  • Azure Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Aziro Full time US$ 1,50,000 - US$ 2,00,000 per year

    Aziro is hiring Azure Data Engineers Job Title: Senior Azure Data EngineerExperience Required: 7+ yearsLocation: Bangalore (Hybrid)Notice Period - Immediate / Quick Joiners (15 to 20 days)Job Description:We are seeking a Senior Azure Data Engineer with hands-on expertise in Azure Databricks, Azure Data Factory (ADF), Python/PySpark, and SQL. The ideal...