Azure Data Engineer

9 hours ago

Malappuram, Kerala, India Peoplefy Full time

Job Title: Azure Data Engineer

Location: Bengaluru - Onsite

Job Description:

We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable. You'll be instrumental in automating workflows, monitoring system health, and enforcing security best practices across our data ecosystem.

Key Responsibilities:

  • Maintain and monitor Databricks-based data pipelines and Azure data services (e.g., Data Lake, Synapse, Key Vault).
  • Implement CI/CD pipelines using Azure DevOps for data engineering workflows.
  • Conduct regular system health checks and performance tuning of clusters and jobs.
  • Automate infrastructure provisioning using tools like Terraform or ARM templates.
  • Use monitoring tools (e.g., Azure Monitor, Log Analytics, Prometheus) to track system metrics and alert on anomalies.
  • Perform security audits using tools like Databricks Security Analysis Tool (SAT) to ensure compliance with best practices.
  • Manage secrets and credentials securely using Azure Key Vault and Databricks secret scopes.
  • Collaborate with security teams to enforce network security, access control, and data encryption policies.
  • Maintain operational runbooks and incident response

Qualifications:

  • Bachelor's degree in computer science, Engineering, or related field.
  • 5+ years of experience in DevOps, cloud operations, or data platform support.
  • Proficiency in Azure services, Databricks, and scripting languages (Python, Bash).
  • Experience with CI/CD tools (Azure DevOps, GitHub Actions) and infrastructure-as-code.
  • Familiarity with security frameworks and auditing tools in cloud environments.
  • Strong troubleshooting skills and a proactive approach to system reliability.

  • Lead Azure Data Engineer

    1 week ago

    Malappuram, Kerala, India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologiesIf you're passionate about building robust applications and thrive in a dynamic environment,...

  • Azure Data Engineer

    7 days ago

    Malappuram, Kerala, India LTIMindtree Full time

    Role: Azure DataBricks Developer Location: Nagpur/Bhubaneshwar/Kolkata About LTIMindtree: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to...

  • Azure Data Expert

    1 week ago

    Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Azure Data ExpertWe are seeking a Subject Matter Expert (SME) to drive the technical depth, accuracy, and instructional value of our training content.This role requires leading the definition and review of presentations, labs, and real-world scenarios on Azure's modern data stack, working closely with content creators to shape advanced,...

  • Azure BI and Data Solutions Engineer

    4 days ago

    Malappuram, Kerala, India beBeeDataDriven Full time ₹ 15,00,000 - ₹ 25,00,000

    The Senior Business Intelligence (BI) and Data Engineer role is focused on designing, developing, and delivering business intelligence and data solutions to support informed decision-making.To achieve this, the incumbent will be responsible for creating robust data architectures, seamless data integrations, and scalable data warehousing to provide timely and...

  • Azure Data Solutions Architect

    7 days ago

    Malappuram, Kerala, India beBeeAzureDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Azure Data Engineer - Design and Develop Scalable Data SolutionsDescription:We seek a skilled professional to design, develop, and deliver complete end-to-end data pipelines using Azure services. This role involves handling data validation, transformation, and warehousing on Azure.Key Responsibilities:Design and develop scalable data-driven...

  • Azure Security Engineer Iii

    4 weeks ago

    Malappuram, Kerala, India Ascendion Full time

    About AscendionAscendion is a fullservice digital engineering solutions company.We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees.Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise...

  • Principal Data Engineer

    4 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Embark on a transformative career path where growth and innovation converge.About the Role:We seek an experienced professional with a strong foundation in Data Engineering, coupled with proven expertise in Generative AI. The ideal candidate will possess 12–20 years of experience in data engineering, with at least 3 years (last 2 years acceptable) of...

  • Senior Data Ingestion Specialist

    1 week ago

    Malappuram, Kerala, India beBeeDataIngestion Full time ₹ 10,00,000 - ₹ 12,00,000

    Job Title:Azure Databricks Engineer with Injection ExperienceDescription:This position requires a deep understanding of data ingestion processes, focusing on integrating various data sources into Azure Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient...

  • Azure Data Factory Integration Specialist

    5 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    ThreatXIntel, a startup cyber security company dedicated to protecting businesses and organizations from cyber threats, offers services like cloud security, web and mobile security testing, tailored to meet the specific needs of their clients.The company takes a proactive approach to security, continuously monitoring and testing digital environments to...

  • Azure Data Migration Specialist

    5 hours ago

    Malappuram, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Azure Data Migration ExpertWe are seeking an experienced Azure data migration expert to lead and execute large-scale data migration projects from on-premises to cloud platforms.