Capco - Azure Databricks Platform Engineer - Insurance Data Infrastructure

1 day ago

Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

Azure Databricks Platform Engineer - Insurance Data Infrastructure

Location : Pune / Bangalore/ Mumbai/ Chennai/ Hyderabad/ Gurugram

Band : M3/M4 (7 to 14 years)

Key Responsibilities :

- Azure Databricks Platform Engineering - Design, deploy, and manage secure, scalable, and high-performance Databricks environments for insurance data processing and analytics.

- Cloud Integration - Collaborate with architects, engineers, and security teams to establish infrastructure standards and ensure connectivity with legacy systems, cloud-native data sources, and third-party platforms.

- Infrastructure as Code (IaC) - Implement automated provisioning and configuration of Azure and Databricks resources using Terraform, supporting enterprise DevOps practices.

- Automation & CI/CD - Build and maintain GitHub Actions-based automation pipelines for environment deployment, monitoring, and incident response to ensure consistency, traceability, and efficiency.

- Performance & Scalability - Monitor platform health, optimize cluster utilization, and conduct tuning to ensure reliability, scalability, and cost efficiency for mission-critical workloads.

- Security & Compliance - Enforce enterprise and regulatory standards (RBAC, Key Vault, Managed Identities, Encryption, PDPO, GDPR, insurance compliance).

- Data Governance - Lead integration of Informatica tools for metadata management, cataloguing, lineage tracking, and compliance across the platform.

- Documentation & Governance - Prepare infrastructure architecture diagrams, network topology, security configurations, and runbooks for governance, audits, and operational readiness.

- Incident Management - Troubleshoot platform and infrastructure issues, perform RCA, and drive continuous improvements to enhance reliability.

- Innovation & Best Practices - Stay up to date with Azure, Databricks, and DevOps advancements, proactively recommending enhancements for platform efficiency and business value.

Requirements :

- Bachelor's degree in Computer Science, IT, or related field (Master's preferred).

- 7-14 years of experience in Azure cloud engineering, with at least 5+ years specialized in Databricks platform management.

- Proven expertise in provisioning and managing Databricks clusters & workspaces for processing structured, semi-structured, and unstructured data in insurance/banking domains.

- Hands-on experience integrating Azure Data Factory (ADF) and Azure Data Lake Storage Gen2 with Databricks for automated ETL/ELT pipelines.

- Strong proficiency in Infrastructure as Code (Terraform) for automated deployments and resource management.

- Experience deploying and integrating Informatica solutions for metadata, lineage, and governance in large-scale data ecosystems.

- Deep knowledge of cloud security, identity & access management, encryption, and compliance frameworks in regulated industries (insurance/financial services preferred).

- Practical expertise in GitHub Actions or similar CI/CD tools for platform automation and DevOps workflows.

- Proven ability in troubleshooting, performance optimization, and incident management for high-availability data platforms.

- Excellent documentation, collaboration, and stakeholder communication skills, with experience supporting both technical and business users.

(ref:hirist.tech)

  • Platform Engineer

    4 days ago

    Pune, Maharashtra, India Capco Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Sr. Platform  Engineer About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients...

  • Senior Databricks Engineer

    21 hours ago

    Pune, Maharashtra, India beBeeDatabricks Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Opportunity: Databricks Platform ExpertWe are seeking a seasoned professional to lead the design, deployment, and management of secure, scalable, and high-performance Databricks environments for insurance data processing and analytics.Key Responsibilities:Design, deploy, and manage secure, scalable, and high-performance Databricks environments for...

  • Azure Databricks

    4 weeks ago

    Pune, Maharashtra, India Phygital Insights Private Limited Full time

    Job DescriptionDescriptionWe are seeking an experienced Azure Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering and be proficient in leveraging Azure Databricks to build robust data solutions.Responsibilities- Design and implement data pipelines using Azure Databricks to process large...

  • Big Data Engineer

    4 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Data Engineer PositionWe are seeking a highly skilled data engineer to spearhead the development of robust data solutions using Azure Databricks. The ideal candidate will possess a strong background in data engineering and be proficient in leveraging Apache Spark to build efficient data pipelines.Responsibilities include:Data Pipeline Development: Design,...

  • Azure DataBricks Engineer

    9 hours ago

    Pune, Maharashtra, India Wipro Full time US$ 1,00,000 - US$ 1,50,000 per year

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines using...

  • Databricks Platform Specialist

    23 hours ago

    Pune, Maharashtra, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000

    Platform Configuration ExpertWe are seeking a skilled Platform Configuration Expert to join our team and play a key role in managing and supporting Databricks environments across multiple clouds.Main Responsibilities:Databricks Management: Configure and manage Databricks workspaces for optimal performance and resource utilization.Data Governance: Implement...

  • Azure Databricks Developer

    4 weeks ago

    Pune, Maharashtra, India People Prime World Wide Full time

    About Client :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...

  • Databricks Data Engineer

    3 days ago

    Pune, Maharashtra, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000

    We are seeking a skilled data engineer to design, develop and optimize data processing pipelines on the Databricks platform. Your primary responsibilities will include architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and performance of our data infrastructure.Key...

  • Big Data Engineer

    8 hours ago

    Pune, Maharashtra, India Capco Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title:Big Data Engineer - ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across...

  • Azure Databricks Engineer

    8 hours ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:5Maximum Experience:12ctc lac lac maxSkill Set:Databricks Engineer, Azure Databricks, SQL, PysparkSkill to Evaluate:Databricks Engineer, Azure Databricks, SQLExperience:5 to 12 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design, build, and...