Capco - Azure Databricks Platform Engineer - Insurance Data Infrastructure

3 weeks ago

Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

Azure Databricks Platform Engineer - Insurance Data Infrastructure

Location : Pune / Bangalore/ Mumbai/ Chennai/ Hyderabad/ Gurugram

Band : M3/M4 (7 to 14 years)

Key Responsibilities :

- Azure Databricks Platform Engineering - Design, deploy, and manage secure, scalable, and high-performance Databricks environments for insurance data processing and analytics.

- Cloud Integration - Collaborate with architects, engineers, and security teams to establish infrastructure standards and ensure connectivity with legacy systems, cloud-native data sources, and third-party platforms.

- Infrastructure as Code (IaC) - Implement automated provisioning and configuration of Azure and Databricks resources using Terraform, supporting enterprise DevOps practices.

- Automation & CI/CD - Build and maintain GitHub Actions-based automation pipelines for environment deployment, monitoring, and incident response to ensure consistency, traceability, and efficiency.

- Performance & Scalability - Monitor platform health, optimize cluster utilization, and conduct tuning to ensure reliability, scalability, and cost efficiency for mission-critical workloads.

- Security & Compliance - Enforce enterprise and regulatory standards (RBAC, Key Vault, Managed Identities, Encryption, PDPO, GDPR, insurance compliance).

- Data Governance - Lead integration of Informatica tools for metadata management, cataloguing, lineage tracking, and compliance across the platform.

- Documentation & Governance - Prepare infrastructure architecture diagrams, network topology, security configurations, and runbooks for governance, audits, and operational readiness.

- Incident Management - Troubleshoot platform and infrastructure issues, perform RCA, and drive continuous improvements to enhance reliability.

- Innovation & Best Practices - Stay up to date with Azure, Databricks, and DevOps advancements, proactively recommending enhancements for platform efficiency and business value.

Requirements :

- Bachelor's degree in Computer Science, IT, or related field (Master's preferred).

- 7-14 years of experience in Azure cloud engineering, with at least 5+ years specialized in Databricks platform management.

- Proven expertise in provisioning and managing Databricks clusters & workspaces for processing structured, semi-structured, and unstructured data in insurance/banking domains.

- Hands-on experience integrating Azure Data Factory (ADF) and Azure Data Lake Storage Gen2 with Databricks for automated ETL/ELT pipelines.

- Strong proficiency in Infrastructure as Code (Terraform) for automated deployments and resource management.

- Experience deploying and integrating Informatica solutions for metadata, lineage, and governance in large-scale data ecosystems.

- Deep knowledge of cloud security, identity & access management, encryption, and compliance frameworks in regulated industries (insurance/financial services preferred).

- Practical expertise in GitHub Actions or similar CI/CD tools for platform automation and DevOps workflows.

- Proven ability in troubleshooting, performance optimization, and incident management for high-availability data platforms.

- Excellent documentation, collaboration, and stakeholder communication skills, with experience supporting both technical and business users.

(ref:hirist.tech)

  • Senior Azure Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India T&N Business Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole :Senior Azure Databricks EngineerExp :8 to 12 yrsLocation :Pune/IndoreNotice Period:Immediate to 30 DaysMust-have skills :Azure Databricks heavyYou will play a key role in...

  • Senior Azure Databricks Engineer

    3 days ago

    Pune, Maharashtra, India TN BUSINESS SERVICES PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the job : We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole : Senior Azure Databricks EngineerExp : 8 to 12 yrsLocation : Pune/IndoreNotice Period : Immediate to 30 DaysMust-have skills : Azure Databricks heavy You will...

  • Big Data Engineer

    1 day ago

    Pune, Maharashtra, India Capco Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Big Data Engineer - ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across...

  • Azure DataBricks Engineer

    1 day ago

    Pune, Maharashtra, India Wipro Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines using...

  • Mid-Data Engineer with Python

    1 week ago

    Pune, Maharashtra, India Capco Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Data Engineer with Python & Snowflake- PuneAbout UsCapco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+...

  • Azure Databricks Engineer

    3 days ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:5Maximum Experience:12ctc lac lac maxSkill Set:Databricks Engineer, Azure Databricks, SQL, PysparkSkill to Evaluate:Databricks Engineer, Azure Databricks, SQLExperience:5 to 12 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design, build, and...

  • Azure Databricks Engineer

    21 hours ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 6,00,000 - ₹ 24,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:6ctc 6+ upto 24 lacSkill Set:Databricks Engineer, Azure Databricks, SQL, PythonSkill to Evaluate:Databricks Engineer, Azure Databricks, SQL,Pyspark, Python, Team HandlingExperience:8 to 14 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design,...

  • Golang Developer

    6 days ago

    Pune, Maharashtra, India Capco Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We...

  • Data Engineer – Azure

    4 weeks ago

    Pune, Maharashtra, India vueverse. Full time

    Hybrid Role: Bengaluru/Hyderabad/Pune/ChennaiYears of experience: 8-10 yearsJob DescriptionWe are looking for a skilled Data Engineer with strong expertise in the Azure Data Platform to design, develop, and optimize large-scale data pipelines and analytics solutions. The ideal candidate should have deep hands-on experience with Azure Databricks, PySpark,...

  • Azure Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Lumiq Full time

    Location Pune 5 Days WFO Who we are LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance FSI industry We are trusted by the world s largest FSIs including insurers banks AMCs and NBFCs to address their data challenges Our clients include 40 enterprises with over 10B in deposits AUM collectively representing...