Data Engineer(Azure Databricks)

1 day ago

Navi Mumbai, Maharashtra, India Persistent Full time ₹ 15,00,000 - ₹ 25,00,000 per year

About Position:

As a Data Engineer, you will design and manage robust data pipelines using Azure Databricks, Spark, and Kafka. You'll process large-scale datasets and implement CDC pipelines to power analytics platforms. Your role includes modeling data using the Medallion Architecture and ensuring data quality and governance. Collaboration with analytics teams for visualization and insights is key to success.

  • Role: Data Engineer (Azure Databricks)
  • Location: Navi Mumbai
  • Experience: 5 to 11 Years
  • Job Type: Full Time Employment

What You'll Do:

  • Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory and Azure Databricks.
  • Implement Change Data Capture (CDC) pipelines to ingest data from origination and servicing platforms into the analytics ecosystem.
  • Process and transform large-scale datasets using PySpark, Spark SQL, and Kafka for real-time and batch data processing.
  • Model data using the Medallion Architecture (Bronze, Silver, Gold layers) to support structured and governed data flows.
  • Ensure data quality, lineage, and compliance with governance standards across all stages of the data lifecycle.
  • Collaborate with analytics teams and support data visualization using Power BI for business insights.

Expertise You'll Bring:

  • Strong hands-on experience with Azure Databricks, Spark, Kafka, PySpark, and Power BI.
  • Proficiency in building data pipelines and implementing CDC mechanisms.
  • Solid understanding of data modeling principles and data governance best practices.

Benefits:

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We support hybrid work and flexible hours to fit diverse lifestyles.
  • Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent -

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."

  • Microsoft Azure, Databricks

    2 weeks ago

    Mumbai, Maharashtra, India Natobotics Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Hi ConnectionsWe are Hiringhashtag#MicrosoftAzure, Digital: Python for Data Science, Digital: Databricks, Digital: PySpark, Azure Data Factory # Immediate Joiners Job Title: Developer Work Location: Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, KA Skill Required: Digital: Microsoft Azure, Digital: Python for Data Science, Digital:...

  • Senior Azure Databricks Engineer

    2 weeks ago

    Mumbai, Maharashtra, India, Maharashtra MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Databricks Data Engineering Lead

    2 days ago

    Mumbai, Maharashtra, India Crisil Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Position Overview:TheDatabricks Data Engineering Leadrole is ideal a highly skilled Databricks Data Engineer who will architect and lead the implementation of scalable, high-performance data pipelines and platforms using the Databricks Lakehouse ecosystem. The role involves managing a team of data engineers, establishing best practices, and collaborating...

  • Senior Data Engineer- Databricks

    2 weeks ago

    Mumbai, Maharashtra, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related...

  • Azure Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India A5E Consulting Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Company DescriptionA5E provides a comprehensive range of consulting, technology, and managed services to global organizations. With a committed and dynamic approach, we deliver projects successfully across all continents, leaving a global footprint of excellence.Role DescriptionThis is a full-time, on-site role for an Azure Data Engineer based in Mumbai. The...

  • Aws Databricks

    2 weeks ago

    Mumbai, Maharashtra, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    As a Data Engineer with 5+ years of hands-on experience in data engineering/ETL using Databricks on AWS/Azure cloud infrastructure and functions, your key responsibilities will include: - Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - Implementing...

  • Databricks Architect

    5 days ago

    Mumbai, Maharashtra, India Jio Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Title: Senior Databricks ArchitectLocation: Mumbai, Gurgaon, HyderabadAbout the RoleWe are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor...

  • Azure Platform Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India, Maharashtra HDFC Bank Full time

    Should have good knowledge on data warehouse and lakehouse conceptsWorking knowledge on Data technologies tools such as Azure Databricks, Azure ML, Azure Datafactory, Azure Datalake storageService provisioning through terraform across the environmentDeployment of application on AKS and REDHAT open shift clusters, managing the dockers and monitor the...

  • Azure Data Engineer

    7 days ago

    Mumbai, Maharashtra, India Anlage Infotech (I) Pvt. Ltd. Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Key Responsibilities : - Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. - Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire...

  • Azure Data Engineer

    5 days ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Roles & ResponsibilitiesJob Profile Summary:In this role, you will support the Data Engineering team in setting up the Data Lake on Cloud and the implementation of standardized Data Model. You will develop data pipelines for new sources, data transformations within the Data Lake, CI/CD and data delivery as per the business requirements.Job DescriptionBuild...