Pyspark Lead

4 days ago


Pune, Maharashtra, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Position Overview

We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.

Required Skills and Qualifications

  • Experience: 7+ years of professional experience in PySpark development.
  • Technical Skills:
  • Strong proficiency in PySpark
  • Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing.
  • Proven experience in building and optimizing complex ETL pipeline using PySpark
  • Experience with various spark components

  • Expertise in Spark Batch for large-scale data processing and analytics.

  • Experience with Spark Streaming for real-time data processing and streaming pipelines.
  • Familiarity with distributed computing concepts and big data frameworks.

Mandatory Skills: PySpark.Experience: 5-8 Years.


  • pyspark developer

    2 weeks ago


    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • pyspark developer

    2 weeks ago


    Pune, Maharashtra, India Capgemini Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • Pyspark Developer

    2 weeks ago


    Pune, Maharashtra, India Capgemini Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Pyspark Developer

    2 days ago


    Pune, Maharashtra, India Capgemini Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Pyspark Developer

    12 hours ago


    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Technology Lead

    4 days ago


    Pune, Maharashtra, India Bitwise Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Technology Lead ETL & Data EngineeringLocation: Pune / HybridExperience: 8 to 12 YearsEmployment Type: Full-TimeJob SummaryWe are seeking a highly skilled and experienced Technology Lead with 10+ years of expertise in ETL, Data Warehousing, and AWS cloud services. The ideal candidate should have strong hands-on experience with Talend (Data Integration, Big...


  • Pune, Maharashtra, India Spectrum Talent Management Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a seasoned Lead Data Python Engineer to lead the design and development of scalable data applications and pipelines. You will leverage Python with Django or Flask frameworks, cloud technologies (GCP or AWS), Redis caching, SQL databases, and big data processing using PySpark to drive our data infrastructure and products forward.Key...


  • Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 335239NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Technical analyst with ETL,GCP using Pyspark to join our team in Pune, Mahārāshtra (IN-MH), India...


  • Pune, Maharashtra, India Admin Looks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • lead data Engineer

    2 weeks ago


    Pune, Maharashtra, India Reveille Technologies,Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're Hiring: Lead Data Engineer (FTE)Location:Pune / CoimbatoreExperience:5 to 12 yearsBudget:As per experienceNotice Period:Immediate joiners onlyWe're looking for aLead Data Engineerwith strong technical and leadership skills to join our growing team.Key Skills:PythonPySparkAWSDatabricksJava platform experience (desirable)Proven leadership and team...