PySpark Developer-12 Months Contract

4 days ago

Pune, Maharashtra, India Compunnel Full time ₹ 14,40,000 - ₹ 28,80,000 per year

PySpark Developer

We are looking for skilled PySpark Developers to design and develop scalable data processing solutions. The role involves working with big data platforms, building ETL pipelines, and collaborating with cross-functional teams to ensure data availability, performance, and quality.

  • Experience: 4-10 years (Mandatory)
  • Qualification: BE / B. Tech
  • Location: Pune
  • Contract Duration: 12 Months
  • Salary: Up to 24 LPA

Key Responsibilities

  • Design, develop, and optimize ETL/ELT pipelines using PySpark.
  • Ingest, clean, transform, and process structured/semi-structured/unstructured data.
  • Work with large-scale datasets on distributed computing platforms (Hadoop, Spark, Databricks).
  • Integrate data from multiple sources, including Delta Lake, Data Lake, RDBMS, APIs.
  • Ensure high-performance, scalability, and reliability of data pipelines.
  • Collaborate with data engineers, analysts, and data scientists to deliver business-ready datasets.
  • Implement monitoring, logging, and error-handling for data pipelines.
  • Contribute to data quality frameworks and best practices.

Required Skills & Experience

  • Bachelors degree in computer science, computer engineering or similar.
  • Excellent communication skills.
  • 4-10 years of experience in data engineering with strong hands-on expertise in PySpark.
  • Proficiency in Python programming for data manipulation and pipeline development.
  • Strong knowledge of Spark SQL, DataFrames, and RDDs.
  • Experience with big data ecosystems Hadoop, Hive, or Databricks.
  • Good understanding of SQL and relational databases (PostgreSQL, MySQL, Oracle).
  • Familiarity with cloud platforms (AWS, Azure, GCP) and services (S3, ADLS, BigQuery).
  • Experience with version control (Git) and CI/CD tools.
  • Strong debugging, performance optimization, and troubleshooting skills.
  • Experience with containerization (Docker, Kubernetes).

Please share the following details along with the most updated resume to if you are interested in the opportunity:

  • Total Experience
  • Relevant experience
  • Current CTC
  • Expected CTC
  • Notice Period (Last working day if you are serving the notice period)
  • Current Location
  • SKILL 1 RATING OUT OF 5
  • SKILL 2 RATING OUT OF 5
  • SKILL 3 RATING OUT OF 5

(Mention the skill)

  • Pyspark Developer

    1 week ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Springboot Developer- 12 Months Contract

    4 days ago

    Pune, Maharashtra, India Compunnel Full time ₹ 1,80,000 - ₹ 2,40,000 per year

    Spring Boot DeveloperWe are looking for experienced Spring Boot Developers to design, build, and maintain robust backend services and APIs for enterprise-grade applications. The role involves developing scalable microservices, ensuring performance, and collaborating with cross-functional teams to deliver high-quality software solutions.Experience: 4-10 years...

  • PySpark Developer

    7 days ago

    Pune, Maharashtra, India 636ca7a0-36ec-40d4-b141-86628a2f9f4a Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Experience: 2-10 YearsQualification: BE / B. TechLocation: Pune, Manila, RemoteTechnical Know -How: Pyspark, Python programming, ETL Pipeline, Spark SQL, DataFrames, Azure, Big data ecosystemWe are looking for skilled PySpark Developers to design and develop scalable data processing solutions. The role involves working with big data platforms, building ETL...

  • pyspark developer

    3 hours ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • Pyspark Developer

    2 weeks ago

    Pune, Maharashtra, India Capgemini Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Pyspark Lead

    2 weeks ago

    Pune, Maharashtra, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position OverviewWe are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.Required Skills and...

  • Contracts Engineer-E4-Contracts-PMO

    6 days ago

    Pune, Maharashtra, India Tata Consultancy Services (TCS) Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Date: 23 Sept 2025Location: Pune, MH, IN, 411021Company: tatacons02About UsTata Consulting Engineers Limited (TCE) is the largest Indian private sector engineering and project consultancy and an emerging global leader in integrated engineering solutions. With more than 60 years of engineering excellence, TCE has a presence in over 64 countries and over 12000...

  • Retainer - Scriptwriter (6 months Contract)

    5 days ago

    Pune, Maharashtra, India Ubisoft Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Description Ubisoft is a global leader in gaming with teams across the world creating original and memorable gaming experiences, from Assassin's Creed, Rainbow Six to Just Dance and more. We believe diverse perspectives help both players and teams thrive. If you're passionate about innovation and pushing entertainment boundaries, join our journey and...

  • graphic designer-contract role-6 months-wfo-baner

    2 weeks ago

    Pune, Maharashtra, India Crescendo Worldwide Full time ₹ 3,60,000 - ₹ 4,80,000 per year

    Hiring Graphic Designers -only immediate joiners2-3 yrs experience in Graphic designing6 months contractBaner, PuneJob Type: Contractual / TemporaryContract length: 6 monthsPay: ₹30, ₹40,000.00 per monthWork Location: In person

  • Lead Python GenAI

    4 days ago

    Pune, Maharashtra, India Focalworks Solutions Pvt Ltd Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Lead – Python GenAI / Agentic AILocation: Pune (Kharadi)Experience: 8–10 YearsContract Duration: 12 MonthsAbout the RoleWe're looking for a Project Lead – Python GenAI / Agentic AI to drive the design and development of next-gen AI applications. The ideal candidate is a hands-on technical leader with deep expertise in Python, Generative AI, and...