PySpark Developer-12 Months Contract

5 days ago

Pune, Maharashtra, India Compunnel Full time ₹ 14,40,000 - ₹ 28,80,000 per year

PySpark Developer

We are looking for skilled PySpark Developers to design and develop scalable data processing solutions. The role involves working with big data platforms, building ETL pipelines, and collaborating with cross-functional teams to ensure data availability, performance, and quality.

  • Experience: 4-10 years (Mandatory)
  • Qualification: BE / B. Tech
  • Location: Pune
  • Contract Duration: 12 Months
  • Salary: Up to 24 LPA

Key Responsibilities

  • Design, develop, and optimize ETL/ELT pipelines using PySpark.
  • Ingest, clean, transform, and process structured/semi-structured/unstructured data.
  • Work with large-scale datasets on distributed computing platforms (Hadoop, Spark, Databricks).
  • Integrate data from multiple sources, including Delta Lake, Data Lake, RDBMS, APIs.
  • Ensure high-performance, scalability, and reliability of data pipelines.
  • Collaborate with data engineers, analysts, and data scientists to deliver business-ready datasets.
  • Implement monitoring, logging, and error-handling for data pipelines.
  • Contribute to data quality frameworks and best practices.

Required Skills & Experience

  • Bachelors degree in computer science, computer engineering or similar.
  • Excellent communication skills.
  • 4-10 years of experience in data engineering with strong hands-on expertise in PySpark.
  • Proficiency in Python programming for data manipulation and pipeline development.
  • Strong knowledge of Spark SQL, DataFrames, and RDDs.
  • Experience with big data ecosystems Hadoop, Hive, or Databricks.
  • Good understanding of SQL and relational databases (PostgreSQL, MySQL, Oracle).
  • Familiarity with cloud platforms (AWS, Azure, GCP) and services (S3, ADLS, BigQuery).
  • Experience with version control (Git) and CI/CD tools.
  • Strong debugging, performance optimization, and troubleshooting skills.
  • Experience with containerization (Docker, Kubernetes).

Please share the following details along with the most updated resume to if you are interested in the opportunity:

  • Total Experience
  • Relevant experience
  • Current CTC
  • Expected CTC
  • Notice Period (Last working day if you are serving the notice period)
  • Current Location
  • SKILL 1 RATING OUT OF 5
  • SKILL 2 RATING OUT OF 5
  • SKILL 3 RATING OUT OF 5

(Mention the skill)

  • Springboot Developer- 12 Months Contract

    6 days ago

    Pune, Maharashtra, India Compunnel Full time ₹ 1,80,000 - ₹ 2,40,000 per year

    Spring Boot DeveloperWe are looking for experienced Spring Boot Developers to design, build, and maintain robust backend services and APIs for enterprise-grade applications. The role involves developing scalable microservices, ensuring performance, and collaborating with cross-functional teams to deliver high-quality software solutions.Experience: 4-10 years...

  • pyspark developer

    24 hours ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • pyspark developer

    20 hours ago

    Pune, Maharashtra, India Capgemini Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • Pyspark Developer

    20 hours ago

    Pune, Maharashtra, India Capgemini Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Officer-Pyspark Developer

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    AtCitiwe're not just building technology, we're building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world's most global...

  • GCP Data Developer- BigQuery, Pyspark

    1 week ago

    Pune, Maharashtra, India Swift Strategic Solutions Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Our technology services client is seeking multipleGCP Data Developer- BigQuery, Pysparkto join their team on a Full Time basis. Below are further details about the role:Role: GCP Data Developer- BigQuery, PysparkExperience: 5-8 YearsLocation: Pune, HyderabadNotice Period: Immediate- 30 DaysMandatory Skills: GCP, BigQuery, Pyspark, SQLJob...

  • Pyspark Architect

    18 hours ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • PySpark Developer

    1 week ago

    Pune, Maharashtra, India Wipro Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role PurposeThe purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parametersDoInstrumental in understanding the requirements and design of the product/ softwareDevelop software solutions by studying information...

  • Retainer - Scriptwriter (6 months Contract)

    1 week ago

    Pune, Maharashtra, India Ubisoft Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Company Description Ubisoft is a global leader in gaming with teams across the world creating original and memorable gaming experiences, from Assassin's Creed, Rainbow Six to Just Dance and more. We believe diverse perspectives help both players and teams thrive. If you're passionate about innovation and pushing entertainment boundaries, join our journey and...

  • Business Consulting-Technical analyst with ETL,GCP using Pyspark

    7 days ago

    Pune, Maharashtra, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    You bring systems design experience with the ability to architect and explain complex systems interactions, data flows, common interfaces and APIs.You bring a deep understanding of and experience with software development and programming languages such as Java/Kotlin, and Shell scripting.You have hands-on experience with the following technologies as a...