Pyspark Lead

1 day ago


Pune, Maharashtra, India Wipro Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Position Overview

We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.

Required Skills and Qualifications

  • Experience: 7+ years of professional experience in PySpark development.
  • Technical Skills:
  • Strong proficiency in PySpark
  • Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing.
  • Proven experience in building and optimizing complex ETL pipeline using PySpark
  • Experience with various spark components

  • Expertise in Spark Batch for large-scale data processing and analytics.

  • Experience with Spark Streaming for real-time data processing and streaming pipelines.
  • Familiarity with distributed computing concepts and big data frameworks.

Mandatory Skills: PySpark.Experience: 5-8 Years.



  • Pune, Maharashtra, India Exusia Full time

    Sr Data Engineers Tech Leads - Python Pyspark DatabricksDepartment Sales and Delivery Team - EmpowerIndustry Information Technology Services Computer Software Management ConsultingLocation WFH India RemoteExperience Range 6 - 10 yearsBasic Qualification Bachelor of Engineering or EquivalentTravel Requirements Not requiredWebsite Exusia a...


  • Pune, Maharashtra, India beBeePySpark Full time ₹ 17,41,389 - ₹ 24,34,756

    Job Title: Solution Architect LeadWe are seeking an experienced and skilled Solution Architect Lead to join our team.Key Responsibilities:Develop and implement comprehensive technical strategies to drive business growth and innovation.Lead the design, development, and deployment of scalable and secure solutions that meet the needs of our...


  • Pune, Maharashtra, India Alphanext Technology Solutions Full time

    Django Backend Lead DeveloperLocation : Pune / IndoreExperience : 8+ Years Employment Type : Full-Time | Overview :Join us as a Django Backend Lead Developer where you'll architect scalable and secure backend systems, drive big data solutions using Azure Databricks, and lead a team of passionate engineers. This role blends leadership, deep technical...

  • Databricks Lead

    7 days ago


    Pune, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Databricks Engineer OpportunityWe're seeking a seasoned Databricks expert to lead our Azure data engineering projects.Develop scalable data pipelines with Databricks, PySpark & Spark SQLImplement & manage Delta Lake & modern data lakehouse architectureConfigure & administer Databricks (Workspace, Jobs, DLT, Unity Catalog)Design CI/CD pipelines using...


  • Pune, Maharashtra, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000

    As a key member of our team, you will be responsible for leading a team of engineers in handling support activities efficiently. You will also oversee the technical aspects of our applications and pipelines built on Databricks, PySpark, Data Factory, and Function Apps.We are seeking a seasoned professional to lead our engineering team. In this role, you will...


  • Pune, Maharashtra, India Admin Looks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • GCP Lead

    2 days ago


    Pune, Maharashtra, India Datametica Full time US$ 90,000 - US$ 1,20,000 per year

    Job descriptionLocation: PuneExp: 6-10 YearsWe are looking to hire a Data Engineer with strong hands-on experience in SQL, ETL, Pyspark, GCP,Required Past Experience:3+ Years experience in ETL pipelines experience along with any GCP cloud experience along with pyspark.Experience in Shorked on at least one development project from ETL Perspective.File...

  • Lead Data Engineer

    2 weeks ago


    Pune, Maharashtra, India TerraGiG Full time

    Job Title : Data Engineer Experience : 8-12 Years Location : Noida, Chennai & Pune Skills : Python, Pyspark, Snowflake & Redshift, AWS, DBT, Data Modeling, Airflow, SQL Key Responsibilities • Migration & Modernization • Lead the migration of data pipelines, models, and workloads from Redshift to Snowflake /Yellowbrick. • Design and...


  • Pune, Maharashtra, India 91HR Full time

    Job Description :We are seeking a highly skilled and experienced Python Lead to join our team. The ideal candidate will have strong expertise in Python coding and development, along with good-to-have skills in cloud technologies, SQL, and data analysis.Key Responsibilities :- Lead the development of high-quality, scalable, and robust Python applications.-...

  • Databricks Lead

    11 hours ago


    Pune, Maharashtra, India Bitwise Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Bitwise id hiring for Expert Databricks Engineer for Pune Location.PFB JD for your reference. Relevant candidate please share resume on Email ID- Noted - We are looking for candidate who can join in 30 Days Only.Mandatory skills needed:1) Strong hands-on experience with Databricks - PySpark notebooks and Datbricks pipeline development2) Experience using...