Lead PySpark Developer

1 week ago


Bengaluru, India LTIMindtree Full time

Job Description:

Primary Skill Set: Lead PySpark Developer

Seconday Skill Set: SAS tools

Lead a team of data engineers in the design and implementation of big data solutions using PySpark.

Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.

Design and implement scalable and robust data pipelines using PySpark.

Ensure data accuracy and integrity by implementing data validation and quality checks.

Mentor and coach team members in PySpark and big data best practices.

Stay up-to-date with the latest developments in big data technologies and incorporate them into the team's workflow.

Requirements:

9+ years in Pyspark/ Data engineer development and implementation

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Proven experience as a PySpark Lead or similar role.

Expertise in PySpark and big data technologies such as Hadoop, Hive, and Spark.



  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...


  • Bengaluru, India LTIMindtree Full time

    Job Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...


  • Bengaluru, India LTIMindtree Full time

    Job Description:Primary Skill Set: Lead PySpark DeveloperSeconday Skill Set: SAS toolsLead a team of data engineers in the design and implementation of big data solutions using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data pipelines using...

  • Python Pyspark Lead

    6 days ago


    Bengaluru, Karnataka, India Virtusa Full time

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Description:Primary Skill Set:Lead Py Spark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using Py Spark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data pipelines using Py...

  • Pyspark Developer

    1 month ago


    Bengaluru, India Manvision Technologies Full time

    SNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...

  • Pyspark Developer

    6 days ago


    Bengaluru, Karnataka, India Manvision Technologies Full time

    SNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...

  • Pyspark

    6 days ago


    Bengaluru, Karnataka, India Riverforest Connections Full time

    Position Purpose For the projects which are implemented on Data SSC platform, we need senior developer for python- pyspark development to migrate project from spark/scala to python-pyspark._ResponsibilitiesDirect ResponsibilitiesDesign high quality deliverables adhering to business requirement with defined standards and design principles, patternsDevelop and...

  • Pyspark Developer

    2 months ago


    Bengaluru, India Corporate Resources Full time

    Job DescriptionDesigning and developing big data applications using the PySpark framework to meet the needs of the businessWriting and optimizing Spark SQL statements to extract and manipulate large datasetsDeveloping and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processingDebugging and...

  • Pyspark Developer

    6 days ago


    Bengaluru, Karnataka, India Corporate Resources Full time

    Job DescriptionDesigning and developing big data applications using the PySpark framework to meet the needs of the businessWriting and optimizing Spark SQL statements to extract and manipulate large datasetsDeveloping and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processingDebugging and...

  • Pyspark Developer

    7 days ago


    Bengaluru, Karnataka, India Manvision Technologies Full time

    SN Required Information Details 1 Role PySpark Developer 2 Required Technical Skill Set PySpark, Python, HDFS, Hadoop, SQL 3 No of Requirements 02 4 Desired Experience Range 5+ years Location of Requirement India Desired Competencies (Technical/Behavioral Competency) Must-Have Sound...

  • Python, Pyspark

    6 days ago


    Bengaluru, India Ziniosedge Full time

    Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...

  • PySpark Developer

    6 days ago


    Bengaluru, India Deloitte Full time

    Deloitte India is hiring for PySpark DeveloperLevel:Deputy ManagerLocation:Bangalore/Delhi NCR/MumbaiJob Type:Full-timeExperience Required:4-6 yearsJob Summary:We are seeking a talented and experienced Deputy Manager - PySpark Developer with 4 to 6 years of experience to join our dynamic team. The ideal candidate will possess extensive expertise in PySpark,...

  • Pyspark Developer

    6 days ago


    Bengaluru, Karnataka, India Corporate Resources Full time

    Job Description Designing and developing big data applications using the PySpark framework to meet the needs of the business Writing and optimizing Spark SQL statements to extract and manipulate large datasets Developing and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processing ...


  • Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...

  • Pyspark Lead

    3 weeks ago


    Bengaluru, India CIEL HR Services Full time

    We are hiring for our client-An International IT service providerRole- Pyspark LeadMandatory skill set- Python+Spark+Scala(experience in all 3 skill sets should be strong & mandatory) ,Data Engineering+ AWSExp. Level- 5-12 yrsLocation- Bangalore & HyderabadNotice Period-Immediate to 15daysJob DescriptionDesign and implement scalable and robust ELT processes...

  • AM-Pyspark Developer

    3 weeks ago


    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...


  • Bengaluru, Karnataka, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We're harnessing the power of technology and humanity to create...

  • AM-Pyspark Developer

    1 month ago


    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • AM-Pyspark Developer

    3 weeks ago


    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...