Pyspark Developer

2 days ago


Pune, Maharashtra, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Pyspark Developer

Requirements:

Mandatory: Primary skill: Pyspark, Data Engineering, Azure Data Bricks

  • Good Experience of Hadoop, Hive, and Cloudera/ Azure/GCP 3+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.
  • Must have excellent knowledge in Apache Spark and Python programming experience
  • Hands-on experience in Azure data bricks & Pyspark to develop ETL pipelines
  • Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, performing data enrichment and loading into target data destinations.
  • Should have experience in integrating PySpark with downstream and upstream applications through a batch/real-time interface
  • Data modeling experience using advanced statistical analysis, unstructured data processing
  • Participate in the agile development process, and document and communicate issues and bugs relative to data standards in scrum meetings
  • Work collaboratively with onsite and offshore team.
  • Develop & review technical documentation for artifacts delivered.
  • Ability to solve complex data-driven scenarios and triage towards defects and production issues
  • Drive discussions with partner teams to identify resolutions to production issues.
  • Clearly document and draft clear, concise, communication on production incidents to share with stakeholders.
  • Identify platform vulnerabilities and opportunities for improvement.
  • Maintain metrics to help drive improvement in all areas of Production Services.

  • pyspark developer

    1 week ago


    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • pyspark developer

    1 week ago


    Pune, Maharashtra, India Capgemini Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • Pyspark Developer

    1 week ago


    Pune, Maharashtra, India Capgemini Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Pyspark Lead

    2 days ago


    Pune, Maharashtra, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position OverviewWe are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.Required Skills and...

  • Python with pyspark

    1 week ago


    Pune, Maharashtra, India Natobotics Full time ₹ 2,04,000 per year

    We're Hiring: Python with PySpark Developer (5–7 Years Experience)Skills Required:PythonPySparkSQLAirflowLocations: Bangalore | Hyderabad | PuneBudget: Up to 17 LPANote: Only immediate joiners or candidates serving notice period (who can join within a week) will be considered.

  • Python Developer

    5 days ago


    Pune, Maharashtra, India, Maharashtra RSquareSoft Technologies Full time

    Job Title: Python Developer (PySpark)Location: Wakad, PuneEmployment Type: Full-timeExperience: 1-4 yearsAbout the RoleWe are looking for a passionate Python Developer to join our team and contribute to building innovative software products. The ideal candidate should have strong problem-solving skills, solid fundamentals in Data Structures & Algorithms, and...


  • Pune, Maharashtra, India Citi Full time ₹ 1,20,000 - ₹ 2,60,000 per year

    The Digital Software Engineer Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Pyspark Architect

    1 week ago


    Pune, Maharashtra, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...


  • Pune, Maharashtra, India Compunnel Full time ₹ 14,40,000 - ₹ 28,80,000 per year

    PySpark DeveloperWe are looking for skilled PySpark Developers to design and develop scalable data processing solutions. The role involves working with big data platforms, building ETL pipelines, and collaborating with cross-functional teams to ensure data availability, performance, and quality.Experience: 4-10 years (Mandatory)Qualification: BE / B....

  • Python Pyspark ML

    2 days ago


    Pune, Maharashtra, India Surge Technology Solutions Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are hiring for Python Developer ( PySpark ML, Snowpark ML, Snowflake ML deployment experience)Experience: 5+yearsNotice Period: Immediate-30 daysJob Description:We need candidate with 5-8 year of experience.Must have Python, PySpark ML, Snowpark ML, Snowflake ML deployment experience.Experience in CDSW Python( ML models) to Snowflake compatible...