Apache Spark Developer

3 weeks ago


Pune, Maharashtra, India Wipro Full time

Role Summary

We are looking for a highly skilled Data Engineer with expertise in Apache Spark to join our team at Wipro.

Key Responsibilities

  • Design, develop, and maintain large-scale data processing pipelines using Apache Spark.
  • Ensure high-performance data processing and optimize Spark framework for optimal performance.
  • Develop and maintain complex data models and data architecture using Spark.
  • Maintain and improve the existing Hadoop ecosystem, including Hive, and ensure seamless integration with other technologies.
  • Develop and maintain robust Unix and Shell scripting skills to automate data processing tasks.
  • Collaborate with cross-functional teams to ensure data quality, security, and compliance.

Requirements

  • 4+ years of experience in Scala or PySpark, with a strong understanding of Spark framework and performance tuning.
  • Excellent knowledge of the Hadoop ecosystem, including Hive, and experience with data warehousing and data governance.
  • Strong Unix and Shell scripting skills to automate data processing tasks.
  • Excellent interpersonal and leadership skills, with experience in managing cross-functional teams.
  • Knowledge of cloud service providers like AWS, Azure, or GCP, with certifications in Azure as a plus.


  • Pune, Maharashtra, India Wipro Full time

    Job Summary:As a Wipro Apache Spark Developer, you will be responsible for designing, testing, and maintaining software programs for operating systems or applications. You will work closely with cross-functional teams to ensure the software meets 100% quality assurance parameters.Main Responsibilities:Design and develop software solutions by studying...


  • Pune, Maharashtra, India Synechron Full time

    About the RoleWe are seeking a highly skilled Ab Initio and Apache Spark Developer to join our team. The ideal candidate will have a strong background in big data processing and a proven track record of delivering scalable and performance-driven solutions.Key Responsibilities:Lead architectural design sessions and technical reviews to create a robust,...


  • Pune, Maharashtra, India Xoriant Full time

    Xoriant is seeking a highly skilled Senior Apache Spark and Big Data Developer to join our team. The ideal candidate will have excellent skills in the Hadoop ecosystem, including Apache Spark, Hive, and My SQL.

  • Spark Developer

    3 weeks ago


    Pune, Maharashtra, India Wipro Full time

    About the RoleWe are seeking a highly skilled Apache Spark Developer to join our team at Wipro. The ideal candidate will have excellent knowledge of the Spark framework, with a strong focus on performance tuning, and hands-on experience with Scala or PySpark.Responsibilities:Spark Framework Expertise: Develop and deploy efficient Spark applications,...


  • Pune, Maharashtra, India Virtusa Full time

    Scala and Spark Developer Job DescriptionAs a skilled Scala and Spark developer at Virtusa, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark. The ideal candidate will have a strong background in Scala programming, experience with Spark, and a solid understanding of data processing...

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Coders Brain Technology Pvt. Ltd. Full time

    Job Title: Senior Data Engineer - Apache Spark and JavaAbout the Role: We are seeking a highly skilled Senior Data Engineer to join our team at Coders Brain Technology Pvt. Ltd.Key Responsibilities:Design, develop, and deploy large-scale data engineering solutions using Apache Spark and Java.Collaborate with cross-functional teams to understand business...


  • Pune, Maharashtra, India Xoriant Full time

    Job TitleData Scientist with Spark and Scala ExpertiseJob DescriptionXoriant seeks a Data Scientist with expertise in Spark and Scala to work on big data projects. Ideal candidate should have a bachelor's or master's degree in computer science or a related field.Key ResponsibilitiesDevelop and implement big data solutions using Apache Spark and...


  • Pune, Maharashtra, India Ashra Technologies Private Limited Full time

    Job Title: Apache Kafka DeveloperJob Description:We are seeking a highly skilled Apache Kafka developer to join our team at Ashra Technologies Private Limited. The ideal candidate will have hands-on experience implementing cloud-based architectures for enterprise environments.Key responsibilities will include designing, developing, and implementing...

  • Data Architect

    1 month ago


    Pune, Maharashtra, India RS Consultants Full time

    Job Title : Data Architect Location : Pune Experience Level : 6+ Years Company Type : AI/ML startup.Please apply only if you are comfortable working with Early stage startup. Job Description : We are seeking a Data Architect to design and oversee the development of scalable, high-performance data systems. In this role, you will leverage your expertise in the...


  • Pune, Maharashtra, India Wipro Full time

    We are seeking a highly skilled Senior Spark Engineer to join our team at Wipro. The ideal candidate will have excellent knowledge of the Apache Spark framework, with a strong understanding of performance tuning and optimization.As a Senior Spark Engineer, you will be responsible for designing, developing, and deploying large-scale data processing systems...


  • Pune, Maharashtra, India Virtusa Full time

    Job Title: Scala and Spark DeveloperJob Summary: We are seeking an experienced Scala and Spark developer to join our team at Virtusa. The ideal candidate will have a strong background in Scala and Spark, with a proven track record of delivering high-quality solutions.Key Responsibilities:Design and develop scalable and efficient Scala and Spark...


  • Pune, Maharashtra, India Wipro Full time

    Job Title: Senior Scala and Spark DeveloperAbout the Role: We are seeking an experienced Senior Scala and Spark Developer to join our team at Wipro. The ideal candidate will have a strong background in Scala and Spark programming languages and a proven track record of working with big-data technologies.Key Responsibilities:Develop and maintain large-scale...

  • Senior Java Developer

    4 weeks ago


    Pune, Maharashtra, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join EXL's dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark-based solutions, managing large data sets, and...


  • Pune, Maharashtra, India Wipro Full time

    About the RoleThe ideal candidate will be a seasoned Scala Developer with a strong background in Spark. They will be responsible for developing scalable, reliable, and efficient data processing systems using Apache Spark on Databricks or similar platforms. The successful candidate will have extensive experience with big-data technologies and will be...


  • Pune, Maharashtra, India 12542 Citicorp Services India Private Limited Full time

    Job Summary We are seeking a highly skilled Big Data Developer to join our team at 12542 Citicorp Services India Private Limited. As a Big Data Developer, you will be responsible for designing, developing, and implementing big data solutions using various technologies such as Apache Hadoop, Spark, Hive, Impala, Yarn, and Talend.Key Responsibilities •...


  • Pune, Maharashtra, India Seventh Contact Hiring Solutions Full time

    Job Role: Java Technical SpecialistKey Responsibilities:• Practicing TDD as your primary way of doing software development• Constantly developing new features in our products• Continuously refactor code to ensure high-quality and maintainable codeOur Tech Stack:Scala, Java, Python, Bash, SQL, Spring, Apache Spark, Neo4j, Teradata, Oracle, MySQL,...


  • Pune, Maharashtra, India Wipro Full time

    Wipro is seeking a seasoned Solutions IT Developer with a strong background in Apache Kafka to join our developer advocacy function in our event streaming team.The ideal candidate will be responsible for Kafka code reviews with clients, troubleshooting client connection issues with Kafka and supporting client onboarding to Confluent Cloud.This role requires...

  • Big Data Engineer

    6 days ago


    Pune, Maharashtra, India Talent Pro Full time

    Talent Pro is seeking a highly skilled Big Data Engineer - Distributed Architecture Specialist to join our team. As a key member of our data engineering group, you will play a crucial role in designing and implementing scalable distributed architectures using Apache Spark.The estimated salary for this position is $120,000 per year, based on industry...

  • Data Engineer

    1 month ago


    Pune, Maharashtra, India Tekgence India Private Limited Full time

    Job Description :We are seeking an experienced Data Engineer to design and develop enterprise-scale ETL processes for data ingestion, transformation, and distribution at Morgan Stanley. The ideal candidate will have a strong background in Scala, Apache Spark, and related technologies.Key Responsibilities :Design and develop ETL processes for data ingestion,...


  • Pune, Maharashtra, India Talent Pro Full time

    Job Role: Spark DeveloperKey Responsibilities:Collaborate with development teams and product managers to build new product features and enhancements.Design and develop well-functioning databases and applications.Develop and manage data and event processing pipelines.Test software to ensure responsiveness and efficiency.Troubleshoot, debug, and upgrade...