Java Spark Developer

3 weeks ago

Pune, India EXL Full time

We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and ensuring the performance, scalability, and reliability of our data pipelines.


Key skills: Java, Backend Developer, Unix, CI / CD tools

Experience-8 – 10 Years


Key Responsibilities

  • Design, develop, and implement largescale data processing pipelines using Java and Apache Spark.
  • Optimize Spark jobs for performance, reliability, and efficiency in handling large data volumes.
  • Develop reusable code and libraries for future use, ensuring the best practices in coding.
  • Perform in-depth troubleshooting and performance tuning of Spark based data workflows.
  • Write and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
  • Collaborate with data engineers, architects, and analysts to understand data requirements and deliver scalable solutions.
  • Integrate and manage data on Snowflake or similar data warehouse platforms.
  • Work with AWS cloud services to deploy and manage data processing pipelines (e.g., EC2, S3, EMR, Lambda).
  • Contribute to the development of scripts and automation processes using Java Scripting or other relevant scripting tools.
  • Ensure the security and scalability of data pipelines while adhering to compliance and governance protocols.

Application Development

  • Design, develop, test, and deploy high-quality, scalable web applications using Java and related technologies.
  • Develop and maintain front-end interfaces using modern JavaScript frameworks (e.g. Java, CI / CD tools).
  • Implement RESTful APIs and integrate with various third-party services and databases.

System Architecture

  • Collaborate with architects and other engineers to design system architecture and ensure seamless integration of front-end and back-end components.
  • Contribute to the design and implementation of scalable and secure software architectures.

Code Quality and Best Practices

  • Write clean, maintainable, and efficient code following best practices and coding standards.
  • Perform code reviews and provide constructive feedback to peers.
  • Implement automated testing and continuous integration processes to ensure software quality.


Required Skills:

  • Proficiency in Java programming with a strong understanding of its ecosystem and tools.
  • In-depth experience with Apache Spark and Spark Optimization techniques.
  • Strong SQL skills with the ability to write and optimize complex queries.
  • Experience with Snowflake.
  • Familiarity with AWS cloud services (EC2, S3, EMR, Lambda) and basic cloud architecture.
  • Solid understanding of Java Scripting and automation tools.
  • Experience with ETL processes and data pipeline development.


Good to Have:

  • Experience in Spark tuning and optimization for distributed data processing.
  • Knowledge of PySpark or other big data technologies.
  • Experience working in an Agile/Scrum environment.
  • Familiarity with CI/CD tools like Jenkins, GitLab, etc.
  • Understanding of data modeling and data governance practices.


Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • ~8 years of working experience in Java, Spark, and related technologies.
  • Experience in data engineering roles and managing largescale data environments.

  • Java spark developer

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    4 days ago

    pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    3 weeks ago

    pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    3 weeks ago

    Pune, Maharashtra, India EXL Full time

    Job Title: Java Spark DeveloperAbout the Role:We are seeking a highly skilled Java + Spark Developer to join our dynamic team at EXL. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus.Key Responsibilities:Design, develop, and implement...

  • Java Spark Developer

    7 days ago

    Pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    1 week ago

    Pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    5 days ago

    pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    3 weeks ago

    pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    3 weeks ago

    pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java Spark Developer

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java spark developer

    1 week ago

    Pune H.o, India EXL Full time

    We are seeking a highly skilled Java + Spark Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Spark, and SQL, with additional knowledge of Snowflake and experience with AWS cloud platforms being a plus. You will be responsible for developing and optimizing Spark based solutions, managing large data sets, and...

  • Java/Spark Developer

    4 weeks ago

    Gurgaon/Gurugram/Chennai/Mumbai/Bangalore/Pune, India Coders Brain Technology Pvt. Ltd. Full time

    Job Title: Java/Spark DeveloperWe are seeking a highly skilled Java/Spark Developer to join our team at Coders Brain Technology Pvt. Ltd.Key Responsibilities:Design and develop complex data platforms and data engineering solutions using Java and Spark.Develop and maintain large-scale data processing systems using AWS services.Collaborate with...

  • Data Engineer with Java and Spark

    3 weeks ago

    Pune, Maharashtra, India Atyeti Inc Full time

    Atyeti Inc is seeking a highly skilled Data Engineer with expertise in Java and Spark to lead our cloud migration project in GCP space.As a Data Engineer, you will be responsible for designing and implementing data processing systems using Spark, as well as developing and enhancing Java code for our cloud-based applications.Key Responsibilities:Design and...

  • Data Engineer with Java and Spark Expert

    4 weeks ago

    Pune, Maharashtra, India Atyeti Inc Full time

    About the RoleWe are seeking a highly skilled Data Engineer with expertise in Java and Spark to join our team at Atyeti Inc. The ideal candidate will have hands-on experience with Java code development, Spark configuration, and cloud migration projects in GCP space.Key ResponsibilitiesDesign and develop scalable data processing systems using Java and...

  • Data Engineer with Java and Spark Expert

    4 weeks ago

    Pune, Maharashtra, India Atyeti Inc Full time

    Job Title: Data Engineer with Java and SparkWe are seeking a highly skilled Data Engineer with expertise in Java and Spark to join our team at Atyeti Inc. The ideal candidate will have hands-on experience in Java code development, Spark configuration, and cloud migration projects in GCP space.Key Responsibilities:Design and develop scalable data processing...

  • Data Engineer with Java and Spark

    1 month ago

    Pune, India Atyeti Inc Full time

    Atyeti now hiring for Data Engineer experts who has hands with Java coding and Spark configuration for the cloud migration project in GCP space. Individual has to be hands with Java code development, Enhancement, OOPS concept and should worked into data processing with Spark . ( Incase no Java we are good with Scala experience).Location:...

  • Data engineer with java and spark

    4 weeks ago

    Pune, India Atyeti Inc Full time

    Atyeti now hiring for Data Engineer experts who has hands with Java coding and Spark configuration for the cloud migration project in GCP space. Individual has to be hands with Java code development, Enhancement, OOPS concept and should worked into data processing with Spark. ( Incase no Java we are good with Scala experience). Location:...

  • Data Engineer with Java and Spark

    4 days ago

    pune, India Atyeti Inc Full time

    Atyeti now hiring for Data Engineer experts who has hands with Java coding and Spark configuration for the cloud migration project in GCP space. Individual has to be hands with Java code development, Enhancement, OOPS concept and should worked into data processing with Spark . ( Incase no Java we are good with Scala experience). Location:...