Java Developer(with Spark SQL)

2 days ago

Bengaluru, Karnataka, India Affine Full time
Experience - 4 - 9 years

Work Location: India - Remote, Bengaluru will be preferred.

Work Timings: 1:00pm to 10:00pm IST

We are seeking experienced Java Developers with strong Spark SQL skills to join a fast-paced project for a global travel technology client. The role focuses on building API integrations to connect with external data vendors and creating high-performance Spark jobs to process and land raw data into target systems.

You will work closely with distributed teams, including US-based stakeholders, and must be able to deliver quality output in a short timeframe.

Key Responsibilities:

- Design, develop, and optimize Java-based backend services (Spring Boot / Microservices) for API integrations.
- Develop and maintain Spark SQL queries and data processing pipelines for large-scale data ingestion.
- Build Spark batch and streaming jobs to land raw data from multiple vendor APIs into data lakes or warehouses.
- Implement robust error handling, logging, and monitoring for data pipelines.
- Collaborate with cross-functional teams across geographies to define integration requirements and deliverables.
- Troubleshoot and optimize Spark SQL for performance and cost efficiency.
- Participate in Agile ceremonies, daily standups, and client discussions.

Required Skills:

- 4 to 8 years of relevant experience.
- Core Java (Java 8 or above) with proven API development experience.
- Apache Spark (Core, SQL, DataFrame APIs) for large-scale data processing.
- Spark SQL – strong ability to write and optimize queries for complex joins, aggregations, and transformations.
- Experience with API integration (RESTful APIs, authentication, payload handling, and rate limiting).
- Hands-on with data ingestion frameworks and ETL concepts.
- Experience with MySQL or other RDBMS for relational data management.
- Proficiency in Git for version control.
- Strong debugging, performance tuning, and problem-solving skills.
- Ability to work with minimal supervision in a short-term, delivery-focused engagement.

  • Spark, Scala, Spark Streaming, Java

    3 weeks ago

    Bengaluru, Karnataka, India Hirexa Solutions Private Limited Full time

    Job Description6+ years of solid experience of programming in designing and developing large scale Big Data Based enterprise applications4+ years of development experience withSpark,Scala, Java and other Big Data technologies, including extensive knowledge ofSpark's core concepts, RDDs, DataFrames, andSparkSQLCreateScala/Sparkjobs for data transformation and...

  • Spark ( Pyspark ) Developer

    2 weeks ago

    Bengaluru, Karnataka, India Phygital Insights Full time

    Job Description- The developer must have sound knowledge in Apache Spark and Python programming.- Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.- Experience in deployment and operationalizing the code is added advantage...

  • Java SQL Lead Developer

    4 days ago

    Bengaluru, Karnataka, India Mastech Digital Full time

    Position: Java SQL Lead DeveloperLocations :- Chennai, Hyderabad, BangaloreDuration: Full TimeNotice Period: Only Immediate Joiners/ Currently Serving Notice/ Notice is less than 60 daysExp:- 6+ yearsHybrid model weekly 3 days at office.Skill Java 8 and microservices SQL and Database programmingAt least 6+ years of IT experience in design and...

  • Oracle PL/SQL Developer with Java

    2 days ago

    Bengaluru, Karnataka, India VRIZE Full time

    Location: Bangalore (Hybrid – 3 days/week from office)- 2-4 years of experience developing in Java technologies with equivalent experience in systems analysis, OO design, OO programming and debugging skills.- 2-4 Experience in technology stack including Spring Boot, Spring Cloud, Gradle, Microservices Architecture, REST, Java 1.8, Spark- Strong in SQL,...

  • Expert Backend Java Developer

    1 day ago

    Bengaluru, Karnataka, India beBeeSpark Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Java Developer RoleOur team is seeking a highly skilled Java Developer with expertise in Spark SQL to collaborate on a dynamic project for a global client.Design, develop and optimize Java-based backend services (Spring Boot / Microservices) for seamless API integrations.Develop and maintain robust Spark SQL queries and data processing pipelines for...

  • EMR _ Spark SME

    3 weeks ago

    Bengaluru, Karnataka, India Unitforce Technologies Consulting Full time

    Job DescriptionTechnical Skills:- 5+ years of experience in big data technologies with hands-on expertise in AWS EMR and Apache Spark.- Proficiency in Spark Core, Spark SQL, and Spark Streaming for large-scale data processing.- Strong experience with data formats (Parquet, Avro, JSON) and data storage solutions (Amazon S3, HDFS).- Solid understanding of...

  • Java Developer

    31 minutes ago

    Bengaluru, Karnataka, India beBeeSoftwareEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    We are currently seeking an experienced software engineer to develop high-quality software solutions using Java.Key Responsibilities:Design and implement scalable, reliable systems that meet business needsTroubleshoot and optimize code for performance and reliabilityThe ideal candidate will possess strong object-oriented programming skills, experience with...

  • Mainly Scala+spark

    3 weeks ago

    Bengaluru, Karnataka, India TapTalent Full time

    Primary Skills Mainly Scala Spark OR Java SparkNotice period immediate to 30 days Above 45 days notice period do not share profiles Location Pune Chennai Bangalore Hyderabad Mumbai GurgoanExp - 4-10 yrs Mainly Scala Spark OR Java Spark experience needed 5 years of experience Expertise in Data Engineering Hands-on experience in design and development...

  • Python / SQL Professional

    3 weeks ago

    Bengaluru, Karnataka, India Unitforce Technologies Consulting Full time

    Job DescriptionRoles and Responsibility- Python/SQL- - Big data technologies (Hadoop data lakes ), SQL, scripting languages (Python, Shell scripting), CI/CD, working Knowledge on Spark/Java/Python Description We are looking for a technically skilled Senior Developer for Big Data development to help prevent financial crime to the benefit of our customers,...

  • Senior Java Developer

    7 hours ago

    Bengaluru, Karnataka, India beBeeSoftware Full time ₹ 1,04,000 - ₹ 1,30,878

    Are you a skilled Java developer with experience in Oracle PL SQL? We are looking for a talented individual to join our team as a Senior Java Developer.