Senior/Lead Java Developer

1 week ago

Anywhere in IndiaMultiple Locations MindBrain Full time

Job Title :

Senior Lead Java Developer - Spark, Azure, Redpanda Expert.

Experience Level :

Senior/Lead (13+ years of experience).

Job Description :

We are seeking a highly skilled Senior Lead Java Developer with expertise in Apache Spark, Azure Data Services (ADLS, Azure Blob Storage, Azure Databases), and Redpanda.

In this role, you will design, architect, and lead the development of scalable data processing pipelines, leveraging Java and Spark to process vast datasets.

As a senior technical leader, you will collaborate with cross-functional teams to deliver robust, data-driven solutions while establishing best practices in cloud-based architecture and data engineering.

If you are passionate about distributed systems, real-time data processing, and cloud technologies, this role is for you.

Key Responsibilities :

Design and Architect Distributed Data Processing Systems :

- Lead the design and development of large-scale Apache Spark jobs using Java to process massive datasets, including blockchain and financial transactions.

- Architect high-performance, scalable data pipelines integrated with Azure Data Lake Storage (ADLS), Azure Blob Storage, and Azure Databases for both batch and real-time processing.

Development and Optimization of Spark Jobs :

- Build and optimize Spark jobs in Java, ensuring high scalability, fault tolerance, and efficient memory usage.

- Implement data validation, schema management, and handle Parquet files for seamless integration with ADLS and Iceberg tables.

Integration with Redpanda :

- Lead the integration of Redpanda (or similar message brokers like Kafka) for real-time data ingestion, ensuring low-latency communication between ingestion services and downstream processing components.

- Develop efficient Redpanda consumers and integrate them with Spark for real-time streaming data processing.

Azure Cloud Services :

- Design cloud-native solutions utilizing Azure services such as ADLS, Azure Blob Storage, and Azure SQL/NoSQL Databases.

- Collaborate with DevOps teams for seamless integration with Azure services, focusing on data ingestion, storage management, and cost optimization.

- Optimize the storage of large datasets for performance and cost-efficiency.

Lead and Mentor Engineering Teams :

- Provide technical leadership, mentoring, and guidance to developers in Java, Spark, and cloud-native architecture best practices.

- Conduct code reviews, performance tuning, and architecture assessments to maintain code quality and adherence to industry standards.

End-to-End Data Pipeline Management :

- Manage data pipelines from ingestion (via Redpanda) to transformation, storage, and serving using Spark and Azure services.

- Implement monitoring and observability tools such as Prometheus, Grafana, and Azure Monitor to ensure high availability and security.

Performance Tuning and Resource Optimization :

- Optimize Spark jobs for performance and resource utilization, focusing on task scheduling, caching, partitioning, and reducing shuffling.

- Develop strategies to maximize throughput and minimize processing time for large-scale data processing.

Required Qualifications :

- 13+ years of experience in software development with strong expertise in Java and JVM-based technologies.

- 5+ years of hands-on experience with Apache Spark for data processing in Java.

- Proficiency with Azure Data Services (ADLS, Azure Blob Storage, Azure Databases).

- Deep understanding of distributed data processing and integration with streaming frameworks like Redpanda or Kafka.

- Proven experience in designing cloud-native solutions with a focus on Azure.

- Strong expertise in storage optimization, partitioning, and Spark performance tuning.

- Experience with CI/CD pipelines, containerization (Docker, Kubernetes), and DevOps practices.

- Leadership experience with a demonstrated ability to mentor and guide engineering teams.

- Strong knowledge of security best practices for cloud-based data pipelines.

Preferred Qualifications :

- Hands-on experience with Iceberg tables and Parquet file formats.

- Knowledge of monitoring tools like Prometheus, Grafana, or Azure Monitor.

- Experience with streaming data integration using Redpanda and Spark.

- Familiarity with microservices architecture using Spring Boot and cloud-based deployment strategies.

(ref:hirist.tech)

  • Senior Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations IT Firm Full time

    Role : Senior Java Drools Developer (Mumbai/Ahmedabad/PWFH)No. of Positions : 1Experience : 5 - 9 yearsJob Description : - Work with Team Lead to understand business requirements- Develop functionality/modules with a focus on usability, reliability and supportability- Ensure excellent levels of performance and scalability- Adhere to architectural goals and...

  • Senior Java Developer

    6 days ago

    Anywhere in India/Multiple Locations FocalWorks Private Limited Full time

    Job Description :We are looking for a Senior Developer with expertise in Java and microservices architecture to develop, optimize, and maintain high-performance backend systems. The ideal candidate will work closely with frontend developers and DevOps teams to build scalable, cloud-native applications running on AWS ECS (Fargate). The role involves designing...

  • Senior Java Developer for API Engineering

    3 days ago

    Anywhere in India/Multiple Locations Easy Recruit Global Full time

    We are seeking a highly skilled Senior Java Developer to join our API engineering team at Easy Recruit Global. The successful candidate will have a strong background in Java and experience with SpringBoot, as well as expertise in GraphQL or NoSQL databases.This role requires a deep understanding of API architecture and the ability to design and implement...

  • Senior Java Backend Developer

    1 week ago

    Anywhere in India/Multiple Locations Genpact Full time

    About GenpactGenpact is a global professional services firm that helps clients navigate change and optimize operational performance. We are leaders in digital transformation, applying innovative technologies such as artificial intelligence, analytics, and robotics process automation to deliver real-world results. Our team of experts works collaboratively to...

  • Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations Securseed Full time

    Role Description :This is a full-time remote role for a Java Developer.The Java Developer will be responsible for architecting, designing, and developing solutions using Java, Spring, Hibernate, and other open-source technologies, writing clean, efficient, and maintainable code, and collaborating with cross-functional teams to identify and prioritize...

  • Java Developer for Cloud Platforms

    3 days ago

    Anywhere in India/Multiple Locations Risk Resources India Full time

    About the RoleThis Senior Java Backend Developer position requires expertise in agile software engineering, with a strong understanding of developing applications for public cloud platforms such as Azure. The ideal candidate should have a minimum of 5 years of experience in backend development and possess skills on Java, Spring Boot, and Restful web...

  • Senior Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations XTGLOBAL INFOTECH LIMITED Full time

    Role : Sr. Java Engineer Location : Hyderabad / Vizag / RemoteYou will work on microservice based, cloud ready solutions and workflows to process transactions into billable events. The systems are high throughput, highly available/scalable, and responsible for millions of micro-transactions per day. The systems are the most accurate, efficient, and robust...

  • Lead Backend Developer

    3 weeks ago

    Anywhere in India/Multiple Locations Questhiring Full time

    Responsibilities : - In this lead role, you will be designing and developing complex software systems that have been successfully delivered to customers. - Ensure the quality of design of systems by serving as a technical lead on our most demanding, cross-functional teams. - Build reusable code and libraries for future use. - Build highly available,...

  • Senior Java Manager

    6 days ago

    Anywhere in India/Multiple Locations Populux HR Full time

    Job Overview :We are looking for an experienced Senior Full-Stack Software Engineer to join our team at Populux HR. As a key member of our agile team, you will be responsible for designing and developing high-quality enterprise applications.Responsibilities :Design and develop full-stack web applications using Java and modern JavaScript frameworksCollaborate...

  • Senior Java Developer with React Expertise

    2 days ago

    Anywhere in India/Multiple Locations Cybyrotek Solutions Full time

    **Company Overview:**Cybyrotek Solutions is a leading technology firm that offers innovative solutions to businesses worldwide. We are currently seeking an experienced Java developer with expertise in React to join our team.**Job Summary:**We are looking for a skilled Java professional with extensive experience in developing web-based applications using...

  • Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations Discoveries Quintessential Pvt Ltd Full time

    JOB DESCRIPTION : MID SENIOR SOFTWARE DEVELOPER : JAVA SCOPE OF WORK : The role of mid/senior java developer is responsible for a range of tasks that help in developing and maintaining Java applications.KEY RESPONSIBILITIES : 1. Software Development : - Coding - Participate in the entire software development life cycle(SDLC). - Identifying and fixing...

  • Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations BlueByte Technologies Full time

    Job Description : Required Skills : - Java : Strong expertise in Java 8+ with hands-on experience in building enterprise applications.- Spring Boot : Proficiency in developing RESTful APIs and microservices using Spring Boot.- Java Batch : Experience with batch processing frameworks like Spring Batch.- Experience with Angular is preferred.- Oracle Database...

  • Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations TekIT Software Solutions Pvt. Ltd. Full time

    Role : Java Developer. Job Type : Contract. Total Experience : 8+ years. Key Responsibilities : - Proven experience in Java development.- Good knowledge Production grade microservice development (Loggin, Error handling, Config. management, Processing of large data/Multithreading) is required.- Strong coding and API development is required.- Experience in...

  • Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations spectrum talent management Full time

    We are looking for an experienced Java Developer with expertise in AWS Cloud technologies to join our dynamic team. In this role, you will be responsible for developing scalable and efficient Java-based applications, optimizing them for the cloud environment, and leveraging AWS services to deliver high-performance solutions. Your expertise will help our...

  • Senior Developer

    3 weeks ago

    Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full time

    We are seeking a Seasoned JAVA + Apache Flink Developer to join our team. The ideal candidate will have hands-on experience with Java development and a strong background in Apache Flink, including working with Stream, Batch, and Table APIs. The role requires proficiency in modern technologies like MongoDB, Kafka/Redpanda, Kubernetes, and Azure-based...

  • Senior Java Backend Developer

    3 days ago

    Anywhere in India/Multiple Locations Risk Resources India Full time

    Key ResponsibilitiesDesign and develop robust and scalable software applications using Java and Spring BootMigrate databases from Oracle to PostgreSQL and manage ETL processes using Azure Logic Apps and/or Azure Data FactoryImplement security measures using modern authentication protocols such as OIDC and OAuth2 with Azure AD and/or Okta

  • Senior Java Developer

    2 weeks ago

    Anywhere in India/Multiple Locations/Remote Follex Technology Full time

    Requirement : Java : 6+ years Location : Remote Interview round : 2 rounds Note : We required all the documents like UAN Number, previous employment details About the job : Our company is seeking a sharp, dynamic and experienced individual to join our team as a developer. As a Java Developer, you will be responsible for supporting an Operations team in...

  • Java Developer

    2 weeks ago

    Anywhere in India/Multiple Locations Muoro Full time

    Job Title : Java Developer (Freelancer)Experience : 5+ YearsContract Duration : Minimum 6 months (Remote)Key Responsibilities :- Develop, test, and maintain scalable and high-performance Java applications.- Design and implement RESTful APIs and microservices.- Collaborate with cross-functional teams to deliver business-critical solutions.- Optimize...

  • Java Developer

    2 weeks ago

    Anywhere in India/Multiple Locations Nazztec Private Limited Full time

    Key Responsibilities : Frontend Development : - Design, develop, and maintain dynamic user interfaces using Angular. - Ensure the technical feasibility of UI/UX designs. - Develop reusable components and front-end libraries for future use. - Collaborate with back-end developers to integrate APIs and services into the application. - Implement responsive...

  • Java Developer

    3 weeks ago

    Anywhere in India/Multiple Locations Muoro Full time

    Job Description :- Must have. : Java, Spring, Spring boot, Rest API, Docker, Jenkins, AWS Cloud, GitHub/GIT, Kubernetes.- Good to have: PostgreSQL, No-SQL, MongoDB, or DynamoDB, Terraform- At least 7 years of experience in Java EE for backend service development- At least 2+ year of experience in developing Services on Kubernetes (Microservices) and Docker...