(3 Days Left) Senior Java Architect
7 days ago
Job Description:
We are seeking an experienced Senior Lead Java Architect with deep expertise in Apache Spark, Azure Data Services (ADLS, Azure Blob Storage, Azure Database), and Redpanda. The ideal candidate will play a pivotal role in designing, architecting, and leading the development of scalable data processing pipelines using Java and Spark. You will work closely with cross-functional teams to build data-intensive applications and drive best practices in cloud-based architecture. If you're passionate about data engineering, distributed systems, and cloud technologies, this role is for you.
Key Responsibilities:
- Design and Architect Distributed Data Processing Systems:- Lead the design and implementation of large-scale Apache Spark jobs using Java for processing vast datasets from various sources, including blockchain data streams and financial transactions.- Architect robust, high-performance data pipelines integrated with Azure Data Lake Storage (ADLS), Azure Blob Storage, and Azure Databases for real-time and batch processing.- Development and Optimization of Spark Jobs:- Develop, optimize, and manage Spark jobs primarily in Java (JVM-based), ensuring high scalability, fault tolerance, and performance.- Implement data validation, schema management, and parquet file handling in Spark jobs for seamless integration with ADLS and Iceberg tables.- Integration with Redpanda:- Lead the integration of Redpanda (or Kafka-like message brokers) for real-time data ingestion, ensuring reliable, low-latency communication between the data ingestion services and downstream processing components.- Collaborate with the engineering team to build Redpanda consumers for real-time streaming data and ensuring that Spark jobs consume this data efficiently.- Azure Cloud Services:- Design cloud-native solutions leveraging Azure services such as Azure Data Lake Storage (ADLS), Azure Blob Storage, and Azure SQL/NoSQL Databases.- Collaborate with the DevOps team to ensure the seamless integration of Spark jobs with Azure services, including data ingestion and storage management.- Manage and optimize storage costs and performance for large datasets on Azure services.- Lead and Mentor Engineering Teams:- Provide technical leadership, mentoring, and guidance to a team of developers, ensuring best practices in Java development, Spark optimization, and cloud-native architecture.- Conduct regular code reviews, architecture assessments, and performance tuning exercises to ensure code quality and adherence to industry standards.- End-to-End Data Pipeline Management:- Manage the full lifecycle of data pipelines, from initial data ingestion in Redpanda to transforming, storing, and serving data using Azure Data Services and Spark.- Ensure that data pipelines are monitored, secure, and highly available by integrating with tools like Prometheus, Azure Monitor, and Grafana.- Performance Tuning and Resource Optimization:- Lead efforts in performance tuning and resource optimization for Spark jobs, ensuring minimal shuffling and efficient memory usage for large-scale data processing.- Develop caching mechanisms, partitioning, and task scheduling strategies to maximize throughput and reduce processing time.
Required Qualifications:
- 13+ years of experience in software development with strong expertise in Java and JVM-based technologies.- 5+ years of experience working with Apache Spark for data processing in Java.- Extensive experience with Azure Data Services, including Azure Data Lake Storage (ADLS), Azure Blob Storage, and Azure Databases.- Strong expertise in distributed data processing and streaming frameworks, with hands-on experience integrating message brokers like Redpanda or Kafka.- Proven track record in cloud-native architecture design with a focus on Azure.- Hands-on experience with data storage optimization, partitioning, and Spark performance tuning.- Leadership and mentoring experience with the ability to guide and develop high-performing engineering teams.- Experience with CI/CD pipelines, containerization (Docker, Kubernetes), and DevOps practices.- Strong understanding of security best practices for cloud-based data pipelines.
Preferred Qualifications:
- Experience with Iceberg tables and Parquet file formats in a distributed processing environment.- Knowledge of Prometheus, Grafana, or Azure Monitor for observability and monitoring.- Experience with streaming data processing using Redpanda and integration with Spark jobs for real-time data flows.- Familiarity with microservices architecture using Spring Boot and cloud-based deployment strategies.
-
Senior Java Developer
1 month ago
Delhi, Delhi, India Lodgiq Full timeAbout the Role:At Lodgiq, we are looking for a talented Senior Java Developer to join our team. As a key member of our software development team, you will be responsible for designing, developing, and implementing high-quality Java modules for our complex enterprise application system.Key Responsibilities:- Design and develop high-quality Java modules for...
-
Senior PLM Architect
2 weeks ago
Delhi, Delhi, India VJcoresoft Full timeJob Title : Senior PLM ArchitectOverviewVJcoresoft is a leading company in the field of Product Lifecycle Management (PLM). We are seeking a highly skilled and experienced Senior PLM Architect to join our team.SalaryWe offer an estimated salary of $140,000 per year for this position. Job DescriptionAs a Senior PLM Architect at VJcoresoft, you will be...
-
▷ 3 Days Left: Senior Java Software Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeJoin Walk-in Drive @ Hyderabad LocationRole : Senior Java DeveloperExperience : 5 - 8 YearsLocation : HyderabadMust Have:- Java/J2ee, Spring, Hibernate, Oracle, SQL/PLSQLRoles & Responsibilities:- Understanding of Coding languages/frameworks for frontend or backend development.- Very good at understanding the logic of code and algorithms- Work directly and...
-
Senior BIM Manager Architect
11 hours ago
Delhi, Delhi, India Studio4 Full timeJob Title: Senior BIM Manager ArchitectAbout Studio4Studio4 is a leading architectural firm that specializes in delivering cutting-edge projects. Our team of experts is passionate about creating innovative solutions that meet the needs of our clients.We are currently looking for a highly skilled Senior BIM Manager Architect to join our team. This role will...
-
(3 Days Left) Lead Java Developer
1 week ago
Delhi, India Mphasis Full timeThis position is only for Bangalore, Hyderabad, Chennai, Mumbai, Pune and Delhi NCR,This is a hybrid position, Candidates has to go 2-3 days a week office.Must have skill are Core Java, SpringBoot, Microservices and Azure Cloud ExperienceAnnual CTC for this position is 30LPAOverview: We are seeking an experienced Senior Java resource with minimum of 10 years...
-
Senior Java Architect
2 weeks ago
Delhi, Delhi, India SourceBae Full timeJob Title: Senior Java ArchitectOverviewWe are seeking an experienced Senior Java Architect to lead the design and implementation of scalable, high-performing solutions. The ideal candidate will possess strong expertise in Java Spring, microservices architecture, and cloud technologies.Key Responsibilities:Solution Design & Architecture : Lead end-to-end...
-
Senior Java Software Engineer
1 day ago
Delhi, India Tech Mahindra Full timeMust Have skills:1. Strong programming skills2. SQL or PL SQL( should write complex Queries)3. Unix and Shell scriptJD : Problem solving in a development or production environment, including experience observing patterns, analyzing root cause and suggesting ideas to resolve issues.Good communication skills with ability to articulate the technical and...
-
Delhi, Delhi, India TribolaTech Inc Full timeAbout the RoleWe are seeking a seasoned Senior Database Architect to join our team at TribolaTech Inc. as a Java Developer with Database Views.Key ResponsibilitiesDesign and develop database views using SQL queriesCollaborate with cross-functional teams to integrate database solutionsAnalyze and optimize database performanceRequirements3+ years of experience...
-
3 Days Left: Architect
1 week ago
Delhi, India Tekton Studio Full timeWe are looking for talented and dynamic architects to join our studio, working on interesting projects in and around Delhi. You will have thorough experience in the role of an architect, working on projects from planning to completion. You will be a good communicator who is able to guide and work as part of an architectural team, directly interfacing with...
-
▷ (3 Days Left) Senior Data Architect
1 day ago
Delhi, India Birlasoft Full timeAbout Birlasoft: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group,...
-
Confluent Cloud Architect
1 month ago
Delhi, India Intuitive.Cloud Full timeAbout us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...
-
Banking Testing Practice Senior Director
1 day ago
Delhi, India ORACLE FINANCIAL SERVICES SOFTWARE LIMITED Full timeAn experienced Consulting Testing Practice Senior Director who understands Testing-as-a-Service (TaaS) solutions, industry best practices, multiple business testing methodologies/processes or technology designs within a product/technology family. Operates independently to drive test strategy across agile and waterfall projects. Provide quality work products...
-
Senior Java Enterprise Architect
3 weeks ago
Delhi, Delhi, India National Payments Corporation Of India (NPCI) Full timeJob Title: Senior Java Enterprise ArchitectAbout the Role:We are seeking an experienced Senior Java Enterprise Architect to join our team at National Payments Corporation Of India (NPCI). As a key member of our architecture team, you will play a crucial role in designing and developing highly available and scalable platforms using Java and J2EE...
-
Senior Azure Data Engineer
3 days ago
Delhi, Delhi, India Manuh Technologies Full timeWe are seeking an experienced Senior Azure Data Engineer to join our team at Manuh Technologies. As a key member of our data engineering team, you will play a critical role in designing, developing, and maintaining large-scale data pipelines, databases, and data infrastructure to support the collection, storage, and analysis of high-quality data.Job...
-
▷ [3 Days Left] Senior Java Software Engineer
2 weeks ago
Delhi, India Applicantz Full timeTHIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and a Flexible work environment. They use cutting-edge technologies to keep themselves ahead of the curve. Diversity in all...
-
[3 Days Left] Senior Java Software Engineer
16 hours ago
Delhi, India NCS Group Full timeAbout the job – Senior Developer ( Java, Spring, Apache Camel)Extraordinary careers start hereNCS , a subsidiary of Singtel Group, is a leading technology services firm with presence in Asia Pacific and partners with governments and enterprises to advance communities through technology. Combining the experience and expertise of its 12,000-strong team...
-
Senior Java Software Engineer
1 month ago
Delhi, India InRhythm Full timeWho Is InRhythm?InRhythm ( Home - InRhythm) is a leading modern product consultancy and digital innovation firm with a mission to make a dent in the digital economy. Founded in 2002, InRhythm is currently engaged by Fortune 50 enterprises to bring their next generation of digital products and platforms to market. InRhythm has helped hundreds of teams launch...
-
Senior Java Cloud Architect
3 days ago
Delhi, Delhi, India CygnusPro Software Solutions Pvt. Ltd Full timeJob Title: Senior Java Cloud ArchitectAbout Us:CygnusPro Software Solutions Pvt. Ltd is a leading software development company that specializes in providing innovative solutions to businesses worldwide.Salary Range:$120,000 - $180,000 per annumJob Overview:We are seeking an experienced Senior Java Cloud Architect to join our team. The ideal candidate will...
-
▷ 3 Days Left: Architect
17 hours ago
Delhi, India HCLTech Full timeServiceNow Architect (HRSD, PSM)- Bachelor’s degree in Computer Science, Engineering, or a related field- 12+ years of experience in ServiceNow development and architecture- Proficiency in HRSD, PSM and best practices- Proficiency in JavaScript, XML, HTML, and CSS for ServiceNow development- Experience in ServiceNow platform upgrades and version...
-
3 Days Left: Java Microservices Engineer
3 weeks ago
Delhi, India Luxoft Full timeProject Description:The team aims to work on green-field projects using the latest technologies on microservices cloud-based architecture in order to drive business innovation. Projects are found in the most evolving area of the Investment Banking domain - Asset Management. Business is dynamic and it demands fast turn-around deliverables from the development...