
Apache Kafka Admin
4 days ago
As part of the modernization initiative, this role is responsible for designing, deploying, and administering Apache Kafka clusters that form the backbone of our SaaS product's event-driven architecture. The role requires a hands-on expert who ensures reliability, scalability, and security of Kafka platforms integrated with modernized applications built on .NET Core and React. As a Senior Kafka Administrator, you will be a key member of the team responsible for modernizing our legacy Microsoft technology platform to a .NET Core and React-based architecture. This role focuses on designing, managing, and optimizing Apache Kafka clusters to support real-time data streaming and processing for our SaaS applications. You will work as an individual contributor, collaborating closely with developers, Azure Architects, data engineers, and infrastructure teams to ensure seamless messaging operations, without team management responsibilities.
Responsibilities:- Install, configure, upgrade, and manage Apache Kafka clusters in production and non-production environments.
- Partner with architects and developers to define messaging strategies, topics, partitions, and retention policies.
- Monitor, tune, and optimize Kafka for throughput, latency, and scalability.
- Implement security controls including SSL, SASL, authentication, and authorization.
- Manage Kafka Connect, Schema Registry, and Kafka Streams to support integrations.
- Develop backup, recovery, disaster recovery, and high availability strategies for Kafka.
- Troubleshoot and resolve incidents related to brokers, producers, and consumers.
- Automate cluster provisioning, scaling, and configuration via scripts and Infrastructure-as-Code.
- Integrate Kafka monitoring and alerting with observability tools.
- Provide expertise and best practices guidance to engineering teams consuming Kafka services.
- Manage, configure, and maintain Apache Kafka clusters to ensure high availability, scalability, and performance for SaaS applications.
- Optimize Kafka configurations, including topics, partitions, replication, and retention policies, to support real-time data streaming for .NET Core and React applications.
- Implement and maintain backup and recovery strategies for Kafka clusters to ensure data durability and reliability.
- Collaborate with the development team to integrate Kafka with modernized .NET Core and React applications, ensuring seamless data flow between components.
- Design and implement Kafka topics, schemas, and producers/consumers to support new application features and data pipelines.
- Assist in migrating legacy messaging or data workflows (e.g., MSMQ, SQL Server-based queues) to Apache Kafka, ensuring minimal disruption.
- Monitor Kafka cluster performance using tools like Confluent Control Center, Prometheus, Grafana, or custom scripts, proactively identifying and resolving issues.
- Troubleshoot complex Kafka-related issues, including connectivity, message delivery failures, and performance bottlenecks.
- Implement monitoring and alerting systems to ensure 24/7 reliability of Kafka clusters for SaaS customers.
- Ensure Kafka cluster security by implementing best practices for access control (e.g., SASL, ACLs), encryption (e.g., SSL/TLS), and auditing.
- Maintain compliance with industry standards (e.g., GDPR, SOC 2, or other relevant regulations) for data streaming and processing.
- Work closely with .NET Core and React developers, data engineers, and DevOps teams to optimize Kafka integration and ensure efficient data processing.
- Document Kafka configurations, processes, and optimization strategies to support team knowledge sharing.
- Minimum 7-8+ years of hands-on experience as a Kafka Administrator in a production environment, preferably within a SaaS or product-based organization.
- Proven experience supporting messaging or streaming systems for applications built on Microsoft technologies (e.g., .NET Framework, MSMQ) and transitioning to modern stacks like .NET Core.
- Experience with migrating legacy messaging systems to Apache Kafka is highly desirable.
- Deep expertise in Apache Kafka administration, including cluster setup, configuration, topic management, replication, and performance tuning.
- Strong knowledge of Kafka ecosystem tools (e.g., Kafka Connect, Schema Registry, Kafka Streams, ksqlDB).
- Familiarity with .NET Core and React application architectures and their integration with Kafka for real-time data processing.
- Experience with monitoring tools (e.g., Confluent Control Center, Prometheus, Grafana) and scripting (e.g., Bash, Python) for automation.
- Knowledge of cloud-based Kafka deployments (e.g., Confluent Cloud, AWS MSK, Azure Event Hubs for Kafka) is a plus.
- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
- Good to Have Kafka certifications (e.g., Confluent Certified Administrator for Apache Kafka) or cloud certifications (e.g., AWS, Azure) are a plus.
- Good to Have Familiarity with DevOps practices, including CI/CD pipelines and infrastructure-as-code (e.g., Terraform, Ansible).
- Good to Have Knowledge of containerization (e.g., Docker, Kubernetes) for Kafka deployments. Exposure to front-end technologies like React for understanding application-Kafka interactions.
If you have any questions, please direct your inquiries to
-
Kafka Bizops
1 week ago
Pune, Maharashtra, India Opus Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearTitle : Bizops (Kafka) DeveloperJob Description SummaryOverviewWhat we create today will define tomorrow. Revolutionary technologies that reshape the digital economy to be more connected and inclusive than ever before. Safer, faster, more sustainable. And we need the best people to do it. Technologists who are energized by the challenges of a truly global...
-
Java engineer ATOS
2 days ago
Pune, Maharashtra, India Axiom Software Solutions Limited Full time ₹ 6,00,000 - ₹ 12,00,000 per yearCandidates should have a strong hold / hands-on experience of Core Java, SpringBoot, Kafka and MicroServices, Spring framework, config server & API gateway, writing the UT's, Apache Kafka & reactive programming, spring boot microservices, hibernate/JPA, Any database,Any cloud experience. Candidates should have a strong hold / hands-on experience of Core...
-
Java Developer
2 days ago
Pune, Maharashtra, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 5,00,000 - ₹ 12,00,000 per yearPosition : Java Microservices Developer - KAFKALocation : Hybrid in Pune, IndiaDuration : 6 Months (Contract)Job Summary : We are seeking a skilled and experienced Java Microservices Developer with a strong background in Apache Kafka to join our team on a 6 month contract. The ideal candidate will be a hands-on developer responsible for designing,...
-
Full Stack Engineer
1 week ago
Pune, Maharashtra, India S2 TECHNOLOGY GmbH Full time ₹ 15,00,000 - ₹ 25,00,000 per yearProject Goal:Migration of three major business processes to a modern IT landscape using Java and ReactImplementation of legal/regulatory changesDevelopment of new features based on business requirementsCore Responsibilities:Migrating existing processes to modern technologies (Java, React)Implementing legal and regulatory requirementsDeveloping new features...
-
Data Streaming Engineer_6+ Years_ PAN India
2 weeks ago
Pune, Maharashtra, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a Data Streaming Engineer to design, develop, and test real-time data pipelines leveraging Solace, Kafka, Databricks Delta Live Tables (DLT), and Apache Spark Structured Streaming. The role involves building ingestion frameworks, streaming data readers, raw data parsers, transformation pipelines from raw to bronze layers, and publishing...
-
Lead I
4 days ago
Pune, Maharashtra, India UST Full time ₹ 10,00,000 - ₹ 25,00,000 per year6 - 9 Years2 OpeningsPuneRole descriptionAdditional Comments:Responsibilities: • Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services. • Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems. • Demonstrate a strong understanding of the Kafka ecosystem, including...
-
Pune, Maharashtra, India Hinduja Tech Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per yearQualifications10-12 years of technical experience in software development, with a significant focus on full stack roles.Proven experience in a leadership or management position, leading a team of 5 or more engineers.Expertise in Python and GoLang for backend development.Strong proficiency in and its ecosystem for front-end development.Extensive...
-
Data Engineers
6 days ago
Pune, Maharashtra, India Axiom Software Solutions Limited Full time ₹ 9,00,000 - ₹ 12,00,000 per yearSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsSQL/NoSQL, clouddata solutionsRequirements• Frontend Framework: Angular• Servers :...
-
UX Designer
4 days ago
Pune, Maharashtra, India Axiom Software Solutions Limited Full time ₹ 2,00,000 - ₹ 12,00,000 per yearFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteFigma, AdobeSuiteRequirements• Frontend Framework: Angular• Servers : Tomcat, Jetty, JBoss, Nginx, Apache HTTP Server• Tools : Maven,...
-
Fullstack Developer
1 week ago
Pune, Maharashtra, India Hinduja Tech Full time ₹ 20,00,000 - ₹ 25,00,000 per yearShift: 12:30 PM-9:30 PMNotice period: Immediate to 15 daysLead/Manager, Full Stack DevelopmentWe're looking for a highly skilled and experienced Lead/Manager, Full Stack Development to lead our engineering team. You'll be responsible for the end-to-end development of our applications, from front-end user interfaces to back-end services and data pipelines....