Kafka Architect

2 weeks ago

BangalorePuneKolkataChennai, India Ultrabot Innovations Full time

Job Description :

As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies.

You will work closely with our clients and internal teams to understand business requirements, design robust architectures, and implement scalable and reliable data pipelines to enable real-time data processing and analytics.

This role offers an exciting opportunity to work on cutting-edge projects and shape the future of data streaming and analytics solutions.

Key Responsibilities :

Architectural Design :


- Design and architect end-to-end data streaming solutions using Apache Kafka, Apache Spark, and other relevant technologies, considering scalability, reliability, performance, and security requirements.

Platform Setup and Configuration :


- Set up and configure Kafka clusters, Spark clusters, and Apache Servers, including installation, configuration, tuning, and optimization for optimal performance and resource utilization.

Data Ingestion and Processing :


- Implement data ingestion pipelines to capture, collect, and ingest data from various sources into Kafka topics, and design and develop Spark streaming applications for real-time data processing, transformation, and analysis.

Integration :


- Integrate Kafka and Spark with other systems and technologies in the data ecosystem, including data lakes, databases, messaging systems, and analytics platforms, to facilitate seamless data exchange and interoperability.

Monitoring and Performance Tuning :


- Implement monitoring and alerting solutions to track the health and performance of Kafka and Spark clusters, and perform performance tuning and optimization to improve throughput, latency, and reliability.

Security and Compliance :


- Implement security controls and best practices to ensure data privacy, confidentiality, and compliance with regulatory requirements, including encryption, authentication, authorization, and auditing.

Documentation and Best Practices :


- Create and maintain comprehensive documentation, architectural diagrams, and best practices for Kafka and Spark implementations, and provide guidance and training to internal teams and clients.

Technical Leadership :


- Provide technical leadership and guidance to development teams, mentor junior architects and engineers, and collaborate with cross-functional teams to drive successful project delivery.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or related field.

- 6-10 years of experience in architecting and implementing data streaming solutions using Apache Kafka, Apache Spark, and related technologies.

- Deep understanding of Kafka architecture, components, and ecosystem, including Kafka brokers, producers, consumers, topics, partitions, and replication.

- Hands-on experience with Apache Spark, including Spark Streaming, Spark SQL, and Spark MLlib, for real-time data processing, analytics, and machine learning.

- Proficiency in setting up and configuring Kafka clusters and Spark clusters, including cluster sizing, deployment, configuration management, and performance tuning.

- Experience with Apache Server setup and configuration for serving web applications and APIs.

- Strong knowledge of data integration and interoperability concepts, including data formats (Avro, Parquet, JSON), serialization (Apache Avro, Apache Thrift), and messaging protocols (Kafka protocol, RESTful APIs).

- Excellent problem-solving skills, with the ability to analyze complex technical challenges and design scalable and reliable solutions.

- Strong communication and interpersonal skills, with the ability to effectively communicate technical concepts to non-technical stakeholders and collaborate with cross-functional teams.

(ref:hirist.tech)

  • Kafka Architect

    2 weeks ago

    Bangalore/Pune/Kolkata/Chennai, IN Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka Architect

    2 months ago

    Bangalore/Pune/Kolkata/Chennai, IN Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka Architect

    2 months ago

    Bangalore, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore. Hybrid model - Working in office 3 days in a week. Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: - Design, deploy, and manage Kafka clusters in a production environment, ensuring...

  • Kafka Architect

    2 weeks ago

    Bangalore, Karnataka, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore. Hybrid model - Working in office 3 days in a week. Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: - Design, deploy, and manage Kafka clusters in a production environment, ensuring...

  • Kafka Architect

    2 months ago

    Bangalore, Karnataka, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore. Hybrid model - Working in office 3 days in a week. Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: - Design, deploy, and manage Kafka clusters in a production environment, ensuring...

  • Kafka Architect

    2 weeks ago

    Bangalore, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore. Hybrid model - Working in office 3 days in a week. Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: - Design, deploy, and manage Kafka clusters in a production environment, ensuring...

  • Java Kafka Architect

    2 months ago

    chennai, India Virtusa Full time

    Java Kafka Architect - CREQ182468 Description Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills SQL, Java, Kafka Years of Experience 12 Travel No

  • Kafka architect

    2 months ago

    bangalore, India Rakuten India Full time

    About Rakuten: Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engineering, Data Science, Machine Learning, Artificial Intelligence and much more....

  • Kafka Architect

    1 month ago

    pune, India Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka Architect

    2 months ago

    Pune, India Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka Architect

    2 weeks ago

    Pune, India Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka architect

    2 months ago

    Bangalore Urban, India Rakuten India Full time

    About Rakuten:Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engineering, Data Science, Machine Learning, Artificial Intelligence and much more. Our...

  • Kafka Developer

    3 weeks ago

    bangalore, India Horigine Consulting Pvt. Ltd Full time

    Description We are seeking a highly skilled Kafka Developer to join our team. As a Kafka Developer, you will be responsible for designing, developing, and implementing Kafka-based solutions for our organization. You will collaborate with cross-functional teams to understand business requirements, architect robust Kafka solutions, and ensure the reliable and...

  • Kafka DeveloperCBS

    2 months ago

    Pune, India Coders Brain Technology Pvt. Ltd. Full time

    Position Name : KafkaDeveloperCollaboratewith software developers architects and data engineers to designdevelop and maintain Kafkabased solutions for our microservicesecosystem.Integrate Kafka and Kafka Streamsinto our Kuberneteshosted environment on Azure ensuring seamlesscommunication and data flow amongmicroservices.Utilize your strong Java andSpring...

  • Kafka DeveloperCBS

    1 week ago

    Pune, India Coders Brain Technology Pvt. Ltd. Full time

    Position Name : KafkaDeveloperCollaboratewith software developers architects and data engineers to designdevelop and maintain Kafkabased solutions for our microservicesecosystem.Integrate Kafka and Kafka Streamsinto our Kuberneteshosted environment on Azure ensuring seamlesscommunication and data flow amongmicroservices.Utilize your strong Java andSpring...

  • Kafka Expert

    2 months ago

    Pune, Maharashtra, India growel softech Full time

    **Position : Kafka Expert Exp-4-6 yrs Budget - 7 LPA to 11 LPA (slightly negotiable) Notice : Immediate joiner or 10 Days **Location - Remote Mandatory: **Kafka, confluent Kafka, AWS, KUBERNETES, kafka architect ( **in-depth **knowledge), python ,terraform **Good communication skills Mandatory Skills**: - In Depth knowledge of Kafka architecture** - MSK,...

  • ServiceNow Kafka Architect

    2 months ago

    pune, India Jade Global Full time

    * Strong experience in different integration technologies, data streaming and messaging technologies primarily Kafka * Solid understanding of Kafka architecture and various components in kafka ecosystem such as Zookeeper, Kafka cluster, Kafka broker, producer, consumer, Connectors, KSQL, Topic, kPow etc * Excellent knowledge on deployment architecture,...

  • Servicenow Kafka Architect

    2 months ago

    Pune, India Jade Global Full time

    ID: 6572 | 8-10 yrs | Pune | careers - Strong experience in different integration technologies, data streaming and messaging technologies primarily Kafka - Solid understanding of Kafka architecture and various components in kafka ecosystem such as Zookeeper, Kafka cluster, Kafka broker, producer, consumer, Connectors, KSQL, Topic, kPow etc - Excellent...

  • Kafka DeveloperCBS

    2 months ago

    Pune, India Coders Brain Technology Pvt. Ltd. Full time

    Position Name : KafkaDeveloperCollaboratewith software developers architects and data engineers to designdevelop and maintain Kafkabased solutions for our microservicesecosystem.Integrate Kafka and Kafka Streamsinto our Kuberneteshosted environment on Azure ensuring seamlesscommunication and data flow amongmicroservices.Utilize your strong Java andSpring...

  • Java Developer

    2 months ago

    bangalore, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Summary :We are seeking a talented Java Developer with expertise in Kafka to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining high-performance, scalable Java applications with Kafka integration. This role requires strong Java programming skills, deep understanding of Kafka architecture and...