Kafka Solutions Architect

1 day ago

Hyderabad, Telangana, India Criticalriver Technologies Full time
About CriticalRiver Technologies:
CriticalRiver Technologies is a technology consulting and IT services firm empowering its workforce to have a direct stake in the company's growth and success. We are committed to fostering a culture of innovation, growth, and collaboration where your ideas and leadership will thrive.

Job Overview:
The estimated salary for this role is $140,000 - $160,000 per year. As a highly skilled and motivated Kafka Lead, you will be responsible for designing, implementing, and maintaining distributed streaming platforms using Apache Kafka. This includes building real-time data streaming pipelines and systems, integrating Kafka with data processing and storage systems, and securing Kafka clusters using SSL/TLS encryption, Kerberos, SASL, and ACLs.

Key Responsibilities:
  • Design, implement, and maintain Kafka-based streaming architectures for real-time data processing.
  • Develop and optimize Kafka producers, consumers, and streams to handle large-scale data volumes.
  • Build highly available, fault-tolerant, and scalable Kafka systems to ensure smooth data flow.
  • Design Kafka topics, partitions, and retention policies to ensure efficient and scalable data storage.
  • Integrate Kafka with ETL pipelines, data lakes, databases, and third-party services.
  • Collaborate with data engineers and application teams to integrate Kafka with other data services, ensuring smooth data ingestion and processing.
  • Implement Kafka Connectors for various external systems like HDFS, Elasticsearch, MySQL, MongoDB, etc.
  • Ensure the implementation of security best practices for Kafka environments, including authentication, authorization, and encryption.
  • Work with Kerberos, SSL, SASL, and ACLs for securing Kafka clusters.
  • Manage and ensure data governance, ensuring compliance with regulatory standards, including data retention policies and auditing.
  • Collaborate with application developers, data engineers, and DevOps teams to ensure that Kafka solutions meet system requirements.
  • Provide technical support for Kafka-related issues and troubleshoot issues in production environments.
  • Mentor junior engineers and assist with best practices for Kafka usage and development.

Required Skills and Qualifications:
To be successful in this role, you should possess:
  • In-depth experience in setting up, managing, and optimizing Apache Kafka clusters for high throughput, fault tolerance, and scalability.
  • Strong knowledge of Kafka Streams, Kafka Connect, and Kafka Consumer APIs.
  • Expertise in building real-time data streaming pipelines and systems using Kafka.
  • Proficient in Java, Scala, or Python for building Kafka producers and consumers.
  • Experience with other messaging systems like RabbitMQ, ActiveMQ, or Kinesis is a plus.
  • Strong understanding of distributed systems, data consistency, partitioning, and replication.
  • Knowledge of integrating Kafka with data processing and storage systems (e.g., HDFS, S3, Relational Databases, NoSQL databases).
  • Proficiency in monitoring Kafka with tools such as Prometheus, Grafana, Zookeeper, and Confluent Control Center.
  • Experience with Kafka on cloud platforms such as AWS MSK, Azure Event Hubs, or Google Cloud Pub/Sub.
  • Experience in securing Kafka clusters using SSL/TLS encryption, Kerberos, SASL, and ACLs

Benefits:
As a valued member of our team, you can expect to receive a competitive salary, opportunities for career growth and professional development, and a collaborative work environment that fosters innovation and creativity.

  • Senior Kafka Architect

    1 week ago

    Hyderabad, Telangana, India CriticalRiver Inc. Full time

    Job OverviewWe are seeking a highly skilled Senior Kafka Architect to lead our cloud-native Kafka solutions team at CriticalRiver Inc.The successful candidate will have 10+ years of experience in designing and implementing scalable, high-performance Kafka Streams solutions for clients. The ideal candidate will be an expert in Java, Spring Boot, Spring, and...

  • Kafka Systems Architect

    3 weeks ago

    Hyderabad, Telangana, India ScaleneWorks Full time

    ScaleneWorks is seeking a highly skilled Kafka Systems Architect to join our team. We are looking for an expert in developing and maintaining high-performance data pipelines and streaming applications using Confluent Kafka.We are offering a competitive salary of $120,000 per year, commensurate with experience.Job Description:We are looking for a talented...

  • Kafka Systems Architect

    1 week ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    At Tata Consultancy Services, we are seeking a highly skilled Kafka Systems Architect to join our team.The ideal candidate will have a minimum of 6 to 8 years of experience in designing and developing event-based architecture based on Kafka & Kafka streams.This is an exceptional opportunity for a talented professional to lead architecture discussions and...

  • Kafka Architect for Data Streaming and Cloud Infrastructure

    3 weeks ago

    Hyderabad, Telangana, India ProArch Full time

    Company OverviewProArch is an innovative technology firm that seeks a skilled Senior Kafka Developer with AWS experience to join our team. We design, develop, and manage data streaming solutions that improve our capabilities and support our cloud infrastructure on AWS.Job DescriptionWe are looking for a talented Senior Kafka Developer to lead the development...

  • DevOps Solutions Architect

    13 hours ago

    Hyderabad, Telangana, India Visionyle Solutions Full time

    Job Title: DevOps Solutions ArchitectExperience: 6+ years in a cloud engineering, site reliability engineering (SRE), or similar role.Location: HyderabadJob Description:Built frameworks, automation, and tooling to enable quality within the organization using tools like Pro Get or JFrog Artifactory.Deployed to and orchestrated containers in production...

  • Java Integration Solutions Architect

    1 week ago

    Hyderabad, Telangana, India HyrEzy Talent Solutions Full time

    About HyrEzy Talent SolutionsWe are a new-age AI-First Digital and Cloud Engineering services company that drives Agility and Relevance for our clients' success. Our cutting-edge technology solutions enable new business models and revenue streams, helping our customers achieve their growth trajectory.Role OverviewThis role requires a highly skilled and...

  • Cloud Solutions Architect

    3 weeks ago

    Hyderabad, Telangana, India Blue Yonder Full time

    At Blue Yonder, we are seeking a highly skilled Cloud Solutions Architect to drive the design and development of our cloud-based solutions.Job OverviewWe are looking for an experienced architect with a strong background in enterprise cloud solutions, who can lead the architecture and design of scalable, resilient, and secure multi-tenant microservices...

  • Pega Solutions Architect

    4 weeks ago

    Hyderabad, Telangana, India Thryve Digital Health LLP Full time

    Job Title: Pega ArchitectAbout the Role:We are seeking a skilled Pega Architect to lead our team in designing, developing, and implementing complex Pega applications. The successful candidate will have a deep understanding of Pega technology and a proven track record of delivering high-quality solutions.Key Responsibilities:- Analyze and design complex Pega...

  • Big Data Solutions Architect

    1 day ago

    Hyderabad, Telangana, India People Tech Group Inc Full time

    Skillful Big Data Solutions Architects drive innovation and growth in our company. We seek an experienced professional to lead the design and implementation of cutting-edge data solutions.This role requires expertise in the Hadoop Ecosystem, particularly in Spark, Python, Hive, Impala, Unix, and OOPs programming languages (Scala preferred).The successful...

  • Senior Solutions Architect

    3 weeks ago

    Hyderabad, Telangana, India Thomson Reuters Full time

    At Thomson Reuters, we are seeking a highly skilled Senior Solutions Architect to join our team in Hyderabad. This role involves designing and architecting solutions to provide a secure, cost-efficient, and resilient environment for applications running in public and private Clouds.The ideal candidate will have at least 9+ years of software development...

  • Integration Solutions Architect

    13 hours ago

    Hyderabad, Telangana, India Visionyle Solutions Full time

    Job DescriptionVisionyle Solutions is seeking a highly skilled Integration Solutions Architect to join our team. As an Integration Solutions Architect, you will be responsible for designing and implementing scalable integration solutions with NetSuite ERP.About the RoleDevelop high-level flow & design documents using tools like Lucid Chart, Visio,...

  • Senior Technical Solutions Architect

    3 weeks ago

    Hyderabad, Telangana, India Blue Yonder Full time

    Job DescriptionWe are seeking a highly skilled Senior Technical Solutions Architect to join our team at Blue Yonder. This role involves leading AI-driven Global Supply Chain Solutions Software Product Company and one of Glassdoor's "Best Places to Work".About the RoleThis position requires an astute individual with a strong technical foundation and the...

  • Enterprise Solutions Architect

    2 weeks ago

    Hyderabad, Telangana, India Advance Auto Parts Full time

    Job SummaryWe are seeking a seasoned Enterprise Solutions Architect to join our team at Advance Auto Parts. As a key member of our architecture group, you will be responsible for designing and developing enterprise-scale solutions using the latest integration paradigms and API-based interactions.About YouYou have 11-15 years of technical experience in...

  • Data Engineering Solutions Architect

    4 weeks ago

    Hyderabad, Telangana, India Evernorth Health Services Full time

    **Job Title:** Data Engineering Solutions Architect**About the Role:At Evernorth Health Services, we're seeking a highly skilled Data Engineering Solutions Architect to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and implementing large-scale software applications, systems, platforms, services, or...

  • Digital Solutions Architect

    2 weeks ago

    Hyderabad, Telangana, India SID Global Solutions Full time

    At SID Global Solutions, we are seeking a highly skilled Digital Solutions Architect to join our team. As a key member of our organization, you will play a crucial role in designing and implementing cutting-edge API solutions using the Apigee platform.About UsSID Global Solutions is a premium global systems integrator and implementation partner of Google...

  • Senior Automation Developer

    2 days ago

    Hyderabad, Telangana, India Aadvi Tech Solutions Full time

    Aadvi Tech Solutions is seeking a highly skilled Senior Automation Developer to join our team. The ideal candidate will have extensive experience in automation testing, particularly with Java and Kafka.**Job Overview:**The successful candidate will be responsible for designing, developing, and maintaining comprehensive automation test suites using Java and...

  • Technical Solutions Architect

    4 weeks ago

    Hyderabad, Telangana, India CHUBB Full time

    At Chubb, we are committed to delivering exceptional services that meet our clients' needs. We strive for excellence in everything we do.The estimated salary for this position is $120,000 - $180,000 per annum, depending on location and experience.We are seeking a highly skilled Technical Solutions Architect/Senior Engineering Lead to join our team. This...

  • Senior Software Solutions Architect

    4 weeks ago

    Hyderabad, Telangana, India Evernorth Health Services Full time

    About Evernorth Health Services:We are a leading provider of pharmacy, care, and benefits solutions. Our mission is to improve health and increase vitality for millions of people.Job Overview:This role is for a Senior Software Solutions Architect with experience in designing and developing large-scale enterprise application solutions.The ideal candidate will...

  • Cloud Solutions Architect

    1 week ago

    Hyderabad, Telangana, India SID Global Solutions Full time

    Job Title: Cloud Solutions Architect  At SID Global Solutions, we are seeking a highly skilled Cloud Solutions Architect to join our team.  Salary: $120,000 - $180,000 per year, depending on experience and qualifications.About the Role  As a Cloud Solutions Architect at SID Global Solutions, you will be responsible for designing, implementing, and...

  • Enterprise Pega Solution Architect

    1 week ago

    Hyderabad, Telangana, India Thryve Digital Health LLP Full time

    About the RoleThryve Digital Health LLP is seeking an experienced Enterprise Pega Solution Architect to lead our complex application development services.Job OverviewThis role involves providing innovative solutions to meet customer requirements, adhering to Highmark IT standards and policies. You will analyze, design, code, test, and implement systematic...