Highly Available Kafka Cluster Specialist

7 days ago

Alleppey, Kerala, India beBeeSystem Full time ₹ 15,00,000 - ₹ 20,00,000

Kafka System Architect

As a Kafka System Architect, you will be responsible for designing and implementing highly available and scalable Kafka clusters. Your primary focus will be on deploying production-grade Kafka environments using tools such as Ansible and Chef.

Main Responsibilities:

  • Cluster Design and Implementation: Collaborate with cross-functional teams to design and implement efficient Kafka cluster architectures that meet business requirements.
  • Deployment and Management: Deploy and manage production-grade Kafka clusters, ensuring high availability, fault tolerance, and optimal performance.
  • Troubleshooting and Optimization: Troubleshoot critical production issues and optimize Kafka performance by analyzing system logs, configuring settings, and applying patches.
  • Data Replication and Integration: Configure MirrorMaker for data replication between two data centers, ensuring effective disaster recovery and seamless data flow across different systems.
  • Monitoring and Security: Deploy Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management, and implement end-to-end security using SSL/TLS.
  • User Onboarding and Support: Onboard new users by managing ACL permissions, creating topics, and providing technical support for Kafka-related issues.
  • Performance Testing and Analysis: Conduct performance testing to optimize partitioning, replication, and retention policies, and analyze system metrics to identify areas for improvement.
  • Infrastructure Development: Develop and maintain Kafka infrastructure to enhance message processing efficiency and scalability.

Required Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or related field, along with 3+ years of experience in designing and implementing Kafka systems.

Necessary Skills:

Kafka clusters, MirrorMaker, Kafka Streams, Schema Registry, Kubernetes, Docker, Ansible, Terraform, Monitoring & Logging, Programming & Scripting, Shell Scripting.

Bonus Points:

Experience with ELK Stack and Solr for scalable data storage and analysis, knowledge of Linux/Unix systems, and proficiency in programming languages such as Java, Python, or Scala.

  • Highly Skilled Distributed Systems Engineer

    3 hours ago

    Alleppey, Kerala, India beBeeKafka Full time ₹ 20,00,000 - ₹ 25,00,000

    Kafka Administrator Job DescriptionWe are seeking a skilled Kafka Administrator to join our team. As a key member of our technical staff, you will be responsible for designing, implementing, and maintaining large-scale Kafka clusters.Job Responsibilities:Cluster Administration: Install, configure, and manage large-scale Kafka clusters on-prem and in the...

  • Kafka Migration Specialist

    14 hours ago

    Alleppey, Kerala, India beBeeMigration Full time ₹ 10,00,000 - ₹ 15,00,000

    Key Responsibilities- Design, develop, and deploy automated migration pipelines for transitioning enterprise Kafka workloads to open-source or cloud-native clusters.- Implement script-driven migration steps, automate validation, rollback, and monitoring tasks using continuous integration/continuous deployment tools like Jenkins and GitHub Actions.- Develop...

  • Kafka System Architect

    3 days ago

    Alleppey, Kerala, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Kafka EngineerWe are seeking an experienced engineer to work on a project involving Kafka architecture. The role involves upgrading the Service Mesh, migrating clusters, and ensuring secure integration in a restricted environment.

  • Hadoop Cluster Expert

    6 days ago

    Alleppey, Kerala, India beBeeHadoop Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Hadoop Cluster SpecialistThe role of a Hadoop Cluster Specialist involves overseeing and maintaining Hadoop environments, ensuring optimal performance, scalability, and security.Designing and configuring Hadoop clusters for maximum efficiencyMigrating data between different systems and formats to optimize cluster performancePerforming in-depth...

  • Highly Skilled Linux Administrator Wanted

    7 days ago

    Alleppey, Kerala, India beBeeInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAs a seasoned Linux administrator, you will be responsible for managing and maintaining Red Hat OpenShift clusters. Your expertise in cluster management, support and troubleshooting, performance optimization, security compliance, automation scripting, and documentation will ensure the smooth operation of our OCP environments.Key...

  • Highly Skilled Database Expert Wanted

    7 days ago

    Alleppey, Kerala, India beBeeDatabaseAdministrator Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Database Administrator PositionThe Senior Database Administrator plays a pivotal role in ensuring the efficient operation and management of our organization's database systems.Key Responsibilities:Analyze existing database systems to identify areas for improvement and recommend optimal solutions.Collaborate with IT Manager to develop and implement...

  • Database Architect Position

    16 hours ago

    Alleppey, Kerala, India beBeeDatabase Full time ₹ 10,00,000 - ₹ 25,00,000

    Job Opening for Database Specialist We are seeking a skilled Database Specialist to join our team. As a key member, you will be responsible for designing, implementing, and maintaining large-scale databases. Your expertise in SQL and noSQL landscape, as well as your experience with database clusters, will be essential in ensuring the performance and...

  • Highly Skilled ETL Specialist

    1 week ago

    Alleppey, Kerala, India beBeeTalented Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title: Talend ETL DeveloperWe are seeking a highly skilled professional to fill the role of a Talend ETL Developer. As a key member of our team, you will be responsible for designing and optimizing complex ETL pipelines using Talend Open Studio.Key Responsibilities:Design and implement efficient ETL pipelines using Talend Open StudioDevelop and deploy...

  • Highly Skilled Power Platform Developer Position Available

    6 hours ago

    Alleppey, Kerala, India beBeePower Full time ₹ 20,00,000 - ₹ 40,00,000

    Senior Power Platform Specialist Job DescriptionThe role of a Senior Power Platform Specialist is multifaceted and demands expertise in designing, developing, and implementing solutions using Microsoft Power Platform. This position requires strong leadership skills to lead the design and development process, as well as collaboration with business...

  • Highly Available System Developer

    14 hours ago

    Alleppey, Kerala, India beBeeEngineering Full time US$ 1,75,000 - US$ 2,25,000

    **Reliability Engineering Role** Site reliability engineering is a blend of development and operations knowledge that helps make organizations better. If you have experience in improving the reliability of your services or products by adding observability, your skillset can benefit from this role. We are looking for passionate individuals who love...