Kafka Cluster Specialist

6 days ago

Kurnool, Andhra Pradesh, India beBeeKafkaCluster Full time ₹ 1,00,00,000 - ₹ 2,00,00,000
Kafka Cluster Specialist Job Description

Our organization seeks an experienced Kafka Cluster Specialist to join our team. In this role, you will be responsible for designing and implementing high-performance Kafka clusters that meet the needs of our business.

Responsibilities:

  • Deploy and manage production-grade Kafka clusters, ensuring high availability and fault tolerance by leveraging industry best practices.
  • Automate Kafka cluster deployment and configuration using tools such as Ansible and Chef, reducing manual effort and improving consistency.
  • Troubleshoot complex production issues, optimizing Kafka performance and minimizing downtime through thorough analysis and effective resolution strategies.
  • Configure MirrorMaker for data replication between two data centers, ensuring effective disaster recovery and minimizing data loss.
  • Deploy and manage Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management, providing valuable insights into system performance.
  • Integrate Schema Registry and deploy multiple Kafka Connectors to facilitate seamless data flow, enabling efficient data processing and analysis.
  • Onboard new users by managing ACL permissions, creating topics, and implementing end-to-end security with SSL/TLS, ensuring secure access and data protection.
  • Design and manage Kafka infrastructure to enhance message processing efficiency, optimizing system performance and scalability.
  • Conduct performance testing to optimize partitioning, replication, and retention policies, ensuring optimal system performance.
  • Integrate Kafka with ELK Stack and Solr for scalable data storage and analysis, providing valuable insights into business operations.

Requirements:

  • 3+ years of experience in designing and implementing high-performance Kafka clusters.
  • Strong knowledge of Kafka architecture, components, and configuration options.
  • Experience with automation tools such as Ansible and Chef.
  • Familiarity with containerization technologies like Docker and Kubernetes.
  • Understanding of data integration and streaming platforms like Kafka Connectors and Schema Registry.
  • Ability to troubleshoot complex production issues and provide effective solutions.
  • Excellent communication skills for collaborating with cross-functional teams.

Preferred Qualifications:

  • Bachelor's degree in Computer Science or related field.
  • Programming skills in languages like Java, Python, or Scala.
  • Knowledge of data analytics and machine learning concepts.

Location: Bangalore

  • Advanced Cloud Integration Specialist

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Advanced Cloud Integration SpecialistJob Description:We are seeking an experienced cloud integration specialist to work onsite for a leading banking client. The role involves upgrading service mesh architectures, migrating kafka clusters, and managing deployments on open-shift environments. Key responsibilities include:Upgrading service mesh from...

  • Elasticsearch Cluster Specialist

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job SummaryThis role is focused on ensuring the optimal performance of Elasticsearch and Splunk clusters. We are seeking a highly skilled individual who can develop a deep understanding of services and applications powering next-gen security products.The ideal candidate will have strong experience with Elasticsearch and Splunk cluster management, performance...

  • Regional Cluster Growth Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeClusterManager Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: Cluster Manager - Financial ServicesObjective:The purpose of this role is to manage and grow the regional cluster in the financial services sector by fostering partnerships, sourcing customers, and driving sales growth.Key Responsibilities:Enter into and manage partnerships with Vehicle Original Equipment Manufacturers (OEMs), local officials, and...

  • Chief Data Architect

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeDatabaseAdministrator Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Database Administrator (Big Data)This role oversees the planning, management, and administration of technology within a specific area. The ideal candidate will collaborate with team members to ensure that technology effectively supports enterprise systems.The successful candidate will have a strong understanding of database systems and be able to...

  • Advanced Data Architecture Specialist

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Advanced Data Architecture SpecialistOur organization is seeking a highly skilled professional to design, develop, and optimize large-scale data pipelines and distributed data processing systems.Develop advanced data architecture solutions using Scala, Spark, Python, NiFi, and Apache Kafka.Work extensively with big data technologies such as...

  • Senior Infrastructure Specialist

    5 days ago

    Kurnool, Andhra Pradesh, India beBeeInfrastructure Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Infrastructure SpecialistWe are seeking a highly skilled and experienced individual to join our team as a Senior Infrastructure Specialist.Key Responsibilities:Design, implement, and optimize cutting-edge infrastructure solutions that support critical workloads.Develop comprehensive automated testing strategies and frameworks across unit,...

  • Chief OpenStack Architect

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeInfrastructure Full time ₹ 15,00,000 - ₹ 25,00,000

    Infrastructure SpecialistWe are seeking a seasoned Infrastructure Specialist to join our team. This role requires a deep understanding of OpenStack components, networking, storage, and virtualization technologies.Key Responsibilities:Design, deploy, and maintain Ceph storage clusters, ensuring high availability and optimal performance.Manage block storage...

  • Advanced Data Pipeline Specialist

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer - Big DataWe are seeking a highly skilled data engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to fill this position.Main Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and Python for data...

  • Chief Data Infrastructure Specialist

    12 hours ago

    Kurnool, Andhra Pradesh, India beBeeEnterpriseDataArchitect Full time ₹ 48,00,000 - ₹ 72,00,000

    Job Title: Enterprise Data ArchitectA highly skilled Enterprise Data Architect is required to design and implement data architectures for cross-product reporting solutions.Key Responsibilities:Develop end-to-end data architecture for a lakehouse/warehouse, streaming + batch pipelines, semantic layer, and BI.Create a canonical insurance data model spanning...

  • Cloud Infrastructure Specialist

    12 hours ago

    Kurnool, Andhra Pradesh, India beBeeCloud Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description:As a Cloud Infrastructure Specialist, you will oversee the deployment and maintenance of scalable cloud infrastructure. You will collaborate with cross-functional teams to design and implement efficient solutions that meet business requirements.Key Responsibilities:Deploy and manage OpenStack environments using Kolla-Ansible and TripleO for...