Highly Available Kafka Architect

21 hours ago

Thoothukudi, Tamil Nadu, India beBeekafka Full time ₹ 18,00,000 - ₹ 25,00,000
Kafka Administrator Job Summary

Seeking an experienced Kafka Administrator to lead the design, implementation, and maintenance of large-scale Kafka clusters. The ideal candidate will have a deep understanding of Kafka architecture, configuration, and best practices.

Key Responsibilities:
  • Cluster Management: Design, deploy, and manage highly available, scalable, and secure Kafka clusters on-premises and in the cloud.
  • Upgrades and Patches: Perform timely upgrades and patches to ensure cluster stability and performance.
  • Security and Availability: Implement robust security measures and ensure high availability of Kafka clusters.
  • Monitoring and Performance Optimization: Monitor cluster performance, collect metrics, and optimize configurations for improved efficiency.
  • Automation and Deployment: Automate cluster installations, topic deployments, ACLs, and connectors using Ansible, Terraform, and GitOps.
Requirements:
  • Kafka Administration: Minimum 2.5 years of experience with Confluent and AWS MSK.
  • Big Data & Hadoop Ecosystem: Strong understanding of Big Data and Hadoop ecosystem, including Apache Spark.
  • Linux/Unix Systems & Windows Server: Experience with Linux/Unix systems and Windows Server.
  • Shell/Python Scripting: Proficient in Shell and Python scripting.
  • Automation Tools: Knowledge of Ansible, Terraform, and GitOps.
  • CI/CD Tools: Familiarity with GitLab and Jenkins.
  • Monitoring Tools: Experience with Prometheus, Grafana, and Dynatrace.
  • Atlassian Stack: Knowledge of JIRA, Confluence, and Bitbucket (Git).
Good to Have:
  • IBM MQ / RabbitMQ: Experience with IBM MQ or RabbitMQ.
  • Elasticsearch, Kubernetes, ServiceNow: Knowledge of Elasticsearch, Kubernetes, and ServiceNow.
  • Troubleshooting & Collaboration Skills: Strong troubleshooting and collaboration skills.

  • Kafka Cluster Engineer

    1 week ago

    Thoothukudi, Tamil Nadu, India beBeeKafka Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview">We are seeking a seasoned Kafka Administrator to join our team. As a key member of our infrastructure group, you will be responsible for designing and implementing scalable Kafka clusters that meet the needs of our rapidly growing business.">">Cluster Administration: Deploy and upgrade production-grade Kafka clusters, ensuring high availability...

  • Chief Data Architect

    1 day ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 21,60,000

    We are seeking a skilled professional to lead the development and implementation of our enterprise-grade data platforms.Key Responsibilities:Design and optimize data pipelines using AWS Glue, Airflow, Databricks, StreamSets, and Snowflake.Architect scalable cloud and big data solutions using AWS (Redshift, Lambda, S3, Athena) and leverage Spark, Kafka, Hive...

  • Highly Skilled Cloud Infrastructure Architect Wanted

    14 hours ago

    Thoothukudi, Tamil Nadu, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Infrastructure Architect LeadWe are seeking a seasoned Cloud Infrastructure Architect to drive the design, development, and implementation of scalable cloud-based solutions.About the Role:This is an exceptional opportunity to leverage your expertise in designing and deploying secure, efficient, and highly available cloud infrastructure services.The...

  • Expert Enterprise Architect

    1 day ago

    Thoothukudi, Tamil Nadu, India beBeeEnterprise Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title: Expert Enterprise ArchitectWe are seeking a seasoned Enterprise Architect with 9–10 years of hands-on experience in designing and delivering scalable enterprise solutions.The ideal candidate will be an expert in container technologies, real-time data streaming, DevOps practices, and performance optimization. You will play a key leadership role...

  • Healthcare Data Architect

    5 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Data Architect and ModelerWe seek a seasoned data architect to join our advisory team. The ideal candidate will bring deep expertise in cloud-based data engineering, healthcare data modeling, consulting, Azure, Databricks, Kafka, Snowflake, and Azure Data Factory.Design, develop, and optimize scalable data pipelines using Azure Data Factory, Databricks,...

  • Scalable Data Solutions Architect

    3 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Solutions ArchitectWe are seeking a highly skilled Data Solutions Architect to help design and implement scalable, high-performance data solutions using Databricks.Main Responsibilities:Design and develop data pipelines and ETL processes on Databricks.Lead the architecture and implementation of secure, reliable, and cost-efficient data...

  • Chief Data Architect

    1 week ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewThis role involves designing and implementing scalable data systems, ensuring high-quality data management, processing, and storage. The successful candidate will have expertise in data integration tools like Apache Spark, Kafka & Airflow.The ideal candidate should have a strong understanding of data optimization architecture,...

  • Global Systems Architect

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeInfrastructurist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned Infrastructure Architect to lead the design, optimization and automation of CAD/EDA infrastructure for global design teams.This role involves re-architecting worldwide LSF setups, implementing advanced features like fair share and preemption, and building dashboards for resource utilization and system monitoring.Key...

  • Cloud Architect Specialist

    1 day ago

    Thoothukudi, Tamil Nadu, India beBeeCloud Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Architect SpecialistDescription:We are seeking a highly skilled Cloud Architect to spearhead the design, development, and maintenance of cloud-based systems. As a key member of our team, you will be responsible for overseeing the implementation of scalable cloud architectures using AWS services.Main Responsibilities:Design and implement...

  • Data Architect

    1 week ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Role: Data ArchitectJob Summary:We are seeking an experienced and skilled Data Architect to design, develop, and maintain scalable data architectures that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, collaborating...