Big Data Messaging Systems Engineer

4 days ago

Malappuram, Kerala, India beBeeAdministration Full time ₹ 10,00,000 - ₹ 17,50,000
Job Description

We are seeking an experienced Kafka Administrator to join our team.

  • Deploy and upgrade production-grade Kafka clusters, ensuring high availability and fault tolerance. This involves implementing robust infrastructure design, managing cluster resources, and troubleshooting complex issues.

  • Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef. This will enable seamless deployment and minimize manual errors.

  • Troubleshoot critical production issues, optimizing Kafka performance and minimizing downtime. This requires in-depth knowledge of Kafka internals, combined with excellent problem-solving skills.

  • Configure MirrorMaker for data replication between two data centers, ensuring effective disaster recovery. This ensures business continuity even in the face of unexpected disruptions.

  • Deploy and manage Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management. This provides valuable insights into Kafka performance and allows for proactive issue resolution.

  • Integrate Schema Registry and deploy multiple Kafka Connectors to facilitate seamless data flow. This streamlines data processing and enables efficient data exchange.

  • Onboard new users by managing ACL permissions, creating topics, and implementing end-to-end security with SSL/TLS. This ensures secure access to Kafka resources and protects sensitive data.

  • Design and manage Kafka infrastructure to enhance message processing efficiency. This involves analyzing system bottlenecks and implementing optimized solutions.

  • Conduct performance testing to optimize partitioning, replication, and retention policies. This identifies areas for improvement and ensures Kafka operates at peak efficiency.

  • Integrate Kafka with ELK Stack and Solr for scalable data storage and analysis. This enables advanced data insights and supports informed decision-making.

Required Skills and Qualifications

  • Bachelor's, Bachelor of Technology, Master of Computer Applications, or Master of Computer Science degree required.

  • 3+ years of experience in Kafka administration and related technologies.

Benefits

  • Opportunity to work with cutting-edge technologies and contribute to innovative projects.

  • Chance to develop expertise in Kafka administration and related areas.

  • Collaborative work environment with experienced professionals.

Others

Location: Bangalore

  • Big Data Solutions Architect

    3 days ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    Job OpportunityWe are seeking a highly skilled data engineering professional to join our team.The ideal candidate will have a strong background in big data technologies and experience with PySpark, Hive, Spark, HBase, DQ tool, and Agile Scrum methodologies.Key responsibilities include designing, developing, and maintaining large-scale data processing...

  • Senior Big Data Engineer

    6 days ago

    Malappuram, Kerala, India beBeeAnalyst Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data Analyst We are seeking a highly skilled Data Analyst with expertise in SQL, Python, and Java, along with exposure to Generative AI tools and techniques.Key Responsibilities:Design, develop, and optimize SQL queries for data extraction, manipulation, and reporting.Build and maintain ETL pipelines for seamless data integration across...

  • Messaging System Specialist

    4 days ago

    Malappuram, Kerala, India beBeeMqspecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled Messaging System Specialist to administer and support IBM MQ Series on the z/OS platform.This role demands deep technical expertise, problem-solving skills, and the ability to collaborate across teams to maintain mission-critical systems.The ideal candidate will ensure a secure, reliable, and high-performing messaging infrastructure...

  • Cloud Messaging Solutions Engineer

    6 days ago

    Malappuram, Kerala, India beBeeMessaging Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Cloud Messaging Solutions EngineerWe are seeking a skilled Cloud Messaging Solutions Engineer to join our team. The ideal candidate will have experience designing and developing solutions using GoAnywhere and Seeburger MFT standard FTP servers, secure FTP servers via SFTP (SSH File Transfer Protocol), SCP, AS2, and FTPS (FTP over SSL) protocols.

  • Chief Data Systems Architect

    6 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    About the RoleWe are seeking an exceptional Data Engineer to join our team. This role will be responsible for designing, building and maintaining data systems.The ideal candidate will have a strong background in data engineering, data architecture, pipeline creation and big data technologies.Design, develop and maintain scalable data pipelines for data...

  • Chief Messaging Architect

    5 days ago

    Malappuram, Kerala, India beBeeMessaging Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityThis is a full-time remote role for a Solace Messaging Engineer.The position involves:Troubleshooting messaging systems and providing technical support.Managing Microsoft Exchange infrastructure.Configuring Solace components such as brokers, VPNs, queues, topics, and client connections for optimal performance.Ensuring robust security, access...

  • Big Data Specialist

    3 days ago

    Malappuram, Kerala, India beBeeDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data SpecialistAs a key member of our team, you will play a critical role in designing and developing large-scale data pipelines to ensure data is clean, secure, and accessible for analytics and operations.Responsibilities:Design scalable data architectures using Azure Data Factory and Databricks.Collaborate with cross-functional teams to...

  • Senior Data Systems Specialist

    4 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Data ArchitectOverview:We seek a highly skilled and motivated Lead Data Architect to design, develop, and maintain large-scale data systems. This role requires strong expertise in data architecture, cloud technologies, and software engineering principles.Key Responsibilities:Design and implement robust data architectures for processing structured and...

  • Big Data Insight Professional

    2 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Transforming Data into InsightsAt the core of our mission is the art of transforming data into actionable insights. As a skilled professional in this field, you will be responsible for designing and developing scalable data pipelines to fuel business growth.We are seeking an experienced expert in Big Data technologies such as Hadoop, Spark, Hive, or similar...

  • Big Data Analytics Expert

    3 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    ETL Developer PositionRole Description:This is a full-time on-site role for an ETL Developer, based in Bengaluru for one of our esteemed overseas clients. The role involves understanding requirements, designing, developing and testing of ETL architecture, transformation jobs and workflow schedules.Key Responsibilities:Design and develop scalable ETL...