Kafka Administrator

3 weeks ago

Delhi, Delhi, India Talpro Full time

Job Description :

As a Kafka Administrator, you will play a crucial role in developing and maintaining our corporate messaging infrastructure, ensuring the smooth delivery, security, retention, and recoverability of topics and messages.

You will be responsible for designing, building, testing, and deploying high-quality messaging and streaming solutions that align with project objectives, technology architecture standards, and departmental best practices.

In addition to administering the enterprise-wide messaging architecture, you will actively manage the Kafka eco-system and implement event sourcing strategies to enhance system performance and reliability.

Requirements :

Manage Large-Scale Kafka Clusters :

- Oversee and manage multi-node Kafka cluster environments residing on AWS and on-prem OpenShift platforms.

- Lead Kafka environment builds, including design, capacity planning, cluster setup, performance tuning, and ongoing monitoring.

Operational Maintenance and Support :

- Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.

- Collaborate closely with product managers and lead engineers to ensure effective communication and alignment on project and Procedures :

- Provide guidance in the creation and modification of standards and procedures related to Kafka administration.

- Implement best practices to optimize Kafka cluster performance and ensure seamless operation.

Topic Management and Monitoring :

- Create topics and set up redundancy clusters to enhance system resilience.

- Deploy monitoring tools and alerts for proactive monitoring of the Kafka Cluster and supporting hardware, ensuring system health and maximum availability.

Technical Expertise and Production Support :

- Offer technical expertise and guidance to production support teams, facilitating issue resolution and continuous improvement.

Requirements :

- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).

- Proven experience as a Kafka Administrator or similar role with hands-on expertise in managing large-scale Kafka clusters.

- Solid understanding of messaging and streaming technologies, Kafka internals, and event sourcing strategies.

- Strong proficiency in AWS services and OpenShift platform for deploying Kafka clusters.

- Familiarity with capacity planning, performance tuning, and cluster optimization techniques.

- Excellent problem-solving skills and the ability to troubleshoot complex issues in a timely manner.

- Effective communication and collaboration skills, with the ability to work closely with cross-functional teams.

Preferred Qualifications :

- Certification in Kafka Administration or related technologies.

- Experience with other distributed data streaming platforms and messaging systems.

- Knowledge of DevOps practices and tools for automating deployment and monitoring tasks.

- Understanding of security best practices for securing Kafka clusters and data.

- Familiarity with other big data technologies and their integration with Kafka

(ref:hirist.tech)

  • Hadoop Administrator

    3 weeks ago

    Delhi, Delhi, India TechnoRight Full time

    WFH and WFOJob description :Role : Hadoop Administrator- General operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.- Very good hands on experience in managing Hadoop cluster skills like HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN,...

  • Senior Big Data Engineer

    4 weeks ago

    Delhi, Delhi, India huns info pvt ltd Full time

    Senior Data :- Skilled and experienced Sr. Data Engineer with proven experience in Spark, Kafka, Hadoop, Data Management.Skills :- Proficiency in programming languages Scala, Java, Python.- Experience with design and development of ELT workflows and data pipelines for high-volume data systems e.g. Datastage, Informatica, Talend, etc.- Experience in Data...

  • MongoDB/Kafka/Redis Database Administrator

    20 hours ago

    Delhi, Delhi, India Pioneer e Solutions Full time

    Job Description- Responsible for the management and maintenance of MySQL, Mongo, Redis, ES databases;- Design and develop database and cache system solutions and operation and maintenance management tools;- Continuously improve the database and cache system solutions to ensure the reliable and stable operation of the database.- Daily maintenance of the...

  • Net Developer

    3 weeks ago

    Delhi, Delhi, India Harpoon Technology and Consultancy Pvt Limited Full time

    - Local Mexican Candidate required- A .NET Application Developer for the PanaCIM Gen2 application is responsible for designing, developing, testing, and maintaining manufacturing automation and MES (Manufacturing Execution System) solutions using .NET technologies, specifically tailored to the PanaCIM Gen2 environment.Key Responsibilities : - Develop and...

  • High-Performance Software Developer

    4 days ago

    Kolkata, Delhi, Mumbai, India beBeeCloud Full time ₹ 8,00,000 - ₹ 20,00,000

    Software Development ProfessionalThe role requires strong technical expertise to drive business growth and innovation.Technical Requirements:Programming skills: Strong Java/J2EE Object Oriented design and development skills, experience with Spring Boot, REST Web Services, and multithreading.Database management: Proficiency in SQL, preferably with Oracle...

  • Senior Data Architect

    2 days ago

    Mumbai, Kolkata, Delhi, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Pursuing a career as a Senior Data EngineerKey ResponsibilitiesDemonstrated expertise in cloud-based data processing using Google Cloud Big Query, Snowflake, and AWSDeveloped proficiency in ETL tools such as Talend, Datastage, Informatica ISS, Data Fusion, Data Flow, and Data ProcMaintained strong knowledge of SQL and PL/SQL scripting for efficient database...

  • Senior Cloud Architect

    1 week ago

    Kolkata, Delhi, Mumbai, India beBeeCloud Full time US$ 90,000 - US$ 1,20,000

    Job OpportunityDeploy and maintain infrastructure & bottomline solutions hosted in private and public clouds.Application release management, configuration, upgrades, and support of Java microservices, open-source tools, and third-party services in a SaaS environment.Identify, diagnose, and resolve complex technology issues efficiently in live production...

  • System Infrastructure Specialist

    9 hours ago

    Mumbai, Delhi, Pune, India beBeeDevops Full time US$ 90,000 - US$ 1,20,000

    Job Title: System Infrastructure SpecialistThis is a role that will focus on ensuring the high availability of our customer-facing applications and services. You will be responsible for collaborating with a team to provision cloud resources, drive DevOps automation activities, and work closely with engineering teams to identify and resolve complex technology...

  • Chief Cloud Infrastructure Architect

    19 hours ago

    Pune, Mumbai, Delhi, India beBeeDevops Full time ₹ 9,00,000 - ₹ 12,00,000

    Job OverviewAs a DevOps Engineer, you will be responsible for deploying and maintaining infrastructure solutions hosted in the private and public cloud. You will work closely with the Engineering team to identify, diagnose, and resolve complex technology issues efficiently in live production environments.Key Responsibilities:Deploy and maintain...

  • Cloud Infrastructure Specialist

    1 week ago

    Delhi, Mumbai, Kolkata, India beBeeDevops Full time US$ 90,000 - US$ 1,20,000

    Job OpportunityThis role requires a high level of technical expertise in ensuring the uptime and availability of systems and applications in a 24x7 SaaS environment.You will be working closely with a team of development engineers to provision cloud resources, drive DevOps automation activities, and size/tune cloud resources for hosted solutions.This position...

  • Cloud Infrastructure Professional

    7 hours ago

    Mumbai, Kolkata, Delhi, India beBeeCloudEngineer Full time US$ 90,000 - US$ 1,20,000

    Job OverviewWe are seeking a highly skilled professional to join our team as a Cloud Engineer. This is a critical role that requires expertise in designing, implementing, and managing cloud infrastructure.Key Responsibilities:Deploy and maintain infrastructure & Bottomline solutions hosted in the private and public cloud.Application release management,...