Data Engineer

7 days ago

rd Floor V Complex Krishna Kamala Enclave Uttarahalli Karnataka Bengaluru India Platformatory Labs Full time ₹ 12,00,000 - ₹ 36,00,000 per year

We are seeking a talented and passionate Kafka Engineer to join our growing team in Bengaluru. This role will be crucial in designing, implementing, and maintaining our Kafka infrastructure, ensuring high availability, performance, and scalability. The ideal candidate will have a strong understanding of Kafka internals, experience with cluster management, and a proven track record of troubleshooting complex issues. Experience with Kubernetes is highly desirable.


Responsibilities:

Kafka Cluster Management:
Design, implement, and maintain highly available and scalable Kafka clusters.
Configure and optimize Kafka brokers, topics, and consumers.
Monitor cluster health, performance, and resource utilization.
Perform capacity planning


Kafka Development and Integration:
Develop and maintain Kafka producers and consumers for various applications.
Integrate Kafka with other systems and data pipelines.
Implement data serialization and schema management strategies.


Troubleshooting and Support:
Diagnose and resolve complex Kafka-related issues.
Provide timely support to development teams and other stakeholders.
Implement proactive monitoring and alerting to prevent issues.


Kubernetes (Desirable):
Deploy and manage Kafka on Kubernetes using operators like Strimzi.
Utilize Kubernetes features for scaling, monitoring, and managing Kafka deployments.
Troubleshoot Kafka deployments within a Kubernetes environment.


Required Skills and Experience:
Proven experience as a Kafka Engineer or similar role.
Strong understanding of Kafka architecture, internals, and best practices.
Experience with Kafka cluster management, monitoring, and troubleshooting.
Proficiency in Java, Scala, or Python for Kafka development.
Experience with Kafka Connect, Kafka Streams, or other Kafka ecosystem tools.
Familiarity with monitoring tools such as Prometheus, Grafana, or similar.
Strong understanding of Linux operating systems.
Excellent problem-solving and communication skills.


Preferred Skills and Experience:
Experience with Kubernetes and containerization technologies (Docker).
Experience with Kafka operators like Strimzi.
Experience with cloud platforms (AWS, Azure, GCP).
Experience with schema registry tools (e.g., Confluent Schema Registry).
Experience with CI/CD pipelines.
Knowledge of networking concepts.


  • Data Engineer

    7 days ago

    Bangalore India - South rd Floor Huron Consulting Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Huron is redefining what a global consulting organization can be. Advancing new ideas every day to build even stronger clients, individuals and communities. We're helping our clients find new ways to drive growth, enhance business performance and sustain leadership in the markets they serve. And, we're developing strategies and implementing solutions that...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Snowflake - working experience...

  • Data Engineer

    1 week ago

    India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...

  • Data Entry Operator

    1 week ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    2 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data & AI Engineer Lead

    1 week ago

    India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 344686NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & AI Engineer Lead to join our team in Remote, Karnātaka (IN-KA), India (IN). "Job Duties: Role Overview The...

  • Lead Data Engineer

    7 days ago

    India Data Science Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    MUST HAVE• Minimum of 4+ years of Azure DE experience • In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...

  • Data Engineer- ADF

    5 days ago

    India Optimum Data Analytics Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Data EngineerExperience: 6–8 yearsShift Timing: 7:00 PM to 3:00 AMResponsible for design, development, and implementation of solutions to exchange data using the required ETL tool, Azure Data Factory, Synapse and DataBricks.Experience in data cleansing and data migration using Python.At least 3+ years of hands-on experience in Azure ADF.Coding in...

  • Data Engineer

    2 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data & Ai Strategist

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 341160 We are currently seeking a Data & AI Strategist to join our team in Bangalore, Karnātaka (IN-KA), India (IN). **Location**: | **Experience**: 15+ years (5+ in AI/ML architecture) **Role Overview** **Key Responsibilities** - Architect and deliver **GenAI, LLM, and agentic AI solutions**: - Excellent understanding of Agentic...