Kafka Streaming Developer

7 days ago


Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 6,00,000 - ₹ 12,00,000 per year

Job Title: -Kafka Streaming Developer

Location: - Kolkata

Job Type 3 days from office (Hybrid)

Minimum 4 to 6 years of experience

Job Summary:

The Kafka Streaming Developer will be responsible for designing, developing, and maintaining robust and scalable real-time data streaming pipelines using Apache Kafka and integrating them with Snowflake for data warehousing and analytics. This role requires expertise in Kafka ecosystem components, streaming data ingestion, and optimizing data flow into Snowflake.

Responsibilities:

Design, build, and maintain real-time data streaming pipelines using Apache Kafka, Kafka Connect, Kafka Streams, and ksqlDB.

Develop and implement Kafka producers and consumers for various data sources and targets.

Integrate Kafka with Snowflake using Kafka Connectors (e.g., Snowflake Sink Connector), Snowpipe Streaming, or custom solutions for efficient data ingestion.

Configure and manage Kafka clusters, topics, partitions, and security settings (SSL, SASL, RBAC).

Optimize Kafka cluster performance, ensuring high availability, scalability, and fault tolerance.

Develop and implement data transformations and processing logic within Kafka Streams or other streaming frameworks.

Design and implement scalable Snowflake data warehouse solutions, including tables, views, and materialized views, optimized for analytical queries.

Monitor and troubleshoot Kafka and Snowflake data pipelines, identifying and resolving performance bottlenecks and data discrepancies.

Collaborate with data engineers, data scientists, and software developers to understand data requirements and deliver integrated solutions.

Ensure data quality, integrity, and security across the streaming and warehousing solutions.

Document technical designs, configurations, and operational procedures.

Participate in code reviews and promote best practices in Kafka and Snowflake development.



  • Chennai, Tamil Nadu, India IT Resonance Inc Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Summary:Kafka & Migration Developer to help with an ongoing migration from Splunk to Grafana.Strong Kafka experience - understand architectureGrafana experience - Splunk nice to have but not necessary since they are moving away from itExperience building/managing dashboardsDeployments done through terraform (more critical skillset)Hands on python &...

  • Freelance Kafka

    19 hours ago


    Chennai, Tamil Nadu, India ThreatXIntel Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionThreatXIntel is a startup cybersecurity company dedicated to protecting businesses and organizations from cyber threats. Our team offers a range of services, including cloud security, web and mobile security testing, and DevSecOps. We deliver customized, affordable solutions to meet the specific needs of our clients, ensuring that every...

  • Tibco Streaming Lead

    17 hours ago


    Chennai, Tamil Nadu, India HIKING IT Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : - Design, develop, and deploy complex event processing (CEP) and real-time streaming analytics solutions using TIBCO Streaming (StreamBase, LiveView). - Integrate and visualize real-time data using TIBCO Spotfire, including live dashboards and interactive reporting. - Architect scalable, end-to-end streaming data pipelines, from...

  • Kafka

    1 week ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a Sr. Developer with 6 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Apache Flink Python Snowflake KSQL and Kafka. Experience in the hotel domain is a plus. This hybrid role requires a proactive individual who can contribute to innovative solutions and drive impactful results in a day...


  • Chennai, Tamil Nadu, India Photon Group Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    DescriptionJob descriptionThis individual will be part of the data engineering team working on the development of data pipelines, transformations of data, participation in proof of concept of new data patterns, optimization of existing data feeds and enhancements.Primary skills - RDBMS (Snowflake, Postgres), Cloud platforms and Services (AWS – IAM, EC2,...


  • Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Overview We are looking for a skilled and motivated Lead Engineer to join the Cosmos.AI platform team, focusing on development of data driven AIML. You will design and build highly performant backend systems to serve features at low latency, includes feature store, streaming, vector search and graph compute platforms, ensure consistency between training...

  • java developer

    1 week ago


    Chennai, Tamil Nadu, India Cognizant Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:We are looking for a highly skilled Java Developer with strong experience in Apache Kafka and Amazon Web Services (AWS) to join our development team. The ideal candidate will be responsible for building robust, scalable, and high-performance backend systems that handle real-time data processing and cloud-native deployments.Key...


  • Chennai, Tamil Nadu, India GeakMinds, Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Developer – Data Engineering & Cloud AnalyticsRole Overview:Responsible for building, maintaining, and optimizing large-scale data pipelines and analytics solutions leveraging Snowflake, Kafka, Splunk, Airflow, AWS, Apache Iceberg, and Presto. The candidate will bring hands-on development skills and collaborate with architects, analysts, and DevOps teams...


  • Chennai, Tamil Nadu, India Indium Software Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role & responsibilities:Strong in Python Developement with ETLFamiliar with REST APIs using web frameworks such as Flask or FastAPI.Must Have• Experience with distributed data stores (e.g. S3 , DynamoDb ) and relational databases (e.g., PostgreSQL, MySQL). PostgresSQL or Mysql is a must• Skilled in big data pipelines and streaming technologies such as...


  • Chennai, Tamil Nadu, India Geakminds Technologies Private Limited Full time ₹ 50,00,000 - ₹ 65,00,000 per year

    Developer - Data Engineering & Cloud Analytics. Role Overview : Responsible for building, maintaining, and optimizing large-scale data pipelines and analytics solutions leveraging Snowflake, Kafka, Splunk, Airflow, AWS, Apache Iceberg, and Presto. The candidate will bring hands-on development skills and collaborate with architects, analysts, and...