Kafka Streaming Developer
1 week ago
Job Title: -Kafka Streaming Developer
Location: - Kolkata
Job Type 3 days from office (Hybrid)
Minimum 4 to 6 years of experience
Job Summary:
The Kafka Streaming Developer will be responsible for designing, developing, and maintaining robust and scalable real-time data streaming pipelines using Apache Kafka and integrating them with Snowflake for data warehousing and analytics. This role requires expertise in Kafka ecosystem components, streaming data ingestion, and optimizing data flow into Snowflake.
Responsibilities:
Design, build, and maintain real-time data streaming pipelines using Apache Kafka, Kafka Connect, Kafka Streams, and ksqlDB.
Develop and implement Kafka producers and consumers for various data sources and targets.
Integrate Kafka with Snowflake using Kafka Connectors (e.g., Snowflake Sink Connector), Snowpipe Streaming, or custom solutions for efficient data ingestion.
Configure and manage Kafka clusters, topics, partitions, and security settings (SSL, SASL, RBAC).
Optimize Kafka cluster performance, ensuring high availability, scalability, and fault tolerance.
Develop and implement data transformations and processing logic within Kafka Streams or other streaming frameworks.
Design and implement scalable Snowflake data warehouse solutions, including tables, views, and materialized views, optimized for analytical queries.
Monitor and troubleshoot Kafka and Snowflake data pipelines, identifying and resolving performance bottlenecks and data discrepancies.
Collaborate with data engineers, data scientists, and software developers to understand data requirements and deliver integrated solutions.
Ensure data quality, integrity, and security across the streaming and warehousing solutions.
Document technical designs, configurations, and operational procedures.
Participate in code reviews and promote best practices in Kafka and Snowflake development.
-
Kafka Migration Developer
1 week ago
Chennai, Tamil Nadu, India IT Resonance Inc Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Summary:Kafka & Migration Developer to help with an ongoing migration from Splunk to Grafana.Strong Kafka experience - understand architectureGrafana experience - Splunk nice to have but not necessary since they are moving away from itExperience building/managing dashboardsDeployments done through terraform (more critical skillset)Hands on python &...
-
Chennai, Tamil Nadu, India UPS Full time ₹ 15,00,000 - ₹ 25,00,000 per yearBefore you apply to a job, select your language preference from the options available at the top right of this page.Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into...
-
Kafka
2 weeks ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob SummaryWe are seeking a Sr. Developer with 6 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Apache Flink Python Snowflake KSQL and Kafka. Experience in the hotel domain is a plus. This hybrid role requires a proactive individual who can contribute to innovative solutions and drive impactful results in a day...
-
Chennai, Tamil Nadu, India Photon Group Full time ₹ 6,00,000 - ₹ 18,00,000 per yearDescriptionJob descriptionThis individual will be part of the data engineering team working on the development of data pipelines, transformations of data, participation in proof of concept of new data patterns, optimization of existing data feeds and enhancements.Primary skills - RDBMS (Snowflake, Postgres), Cloud platforms and Services (AWS – IAM, EC2,...
-
Lead Engineer- Java FS with Streaming
2 days ago
Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per yearOverview We are looking for a skilled and motivated Lead Engineer to join the Cosmos.AI platform team, focusing on development of data driven AIML. You will design and build highly performant backend systems to serve features at low latency, includes feature store, streaming, vector search and graph compute platforms, ensure consistency between training...
-
java developer
1 week ago
Chennai, Tamil Nadu, India Cognizant Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Summary:We are looking for a highly skilled Java Developer with strong experience in Apache Kafka and Amazon Web Services (AWS) to join our development team. The ideal candidate will be responsible for building robust, scalable, and high-performance backend systems that handle real-time data processing and cloud-native deployments.Key...
-
Java Kafka with AWS
2 weeks ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Senior Kafka Engineer AWS MSK & ECS InfrastructureRole OverviewWe are seeking a highly skilled Kafka Engineer to lead the setup, deployment, and monitoring of Kafka components on AWS. The ideal candidate will have hands-on experience with AWS MSK, ECS, GitLab CI/CD, and observability tools like Prometheus and Grafana.Key ResponsibilitiesKafka...
-
Developer – Data Engineering
2 weeks ago
Chennai, Tamil Nadu, India GeakMinds, Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDeveloper – Data Engineering & Cloud AnalyticsRole Overview:Responsible for building, maintaining, and optimizing large-scale data pipelines and analytics solutions leveraging Snowflake, Kafka, Splunk, Airflow, AWS, Apache Iceberg, and Presto. The candidate will bring hands-on development skills and collaborate with architects, analysts, and DevOps teams...
-
Senior Python Developer
1 week ago
Chennai, Tamil Nadu, India Indium Software Full time ₹ 9,00,000 - ₹ 12,00,000 per yearRole & responsibilities:Strong in Python Developement with ETLFamiliar with REST APIs using web frameworks such as Flask or FastAPI.Must Have• Experience with distributed data stores (e.g. S3 , DynamoDb ) and relational databases (e.g., PostgreSQL, MySQL). PostgresSQL or Mysql is a must• Skilled in big data pipelines and streaming technologies such as...
-
Chennai, Tamil Nadu, India Flexilant Works Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Senior Business Analyst – Streaming Market Data PlatformLocation:ChennaiExperience Level:6 to 15 yearsDepartment:Market Data / TechnologyEmployment Type:Full-timeRole OverviewWe are building anext-generation low-latency, real-time (streaming) market data platformto support advanced trading and analytics use cases. As aSenior Business Analyst,...