Kafka Connect Data Engineer

3 weeks ago

Bengaluru, India Philodesign Technologies Inc Full time

Job Title: Kafka Connect Data EngineerExperience: 5 YearsWork Mode: RemoteBudget: ₹70,000 per monthAbout the RoleWe are looking for a highly skilled Kafka Connect Data Engineer with strong hands-on experience in data ingestion frameworks to help design and implement the Bronze Layer of our data platform.You will work closely with our Data Platform and Analytics teams to build scalable, reliable, and high-performance ingestion pipelines from diverse data sources into cloud-based storage systems.Key ResponsibilitiesDesign, develop, and maintain ingestion pipelines using Kafka Connect and Debezium for real-time and batch integrations.Build ingestion solutions from MySQL and PostgreSQL into AWS S3 , Google Cloud Storage (GCS) , and BigQuery .Implement best practices in data modeling, schema evolution, and partitioning for Bronze Layer architecture.Manage, monitor, and optimize Kafka Connect clusters and connectors for scalability and reliability.Collaborate with teams to analyze source systems and define downstream data needs.Optimize ingestion workflows for performance and cost efficiency .Create automation and deployment scripts using Python and cloud-native tools.Explore emerging data lake technologies like Apache Hudi and Apache Iceberg .✅ Required Skills & QualificationsMinimum 2+ years as a Data Engineer or similar role.Strong hands-on experience with Apache Kafka and Kafka Connect (source & sink connectors).Experience with Debezium for CDC (Change Data Capture).Expertise in MySQL and PostgreSQL .Working knowledge of AWS S3 , GCP BigQuery , and GCS .Proficient in Python for scripting and automation.Understanding of data lake architectures , ETL/ELT pipelines, data quality, and observability.✨ Good to HaveExperience with Docker / Kubernetes .Familiarity with orchestration tools like Airflow or Dagster .Knowledge of IaC tools such as Terraform or CloudFormation.Exposure to Apache Hudi or Apache Iceberg (highly preferred).How to apply send your cv on

  • Kafka Administrator

    3 weeks ago

    Bengaluru, India Human Horizon Full time

    Description :Responsibilities :- Design, build, and manage Kafka clusters using the Confluent Platform for enterprise-grade data streaming solutions.- Implement Kafka Connect, Kafka Streams, and ksqlDB to develop and manage real-time data pipelines and stream processing applications.- Monitor, maintain, and optimize Kafka cluster performance, ensuring high...

  • Kafka Architect

    6 days ago

    Bengaluru, Karnataka, India Ascent Solutions Full time

    **Job Title**: Kafka Architect **Location**: Bangalore, India (On-site/Hybrid as per project requirement) **Job Summary**: **Key Responsibilities**: - Architect and design enterprise-level **Kafka-based data streaming platforms**. - Define best practices for **Kafka cluster setup, scaling, monitoring, and security**. - Collaborate with development and data...

  • Kafka

    1 week ago

    Bengaluru, India Quess IT Staffing Full time

    **About Us** “Magna Infotech, now Quess IT Staffing, is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions...

  • Kafka Developer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Experience Range : 8+ YearsResponsibilities:8+ years of experience in the field of data streaming and transformation.Knowledge of Kafka cluster, Kafka connect, Kafka Streams, Kafka security, Schema Registry, Java/Python, Apache Flink, REST APIs, Cloud platforms (AWS, Azure, Confluent Cloud), Kubernetes, Terraform and Ansible, Prometheus & Grafana, Confluent...

  • Kafka Developer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Experience Range : 8+ YearsResponsibilities: 8+ years of experience in the field of data streaming and transformation.Knowledge of Kafka cluster, Kafka connect, Kafka Streams, Kafka security, Schema Registry, Java/Python, Apache Flink, REST APIs, Cloud platforms (AWS, Azure, Confluent Cloud), Kubernetes, Terraform and Ansible, Prometheus & Grafana, Confluent...

  • Kafka Developer

    7 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Experience Range : 8+ Years Responsibilities: 8+ years of experience in the field of data streaming and transformation. Knowledge of Kafka cluster, Kafka connect, Kafka Streams, Kafka security, Schema Registry, Java/Python, Apache Flink, REST APIs, Cloud platforms (AWS, Azure, Confluent Cloud), Kubernetes, Terraform and Ansible, Prometheus & Grafana,...

  • Technical Lead

    3 weeks ago

    Bengaluru, India Bajaj Technology Services Full time

    Experience : 7+ Yrs Responsibilities :Development and Maintenance of a large scale KAFKA based real time Digital platformPerforming RCA and driving short term and long term fixingWorking with Customer Technology Architects to implement long term solutions for critical issuesProvide technical leadership to engineer teamsCore Skills:Strong experience in design...

  • Kafka Developer

    1 week ago

    Bengaluru, Karnataka, India Digital Business People Full time US$ 5,00,000 - US$ 10,00,000 per year

    Key ResponsibilitiesPlatform AdministrationInstall, configure, and manage Confluent Kafka clusters (on-premises and/or cloud environments such as Confluent Cloud or Kubernetes).Manage Kafka brokers, ZooKeeper, Schema Registry, Kafka Connect, ksqlDB, Control Center, and REST Proxy.Implement and enhance monitoring, alerting, and logging for Kafka components...

  • Data Engineer

    7 days ago

    Bengaluru, India Job Connect India Full time

    Data Engineer Job Title: Data EngineerLocation: BangaloreExperience: 5+ yearsEmployment Type: Full-timeJob Summary: We are looking for a Data Engineer with 5+ years of experience to design, develop, and optimize data pipelines and infrastructure. The ideal candidate will have strong expertise in Big Data technologies, ETL processes, and cloud platforms . You...

  • Technical Lead

    4 weeks ago

    Bengaluru, India Bajaj Technology Services Full time

    Experience : 7+ Yrs Responsibilities : Development and Maintenance of a large scale KAFKA based real time Digital platform Performing RCA and driving short term and long term fixing Working with Customer Technology Architects to implement long term solutions for critical issues Provide technical leadership to engineer teams Core Skills: Strong experience in...