Kafka Connect Data Engineer

17 hours ago

bangalore, India Philodesign Technologies Inc Full time

Job Title: Kafka Connect Data Engineer Experience: 5 Years Work Mode: Remote Budget: ₹70,000 per month About the RoleWe are looking for a highly skilled Kafka Connect Data Engineer with strong hands-on experience in data ingestion frameworks to help design and implement the Bronze Layer of our data platform. You will work closely with our Data Platform and Analytics teams to build scalable, reliable, and high-performance ingestion pipelines from diverse data sources into cloud-based storage systems. Key ResponsibilitiesDesign, develop, and maintain ingestion pipelines using Kafka Connect and Debezium for real-time and batch integrations.Build ingestion solutions from MySQL and PostgreSQL into AWS S3, Google Cloud Storage (GCS), and BigQuery.Implement best practices in data modeling, schema evolution, and partitioning for Bronze Layer architecture.Manage, monitor, and optimize Kafka Connect clusters and connectors for scalability and reliability.Collaborate with teams to analyze source systems and define downstream data needs.Optimize ingestion workflows for performance and cost efficiency.Create automation and deployment scripts using Python and cloud-native tools.Explore emerging data lake technologies like Apache Hudi and Apache Iceberg. Required Skills & QualificationsMinimum 2+ years as a Data Engineer or similar role.Strong hands-on experience with Apache Kafka and Kafka Connect (source & sink connectors).Experience with Debezium for CDC (Change Data Capture).Expertise in MySQL and PostgreSQL.Working knowledge of AWS S3, GCP BigQuery, and GCS.Proficient in Python for scripting and automation.Understanding of data lake architectures, ETL/ELT pipelines, data quality, and observability. Good to HaveExperience with Docker / Kubernetes.Familiarity with orchestration tools like Airflow or Dagster.Knowledge of IaC tools such as Terraform or CloudFormation.Exposure to Apache Hudi or Apache Iceberg (highly preferred).How to apply send your cv on priyanka.jadhav@philodesigntech.com

  • Data Engineer

    14 hours ago

    bangalore, India beBeeDataEngineer Full time

    Job SummaryWe are seeking an experienced Data Engineer (Apache Kafka) to join our team.The ideal candidate will have a strong background in designing and implementing scalable, reliable, and high-performance data ingestion pipelines using Apache Kafka and its ecosystem.Design and develop complex data pipelines that integrate with various data sources and...

  • Kafka Developer

    2 days ago

    bangalore, India Tata Consultancy Services Full time

    Experience Range : 8+ YearsResponsibilities: 8+ years of experience in the field of data streaming and transformation.Knowledge of Kafka cluster, Kafka connect, Kafka Streams, Kafka security, Schema Registry, Java/Python, Apache Flink, REST APIs, Cloud platforms (AWS, Azure, Confluent Cloud), Kubernetes, Terraform and Ansible, Prometheus & Grafana, Confluent...

  • Kafka Developer

    2 days ago

    bangalore, India Tata Consultancy Services Full time

    Experience Range : 8+ YearsResponsibilities:- 8+ years of experience in the field of data streaming and transformation.- Knowledge of Kafka cluster, Kafka connect, Kafka Streams, Kafka security, Schema Registry, Java/Python, Apache Flink, REST APIs, Cloud platforms (AWS, Azure, Confluent Cloud), Kubernetes, Terraform and Ansible, Prometheus & Grafana,...

  • Kafka Admin

    13 hours ago

    bangalore, India Apptad Full time

    Job Description:•Standing up and administer on premise Kafka cluster.•Ability to architect and create reference architecture for kafka Implementation standards• Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center.• Ensure optimum performance, high availability and stability of...

  • Kafka Admin

    2 weeks ago

    bangalore, India ALIQAN Technologies Full time

    Job OverviewALIQAN Technologies is seeking a skilled Kafka Admin for a mid-level contract position. The role is based in Bangalore, Chennai, or Pune. We are looking for candidates with 4 to 6 years of relevant work experience who can bring expertise in managing and optimizing Kafka ecosystems.Qualifications and SkillsMust have a minimum of 4 years of working...

  • Kafka DataEngineer

    2 weeks ago

    bangalore, India Virtusa Full time

    Job Description Kafka Data EngineerData Engineer to build and manage data pipelines that support batch and streaming data solutions. The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines etc.ResponsibilitiesStrong experience in...

  • Databricks + Snowflake + Kafka Consultant

    2 weeks ago

    bangalore, India Nilasu Consulting Services Full time

    DataBricks/Kafka/Snowflake- Primary Skills Work on Datalake project. Will create data pipelines and deploy in production. Work on Datalake project. Will create data pipelines and deploy in production. Technical: Databricks, ADF, Kafka and Snowflake. Github ,Airflow can be trained, snowpipe is optional . Healthcare Experience is required . • 5+ years of...

  • Kafka Developer

    1 week ago

    Bangalore Rural, Hyderabad, Pune, India SP Staffing Full time ₹ 5,00,000 - ₹ 20,00,000 per year

    Job description:Work Location: Pan IndiaExperience:3-12yrsSkills Required:Experience In Kafka DeveloperKafka connect using schema registry in a very high-volume data handling environment.Kafka brokers, zookeepers, KSQL, KStream and Kafka Control center.Json Converters, Avro Converters and String Converters.Kafka connectors such as Elastic Search connectors,...

  • Kafka Administrator

    2 weeks ago

    bangalore, India Talent Worx Full time

    Kafka AdministratorWe are looking for a skilled Kafka Administrator to join our team . In this role, you will be responsible for setting up, configuring, and managing Kafka clusters, ensuring high availability and performance of our data streaming platform. You will work closely with development and operations teams to design and implement Kafka solutions...

  • Java Kafka Developer

    6 days ago

    bangalore, India Persistent Systems Full time

    About Position: We are looking for an experienced Java Developer with strong expertise in Apache Kafka to design, build, and maintain scalable, event-driven systems. The ideal candidate will have a solid background in backend development, distributed systems, and real-time data streaming, with a passion for building high-performance, resilient...