Kafka Data Engineer_103037

4 days ago

India Orion Systems Integrators Inc Full time ₹ 5,00,000 - ₹ 8,00,000 per year

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Job Title: Kafka Data Engineer

Location: Bangalore/Chennai India

Employment Type: Full-Time

Role Overview:

We are seeking a skilled Kafka Data Engineer to design, build, and optimize real-time data streaming solutions using Apache Kafka and Google Cloud Platform (GCP). The ideal candidate will have hands-on experience in Kafka topic design, data pipeline development, and cloud-native data engineering practices.

Key Responsibilities:

  • Design and implement scalable and secure Kafka-based data streaming solutions.
  • Develop and maintain real-time and batch data pipelines using GCP services such as Dataflow,Pub/Sub, and BigQuery.
  • Collaborate with architects, data engineers, and DevOps teams to ensure seamless integration of Kafka with cloud data platforms.
  • Optimize Kafka topic design, partitioning strategies, and message schemas for performance and reliability.
  • Monitor and troubleshoot Kafka clusters and streaming jobs to ensure high availability and low latency.
  • Implement best practices for data quality, governance, and security in streaming environments.
  • Participate in code reviews, design discussions, and continuous improvement initiatives.

Required Qualifications:

  • 5+ years of experience in data engineering with a focus on real-time data processing.
  • Strong hands-on experience with Apache Kafka, including topic design, schema registry, and Kafka Streams.
  • Proficiency in GCP services such as Pub/Sub, Dataflow, BigQuery, and Cloud Storage.
  • Solid understanding of ETL/ELT processes, data modeling, and distributed systems.
  • Experience with CI/CD pipelines and infrastructure-as-code tools like Terraform.
  • Strong problem-solving skills and the ability to work in a collaborative, agile environment.

Preferred Qualifications:

  • GCP certifications (e.g., Professional Data Engineer).
  • Experience with DevOps practices and containerization (Docker, Kubernetes).
  • Familiarity with multi-cloud environments and hybrid data architectures.

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, "Orion," "we" or "us") are committed to protecting your privacy. This Candidate Privacy Policy ) ("Notice") explains:

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.

  • Kafka Data simran remote

    2 weeks ago

    India Coders Brain Technology Pvt. Ltd. Full time

    **Company Overview**: Coders Brain Technology Pvt. Ltd. is a leading IT Services and IT Consulting company operating in India. We specialize in providing innovative solutions to our clients in various industries. Our team of talented professionals is dedicated to delivering high-quality services and ensuring customer satisfaction. **Role and...

  • Kafka Engineer

    1 week ago

    India Response Informatics Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Kafka EngineerLocation : Offshore (Remote)Experience : 4+ YearsWorking Hours : 9 hours with 2 hours overlap with US working hoursPermanent with TechMProject Context: The organization is building a Near Real-Time (NRT) data service offering from its ODP (Data Platform). This involves:NRT Outbound: Replicating source data from the ODP data hub to...

  • Kafka Data Engineer 103037

    4 days ago

    India Orion Systems Integrators, Inc. Full time

    Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • Data Architect

    1 week ago

    India Health Catalyst Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Principal Data Architect / Lead Data Platform Architect / Enterprise Data Architect / Solutions Architect – Data EngineeringAbout Company:The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving...

  • Data Engineering Leader

    2 days ago

    India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Overview: Big Data Engineer - ScalaWe are seeking a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data...

  • SAP Data Intelligence Cloud Expert

    2 weeks ago

    India Newforceltd Full time

    **SAP Data Intelligence Cloud Expert**: - 5-7 Years- Full Time Jobs- Market Rate- India**#Python** **#Kafka** **#Splunk** **#Sap_data** **- Expert-level SAP_Data Hub / Intelligence experience; designing and developing working production workflows - Streaming solutions - Expert Knowledge of all Data Intelligence tiles, concentration on Modeler,...

  • Data Bricks Devloper

    2 weeks ago

    India Ushankk Full time

    **Data bricks devloper** *** **Location**: Anywhere in India **Industry**: Information Technology **Skill**: Data brick **Experience**: 5 - 9 years Databricks DeveloperDatabricks Developer/Designer - 7+ years of overall experience with 2+ year in Azure cloud eco-system Competent Big Data Engineer, who is independent, results driven and is capable of...

  • Cloud Data Engineer

    5 days ago

    India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled data engineer with strong expertise in scalable cloud-based systems.Job RequirementsCreate, optimize and maintain large-scale data pipelines and distributed data processing systems.Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi/Airflow.Work extensively with Scala, Spark (PySpark)...

  • Data Engineer

    2 weeks ago

    India R Systems Full time

    Job Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)Experience- Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)- Proven experience in Python, Spark, and...

  • Data Systems Architect

    2 weeks ago

    India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Expert Data Developer SoughtWe are on the lookout for an experienced data developer to lead our efforts in designing and developing large-scale data processing systems. Main Responsibilities:Create scalable, high-performance data processing architectures using leading-edge technologies such as Apache Spark and Kafka.Develop and maintain efficient ETL...