
Kafka Data Engineer 103037
4 days ago
Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.
Job Title: Kafka Data Engineer
Location: Bangalore/Chennai India
Employment Type: Full-Time
Role Overview:
Key Responsibilities:
- Design and implement scalable and secure Kafka-based data streaming solutions.
- Develop and maintain real-time and batch data pipelines using GCP services such as Dataflow,Pub/Sub, and BigQuery.
- Collaborate with architects, data engineers, and DevOps teams to ensure seamless integration of Kafka with cloud data platforms.
- Optimize Kafka topic design, partitioning strategies, and message schemas for performance and reliability.
- Monitor and troubleshoot Kafka clusters and streaming jobs to ensure high availability and low latency.
- Implement best practices for data quality, governance, and security in streaming environments.
- Participate in code reviews, design discussions, and continuous improvement initiatives.
Required Qualifications:
- 5+ years of experience in data engineering with a focus on real-time data processing.
- Strong hands-on experience with Apache Kafka, including topic design, schema registry, and Kafka Streams.
- Proficiency in GCP services such as Pub/Sub, Dataflow, BigQuery, and Cloud Storage.
- Solid understanding of ETL/ELT processes, data modeling, and distributed systems.
- Experience with CI/CD pipelines and infrastructure-as-code tools like Terraform.
- Strong problem-solving skills and the ability to work in a collaborative, agile environment.
Preferred Qualifications:
- GCP certifications (e.g., Professional Data Engineer).
- Experience with DevOps practices and containerization (Docker, Kubernetes).
- Familiarity with multi-cloud environments and hybrid data architectures.
Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
- How we handle that information; and
- How to access and update that information.
Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.
-
Kafka Engineer
1 week ago
India Response Informatics Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title: Kafka EngineerLocation : Offshore (Remote)Experience : 4+ YearsWorking Hours : 9 hours with 2 hours overlap with US working hoursPermanent with TechMProject Context: The organization is building a Near Real-Time (NRT) data service offering from its ODP (Data Platform). This involves:NRT Outbound: Replicating source data from the ODP data hub to...
-
Kafka Data Engineer_103037
4 days ago
India Orion Systems Integrators Inc Full time ₹ 5,00,000 - ₹ 8,00,000 per yearOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...
-
Kafka Data simran remote
2 weeks ago
India Coders Brain Technology Pvt. Ltd. Full time**Company Overview**: Coders Brain Technology Pvt. Ltd. is a leading IT Services and IT Consulting company operating in India. We specialize in providing innovative solutions to our clients in various industries. Our team of talented professionals is dedicated to delivering high-quality services and ensuring customer satisfaction. **Role and...
-
Data Engineering Leader
2 days ago
India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 28,00,000Job Overview: Big Data Engineer - ScalaWe are seeking a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data...
-
Data Engineer
2 weeks ago
India R Systems Full timeJob Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)Experience- Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)- Proven experience in Python, Spark, and...
-
Data Engineer
2 weeks ago
India R Systems Full timeJob Title: Data Engineer Contract Period: 12 Months Location: Offshore candidates accepted (Singapore Based Company) Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing) Experience Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer) Proven experience in Python,...
-
Data Engineer
1 week ago
India R Systems Full timeJob Title:Data EngineerContract Period:12 MonthsLocation:Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)ExperienceMinimum4+ yearsas aData Engineeror similar role.(Please don't apply if less than 4 years exp in Data Engineer)Proven experience inPython, Spark, and...
-
Cloud Data Engineer
5 days ago
India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000We are seeking a highly skilled data engineer with strong expertise in scalable cloud-based systems.Job RequirementsCreate, optimize and maintain large-scale data pipelines and distributed data processing systems.Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi/Airflow.Work extensively with Scala, Spark (PySpark)...
-
Data Engineer
16 hours ago
India Talent Corner HR Services Pvt Ltd Full timeData Engineer is required to be proactive in designing, building and maintaining data systems. The role also requires cross-functional collaborations and ensure highest standards of data quality and performance by extending his expertise in data engineering, data architecture, pipeline creation and big data technologies. Responsibilities ●...
-
Data Engineering Lead
5 days ago
India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 12,00,000Job Title: Data Engineering LeadJob DescriptionWe are seeking an experienced Data Engineering Lead to lead our data engineering team in setting up and implementing a data lake on cloud, as well as developing standardized data models. The ideal candidate will have experience with big data technologies and be able to develop scalable data pipelines.In this...