Data Engineer

4 weeks ago

Pune, Maharashtra, India Maveric Systems Limited Full time
Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka.

This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platforms

As part of the CTO Data Ingestion Service, the incumbent will be required to:

- Building scalable, real-time systems in Kafka.
- Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.
- Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam.
- Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.
- Implementing security measures to protect Kafka clusters and data streams.
- Monitoring Kafka performance and troubleshooting issues to ensure optimal performance.
- Providing technical guidance and support to development operations teams.
- Staying updated with the latest Kafka features, updates and industry practices.

Required Skills Experience

- Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks.
- Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.
- Experience with cloud platform such as GCP Pub/Sub.
- Excellent problem-solving skills.

Knowledge & Experience / Qualifications

- Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.
- Monitoring Kafka performance, enhancing decision making and operational efficiency
- Collaborating with development teams to integrate Kafka applications and services.
- Maintain an architectural library for Kafka deployment models and patterns
- Helping developers to maintain Kafka connectors such as JDBC, MongoDB and S3 connectors, along with topics schemas, to streamline data ingestion from databases, NoSQL data stores and cloud storage, enabling faster data insight.

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330977NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior QE Engineer

    2 days ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior Software Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Whitehorse Manpower Full time

    Responsibilities: Design, develop, and deploy data solutions on Azure, leveraging SQL Azure, Azure Data Factory, and Databricks. Build and maintain scalable data pipelines to ingest, transform, and load data from various sources into Azure data repositories. Implement data security and compliance measures to safeguard sensitive information....

  • Mid .Net Engineer

    2 days ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:331146NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Mid .Net Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Who we are:NTT DATA America...

  • Data Engineer

    9 hours ago

    Pune, Maharashtra, India aQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable PostgreSQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Mount Talent Consulting Pvt Ltd. Full time

    We are hiring a Data Engineer for Pune/Hyderabad/Bangalore. Experience: 6+ Years Designation: Senior Software Engineer/Lead Software Engineer –Data Engineer Skill Tech stack: AWS Data Engineer, Python, PySpark, SQL, Data Pipeline, AWS, AWS Glue, Lambda JD: 6+ years of experience in data engineering, specifically in cloud environments like AWS....

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Mount Talent Consulting Pvt Ltd. Full time

    We are hiring a Data Engineer for Pune/Hyderabad/Bangalore.Experience: 6+ YearsDesignation: Senior Software Engineer/Lead Software Engineer –Data EngineerSkill Tech stack: AWS Data Engineer, Python, PySpark, SQL, Data Pipeline, AWS, AWS Glue, LambdaJD:6+ years of experience in data engineering, specifically in cloud environments like AWS.Proficiency in...