Data Engineer

6 days ago


Pune, Maharashtra, India Maveric Systems Limited Full time

Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka.

This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platforms

As part of the CTO Data Ingestion Service, the incumbent will be required to:

  • Building scalable, real-time systems in Kafka.
  • Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.
  • Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam.
  • Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.
  • Implementing security measures to protect Kafka clusters and data streams.
  • Monitoring Kafka performance and troubleshooting issues to ensure optimal performance.
  • Providing technical guidance and support to development operations teams.
  • Staying updated with the latest Kafka features, updates and industry practices.

Required Skills Experience

  • Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks.
  • Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.
  • Experience with cloud platform such as GCP Pub/Sub.
  • Excellent problem-solving skills.

Knowledge & Experience / Qualifications

  • Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.
  • Monitoring Kafka performance, enhancing decision making and operational efficiency
  • Collaborating with development teams to integrate Kafka applications and services.
  • Maintain an architectural library for Kafka deployment models and patterns
  • Helping developers to maintain Kafka connectors such as JDBC, MongoDB and S3 connectors, along with topics schemas, to streamline data ingestion from databases, NoSQL data stores and cloud storage, enabling faster data insight.

  • Data Engineer

    2 days ago


    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...


  • Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Software Engineer

    2 days ago


    Pune, Maharashtra, India Data Axle Full time US$ 80,000 - US$ 1,20,000 per year

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...


  • Pune, Maharashtra, India NTT DATA Full time

    Req ID 277728NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Roles ...

  • Senior QE Engineer

    3 weeks ago


    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330977NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior QE Engineer

    5 days ago


    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...


  • Pune, Maharashtra, India Hevo Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About Hevo Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Hevo powers data analytics for 2000 data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...

  • Quality Engineer

    2 days ago


    Pune, Maharashtra, India NTT DATA Full time

    Req ID 293809NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Quality Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Once You Are Here You...

  • Senior QE Engineer

    2 days ago


    Pune, Maharashtra, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...


  • Pune, Maharashtra, India Data Axle Full time

    Data Axle Inc has been an industry leader in data marketing solutions sales and research for 50 years in the US Data Axle has set up a strategic global centre of excellence in Pune This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business ...