Senior Real-Time Data Engineer for Big Data Environments

2 weeks ago


Gurgaon, Haryana, India AIDA projektai, MB Full time
Job Description:

We are seeking a highly skilled Senior Real-Time Data Engineer to join our team at AIDA projektai, MB. This role is ideal for someone with strong expertise in working with big data and hands-on experience in managing and deploying real-time data streaming pipelines.

Key Responsibilities:
  • Design, implement, and manage real-time data streaming pipelines using Spark and Spark Streaming.
  • Build and maintain CI/CD pipelines for deploying ML models in live frameworks.
  • Collaborate with data scientists and software engineers to ensure smooth deployment of ML models.
  • Work with Kubernetes and Docker to manage containerized ML applications.
  • Ensure high availability and scalability of data infrastructure.
  • Be available for 24/7 on-call support to troubleshoot and resolve critical issues.
  • Handle and process large volumes of data, ensuring efficient data workflows.
  • Implement and optimize the full ML lifecycle from data ingestion to model monitoring.
Must-Have Skills:
  • Proficiency with Spark and Spark Streaming.
  • In-depth knowledge of the ML lifecycle and experience deploying models in production environments.
  • Experience with CI/CD pipelines for machine learning.
  • Hands-on experience with Kubernetes and Docker for container orchestration and deployment.
  • Strong experience with Python and working with real-time streaming pipelines.
  • Expertise in working with big data and processing large-scale datasets.
Nice-to-Have Skills:
  • Experience with Scala.
  • Experience with managing large, distributed systems and infrastructure.
On-Call Requirement:
  • Must be available for 24/7 on-call support to manage and resolve production issues as they arise.
Qualifications:
  • Proven hands-on experience in big data environments.
  • 3+ years of relevant experience in machine learning, data engineering, and real-time data processing.
  • Ability to work in high-pressure environments with tight deadlines.

Estimated Salary: ₹15,00,000 - ₹25,00,000 per annum based on experience and qualifications.
The salary will be competitive and commensurate with the candidate's skills and experience.



  • Gurgaon, Haryana, India Real Time Data Services Full time

    Are you looking for a challenging and rewarding career in sales? Do you have a passion for building relationships with customers and driving business growth?About the RoleWe are seeking a highly motivated Business Development Representative to join our team at Real Time Data Services. As a BDR, you will be responsible for generating new leads, qualifying...


  • Gurgaon, Haryana, India AIDA projektai, MB Full time

    AIDA projektai, MB is seeking a highly skilled Senior DevOps Engineer to join our dynamic team. This role is ideal for someone with strong expertise in working with big data and hands-on experience in managing and deploying machine learning models in real-time environments.Job Description:We are looking for a talented professional who can design, implement,...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    We are seeking a skilled Marketing Operations Specialist to lead our marketing automation efforts and drive data-driven insights at Real Time Data Services.Job SummaryThis is an exciting opportunity to leverage your expertise in marketing automation, CRM systems, and data analysis to optimize our marketing performance. You will be responsible for integrating...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    Job DescriptionWe are seeking a skilled Technical Support Specialist to join our team at Real Time Data Services. As a key member of our support team, you will be responsible for providing technical assistance to our global clients.Key ResponsibilitiesTechnical Support and Troubleshooting: Provide prompt and efficient technical support to our clients,...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    Job SummaryWe are seeking a highly skilled Senior Business Intelligence Analyst to join our team at Real Time Data Services. As a key member of our marketing department, you will be responsible for delivering actionable insights and data-driven recommendations to drive business growth.About the Role:Coordinate with the Business Intelligence team to create...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    We are seeking an experienced Software Development Engineer to join our team at Real Time Data Services.About the Role:As a key member of our software engineering team, you will be responsible for designing and developing high-performance, secure RESTful APIs and web services using NodeJs, React.js, and Typescript. You will also work closely with our...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    About Real Time Data ServicesWe are a leading provider of real-time data services, dedicated to delivering high-quality solutions that meet the evolving needs of our clients.Salary Range$120,000 - $180,000 per year, depending on experience and qualifications.Job DescriptionWe are seeking an experienced Software Development Engineer II to join our team. As a...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    Job OverviewWe are seeking a skilled Senior Content Writer to join our team at Real Time Data Services.


  • Gurgaon, Haryana, India Real Time Data Services Full time

    About Real Time Data ServicesReal Time Data Services is a cutting-edge technology company dedicated to delivering innovative solutions for the modern world. Our team of experts works tirelessly to create high-quality products that exceed our clients' expectations.


  • Gurgaon, Haryana, India Real Time Data Services Full time

    About the RoleWe are seeking a highly skilled Senior Corporate Events Coordinator to join our team at Real Time Data Services. This is an excellent opportunity for an experienced event professional to utilize their skills and expertise in managing corporate driven live, virtual, and hybrid events.Key Responsibilities:Coordinate event logistics for smaller...


  • Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...


  • Gurgaon, Haryana, India AIDA projektai, MB Full time

    Job Type: Full-TimeWork Arrangement: HybridOnboarding: 1 month in the officeAfter Onboarding: 50% office visits per monthUrgency: Super UrgentLocation: GurgaonAbout This Role:We are seeking a highly skilled data engineer to join our team. The ideal candidate will have strong expertise in working with big data and hands-on experience in managing and deploying...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    Acefone is seeking a talented Engineering Manager to lead our dynamic engineering team. As an Engineering Manager, you will grow our engineering team and help our customers build better connections by building the next generation of real-time communication products. You will collaborate with the Product and Customer Support teams while expanding your team's...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    System Administrator Job DescriptionWe are seeking a highly skilled System Administrator to join our team at Real Time Data Services. In this role, you will be responsible for designing, organizing, and modifying the company's computer systems.Key Responsibilities:Manage, configure, and maintain physical and virtual servers.Monitor server performance,...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    Job Role: Software Development Engineer II at Real Time Data ServicesKey Responsibilities:Develop high-performance and secure RESTful APIs and web services using NodeJs, React.js, and Typescript.Implement software best practices and champion architecture patterns such as Microservices and Event-Driven Architecture.Design and develop robust databases using...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....

  • Data Architect

    3 days ago


    Gurgaon, Haryana, India Impetus Full time

    Job SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    About Us:At Real Time Data Services, we are passionate about delivering high-quality solutions that meet the evolving needs of our clients. As a company, we value innovation, collaboration, and continuous improvement.The Role:We are seeking an experienced Technical Lead Software Developer to join our team. This role will lead the development of our software...


  • Gurgaon, Haryana, India Real Time Data Services Full time

    Job Description:We are seeking a skilled Database Administrator to manage, maintain and optimize our database systems. The ideal candidate should have strong expertise in MySQL and MongoDB ensuring high performance, availability and security of our databases.About the Role:This is an exciting opportunity for a talented individual to join Real Time Data...

  • Technical Lead

    2 weeks ago


    Gurgaon, Haryana, India Real Time Data Services Full time

    Job DescriptionWe are seeking an experienced Technical Lead - Software Architect to join our team at Real Time Data Services.About the RoleThis is a key leadership position responsible for designing, developing, and implementing software systems that meet our high standards of quality and performance. As a Technical Lead, you will lead cross-functional teams...