Big Data Engineer

4 weeks ago


Pushkar, Rajasthan, India Idyllic Services Full time

Job Title: Big Data Engineer – Scala

Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

Experience: 7–10 Years (Minimum 3+ years in Scala)

Notice Period: Immediate to 30 Days

Mode of Work: Hybrid

Role Overview

We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities

- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.

- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.

- Collaborate with cross-functional teams to design scalable cloud-based data architectures.

- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.

- Build monitoring and alerting systems leveraging Splunk or equivalent tools.

- Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

- Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills

- Scala – Minimum 3+ years of hands-on experience.

- Strong expertise in Spark (PySpark) and Python.

- Hands-on experience with Apache Kafka.

- Knowledge of NiFi / Airflow for orchestration.

- Strong experience in Distributed Data Systems (5+ years).

- Proficiency in SQL and query optimization.

- Good understanding of Cloud Architecture.

Preferred Skills

- Exposure to messaging technologies like Apache Kafka or equivalent.

- Experience in designing intuitive, responsive UIs for data analytics visualization.

- Familiarity with Splunk or other monitoring/alerting solutions.

- Hands-on experience with CI/CD tools (Git, Jenkins).

- Strong grasp of software engineering concepts, data modeling, and optimization techniques.



  • Pushkar, Rajasthan, India YASH Technologies Full time

    Job Overview: We are looking for a AI/ML Developer to join our team of researchers, data scientists, and developers. You will work on cutting-edge AI solutions across industries such as commerce, agriculture, insurance, financial markets, and procurement. Your role involves developing and optimizing machine learning and generative AI models to solve...


  • Pushkar, Rajasthan, India Seventh Contact Hiring Solutions Full time

    The Position:-We are seeking a highly skilled Data Scientist to lead the development and optimization of our Forecasting and Measurement & Verification (M&V) platform.This platform supports forecasting and M&V for approximately 3 million distributed energy devices at once.As a senior member of the Forecasting team, you will collaborate closely with data...


  • Pushkar, Rajasthan, India Morphedo Technologies Pvt Ltd Full time

    Embedded Firmware EngineerAbout the RoleAt Morphedo, Embedded System Engineers are not just coders, they are system architects ensuring our devices survive critical missions, from ICU wards to defence outposts. You will design firmware that must perform in unpredictable, unforgiving environments. Alongside firmware, you will collaborate closely with hardware...

  • Language specialist

    4 weeks ago


    Pushkar, Rajasthan, India People Prime Worldwide Full time

    About CompanyOur client is a Palo Alto–based AI infrastructure and talent platform founded in 2018. It helps companies connect with remote software developers using AI-powered vetting and matching technology. Originally branded as the "Intelligent Talent Cloud," They enabled companies to "spin up their engineering dream team in the cloud" by sourcing and...


  • Pushkar, Rajasthan, India Mulya Technologies Full time

    Processor Architecture and Logic design LeadFortune 100 OrganizationLocation: BangaloreAs a Hardware at , you'll get to work on the systems that are driving the quantum revolution and the AI era. Join an elite team of engineering professionals who enable customers to make better decisions quicker on the most trusted hardware platform in today's market.Your...


  • Pushkar, Rajasthan, India Marriott International Full time

    Additional Information Job Number25114661 Job CategoryProperty Leadership LocationThe Westin Pushkar Resort Spa Khasra No 1242 1243 1196 1726 Pushkar Rajasthan India 305022 ScheduleFull Time Located RemotelyN Position Type Management JOB SUMMARY Functions as the primary strategic business leader of...


  • Pushkar, India Pando Data Full time

    Sensor & Machine Vision EngineerAt Pando Data, we’re on a mission to bring Industry 4.0 to life in factories that need it most. We design smart, affordable AI + sensor systems that actually work on the shop floor - from measuring steel bars flying out of a rolling mill, to spotting defects in plastic pipes, to preventing theft in dispatch yards.We’re a...

  • Data Engineer

    1 week ago


    Pushkar, India Vriba Solutions Full time

    Role: Data Engineering Remote Looking for 5-10 years of Exp• Design, develop & maintain ETL/ELT pipelines• Ingest & transform data from APIs, DBs, files, streams• Build real-time & batch processing solutions• Data validation, quality & cleansing• Translate business needs into data models• Ensure data security, access control & compliance•...

  • Junior AI

    3 weeks ago


    Pushkar, India Omni Reach Full time

    Job DescriptionThis is a remote position.Role OverviewWe are hiring smart, analytical freshers and early-career engineers passionate about data, mathematics, problem-solving, and building systems. This is a developmental role aimed at nurturing strong fundamentals in Data Science, Machine Learning, and Data Engineering over time. You will work on real-world...


  • Pushkar, India Digitrix Software LLP Full time

    Experience: 5 to 8 yearsJob description: Python API + Data EngineerWe are looking for a self-motivated Python Data Engineer with strong skills in backend/API development and large-scale data processing, who can work independently and thrive in a fast-paced, agile environment.Key ResponsibilitiesDesign, develop, and optimize data pipelines using PySpark, AWS...

  • Engineering Manager

    4 weeks ago


    Pushkar, India Pine Labs Full time

    Role Purpose:We are looking for proactive engineering managers with 10+ years of engineering experience and proven leadership skills. Engineering managers are expected to work on many projects at the same time, build and manage diverse teams of engineers from different disciplines, formulate and execute strategies, and coordinate with other managers. The...


  • Pushkar, India Green HR Solutions Full time

    Hiring for USA based big MNC, pls apply if following Job Description suits your aspirations.We are seeking a skilled and detail-oriented Physical Design Engineer to contribute to the development of high-performance digital integrated circuits (ICs). In this role, you will be responsible for the physical implementation of digital logic, from RTL to GDSII,...


  • Pushkar, India Artificial Intelligence Global Company Full time

    We are currently hiring candidates located in or willing to work from Manyata Tech Park, Bangalore.Atleast 7+ Years of experience in IoT(Complete ecosystem) is preferred.  Hands on and project experience in industrial applications using IoT and AI based video surviellance technology stack and its ecosystem.Experience in industry leading IoT platforms like...


  • Pushkar, India Recro Full time

    📍 Remote (India) | 💼 Full-time | 🎯 4–8 Years Experience🚀 About UsWe are a fast-growing AI startup on a mission to build the world’s first AI-powered finance team. Our AI agents close books, reconcile cash, forecast revenue, and prepare board decks—instantly, accurately, and auditable in real-time.Backed by $8.5M seed funding from Foundation...

  • IT Engineer

    4 weeks ago


    Pushkar, India Shyld AI Full time

    About Shyld AIShyld AI is building the first generation of Physical AI Agents to automate infection prevention and operational intelligence in hospitals and controlled environments. Our flagship wall-mounted UV-C disinfection system leverages AI, robotics, and multi-modal sensing to keep healthcare environments safe and efficient. Shyld AI partners with...


  • Pushkar, India Havas Life Mumbai Full time

    Job SummaryWe are seeking a highly skilled and detail-oriented finance professional to work closely with senior management in shaping the organization's financial strategy. The ideal candidate should be confident in handling large volumes of data, providing actionable insights, and supporting decision-making through accurate and timely financial...