Big Data Engineer

10 hours ago


India Weekday AI Full time ₹ 6,00,000 - ₹ 19,00,000

This role is for one of the Weekday's clients

Salary range: Rs Rs ie INR 6-19 LPA)

Min Experience: 4 years

JobType: full-time

We are looking for an experienced Big Data Engineer with strong expertise in real-time streaming systems and large-scale data processing. This role focuses on building high-performance, low-latency streaming pipelines using Java and modern big data technologies. You will work on complex, scalable systems in a high-velocity engineering environment.

Key Responsibilities
  • Design, build, and optimize large-scale real-time streaming data pipelines.
  • Develop robust data ingestion and processing frameworks using Apache Spark Streaming or Hadoop streaming tools.
  • Use Java to implement performant, production-ready distributed systems.
  • Ensure low latency, high throughput, scalability, and fault tolerance across streaming workflows.
  • Collaborate with product, data, and engineering teams to integrate streaming pipelines into core platforms.
  • Diagnose, troubleshoot, and improve streaming system performance and reliability.
Required Skills & Qualifications
  • 4+ years of experience as a Big Data Engineer.
  • Strong command of real-time streaming technologies (Kafka, Spark Streaming, Flink, or similar).
  • Advanced proficiency in Java for core development.
  • Hands-on experience with Hadoop or Apache Spark (streaming use cases only).
  • Solid understanding of distributed systems and scalable architecture patterns.
  • Experience in monitoring, tuning, and debugging streaming pipelines.
  • Background working in high-scale or big-tech engineering environments.
Nice to Have
  • Experience with cloud ecosystems (AWS, GCP, or Azure).
  • Knowledge of microservices, Docker, Kubernetes, or container orchestration.
  • Familiarity with CI/CD pipelines and DevOps workflows.

  • Big Data Engineer

    3 weeks ago


    Pune, India Coforge Full time

    Job Description Coforge Ltd is Hiring for Big Data Engineer AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: [Confidential Information] For queries, contact via WhatsApp: 9667427662 Key Responsibilities:- Design, develop, and optimize Big Data...

  • Big Data Engineer

    2 weeks ago


    India Alef Education Full time

    Who we are Alef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world's most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe. Today, Alef is proudly...

  • Sr. Big Data Engineer

    2 weeks ago


    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R34As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical...

  • Big Data Developer

    3 weeks ago


    Pune, India airtel Full time

    Job Description Job Title: Big Data Developer (Manager) Location: Pune Experience: 3-5 years Job Description: Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools....


  • India Oracle Full time ₹ 25,00,000 - ₹ 40,00,000 per year

    DescriptionWe're seeking a Senior Data Integration Engineer to design, develop, and manage enterprise-grade data integration solutions. The ideal candidate will have experience with ETL/ELT processes, API-driven integrations, and enterprise data platforms, with strong technical skills and collaboration abilities.Please apply, If you have the passion and...

  • Big Data Full-time

    1 week ago


    India HyreFox Consultants Full time

    **POSITION: Big Data Engineer** **Primary skills**: Apache Hadoop, Apache Spark, Apache Kafka **Roles & Responsibilities** - Developing Hadoop systems. - Loading disparate data sets and conducting pre-processing services using Hive or Pig. - Finalizing the scope of the system and delivering Big Data solutions. - Managing the communications between the...


  • Pune, India EXL Full time

    Job Description Job Summary We are seeking an experienced GCP Data Engineer with strong expertise in designing, building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP). The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on...

  • Senior Big Data SME

    2 weeks ago


    India Information Tech Consultants Full time

    Job Title: Senior Big Data SME (Subject Matter Expert) Location: Remote Shift : UK Shift timings Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer) Employment Type: Full-Time About Us: We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part...


  • india Allstate Full time

    At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing...

  • Big Data Engineer

    7 days ago


    Bengaluru, India Adobe Full time

    Job Description Our Company Changing the world through digital experiences is what Adobe's all about. We give everyonefrom emerging artists to global brandseverything they need to design and deliver exceptional digital experiences! We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...