Big Data Engineer

23 hours ago

India Weekday AI Full time ₹ 7,20,000 - ₹ 19,00,000 per year

This role is for one of the Weekday's clients

Salary range: Rs Rs ie INR 6-19 LPA)

Min Experience: 4 years

JobType: full-time

We are looking for an experienced Big Data Engineer with strong expertise in real-time streaming systems and large-scale data processing. This role focuses on building high-performance, low-latency streaming pipelines using Java and modern big data technologies. You will work on complex, scalable systems in a high-velocity engineering environment.

Requirements
Key Responsibilities
  • Design, build, and optimize large-scale real-time streaming data pipelines.
  • Develop robust data ingestion and processing frameworks using Apache Spark Streaming or Hadoop streaming tools.
  • Use Java to implement performant, production-ready distributed systems.
  • Ensure low latency, high throughput, scalability, and fault tolerance across streaming workflows.
  • Collaborate with product, data, and engineering teams to integrate streaming pipelines into core platforms.
  • Diagnose, troubleshoot, and improve streaming system performance and reliability.
Required Skills & Qualifications
  • 4+ years of experience as a Big Data Engineer.
  • Strong command of real-time streaming technologies (Kafka, Spark Streaming, Flink, or similar).
  • Advanced proficiency in Java for core development.
  • Hands-on experience with Hadoop or Apache Spark (streaming use cases only).
  • Solid understanding of distributed systems and scalable architecture patterns.
  • Experience in monitoring, tuning, and debugging streaming pipelines.
  • Background working in high-scale or big-tech engineering environments.
Nice to Have
  • Experience with cloud ecosystems (AWS, GCP, or Azure).
  • Knowledge of microservices, Docker, Kubernetes, or container orchestration.
  • Familiarity with CI/CD pipelines and DevOps workflows.

  • Big Data Engineer

    1 week ago

    India Weekday AI Full time ₹ 6,00,000 - ₹ 19,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 6-19 LPA)Min Experience: 4 yearsJobType: full-timeWe are looking for an experienced Big Data Engineer with strong expertise in real-time streaming systems and large-scale data processing. This role focuses on building high-performance, low-latency streaming pipelines using Java and...

  • Big Data Engineer

    4 weeks ago

    Pune, India Coforge Full time

    Job Description Coforge Ltd is Hiring for Big Data Engineer AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: [Confidential Information] For queries, contact via WhatsApp: 9667427662 Key Responsibilities:- Design, develop, and optimize Big Data...

  • Big Data Engineer

    3 weeks ago

    India Alef Education Full time

    Who we are Alef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world's most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe. Today, Alef is proudly...

  • Big Data Developer

    4 weeks ago

    Pune, India airtel Full time

    Job Description Job Title: Big Data Developer (Manager) Location: Pune Experience: 3-5 years Job Description: Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools....

  • Senior Big Data Engineer

    5 days ago

    India Allstate Full time

    At Allstate great things happen when our people work together to protect families and their belongings from life s uncertainties And for more than 90 years our innovative drive has kept us a step ahead of our customers evolving needs From advocating for seat belts air bags and graduated driving laws to being an industry leader in pricing sophistication...

  • Senior Big Data Engineer

    1 week ago

    India Oracle Full time ₹ 25,00,000 - ₹ 40,00,000 per year

    DescriptionWe're seeking a Senior Data Integration Engineer to design, develop, and manage enterprise-grade data integration solutions. The ideal candidate will have experience with ETL/ELT processes, API-driven integrations, and enterprise data platforms, with strong technical skills and collaboration abilities.Please apply, If you have the passion and...

  • Data Engineer-Data Engineering-Big Data Engineering

    2 weeks ago

    Pune, India EXL Full time

    Job Description Job Summary We are seeking an experienced GCP Data Engineer with strong expertise in designing, building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP). The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on...

  • Data Engineer

    2 days ago

    India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...

  • Senior Big Data SME

    3 weeks ago

    India Information Tech Consultants Full time

    Job Title: Senior Big Data SME (Subject Matter Expert) Location: Remote Shift : UK Shift timings Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer) Employment Type: Full-Time About Us: We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part...

  • Senior Data Engineer

    6 days ago

    India Quapton AI Solutions Full time

    Company Description Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solutions that optimise operational efficiency and enable data-driven decision-making. Our focus lies in fostering sustainable growth and...