Big Data Engineer

3 days ago

India Weekday AI Full time ₹ 6,00,000 - ₹ 19,00,000

This role is for one of the Weekday's clients

Salary range: Rs Rs ie INR 6-19 LPA)

Min Experience: 4 years

JobType: full-time

We are looking for an experienced Big Data Engineer with strong expertise in real-time streaming systems and large-scale data processing. This role focuses on building high-performance, low-latency streaming pipelines using Java and modern big data technologies. You will work on complex, scalable systems in a high-velocity engineering environment.

Key Responsibilities
  • Design, build, and optimize large-scale real-time streaming data pipelines.
  • Develop robust data ingestion and processing frameworks using Apache Spark Streaming or Hadoop streaming tools.
  • Use Java to implement performant, production-ready distributed systems.
  • Ensure low latency, high throughput, scalability, and fault tolerance across streaming workflows.
  • Collaborate with product, data, and engineering teams to integrate streaming pipelines into core platforms.
  • Diagnose, troubleshoot, and improve streaming system performance and reliability.
Required Skills & Qualifications
  • 4+ years of experience as a Big Data Engineer.
  • Strong command of real-time streaming technologies (Kafka, Spark Streaming, Flink, or similar).
  • Advanced proficiency in Java for core development.
  • Hands-on experience with Hadoop or Apache Spark (streaming use cases only).
  • Solid understanding of distributed systems and scalable architecture patterns.
  • Experience in monitoring, tuning, and debugging streaming pipelines.
  • Background working in high-scale or big-tech engineering environments.
Nice to Have
  • Experience with cloud ecosystems (AWS, GCP, or Azure).
  • Knowledge of microservices, Docker, Kubernetes, or container orchestration.
  • Familiarity with CI/CD pipelines and DevOps workflows.

  • Senior Big Data Engineer

    3 weeks ago

    India Allstate Full time

    At Allstate great things happen when our people work together to protect families and their belongings from life s uncertainties And for more than 90 years our innovative drive has kept us a step ahead of our customers evolving needs From advocating for seat belts air bags and graduated driving laws to being an industry leader in pricing sophistication...

  • Big Data Administrator

    7 days ago

    India HNM Solutions Full time

    **Big Data Administrator**: - (Engagement - 6 Months+) _ **Experience**:5+ years **Key Skills**:Hadoop ecosystem (HDFS, YARN, Hive, Impala), Cloudera/HDP administration, Linux, security, monitoring **Responsibilities**:Administer and monitor big data infrastructure & jobs, manage user access, data storage, and cluster health; implement security controls...

  • Senior Big Data Engineer

    5 days ago

    India Oracle Full time

    DescriptionWe're seeking a Senior Data Integration Engineer to design, develop, and manage enterprise-grade data integration solutions. The ideal candidate will have experience with ETL/ELT processes, API-driven integrations, and enterprise data platforms, with strong technical skills and collaboration abilities.Please apply, If you have the passion and...

  • Big Data Developer

    2 weeks ago

    Hyderabad, India Miamin Systems Full time

    Job Description About the Role We are looking for a skilled Big Data Engineer to design, build, and optimize scalable data pipelines and big data platforms. The ideal candidate will have strong hands-on experience with data processing frameworks, cloud platforms, and real-time data systems. Key Responsibilities - Design, develop, and maintain large-scale...

  • Big Data Full-time

    5 days ago

    India HyreFox Consultants Full time

    **POSITION: Big Data Engineer** **Primary skills**: Apache Hadoop, Apache Spark, Apache Kafka **Roles & Responsibilities** - Developing Hadoop systems. - Loading disparate data sets and conducting pre-processing services using Hive or Pig. - Finalizing the scope of the system and delivering Big Data solutions. - Managing the communications between the...

  • Data Engineer-Data Engineering-Big Data Engineering

    4 weeks ago

    Pune, India EXL Full time

    Job Description Job Summary We are seeking an experienced GCP Data Engineer with strong expertise in designing, building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP). The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on...

  • SAP Data

    2 days ago

    India MIB IT Solutions Full time

    We’re Hiring: SAP Data & Analytics Engineer (Big Data) Location: Remote (India) Availability: Immediate to 60 Days We have an opening for an SAP Data & Analytics Engineer (Big Data) to support a major implementation project. The role involves designing and building scalable data solutions that integrate SAP systems with modern Big Data platforms. You will...

  • SAP Data

    2 days ago

    India MIB IT Solutions Full time

    We’re Hiring: SAP Data & Analytics Engineer (Big Data)Location: Remote (India)Availability: Immediate to 60 DaysWe have an opening for an SAP Data & Analytics Engineer (Big Data) to support a major implementation project. The role involves designing and building scalable data solutions that integrate SAP systems with modern Big Data platforms. You will...

  • AI and Big Data Architect

    2 days ago

    India IGT Solutions Full time

    Job Title: Architect - Gen AI, LLM, Big Data Experience: 18+ Years Location: Pune/ Gurugram Employment Type: Full-Time / Permanent Job Summary: We are looking for an experienced Architect with deep expertise in Generative AI (Gen AI), Large Language Models (LLM), and Big Data technologies. The ideal candidate will have 18+ years of experience in designing...

  • Chief Big Data Architect

    2 weeks ago

    india beBeeDataEngineer Full time

    Big Data Engineer PositionWe are seeking a skilled Big Data Engineer to design and implement large-scale data pipelines using Azure Databricks, ADF, and Spark that support both batch and real-time analytics.Develop and optimize Spark jobs for large-volume data processing and transformation. Ensure efficient data handling through careful tuning of system...