Senior Big Data Engineer

2 weeks ago

Noida, Uttar Pradesh, India VARAISYS PVT. LTD. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Role:
Big Data Engineer

Location:
Noida (Work From Office)

Experience:
5 Years

Role Overview

We're looking for a
Big Data Engineer
who thrives on scale — the kind where
terabytes of data move every single day
. You'll be building and optimizing high-throughput data pipelines that fuel analytics, AI, and business intelligence across the org.

Key Responsibilities

  • Design, develop, and optimize
    data pipelines
    processing
    terabytes of structured and unstructured data per day
    .
  • Build
    real-time and batch data processing systems
    using Spark, Kafka, and Hadoop ecosystem tools.
  • Manage
    data ingestion, transformation, and storage
    for analytics, ML, and reporting needs.
  • Work with
    Data Scientists, ML Engineers, and Analysts
    to deliver scalable, production-ready datasets.
  • Implement
    data quality, lineage, and observability frameworks
    to ensure reliability and consistency.
  • Optimize
    ETL performance, cluster utilization, and query execution
    across distributed environments.
  • Manage
    data workflows on the cloud
    (AWS, GCP, or Azure) for speed, cost, and scalability.

Must-Have Skills

  • Deep expertise with
    Apache Spark, Kafka, Hadoop (HDFS, Hive, YARN), Airflow
    .
  • Strong programming skills in
    Python, Scala, or Java
    .
  • Proven experience handling
    large-scale, high-velocity data (TBs/day)
    in production systems.
  • Strong understanding of
    distributed computing, data partitioning, and cluster performance tuning
    .
  • Hands-on with
    cloud-native data tools
    (AWS EMR, Glue, Redshift, GCP BigQuery, or Azure Databricks).
  • Familiarity with
    data lake/lakehouse architectures
    and
    schema evolution
    .

Good to have

  • Experience with
    real-time streaming
    (Flink, Kinesis, Pulsar) and
    data lake formats
    (Delta, Iceberg, Hudi).
  • Understanding of
    data governance, cataloging, and lineage
    .
  • Exposure to
    ML pipelines or feature store engineering
    .

𝐀𝐩𝐩𝐥𝐲 𝐧𝐨𝐰: Send your CV to 𝐩𝐫𝐢𝐭𝐢..𝐜𝐨𝐦

  • Big Data

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Must have:7+ years of years of dev experienceBig data developer with exposure to JavaSpark/Scala/Hive experienceGood background in SQLNice to have:Familiarity/Experience with Cloud*Mandatory Competencies*Big Data - Big Data - HIVEBig Data - Big Data - SPARKDatabase - Database Programming - SQLProgramming Language - Scala - ScalaBeh - Communication

  • Senior Software Big Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Info Edge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities: -Design, develop, and maintain robust data pipelines using Kafka, Airflow, and Spark. -Implement data models and schemas for efficient querying. -Develop and optimize code in Scala and Java for data processing tasks. -Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability. -Collaborate with...

  • Big Data Engineering

    1 day ago

    Noida, Uttar Pradesh, India prudentialmanp Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Bachelor's degree in computer science, or similar technical fieldMinimum 5 years of experience in Big Data Engineering/Data AnalysisPreferred Skills and Qualifications:Proficiency in Python, SQL and Apache SparkStrong Experience on Snowflake AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatchCore Spark,...

  • Big Data Engineer

    1 day ago

    Noida, Uttar Pradesh, India 1hresource Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities:* Design, develop & maintain big data pipelines using Spark, Hive & Hadoop.* Optimize performance through data modeling & query optimization.* Collaborate with cross-functional teams on project delivery.Food allowanceAnnual bonusHealth insuranceOffice cab/shuttleProvident fund

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India GlobalLogic Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Company DescriptionGlobalLogic, a Hitachi Group company, is a trusted partner in design, data, and digital engineering for the world's largest and most innovative companies. Since our inception in 2000, we have been at the forefront of the digital revolution, helping to create some of the most widely used digital products and experiences. Our purpose is to...

  • Big Data Lead

    1 day ago

    Noida, Uttar Pradesh, India Briskwin IT Solutions Full time ₹ 1,20,000 - ₹ 6,00,000 per year

    Exp: 6-9yrs**Work location : Pune/Chennai/Mumbai/Noida/Coimbatore/BangaloreWork Mode: Hybrid**Notice Period : Imm – 30 daysMandatory skills : SSIS + MongoDB + SQLJob Title: Data Engineer Experience: 5+ yearsJob Description: We are looking for an experienced Data Engineer with strong expertise in building and managing data pipelines, integrating diverse...

  • Data Senior Engineer

    3 days ago

    Noida, Uttar Pradesh, India NTT DATA North America Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID:345995NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Senior Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Job Duties: As a data analyst you will...

  • Senior Data Engineer

    1 day ago

    Noida, Uttar Pradesh, India Thanks Buddy Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer   Our company is a leading provider of practical, scalable, and transformative artificial intelligence and machine learning (AI + ML) solutions for businesses and government entities. Our machine learning offerings empower organizations to enhance profitability and efficiency while minimizing risk. We specialize in various sectors...

  • Data - Senior Engineer

    6 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Why Join Iris?Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?Join Iris Software — one of thefastest-growing IT services companies— whereyou own and shape your success story.About UsAt Iris Software, our...

  • Data Engineer II

    4 days ago

    Noida, Uttar Pradesh, India Microsoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.  Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of...