Senior Big Data Engineer

2 days ago

Noida, Uttar Pradesh, India VARAISYS PVT. LTD. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Role:
Big Data Engineer

Location:
Noida (Work From Office)

Experience:
5 Years

Role Overview

We're looking for a
Big Data Engineer
who thrives on scale — the kind where
terabytes of data move every single day
. You'll be building and optimizing high-throughput data pipelines that fuel analytics, AI, and business intelligence across the org.

Key Responsibilities

  • Design, develop, and optimize
    data pipelines
    processing
    terabytes of structured and unstructured data per day
    .
  • Build
    real-time and batch data processing systems
    using Spark, Kafka, and Hadoop ecosystem tools.
  • Manage
    data ingestion, transformation, and storage
    for analytics, ML, and reporting needs.
  • Work with
    Data Scientists, ML Engineers, and Analysts
    to deliver scalable, production-ready datasets.
  • Implement
    data quality, lineage, and observability frameworks
    to ensure reliability and consistency.
  • Optimize
    ETL performance, cluster utilization, and query execution
    across distributed environments.
  • Manage
    data workflows on the cloud
    (AWS, GCP, or Azure) for speed, cost, and scalability.

Must-Have Skills

  • Deep expertise with
    Apache Spark, Kafka, Hadoop (HDFS, Hive, YARN), Airflow
    .
  • Strong programming skills in
    Python, Scala, or Java
    .
  • Proven experience handling
    large-scale, high-velocity data (TBs/day)
    in production systems.
  • Strong understanding of
    distributed computing, data partitioning, and cluster performance tuning
    .
  • Hands-on with
    cloud-native data tools
    (AWS EMR, Glue, Redshift, GCP BigQuery, or Azure Databricks).
  • Familiarity with
    data lake/lakehouse architectures
    and
    schema evolution
    .

Good to have

  • Experience with
    real-time streaming
    (Flink, Kinesis, Pulsar) and
    data lake formats
    (Delta, Iceberg, Hudi).
  • Understanding of
    data governance, cataloging, and lineage
    .
  • Exposure to
    ML pipelines or feature store engineering
    .

𝐀𝐩𝐩𝐥𝐲 𝐧𝐨𝐰: Send your CV to 𝐩𝐫𝐢𝐭𝐢..𝐜𝐨𝐦

  • Big Data

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...

  • Lead Big Data Solution Engineer

    1 week ago

    Noida, Uttar Pradesh, India Impetus Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    QualificationRequiredProven hands-on experience on designing, developing and supporting Database projects for analysis in a demanding environment.Proficient in database design techniques – relational and dimension designsExperience and a strong understanding of business analysis techniques used.High proficiency in the use of SQL or MDX queries.Ability to...

  • Azure & Big Data - Lead

    6 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...

  • Senior Azure Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Eice Technology Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Urgent Requirement Senior Azure Data Engineer - Microsoft Fabric SpecialistLocation: Noida (Onsite, Long-Term Project Full Time)Need Immediate Joiners OnlyAbout the RoleWe are looking for a highly experienced Azure Data Engineer with 10+ years of expertise in data engineering, Microsoft Fabric, and modern data platforms. The ideal candidate will have deep...

  • Senior DevOps Engineer

    4 days ago

    Noida, Uttar Pradesh, India Paytm Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data DevOps - Senior DevOps EngineerJob Overview: We are seeking an experienced Senior Devops Engineer to lead our Data DevOps team in building, managing, and optimizing high-scale, secure, and reliable big data platforms. The ideal candidate will combine strong technical expertise with proven leadership skills, driving best practices in cloud...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Delhivery Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Delhivery:Delhivery is India's leading fulfillment platform for digital commerce. With a vast logistics network spanning 18,000+ pin codes and over 2,500 cities, Delhivery provides a comprehensive suite of services including express parcel transportation, freight solutions, reverse logistics, cross-border commerce, warehousing, and cutting-edge...

  • Big Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India DCS IT Solution Pvt. Ltd Full time ₹ 19,92,000 - ₹ 22,80,000 per year

    Job Title: Python Databricks EngineerExperience: 7–10 YearsLocation: NoidaJob SummaryWe are seeking a highly skilled Python Databricks Engineer with strong expertise in data engineering and cloud technologies. The ideal candidate will have a solid background in building scalable data pipelines, working with Databricks/Spark, and leveraging AWS services for...

  • Data - Senior Engineer

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS-Specific SkillsAWS Storage & Compute ServicesS3: Deep understanding of bucket policies, lifecycle rules, and data organizationGlue: For ETL jobs, crawlers, and data catalogingAthena: Querying data directly from S3 using SQLEMR: For big data processing using Spark/HadoopLakehouse TechnologiesApache Hudi: Knowledge of transactional data lakes, schema...

  • Data Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India HCLTech Full time

    Job DescriptionRole: Data EngineerTotal years of experience: 9+ YearsLocation: PAN India (Any HCL office)Relevant experience for engagement: 5 YearsNote: - We are conducting a virtual discussion on this coming Saturday, 13th of Sep 25 from 9:30 am to 6:30 pm, if interested please feel free to share your profilesJob Description:Relevant Skills:Maintain...

  • Data Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India HCLTech Full time

    Role: Data Engineer Total years of experience: 9+ Years Location: PAN India (Any HCL office) Relevant experience for engagement: 5 Years Note: - We are conducting a virtual discussion on this coming Saturday, 13th of Sep 25 from 9:30 am to 6:30 pm, if interested please feel free to share your profiles Job Description: Relevant Skills: Maintain...