Big Data Developer

11 hours ago

Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

About The Opportunity
A staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.

We are hiring an on-site Big Data Engineer in India to design, build, and optimise data pipelines and platform components for mission-critical data applications.

Role & Responsibilities

  • Design and implement end-to-end batch and streaming data pipelines using Spark and Hadoop ecosystem components.
  • Develop ETL jobs and data transformation logic in Python/SQL, ensuring scalability and maintainability.
  • Integrate and process real-time data streams using Kafka and related ingestion tools; ensure low-latency delivery to downstream systems.
  • Author Hive queries and optimize performance for large-scale datasets; tune Spark jobs to reduce cost and improve throughput.
  • Collaborate with data engineers, analysts, and stakeholders to translate business requirements into robust data models and pipelines.
  • Implement monitoring, logging, and automated testing for data workflows; troubleshoot production issues and perform root-cause analysis.

Skills & Qualifications
Must-Have

  • Apache Spark
  • Hadoop HDFS
  • Apache Hive
  • Apache Kafka
  • SQL
  • Python

Preferred

  • Scala
  • Apache Airflow
  • AWS EMR

Other Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience).
  • Proven experience delivering on-site in enterprise Big Data environments; familiarity with production deployment practices and CI/CD for data workflows.
  • Strong troubleshooting mindset with experience in performance tuning and data quality assurance.

Benefits & Culture Highlights

  • On-site delivery model with high-impact projects for large enterprise clients and opportunities to work end-to-end on data platforms.
  • Collaborative engineering culture, technical mentoring, and exposure to modern data stack components.
  • Competitive compensation and opportunities for certification/training in cloud and Big Data technologies.

Keywords: Big Data Engineer, Hadoop, Spark, Kafka, ETL, data pipelines, on-site India, data platform, Python, Hive.

Skills: spark,apache spark,sql,apache kafka,python,scala,big data

  • Big Data Developer

    3 weeks ago

    Gurgaon, Haryana, India Intraedge Technologies Ltd. Full time

    Job Title : Big Data Developer (Java/Python)Location : Chennai, Bangalore, GurugramExperience Required : 5+ years (5 to 15 yrs)Joining : Immediate or Early Joiners PreferredEmployment Type : Full-timeJob Summary : We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big Data Developer

    12 hours ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Big Data Engineer ( Immediate Joiner)Experience: 5+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerBudget LPAJob Summary:We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate...

  • Big Data Developer

    10 hours ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Big Data EngineerExperience: 5+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerBudget=16.5 LPAJob Summary:We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate will have...

  • Big Data Tester

    12 hours ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 6,00,000 - ₹ 15,00,000 per year

    Job Title:Big Data Tester (SQL)Experience:3+YearsLocation:[Gurugram/Bangalore]Employment Type:Full-TimeJob Summary:We are seeking a highly skilledBig Data Tester with strong SQL expertiseto join our team. The ideal candidate will be responsible for validating, testing, and ensuring the quality of large-scale data pipelines, data lakes, and big data...

  • Big Data Tester

    8 hours ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 9,60,000 - ₹ 13,20,000 per year

    Big Data Tester (AWS + SQL) (Immediate joiner)Location:Gurugram / Bangalore (Hybrid)Experience:4–7 YearsBudget:Up to ₹11 LPAAbout the Role:We are looking for a skilled and detail-orientedBig Data Testerwith expertise inAWSandSQLto join our growing team. This role requires hands-on experience in data validation, test automation for big data pipelines, and...

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Infogain Full time

    Posted on August 17 2024ROLES RESPONSIBILITIESBig Data Engineer Senior As a Big Data Engineer Senior you will be responsible for designing and implementing complex big data solutions You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs You will also be responsible for...

  • Data Scientist/Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Techmora Full time

    Job Description : Data Science / Big Data EngineerLocation : Gurgaon / PuneEmployment Type : Full-timeNotice Period : 30 DaysExperience : 4-6 YearsAbout the Role :We are seeking a skilled Data Science / Big Data Engineer with strong expertise in data wrangling, large-scale data processing, and advanced analytics. The ideal candidate will have hands-on...

  • Big Data Engineer

    12 hours ago

    Gurgaon, Haryana, India Insight Global Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Pay Range: LPA (INR)Required Qualifications:3–5 years of hands-on experience in Big Data engineering.Proficiency in Python (Java is a plus).Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus.Solid problem-solving skills and a structured thought process.Experience with data migration and...

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Idyllic Services Pvt Ltd Full time

    Job Title : Big Data Engineer - ScalaExperience : 7 to 10Years (Minimum 3+ years in Scala)Notice Period : Immediate to 30 DaysRole Overview : We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track...

  • Big Data Automation QA

    11 hours ago

    Gurgaon, Haryana, India Xcel HR Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities: Develop and automate processes for gathering of expected results from data sources and comparing data results from testing.Assist with the development and maintenance of smoke, performance, functional, and regression tests to ensure code is functioning as designed.Work with the team to understand how changes in the DL affect maintenance of...