Big Data Developer

4 days ago

Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

About The Opportunity
A staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.

We are hiring an on-site Big Data Engineer in India to design, build, and optimise data pipelines and platform components for mission-critical data applications.

Role & Responsibilities

  • Design and implement end-to-end batch and streaming data pipelines using Spark and Hadoop ecosystem components.
  • Develop ETL jobs and data transformation logic in Python/SQL, ensuring scalability and maintainability.
  • Integrate and process real-time data streams using Kafka and related ingestion tools; ensure low-latency delivery to downstream systems.
  • Author Hive queries and optimize performance for large-scale datasets; tune Spark jobs to reduce cost and improve throughput.
  • Collaborate with data engineers, analysts, and stakeholders to translate business requirements into robust data models and pipelines.
  • Implement monitoring, logging, and automated testing for data workflows; troubleshoot production issues and perform root-cause analysis.

Skills & Qualifications
Must-Have

  • Apache Spark
  • Hadoop HDFS
  • Apache Hive
  • Apache Kafka
  • SQL
  • Python

Preferred

  • Scala
  • Apache Airflow
  • AWS EMR

Other Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience).
  • Proven experience delivering on-site in enterprise Big Data environments; familiarity with production deployment practices and CI/CD for data workflows.
  • Strong troubleshooting mindset with experience in performance tuning and data quality assurance.

Benefits & Culture Highlights

  • On-site delivery model with high-impact projects for large enterprise clients and opportunities to work end-to-end on data platforms.
  • Collaborative engineering culture, technical mentoring, and exposure to modern data stack components.
  • Competitive compensation and opportunities for certification/training in cloud and Big Data technologies.

Keywords: Big Data Engineer, Hadoop, Spark, Kafka, ETL, data pipelines, on-site India, data platform, Python, Hive.

Skills: spark,apache spark,sql,apache kafka,python,scala,big data

  • Big Data Engineer

    7 days ago

    Gurgaon, Haryana, India Source4hire Full time ₹ 10,00,000 - ₹ 12,00,000 per year

    Description : - Provides technical leadership in the Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc.) and contributes to open-source Big Data technologies. Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer...

  • GCP Big Data Engineer

    1 week ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Engineer- Big Data

    7 days ago

    Gurgaon, Haryana, India American Express Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    You Lead the Way. We've Got Your Back.With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you'll learn and grow as we help you create a career...

  • Engineer- Big Data

    5 days ago

    Gurgaon, Haryana, India American Express Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include:Competitive base salaries  Bonus incentives  Support for financial-well-being and retirement  Comprehensive medical, dental,...

  • Big Data Engineer

    4 days ago

    Gurgaon, Haryana, India MyCareernet Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company:Indian / Global Digital OrganizationKey Skills:Pyspark, AWS, Python, SCALA, ETLRoles and Responsibilities:Develop and deploy ETL and data warehousing solutions using Python libraries and Linux bash scripts on AWS EC2, with data stored in Redshift.Collaborate with product and analytics teams to scope business needs, design metrics, and build...

  • Staff Engineer, Big Data

    1 week ago

    Gurgaon, Haryana, India Nagarro Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Description We're Nagarro.We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world experts across 39 countries, to be exact). Our work culture is dynamic...

  • Staff Engineer, Big Data

    1 week ago

    Gurgaon, Haryana, India Nagarro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionWe're Nagarro.We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world experts across 39 countries, to be exact). Our work culture is dynamic...

  • Big Data + GCP Engineer

    1 week ago

    Gurgaon, Haryana, India Impetus Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Gurugram, Haryana, India; Bangalore, Karnataka, IndiaQualification:Must have : Bigdata ,GCPRoles And Responsibilities :Must have : Bigdata ,GCP, Dataproc, Dataflow, SQL, SparkExperience:3 to 12 yearsJob Reference Number:13154Skills Required:Big DataRole:Must have : Bigdata ,GCP

  • Engineer - Big Data

    2 weeks ago

    Gurgaon, Haryana, India American Express Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Big Data Analysis Tool and Techniques

    2 days ago

    Gurgaon, Haryana, India ICS Consultancy Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Description:Project Role : Application Developer  Project Role Description : Design, build and configure applications to meet business process and application requirements Must have Skills : Big Data Analysis Tool and Techniques  Good to Have Skills :  Amazon Web Services, Linux with spark and shell Scr, ansible, puppet and kubernets  Job...