Big Data Developer

17 hours ago

Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

About The Opportunity
A staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.

We are hiring an on-site Big Data Engineer in India to design, build, and optimise data pipelines and platform components for mission-critical data applications.

Role & Responsibilities

  • Design and implement end-to-end batch and streaming data pipelines using Spark and Hadoop ecosystem components.
  • Develop ETL jobs and data transformation logic in Python/SQL, ensuring scalability and maintainability.
  • Integrate and process real-time data streams using Kafka and related ingestion tools; ensure low-latency delivery to downstream systems.
  • Author Hive queries and optimize performance for large-scale datasets; tune Spark jobs to reduce cost and improve throughput.
  • Collaborate with data engineers, analysts, and stakeholders to translate business requirements into robust data models and pipelines.
  • Implement monitoring, logging, and automated testing for data workflows; troubleshoot production issues and perform root-cause analysis.

Skills & Qualifications
Must-Have

  • Apache Spark
  • Hadoop HDFS
  • Apache Hive
  • Apache Kafka
  • SQL
  • Python

Preferred

  • Scala
  • Apache Airflow
  • AWS EMR

Other Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience).
  • Proven experience delivering on-site in enterprise Big Data environments; familiarity with production deployment practices and CI/CD for data workflows.
  • Strong troubleshooting mindset with experience in performance tuning and data quality assurance.

Benefits & Culture Highlights

  • On-site delivery model with high-impact projects for large enterprise clients and opportunities to work end-to-end on data platforms.
  • Collaborative engineering culture, technical mentoring, and exposure to modern data stack components.
  • Competitive compensation and opportunities for certification/training in cloud and Big Data technologies.

Keywords: Big Data Engineer, Hadoop, Spark, Kafka, ETL, data pipelines, on-site India, data platform, Python, Hive.

Skills: spark,apache spark,sql,apache kafka,python,scala,big data

  • Big Data Automation QA

    19 hours ago

    Gurgaon, Haryana, India Xcel HR Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities: Develop and automate processes for gathering of expected results from data sources and comparing data results from testing.Assist with the development and maintenance of smoke, performance, functional, and regression tests to ensure code is functioning as designed.Work with the team to understand how changes in the DL affect maintenance of...

  • GCP Big Data Engineer

    6 days ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Big Data Engineer

    17 hours ago

    Gurgaon, Haryana, India MyCareernet Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company:Indian / Global Digital OrganizationKey Skills:Pyspark, AWS, Python, SCALA, ETLRoles and Responsibilities:Develop and deploy ETL and data warehousing solutions using Python libraries and Linux bash scripts on AWS EC2, with data stored in Redshift.Collaborate with product and analytics teams to scope business needs, design metrics, and build...

  • Big Data Engineer

    23 hours ago

    Gurgaon, Haryana, India Qcentrio Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Notice Period : Immediate - 30 days Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud JD and required Skills & Responsibilities : Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support. Solve complex...

  • Engineer - Data Management / Big Data

    16 hours ago

    Gurgaon, Haryana, India American Express Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Engineer - Big Data

    2 weeks ago

    Gurgaon, Haryana, India American Express Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Engineer - Big Data

    2 weeks ago

    Gurgaon, Haryana, India American Express Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Android Developer

    21 hours ago

    Gurgaon, Haryana, India Big Oh Tech Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    ResponsibilitiesDesign, build, and maintain high-performance, reusable, and reliable Kotlin/Java code for Android Mobile Applications.Designs maintain and continuously improve the application basis requirements and user feedback.Ensures the best performance, quality, and responsiveness of the application.Create a secure, seamless mobile experience.Ensure the...

  • Senior Big Data Engineer

    6 days ago

    Gurgaon, Haryana, India dunnhumby Full time ₹ 8,00,000 - ₹ 13,00,000 per year

    dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of...

  • Big Data Analytics

    21 hours ago

    Gurgaon, Haryana, India Randstad Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job descriptionAll about You: Qualifications & Experience:-• 5+ years of experience in analytics, data science, pricing strategy, customer success, or related roles, ideally in the payments, financial services, or technology sectors.• Proven track record of developing and scaling data-driven tools and frameworks with measurable outcomes.• Expertise in...