Big Data Engineer

4 days ago

Gurgaon, Haryana, India MyCareernet Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Company:Indian / Global Digital Organization

Key Skills:
Pyspark, AWS, Python, SCALA, ETL

Roles and Responsibilities:

  • Develop and deploy ETL and data warehousing solutions using Python libraries and Linux bash scripts on AWS EC2, with data stored in Redshift.
  • Collaborate with product and analytics teams to scope business needs, design metrics, and build reports/dashboards.
  • Automate and optimize existing data sets and ETL pipelines for efficiency and reliability.
  • Work with multi-terabyte data sets and write complex SQL queries to support analytics.
  • Design and implement ETL solutions integrating multiple data sources using Pentaho.
  • Utilize Linux/Unix scripting for data processing tasks.
  • Leverage AWS services (Redshift, S3, EC2) for storage, processing, and pipeline automation.
  • Follow software engineering best practices for coding standards, code reviews, source control, testing, and operations.

Skills Required:

Must-Have:

  • Hands-on experience with PySpark for big data processing
  • Strong knowledge of AWS services (Redshift, S3, EC2)
  • Proficiency in Python for data processing and automation
  • Strong SQL skills for working with RDBMS and multi-terabyte data sets

Nice-to-Have:

  • Experience with SCALA for distributed data processing
  • Knowledge of ETL tools such as Pentaho
  • Familiarity with Linux/Unix scripting for data operations
  • Exposure to data modeling, pipelines, and visualization

Education:
Bachelor's degree in Computer Science, Information Technology, or a related field

  • GCP Big Data Engineer

    1 week ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Big Data Developer

    4 days ago

    Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About The OpportunityA staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.We are hiring an...

  • Big Data Engineer

    7 days ago

    Gurgaon, Haryana, India Source4hire Full time ₹ 10,00,000 - ₹ 12,00,000 per year

    Description : - Provides technical leadership in the Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc.) and contributes to open-source Big Data technologies. Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer...

  • Engineer- Big Data

    7 days ago

    Gurgaon, Haryana, India American Express Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    You Lead the Way. We've Got Your Back.With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you'll learn and grow as we help you create a career...

  • Engineer- Big Data

    5 days ago

    Gurgaon, Haryana, India American Express Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include:Competitive base salaries  Bonus incentives  Support for financial-well-being and retirement  Comprehensive medical, dental,...

  • Staff Engineer, Big Data

    1 week ago

    Gurgaon, Haryana, India Nagarro Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Description We're Nagarro.We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world experts across 39 countries, to be exact). Our work culture is dynamic...

  • Staff Engineer, Big Data

    1 week ago

    Gurgaon, Haryana, India Nagarro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionWe're Nagarro.We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world experts across 39 countries, to be exact). Our work culture is dynamic...

  • Big Data + GCP Engineer

    1 week ago

    Gurgaon, Haryana, India Impetus Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Gurugram, Haryana, India; Bangalore, Karnataka, IndiaQualification:Must have : Bigdata ,GCPRoles And Responsibilities :Must have : Bigdata ,GCP, Dataproc, Dataflow, SQL, SparkExperience:3 to 12 yearsJob Reference Number:13154Skills Required:Big DataRole:Must have : Bigdata ,GCP

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer Location: India (Gurugram)About CoPointAIAI isn't coming — it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise — not just around it — to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team partners...

  • Senior Big Data Engineer

    1 week ago

    Gurgaon, Haryana, India dunnhumby Full time ₹ 8,00,000 - ₹ 13,00,000 per year

    dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of...