Big Data Engineer

4 weeks ago

Pune, India Nice Software Solutions Pvt. Ltd. Full time

Big Data Engineer (PySpark)

Location:
Pune/Nagpur (WFO)

Experience:
8 - 12 Years

Employment Type:
Full-time

Job Overview

We are looking for an experienced
Big Data Engineer
with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability.

Key Responsibilities

  • Design, develop, and maintain data pipelines using
    PySpark
    and related Big Data technologies.
  • Work with
    HDFS, Hive, Sqoop
    , and other tools in the Hadoop ecosystem.
  • Write efficient
    HiveQL and SQL
    queries to handle large-scale datasets.
  • Perform
    performance tuning and optimization
    of distributed data systems.
  • Collaborate with cross-functional teams in an
    Agile environment
    to deliver high-quality solutions.
  • Manage and schedule workflows using
    Apache Airflow
    or
    Oozie
    .
  • Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy.

Required Skills

  • Proven experience in
    Big Data Engineering
    with a focus on PySpark.
  • Strong knowledge of
    HDFS, Hive, Sqoop
    , and related tools.
  • Proficiency in
    SQL/HiveQL
    for large datasets.
  • Expertise in
    performance tuning and optimization
    of distributed systems.
  • Familiarity with
    Agile methodology
    and collaborative team practices.
  • Experience with workflow orchestration tools (
    Airflow/Oozie
    ).
  • Strong
    problem-solving, analytical, and communication
    skills.

Good to Have

  • Knowledge of
    data modeling
    and
    data warehousing
    concepts.
  • Exposure to
    DevOps practices
    and
    CI/CD pipelines
    for data engineering.
  • Experience with other Big Data frameworks such as
    Spark Streaming
    or
    Kafka
    .

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India FUNIC TECH PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description :Job Opening : Big Data Engineer (7-10 yrs)Location : Aundh, Pune (Work From Office)Job Type : Full-Time | General Shift | Monday FridayKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal...

  • Big Data Engineer

    2 days ago

    Pune, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Big Data Engineer

    14 hours ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: Gaurav.2.Kumar@coforge.com For queries, contact via WhatsApp: 9667427662 Key Responsibilities:-• Design, develop, and optimize Big Data architectures...

  • Big Data Engineer

    14 hours ago

    pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: Gaurav.2.Kumar@coforge.com For queries, contact via WhatsApp: 9667427662 Key Responsibilities:-• Design, develop, and optimize Big Data architectures...

  • Big Data Engineer

    1 day ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: Gaurav.2.Kumar@coforge.com For queries, contact via WhatsApp: 9667427662 Key Responsibilities:-• Design, develop, and optimize Big Data architectures...

  • Big data engineer

    8 hours ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: Gaurav.2. For queries, contact via Whats App: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for...

  • Big Data Engineer

    8 hours ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Big Data Engineer

    11 hours ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:- • Design, develop, and optimize Big Data architectures leveraging AWS services for...