Big Data Engineer

2 weeks ago

Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Big Data Engineer (PySpark)

Location:
Pune/Nagpur (WFO)

Experience:
8 - 12 Years

Employment Type:
Full-time

Job Overview

We are looking for an experienced
Big Data Engineer
with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability.

Key Responsibilities

  • Design, develop, and maintain data pipelines using
    PySpark
    and related Big Data technologies.
  • Work with
    HDFS, Hive, Sqoop
    , and other tools in the Hadoop ecosystem.
  • Write efficient
    HiveQL and SQL
    queries to handle large-scale datasets.
  • Perform
    performance tuning and optimization
    of distributed data systems.
  • Collaborate with cross-functional teams in an
    Agile environment
    to deliver high-quality solutions.
  • Manage and schedule workflows using
    Apache Airflow
    or
    Oozie
    .
  • Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy.

Required Skills

  • Proven experience in
    Big Data Engineering
    with a focus on PySpark.
  • Strong knowledge of
    HDFS, Hive, Sqoop
    , and related tools.
  • Proficiency in
    SQL/HiveQL
    for large datasets.
  • Expertise in
    performance tuning and optimization
    of distributed systems.
  • Familiarity with
    Agile methodology
    and collaborative team practices.
  • Experience with workflow orchestration tools (
    Airflow/Oozie
    ).
  • Strong
    problem-solving, analytical, and communication
    skills.

Good to Have

  • Knowledge of
    data modeling
    and
    data warehousing
    concepts.
  • Exposure to
    DevOps practices
    and
    CI/CD pipelines
    for data engineering.
  • Experience with other Big Data frameworks such as
    Spark Streaming
    or
    Kafka
    .

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITED Full time

    Job Description : We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data environment at an enterprise scale application. You will work...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title:Big Data EngineerAbout the RoleWe're seeking an experienced data engineer to lead the development of large-scale data processing pipelines using Apache Spark and related technologies.The ideal candidate will have a strong background in data warehousing, ETL concepts, and SQL/NoSQL operations.Familiarity with UNIX shell scripting for scheduling and...

  • Senior Big Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale big data pipelines, real-time systems, and data warehouses.Required Skills and QualificationsCoding Experience: 2-5 years of experience in Java programming with a solid understanding of...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...

  • Big Data Engineering Specialist

    1 week ago

    Pune, Maharashtra, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Big Data EngineerCome work at a place where innovation and collaboration come together to support the most exciting missions in the world.Job Description:We are seeking a talented Big Data Engineering Specialist to deliver roadmap features of our Enterprise TruRisk Platform which would help customers to measure, communicate and eliminate cyber risks...