Big Data Engineer

2 weeks ago

Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Big Data Engineer (PySpark)

Location:
Pune/Nagpur (WFO)

Experience:
8 - 12 Years

Employment Type:
Full-time

Job Overview

We are looking for an experienced
Big Data Engineer
with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability.

Key Responsibilities

  • Design, develop, and maintain data pipelines using
    PySpark
    and related Big Data technologies.
  • Work with
    HDFS, Hive, Sqoop
    , and other tools in the Hadoop ecosystem.
  • Write efficient
    HiveQL and SQL
    queries to handle large-scale datasets.
  • Perform
    performance tuning and optimization
    of distributed data systems.
  • Collaborate with cross-functional teams in an
    Agile environment
    to deliver high-quality solutions.
  • Manage and schedule workflows using
    Apache Airflow
    or
    Oozie
    .
  • Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy.

Required Skills

  • Proven experience in
    Big Data Engineering
    with a focus on PySpark.
  • Strong knowledge of
    HDFS, Hive, Sqoop
    , and related tools.
  • Proficiency in
    SQL/HiveQL
    for large datasets.
  • Expertise in
    performance tuning and optimization
    of distributed systems.
  • Familiarity with
    Agile methodology
    and collaborative team practices.
  • Experience with workflow orchestration tools (
    Airflow/Oozie
    ).
  • Strong
    problem-solving, analytical, and communication
    skills.

Good to Have

  • Knowledge of
    data modeling
    and
    data warehousing
    concepts.
  • Exposure to
    DevOps practices
    and
    CI/CD pipelines
    for data engineering.
  • Experience with other Big Data frameworks such as
    Spark Streaming
    or
    Kafka
    .

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Engineer

    3 days ago

    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...

  • Big Data Engineer

    3 days ago

    Pune, Maharashtra, India FUNIC TECH PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description :Job Opening : Big Data Engineer (7-10 yrs)Location : Aundh, Pune (Work From Office)Job Type : Full-Time | General Shift | Monday FridayKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Engineer Job Title: Big Data Engineer About Us "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Big Data Lead

    6 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Location – Pune/ChennaiExp - 6 to 9Technology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration and data...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Ashra Technology Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Gretting of dayWe are HiringRole: Big Data EngineerExp: 7+YearsLocations: Noida and Gurugram8+ years of overall IT experience, which includes hands on experience in Big Data technologies.Mandatory - Hands on experience in Python and PySpark.Build pySpark applications using Spark Dataframes in Python.Worked on optimizing spark jobs that processes huge volumes...

  • Big Data Architect

    5 days ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...