Big Data Lead

5 hours ago


Pune, Maharashtra, India Populace World Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Designation: Big Data Lead

Location: Pune

Experience: 8-10 years

Reports To – Product Engineering Head

Job Overview

We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.

To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.

Responsibilities:

  • Meeting with managers to determine the company's Big Data needs.
  • Developing big data solutions on AWS, using Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, Hadoop, etc.
  • Loading disparate data sets and conducting pre-processing services using Athena, Glue, Spark, etc.
  • Collaborating with the software research and development teams.
  • Building cloud platforms for the development of company applications.
  • Maintaining production systems.

Requirements:

  • 8-10 years of experience as a big data engineer.
  • Must be proficient with Python & PySpark.
  • In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services.
  • Must have extensive experience with Delta Tables, JSON, Parquet file format.
  • Good to have experience with AWS data analytics services like Athena, Glue, Redshift, EMR.
  • Familiarity with Data warehousing will be a plus.
  • Must have Knowledge of NoSQL and RDBMS databases.
  • Good communication skills.
  • Ability to solve complex data processing, transformation related problems

  • Big Data Lead

    2 weeks ago


    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...


  • Pune, Maharashtra, India Devlats Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security Risk Prioritization...

  • Big Data Lead

    12 hours ago


    Pune, Maharashtra, India DemandMatrix Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description At DemandMatrix, our vision is to disrupt the $100 billion sales and marketing intelligence industry by using domain knowledge, machine learning and AI. Fortune 100 companies like Microsoft, Google, Adobe, Amazon, IBM trust us to identify their next customer. Job Description What will you do?To help us go to the next level we are looking...

  • Big Data

    1 week ago


    Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...

  • Big Data

    2 weeks ago


    Pune, Maharashtra, India Vi (Vodafone Idea) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GM - Application Operations Vodafone Idea Limited is an Aditya Birla Group and Vodafone Group partnership. It is India's leading telecom service provider. The Company provides pan India Voice and Data services across 2G, 3G and 4G platform. With the large spectrum portfolio to support the growing demand for data and voice, the company is committed to...

  • Big Data Architect

    15 hours ago


    Pune, Maharashtra, India Datametica Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Architect GCPExperience: 10–12 YearsLocation: PuneRoleWe are looking for a Big Data Architect with deep GCP expertise to define, design, and lead cloud-native data platforms for enterprise clients. You will be responsible for architecting large-scale data lakes, warehouses, and pipelines on GCP, modernizing on-premise workloads, and...


  • Pune, Maharashtra, India Recruin Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on expertise in cloud-based big data technologies, a strong background in the software development life cycle (SDLC), and experience in microservices and backend...

  • Big Data Developer

    1 week ago


    Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Engineer

    1 week ago


    Pune, Maharashtra, India FUNIC TECH PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description :Job Opening : Big Data Engineer (7-10 yrs)Location : Aundh, Pune (Work From Office)Job Type : Full-Time | General Shift | Monday FridayKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal...

  • Big Data Engineer

    1 week ago


    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...