Big Data Lead

3 days ago

Pune, India Populace World Solutions Full time

Designation: Big Data Lead

Location: Pune

Experience: 8-10 years

Reports To Product Engineering Head

Job Overview

We are looking to hire a talented big data engineer to develop and manage our companys Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.

To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.

Responsibilities:

  • Meeting with managers to determine the companys Big Data needs.
  • Developing big data solutions on AWS, using Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, Hadoop, etc.
  • Loading disparate data sets and conducting pre-processing services using Athena, Glue, Spark, etc.
  • Collaborating with the software research and development teams.
  • Building cloud platforms for the development of company applications.
  • Maintaining production systems.

Requirements:

  • 8-10 years of experience as a big data engineer.
  • Must be proficient with Python & PySpark.
  • In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services.
  • Must have extensive experience with Delta Tables, JSON, Parquet file format.
  • Good to have experience with AWS data analytics services like Athena, Glue, Redshift, EMR.
  • Familiarity with Data warehousing will be a plus.
  • Must have Knowledge of NoSQL and RDBMS databases.
  • Good communication skills.
  • Ability to solve complex data processing, transformation related problems


  • Big Data Lead

    3 days ago

    Pune, India Populace World Solutions Full time

    Designation: Big Data Lead Location: Pune Experience: 8-10 years Reports To Product Engineering Head Job Overview We are looking to hire a talented big data engineer to develop and manage our companys Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes,...

  • Big Data Lead

    7 days ago

    Pune, Maharashtra, India Persistent Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Big Data Senior Developer

    3 days ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Big Data Senior Developer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).  •...

  • Big Data Senior Developer

    3 days ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Big Data Senior Developer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).  • Bachelor...

  • Lead Big Data Engineer

    3 weeks ago

    Pune, India Devlats Pvt Ltd Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features which would helpcustomers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security Risk Prioritization...

  • Big Data

    6 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Lead Big Data Engineer

    3 weeks ago

    Pune, India WorkiFicient Full time

    Job Description :Roles And Responsibility :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems...

  • Lead Big Data Software Engineer

    3 days ago

    Pune, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Big Data

    3 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...