Big Data Lead

8 hours ago

Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Designation: Big Data Lead/Architect

Location: Pune

Experience: 8-10 years

NP - immediate joiner/15-30 days' notice

Job Overview

We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.

To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.

Responsibilities:

  • Meeting with managers to determine the company's Big Data needs.
  • Developing big data solutions on AWS, using Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, Hadoop, etc.
  • Loading disparate data sets and conducting pre-processing services using Athena, Glue, Spark, etc.
  • Collaborating with the software research and development teams.
  • Building cloud platforms for the development of company applications.
  • Maintaining production systems.

Requirements:

  • 8-10 years of experience as a big data engineer.
  • Must be proficient with Python & PySpark.
  • In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services.
  • Must have extensive experience with Delta Tables, JSON, Parquet file format.
  • Good to have experience with AWS data analytics services like Athena, Glue, Redshift, EMR.
  • Familiarity with Data warehousing will be a plus.
  • Must have Knowledge of NoSQL and RDBMS databases.
  • Good communication skills.
  • Ability to solve complex data processing, transformation related problems

  • Big Data Lead

    1 week ago

    Pune, Maharashtra, India Persistent Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Big Data

    6 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data

    3 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data

    3 days ago

    Pune, Maharashtra, India Vi (Vodafone Idea) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GM - Application Operations Vodafone Idea Limited is an Aditya Birla Group and Vodafone Group partnership. It is India's leading telecom service provider. The Company provides pan India Voice and Data services across 2G, 3G and 4G platform. With the large spectrum portfolio to support the growing demand for data and voice, the company is committed to...

  • Big Data

    4 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Datametica Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Architect GCPExperience: 10–12 YearsLocation: PuneRoleWe are looking for a Big Data Architect with deep GCP expertise to define, design, and lead cloud-native data platforms for enterprise clients. You will be responsible for architecting large-scale data lakes, warehouses, and pipelines on GCP, modernizing on-premise workloads, and...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Lead

    5 days ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Investor Services, a leading business line in the Citi Services and offers the full spectrum of capabilities to clients including Custody, Fund Accounting, Investment Accounting, Fund Administration, Middle Office Services, Performance and Risk Analytics, Transfer Agency and Securities lending across multiple jurisdictions.Investor Services has embarked on...