Big Data Lead

6 hours ago

Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Designation: Big Data Lead/Architect

Location: Pune

Experience: 8-10 years

NP - immediate joiner/15-30 days' notice

Job Overview

We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.

To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.

Responsibilities:

  • Meeting with managers to determine the company's Big Data needs.
  • Developing big data solutions on AWS, using Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, Hadoop, etc.
  • Loading disparate data sets and conducting pre-processing services using Athena, Glue, Spark, etc.
  • Collaborating with the software research and development teams.
  • Building cloud platforms for the development of company applications.
  • Maintaining production systems.

Requirements:

  • 8-10 years of experience as a big data engineer.
  • Must be proficient with Python & PySpark.
  • In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services.
  • Must have extensive experience with Delta Tables, JSON, Parquet file format.
  • Good to have experience with AWS data analytics services like Athena, Glue, Redshift, EMR.
  • Familiarity with Data warehousing will be a plus.
  • Must have Knowledge of NoSQL and RDBMS databases.
  • Good communication skills.
  • Ability to solve complex data processing, transformation related problems

  • Big Data

    2 days ago

    Pune, Maharashtra, India Vi (Vodafone Idea) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GM - Application Operations Vodafone Idea Limited is an Aditya Birla Group and Vodafone Group partnership. It is India's leading telecom service provider. The Company provides pan India Voice and Data services across 2G, 3G and 4G platform. With the large spectrum portfolio to support the growing demand for data and voice, the company is committed to...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Datametica Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Architect GCPExperience: 10–12 YearsLocation: PuneRoleWe are looking for a Big Data Architect with deep GCP expertise to define, design, and lead cloud-native data platforms for enterprise clients. You will be responsible for architecting large-scale data lakes, warehouses, and pipelines on GCP, modernizing on-premise workloads, and...

  • Big Data Lead

    6 days ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Investor Services, a leading business line in the Citi Services and offers the full spectrum of capabilities to clients including Custody, Fund Accounting, Investment Accounting, Fund Administration, Middle Office Services, Performance and Risk Analytics, Transfer Agency and Securities lending across multiple jurisdictions.Investor Services has embarked on...

  • Big Data Cloud Architect

    2 days ago

    Pune, Maharashtra, India Recruin Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on expertise in cloud-based big data technologies, a strong background in the software development life cycle (SDLC), and experience in microservices and backend...

  • Lead Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability.Key Responsibilities:Design, develop, and maintain big data pipelines using PySpark and...

  • Lead Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability.Key Responsibilities:Design, develop, and maintain big data pipelines using PySpark and...

  • Big Data Architect

    1 week ago

    Pune, Maharashtra, India Datametica Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We at Onix Datametica Solutions Private Limited are looking for Bigdata Lead who have a passion for cloud with knowledge of different on-premise and cloud Data implementation in the field of Big Data and Analytic s including and not limiting to Teradata, Netezza, Exadata, Oracle, Cloudera, Hortonworks and alike. Ideal candidates should have technical...

  • Big Data

    4 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Work Location:Pune(Work-from -Office mode)Notice Period:Immediate to 30 DaysExperience:2+ yearsMust Have skills:Hadoop Administration (Cloudera CDP/CDH, Hortonworks HDP) – hands-on experience in setup, configuration, and support.Linux/Unix System Administration – strong knowledge of OS internals, shell/bash scripting, and automation.Security...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Citi Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.Responsibilities:Architect Data solutions...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities:Architect Data...