Big Data Lead

3 days ago

Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Designation: Big Data Lead/Architect

Location: Pune

Experience: 8-10 years

NP - immediate joiner/15-30 days' notice

Job Overview

We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.

To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.

Responsibilities:

  • Meeting with managers to determine the company's Big Data needs.
  • Developing big data solutions on AWS, using Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, Hadoop, etc.
  • Loading disparate data sets and conducting pre-processing services using Athena, Glue, Spark, etc.
  • Collaborating with the software research and development teams.
  • Building cloud platforms for the development of company applications.
  • Maintaining production systems.

Requirements:

  • 8-10 years of experience as a big data engineer.
  • Must be proficient with Python & PySpark.
  • In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services.
  • Must have extensive experience with Delta Tables, JSON, Parquet file format.
  • Good to have experience with AWS data analytics services like Athena, Glue, Redshift, EMR.
  • Familiarity with Data warehousing will be a plus.
  • Must have Knowledge of NoSQL and RDBMS databases.
  • Good communication skills.
  • Ability to solve complex data processing, transformation related problems

  • Big Data Lead

    2 weeks ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Designation: Big Data LeadLocation: PuneExperience: 8-10 yearsReports To – Product Engineering HeadJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with...

  • Big Data Lead

    1 week ago

    Pune, Maharashtra, India Persistent Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Big Data Lead

    2 weeks ago

    Pune, Maharashtra, India DemandMatrix Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description At DemandMatrix, our vision is to disrupt the $100 billion sales and marketing intelligence industry by using domain knowledge, machine learning and AI. Fortune 100 companies like Microsoft, Google, Adobe, Amazon, IBM trust us to identify their next customer. Job Description What will you do?To help us go to the next level we are looking...

  • Tech Lead Data Engineer

    7 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Datametica Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Architect GCPExperience: 10–12 YearsLocation: PuneRoleWe are looking for a Big Data Architect with deep GCP expertise to define, design, and lead cloud-native data platforms for enterprise clients. You will be responsible for architecting large-scale data lakes, warehouses, and pipelines on GCP, modernizing on-premise workloads, and...

  • Big Data Developer Lead

    2 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Our is Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence: 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA).· Job Title: Big Data Developer...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Information Technology Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Big Data EngineerKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal solutions. - Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks. -...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Citi Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.Responsibilities:Architect Data solutions...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities:Architect Data...

  • Big Data Specialist

    6 days ago

    Pune, Maharashtra, India Atomic North Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Big Data EngineerLocation: Pune/Nagpur (WFO)Experience Required: 8+ Years**Long term onsite to Abu Dhabi**Job Summary:We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...