Principal Big Data Specialist

3 days ago

Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

Job Title: Lead Data Engineer

Overview

We are seeking a skilled professional to serve as the primary technical lead for support and enhancement of assigned data products.

Main Responsibilities
  • Serve as the technical lead for support and enhancement of assigned data products.
  • Ensure incident resolution, problem management, and enhancement delivery within agreed upon service level agreements (SLAs).
  • Perform root cause analysis (RCA) and provide technical solutions to recurring issues.
  • Design end-to-end data engineering solutions that are scalable and modular.
  • Lead all data engineering initiatives in Agile implementations.
Technical Expertise
  • Provide technical direction and architectural guidance for improvements, optimizations, and issue resolutions.
  • Drive best practices in code performance tuning, extract transform load (ETL) processing, and cloud-native data management.
  • Lead the modernization of legacy data pipelines and applications by leveraging Amazon Web Services (AWS) services.
  • Utilize PySpark, Structured Query Language (SQL), and Python to manage big data processing pipelines efficiently.
Client Engagement
  • Maintain high visibility with client stakeholders and act as a trusted technical advisor.
  • Proactively identify and suggest areas for improvement or innovation to enhance business outcomes.
  • Communicate complex technical concepts clearly to various audiences.
Team Management
  • Lead a cross-functional team of engineers, providing mentorship and driving upskilling.
  • Monitor team performance, support capacity planning, and ensure timely, high-quality deliveries.
  • Enforce adherence to governance, documentation, and change management practices.
Required Skills & Qualifications
  • Extensive experience in Data Engineering or Application Support and Development.
  • Deep hands-on expertise in the AWS ecosystem.
  • Proficiency in PySpark, SQL, and Python, with experience in handling big data pipelines.
  • Strong application debugging skills across batch and near real-time systems.
  • Good knowledge of incident lifecycle management, RCA, and performance optimization.
  • Proven leadership experience leading engineering teams, preferably in support/enhancement environments.
  • Excellent communication and client-facing skills.
  • Experience with tools like JIRA, Confluence, Git, and Jenkins.
Good to Have
  • Experience in on-prem to AWS migration projects.
  • Familiarity with legacy technologies and their interaction with modern cloud stacks.
  • Good knowledge of designing Hive tables with partitioning for performance.

  • Big Data Engineering Specialist

    1 day ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 1,04,000 - ₹ 1,30,878

    We are seeking a seasoned professional to fill the role of Big Data Engineering Specialist. This is an exceptional opportunity for individuals with expertise in designing and developing large-scale data processing systems.The ideal candidate will have extensive knowledge of big data technologies and a strong track record of delivering projects on time and...

  • Principal Big Data Specialist

    7 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    We are seeking a Senior Data Engineer to join our data analytics team. As a key member of our organization, you will be responsible for designing and developing robust ETL pipelines using Apache Spark.Roles and ResponsibilitiesDevelop and manage scalable, reliable, and high-performance data processing pipelines to extract, transform, and load data from...

  • Big Data Technology Specialist

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data Engineer PositionOur organization is looking for a highly skilled Big Data Engineer to join our team.Required Skills:Must have 3-8 years of strong experience in Java J2EE technologies with expertise in big data technology stacks such as Hadoop, Spark, Kafka, HBase, and Hive.Strong fundamentals including data structures, algorithms, object-oriented...

  • Senior Big Data Engineer Role

    15 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    \\Big Data SpecialistTo excel in this role, you must possess a unique blend of technical expertise and problem-solving skills.You will collaborate closely with cross-functional teams to devise and build scalable solutions for complex data challenges.Your responsibilities will include designing and implementing systems to process and analyze large datasets...

  • Big Data Solutions Professional

    3 days ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Solutions SpecialistWe are seeking an experienced data solutions specialist to join our team.About the Role:This position plays a key role in designing and developing software solutions using Java and other big data technologies. As part of a squad, you will be actively working on strategic and challenging projects, including the...

  • Big Data Specialist

    3 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data EngineerWe are seeking a highly skilled software engineer to design and develop high-quality software applications using big data technologies.Responsibilities:Design and develop software applications using Hadoop, Scala, and Java technologies.Work closely with team leads or software development managers to ensure good quality,...

  • Big Data

    11 hours ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data

    2 days ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Principal Big Data Architect

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineer- Apache DruidJoin a leading organization as a highly skilled data engineer to leverage your expertise in designing, building and maintaining scalable, real-time analytics systems.Key Responsibilities:Design and implement efficient data pipelines using Apache Druid in production environments.Collaborate with cross-functional teams to...

  • Big Data

    3 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time

    Job DescriptionATG_JOB_0059Advanced Data AnalyticsGlobal Delivery Center (Pune)Full Time10-15 ExperienceMinimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir&aposs Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required...