Principal Big Data Specialist

7 days ago

Pune, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

We are seeking a Senior Data Engineer to join our data analytics team. As a key member of our organization, you will be responsible for designing and developing robust ETL pipelines using Apache Spark.


Roles and Responsibilities
  • Develop and manage scalable, reliable, and high-performance data processing pipelines to extract, transform, and load data from various systems to the Enterprise Data Warehouse/Data Lake hosted on cloud platforms like AWS or Azure
  • Collaborate cross-functionally to design effective data solutions that meet business needs
  • Implement data workflows utilizing cloud-based orchestration services for efficient execution
  • Monitor, troubleshoot, and optimize pipeline performance and data quality
  • Maintain high coding standards and produce thorough documentation contributing to high-level (HLD) and low-level (LLD) design discussionsTechnical Skills
    • Minimum 7 years of progressive experience building solutions in Big Data environments
    • Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant, and reliable in terms of data movement
    • 3+ years of hands-on expertise in Python, Spark, and Kafka
    • Strong command of cloud-based services such as AWS or Azure
    • Strong hands-on capabilities on SQL and NoSQL technologies
    • Solid understanding of data warehousing, modeling, and ETL concepts
    • Familiarity with High-Level Design (HLD) and Low-Level Design (LLD) principles
● Strong written and verbal communication skills

  • Big Data Engineering Specialist

    1 day ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 1,04,000 - ₹ 1,30,878

    We are seeking a seasoned professional to fill the role of Big Data Engineering Specialist. This is an exceptional opportunity for individuals with expertise in designing and developing large-scale data processing systems.The ideal candidate will have extensive knowledge of big data technologies and a strong track record of delivering projects on time and...

  • Principal Big Data Specialist

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Lead Data EngineerOverviewWe are seeking a skilled professional to serve as the primary technical lead for support and enhancement of assigned data products.Main ResponsibilitiesServe as the technical lead for support and enhancement of assigned data products.Ensure incident resolution, problem management, and enhancement delivery within agreed...

  • Big Data Technology Specialist

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data Engineer PositionOur organization is looking for a highly skilled Big Data Engineer to join our team.Required Skills:Must have 3-8 years of strong experience in Java J2EE technologies with expertise in big data technology stacks such as Hadoop, Spark, Kafka, HBase, and Hive.Strong fundamentals including data structures, algorithms, object-oriented...

  • Senior Big Data Engineer Role

    18 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    \\Big Data SpecialistTo excel in this role, you must possess a unique blend of technical expertise and problem-solving skills.You will collaborate closely with cross-functional teams to devise and build scalable solutions for complex data challenges.Your responsibilities will include designing and implementing systems to process and analyze large datasets...

  • Big Data Solutions Professional

    3 days ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Solutions SpecialistWe are seeking an experienced data solutions specialist to join our team.About the Role:This position plays a key role in designing and developing software solutions using Java and other big data technologies. As part of a squad, you will be actively working on strategic and challenging projects, including the...

  • Big Data Specialist

    3 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data EngineerWe are seeking a highly skilled software engineer to design and develop high-quality software applications using big data technologies.Responsibilities:Design and develop software applications using Hadoop, Scala, and Java technologies.Work closely with team leads or software development managers to ensure good quality,...

  • Big Data

    14 hours ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data

    3 days ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Principal Big Data Architect

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineer- Apache DruidJoin a leading organization as a highly skilled data engineer to leverage your expertise in designing, building and maintaining scalable, real-time analytics systems.Key Responsibilities:Design and implement efficient data pipelines using Apache Druid in production environments.Collaborate with cross-functional teams to...

  • Big Data

    4 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time

    Job DescriptionATG_JOB_0059Advanced Data AnalyticsGlobal Delivery Center (Pune)Full Time10-15 ExperienceMinimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir&aposs Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required...