Big Data Architect Lead

2 days ago

Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Overview

We are seeking a seasoned professional to lead our data engineering team. This is an exceptional opportunity for a talented individual to join our organization and drive the development of large-scale data systems.

Key Responsibilities
  • Lead a distributed team of data engineers across multiple geographies and time zones, fostering collaboration and ensuring the delivery of high-quality projects.
  • Develop and implement effective cross-team collaboration strategies with architects, product managers, and operations teams.
Technical Requirements
  • Mastery of Scala and Python programming languages.
  • In-depth knowledge of Apache Spark (batch & streaming), including its internal workings and migration strategies.
  • Deep understanding of HDFS internals and experience with table formats like Iceberg, Delta Lake, or Apache Hudi for schema evolution, ACID transactions, and time travel.
  • Experience with running Spark and/or Flink jobs on Kubernetes (e.g., Spark-on-K8s operator, Flink-on-K8s).
  • Familiarity with distributed blob storages like Ceph or AWS S3.
  • Skill in building ingestion, transformation, and enrichment pipelines for large datasets.
  • Expertise in infrastructure-as-Code provisioning using Terraform and Helm.
Benefits

As a member of our team, you will have access to:

  • A dynamic and collaborative work environment.
  • The opportunity to work on cutting-edge projects and technologies.
  • Ongoing training and professional development opportunities.

About Us

We are a leading provider of technology consulting, platform, and product engineering services, as well as advanced analytics solutions. Our expertise lies in combining technical vision with business acumen to deliver positive outcomes for enterprise companies undergoing transformation. With 7+ years of experience in AI leadership, we possess profound expertise and ongoing investment in data, cloud, DevOps, application modernization, and customer experience.

  • Chief Big Data Architect

    6 days ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Technical LeadWe are seeking an experienced technical lead to join our team. As a technical lead, you will be responsible for building a scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to an engineering manager and requires...

  • Enterprise Big Data Solutions Architect

    5 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Big Data Engineer JobGreetings from a leading technology firmWe are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 6 years and maximum of 12 years of experience in big data engineering.Key Responsibilities:Designing, developing, and deploying big data solutions using PySpark and Hive.Working with...

  • Big Data Specialist

    6 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistThis is a key role for a seasoned professional to lead big data projects from start to finish. With 6-12 years of experience, you will be responsible for spearheading big data initiatives and driving business outcomes.Key Responsibilities:Develop innovative big data solutions using PySpark, Hive, Spark, HBase, and DQ tools.Lead agile scrum...

  • Big Data and Cloud Expert

    2 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Architect PositionJob Description:We are seeking a skilled Cloud Data Architect to join our team. As a key member of our Digital & Data Solutions (DDS) group, you will be responsible for designing and implementing Big Data architectures and cloud adoption strategies.This is a full-time hybrid role that offers flexibility for remote work. The ideal...

  • Senior Big Data Professional

    6 hours ago

    Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ExpertWe are seeking a highly skilled expert to lead our big data projects. The ideal candidate will have expertise in distributed computing principles, Apache Spark, and Python programming.5-12 years of experience in Big Data & Data related technologyExpert-level understanding of distributed computing principlesStrong skills in Apache...

  • Big Data Specialist

    1 week ago

    Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data EngineerJob Summary:We are seeking an experienced and skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies.Key Responsibilities:Design and develop scalable big data...

  • Big Data Analyst

    2 days ago

    Bellary, Karnataka, India beBeeDataSpecialist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a talented professional to join our team as a Data Specialist.The ideal candidate will have 6-12 years of experience in big data technologies, including Scala Spark and Java Spark SQL. They should also have a good understanding of data structures and algorithms, and have worked on implementation projects building data pipelines, transformation...

  • Data Governance Solutions Architect

    2 days ago

    Bellary, Karnataka, India beBeeSolutions Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    ">Solutions Architect">We are seeking a skilled Solutions Architect to design, deploy, and maintain big data-based solutions. As a Solutions Architect, your work will be a combination of hands-on contribution, customer engagement, and technical team management.You will be responsible for:Technical management across the full life cycle of big data-based...

  • Lead Data Infrastructure Specialist

    4 hours ago

    Bellary, Karnataka, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Architect RoleWe are seeking a visionary Senior Data Architect to join our Global Data & Advanced Analytics team. As the designer of our data ecosystem, you will play a pivotal role in shaping our organization's data architecture and ensuring seamless data flow across products.About the RoleDesign and strategy: Collaborate with the data...

  • Etl Data Architect

    7 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Senior ETL Developer (Informatica BDM/DEI)Key Responsibilities:Design and develop scalable data pipelines using Informatica BDM/DEI.Integrate data from structured and unstructured sources including big data platforms.Apply strong data warehousing concepts to ensure efficient data modeling and transformation.Collaborate with data architects and...