Chief Data Systems Architect

5 days ago

Bengaluru, Karnataka, India beBeeData Full time

Key Data Architect Role for Advanced Spark Solutions

We are looking for an experienced and innovative Data Architect to design, implement, and lead modern data processing solutions using Apache Spark. The ideal candidate will have extensive knowledge of distributed data processing, large-scale data pipelines, and cloud-native data platforms.

This is a strategic role focused on creating scalable, fault-tolerant, and high-performance data systems.

  • Design and implement large-scale data pipelines using Spark (batch and streaming).
  • Optimize Spark jobs for performance, cost-efficiency, and scalability.
  • Develop and enforce enterprise data architecture standards and best practices.
  • Guide the transition from traditional ETL platforms to Spark-based solutions.
  • Lead the integration of Spark-based pipelines into cloud platforms (e.g., Azure Fabric/Spark pools).
  • Establish robust monitoring, alerting, and logging for Spark applications.

Required Skills & Qualifications:

  • 10+ years of experience in data engineering, with 7+ years of hands-on experience with Apache Spark (PySpark/Scala).
  • Proficiency in Spark optimization techniques, Monitoring, Caching, advanced SQL, and distributed data design.
  • Experience with Spark on Databricks and Azure Fabric.
  • Solid understanding of Delta Lake, Spark Structured Streaming, and data pipelines.
  • Strong experience in cloud platforms (Azure).
  • Proven ability to handle large-scale datasets (terabytes to petabytes).
  • Familiarity with data lakehouse architectures, schema evolution, and data governance.
  • Candidate to be experienced in Power BI, with at least 3+ years of experience.

Preferred Qualifications:

  • Experience implementing real-time analytics using Spark Streaming or Structured Streaming.
  • Certifications in Databricks, Fabric or Spark would be a plus.

  • Chief Product Security Architect

    4 days ago

    Bengaluru, Karnataka, India beBeeRisk Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Chief Product Security Architect We are seeking an accomplished and experienced Chief Product Security Architect to lead our product security initiatives. This role will be responsible for designing, implementing, and maintaining the security framework of our products.Job Description:The Chief Product Security Architect will work closely with...

  • Chief Distribution Architect

    4 days ago

    Bengaluru, Karnataka, India beBeeEntrepreneur Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Co-Founder & Chief Business OfficerSpearhead India's first advisor ownership platform and empower financial advisors to own a piece of the value they create.Insurance advisors have been treated as disposable resources, building vast businesses and generating immense value but their wealth is capped at their last commission cheque.The SolutionRFL's philosophy...

  • Chief Data Processing Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeBigquery Full time

    Job Title: Chief Data Processing Specialist About the Role: We are seeking a highly skilled and experienced data processing professional to join our team. As a Chief Data Processing Specialist, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities: Developing and implementing efficient...

  • Building the Operating System for Enterprise Decisions

    2 days ago

    Bengaluru, Karnataka, India beBeeDevelopment Full time ₹ 15,00,000 - ₹ 20,00,000

    Backend System ArchitectDecisionX AI is a Self-Learning, Goal-Aware Decision OS that transforms how enterprises move from Goal → Plan → Act → Learn → Evolve.Our platform unifies siloed enterprise data and powers a suite of Decision Agents (AI Chief of Staff, AI Strategist, AI Analyst) to help organisations act with clarity and precision. As an early...

  • Chief Java Microservices Architect

    3 weeks ago

    Bengaluru, Karnataka, India Scripting Resumes Full time

    We are assisting our client in hiring for a Chief Java Microservices Architect Offshore Delivery Development position. This is a full-time role with multiple location options Bangalore, Chennai, or Pune.The client is seeking immediate joiners or candidates who can join within 15 days, and welcomes applications from professionals willing to relocate.You can...

  • Data Systems Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    As a skilled Data Engineering Consultant, you will be responsible for developing and implementing high-performance data systems, applications, and pipelines to process large datasets from multiple sources. This role requires strong technical expertise in building scalable architectures and collaborating with cross-functional teams to deliver solutions that...

  • Chief Data Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.Key ResponsibilitiesDesign, develop, and maintain scalable and robust...

  • Chief Data Architect

    10 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Data PotentialAs a skilled Data Engineer, you will play a crucial role in designing, building, and optimizing scalable data pipelines and architectures. This will involve expertise in seamless data collection, storage, and analysis.About the RoleYou will be part of an emerging team focused on building and improving our innovative data warehouse...

  • Chief Data Architect

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Data Architect to lead our data architecture lifecycle and design scalable, secure, and high-performance Big Data architectures using Databricks, Apache Spark, and cloud-native services.The ideal candidate will have hands-on expertise in Apache Spark, Python, SQL, and cloud platforms (Azure/AWS/GCP), as well as...

  • Data Systems Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Transform your career as a Data Systems Architect where you will lead the development of a cutting-edge data platform built on Apache open-source technologies.About the RoleWe seek a skilled expert to drive the technical direction of the project, submit patches, and review contributions to enhance functionality, security, and reliability.In this role, you...