Chief Data Architect

1 week ago

Bengaluru Bangalore Chennai Gurgaon Gurugram, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878
Senior Data Engineer Position

We are seeking a skilled professional to join our team of data engineers and analysts working with various stakeholders.

This is a senior role that requires the candidate to design, implement, and maintain sophisticated software solutions leveraging expertise in Python, PySpark, SQL, and API integration on Azure platform services like ADF and Databricks.

  • The ideal candidate will be responsible for providing high-quality data pipeline engineering solutions using Azure Data Factory and Databricks, handling ingestion and transformation of data from diverse internal and external sources.
  • They will also leverage various AI Agents like Genie and Copilot to improve productivity and efficiency.

Key Responsibilities:

  • Data Pipeline Engineering: Design and build scalable, high-performance ETL/ELT pipelines using Azure Data Factory and Databricks, handling ingestion and transformation of data from diverse internal and external sources.
  • Advanced Data Preparation & Transformation: Implement complex transformation logic using PySpark and SQL to standardize, cleanse, and normalize large-scale datasets including nested JSON.
  • Data Modeling: Create and maintain dimensional models (star/snowflake schemas) and structured outputs to support analytics, reporting, and regulatory use cases.
  • Performance Optimization: Profile and tune PySpark jobs for performance using techniques such as caching, partitioning, and broadcast joins. Ensure pipelines scale efficiently with increasing data volumes.
  • Governance & Quality Assurance: Apply robust data validation, quality checks, and maintain metadata lineage with Unity Catalog. Adhere to governance standards across the pipeline lifecycle.
  • Cross-Functional Collaboration: Partner with business analysts, product managers, data scientists, and QA teams to understand data requirements and deliver fit-for-purpose solutions.
  • Documentation & Knowledge Sharing: Maintain comprehensive documentation on data flows, architecture, and models. Support upskilling and mentoring of junior team members.
  • AI-Enhanced Development: Utilize Databricks Genie and related AI assistants to accelerate development, ensure code quality, and assist in troubleshooting.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or equivalent practical experience.
  • Total experience of 6 to 8 years and 5+ years in data engineering roles with hands-on experience in PySpark, SQL, and Azure-based data ecosystems.
  • Strong background in building robust and maintainable pipelines using Azure Data Factory and Databricks.
  • Proven expertise in data modeling, schema design, and large-scale data preparation for analytics.
  • Proficient in Git, version control workflows, and CI/CD practices.
  • Solid understanding of data governance, metadata management, and data quality frameworks.
  • Exposure to Unity Catalog, Databricks Genie, or other AI-enhanced data engineering tools is preferred.
  • Excellent analytical, debugging, and stakeholder communication skills. Familiarity with Agile or Scrum-based delivery.
  • Experience with machine learning workflows and integrating model outputs into data pipelines.
  • Exposure to Salesforce, Alfresco, or Schedule A contract data formats is a bonus.

  • Chief Data Architect

    7 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Chief Data ArchitectWe are seeking a skilled Chief Data Architect to lead our data engineering team. As a key member of the organization, you will work closely with clients and team members to understand their requirements and develop architectures that meet their needs.The ideal candidate will have experience in leading teams, providing technical...

  • Chief Data Architect

    5 days ago

    Gurgaon / Gurugram, Bengaluru / Bangalore, India beBeeDataModeller Full time ₹ 1,04,000 - ₹ 13,08,780

    Job DescriptionWe are seeking a skilled Data Modeller to join our team. As a Data Modeller, you will be responsible for designing and developing logical and physical data models to support business requirements.You will participate in requirements definition, analysis, and the design of data models for Dimensional Data Model, NoSQL, or Graph Data Model.Lead...

  • Chief Data Innovation Officer

    4 days ago

    Bengaluru / Bangalore, Gurgaon / Gurugram, Chennai, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Chief Data Innovation OfficerAs a key member of our team, you will play a vital role in driving innovation and excellence in data science. Your primary responsibility will be to design and implement advanced solutions utilizing Large Language Models (LLMs). You will work closely with cross-functional teams to align messaging, contribute to...

  • Chief Data Architect

    3 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time

    Job Title: Chief Data ArchitectAbout the RoleWe are seeking an experienced Data Engineer with expertise in ontology development and knowledge graph implementation to lead our data infrastructure team. As a key member of our organization, you will be responsible for designing, developing, and maintaining comprehensive ontologies and semantic data models on...

  • Chief Data Architect

    6 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Chief Data Architect to lead our data engineering efforts. This is a full-time role that involves designing and developing scalable data pipelines, collaborating with cross-functional teams, and ensuring data quality.About the RoleThe ideal candidate will have 5+ years of experience in SQL, Python, PySpark, and Linux, as...

  • Chief Data Architect

    7 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Chief Data ArchitectThe ideal candidate will have a deep understanding of data architecture and be able to contribute to the development and execution of our data strategy.We are looking for someone with strong analytical skills and experience in designing and implementing large-scale data systems.Key Responsibilities:Contribute to the development...

  • Chief Data Pipeline Architect

    5 days ago

    Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a highly skilled Chief Data Pipeline Architect to lead the development of our data infrastructure.Key Responsibilities:Develop and implement scalable data pipelines using AWS cloud services and technologiesDesign and optimize data storage solutions for high-performance computingCollaborate with cross-functional teams to integrate...

  • Chief Cybersecurity Architect

    6 days ago

    Hyderabad / Secunderabad, Telangana, Chennai, Bengaluru / Bangalore, India beBeeCybersecurity Full time ₹ 7,00,000 - ₹ 12,00,000

    Job OverviewWe are seeking a highly skilled Chief Cybersecurity Architect to join our team.This is a senior leadership role that will lead the development of our organization’s cybersecurity strategy and architecture.Key Responsibilities

  • Chief Data Architect for Generative AI

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:We are seeking a highly skilled Chief Data Architect for Generative AI to design and implement robust data architectures that support AI and machine learning (ML) workloads, including Generative AI applications.This role will involve developing and optimizing data pipelines for training, validating, and deploying AI models efficiently and...

  • Chief Data Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 60,00,000 - ₹ 1,00,00,000

    Job SummaryWe are seeking an experienced Chief Data Architect to design and develop a robust data engineering environment.Key Responsibilities:Data Engineering Development & Optimization: Design, develop, and optimize ETL pipelines using open-source or cloud ETL tools (e.g., Apache Nifi, Talend).Python Scripting for Data Analysis: Write Python scripts to...