Chief Data Architect

19 hours ago

Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000
Job Title: Data Engineer

We are seeking a skilled data engineer to develop, optimize and maintain automated data pipelines supporting data governance and analytics initiatives.

This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking and metadata integration, primarily using Azure Databricks, Azure Data Lake and Microsoft Purview.

Key Responsibilities:
  • Pipeline Development – Design, build and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform and curate governance and operational metadata from multiple sources landed in Databricks.
  • Granular Data Quality Capture – Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.
  • Governance Metrics Automation – Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping and governance KPIs.
  • Microsoft Purview Integration – Automate asset onboarding, metadata enrichment, classification tagging and lineage extraction for integration into governance reporting.
  • Data Retention & Policy Enforcement – Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  • Job & Query Monitoring – Build pipelines to track job performance, SLA adherence and query costs for cost and performance optimization.
  • Metadata Storage & Optimization – Maintain curated Delta tables for governance metrics, structured for efficient dashboard consumption.
  • Testing & Troubleshooting – Monitor pipeline execution, optimize performance and resolve issues quickly.
  • Collaboration – Work closely with the lead engineer, QA and reporting teams to validate metrics and resolve data quality issues.
  • Security & Compliance – Ensure all pipelines meet organizational governance, privacy and security standards.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, Information Systems or related field.
  • 4+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL and ETL/ELT pipeline design.
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines.
  • Working knowledge of Microsoft Purview for metadata management, lineage capture and classification.
  • Experience with Azure Data Factory or equivalent orchestration tools.
  • Understanding of data modeling, metadata structures and data cataloging concepts.
  • Strong debugging, performance tuning and problem-solving skills.
  • Ability to document pipeline logic and collaborate with cross-functional teams.
Preferred Qualifications:
  • Microsoft certification in Azure Data Engineering.
  • Experience in governance-heavy or regulated environments.
  • Exposure to Power BI or other BI tools as a data source consumer.
  • Familiarity with DevOps/CI-CD for data pipelines in Azure.
  • Experience integrating both cloud and on-premises data sources into Azure.

  • Chief Data Solutions Architect

    19 hours ago

    Amrāvati, Maharashtra, India beBeeDataArchitect Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    About the Data Architect RoleWe are seeking a seasoned data professional to spearhead our end-to-end data architecture strategy and collaborate closely with cross-functional teams to create a robust and scalable data ecosystem.The ideal candidate will have deep technical expertise in data modeling, databases, cloud platforms, and integration frameworks, as...

  • Big Data Architect

    2 hours ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Big Data ArchitectWe are seeking a highly skilled Big Data Architect to design, develop, and optimize large-scale data pipelines and distributed data processing systems.The ideal candidate will have a proven track record in building scalable cloud-based data architectures using Scala, Spark, Python, Apache Kafka, and NiFi.

  • Data Architect

    20 hours ago

    Amrāvati, Maharashtra, India beBeeDatabase Full time ₹ 20,00,000

    Job Title: Data ArchitectAs a highly skilled data architect, you will play a key role in designing and implementing scalable and efficient data systems that support business growth. Your expertise will be instrumental in developing robust database solutions, integrating disparate data sources, and optimizing data flow to meet the evolving needs of our...

  • Data Architect Opportunity

    2 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Cloud Data Architect RoleWe are seeking an experienced Cloud Data Architect to work remotely on designing, governing, and implementing conceptual, logical, and physical data models across modern cloud platforms.The ideal candidate will have strong experience with SQL Data Warehouses, Databricks Delta Lakehouse, and other MPP databases, combined with domain...

  • Chief Data Architect

    1 hour ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineer RoleWe are seeking an experienced Data Engineer to design, build, and maintain robust data pipelines and ETL/ELT processes. This individual will develop data ingestion frameworks to collect data from various sources, implement data transformation and cleaning processes to ensure data quality and consistency, and optimize data pipeline...

  • Chief Data Architect

    16 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Roles and ResponsibilitiesDesign, develop, and execute end-to-end data pipelines on Azure. Create scalable data solutions that cater to business needs.Utilize expertise in PySpark, SQL, Azure Data Factory (ADF), Databricks (ADB), Data Lake (ADLS Gen2), and Python for data processing to deliver high-quality outputs.Work collaboratively with stakeholders...

  • Chief Data Architect

    22 hours ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking an accomplished data expert with in-depth knowledge of Microsoft Azure to design, build, and optimize scalable data pipelines and lakehouse architectures.Design, develop, and maintain large-scale data pipelines using Azure Data Factory and Azure Synapse Analytics for complex data processing and analysis.Become proficient in...

  • Chief Data Architect

    2 hours ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Azure Data Engineer || 9 to 12 yearsJob Description:Our organization is seeking a skilled professional with at least 9 years of experience in designing, building, and maintaining robust data pipelines. The ideal candidate will have expertise in Azure cloud services to deploy and manage scalable data solutions.Design and build efficient data...

  • Chief Data Architect

    6 hours ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Data Engineer to lead the development of our data infrastructure.Key Responsibilities:Design, implement, and maintain large-scale data pipelines using Azure Data Factory and Databricks.Develop and deploy data processing workflows using Python, R, or Scala.Collaborate with...

  • Chief Data Architect

    20 hours ago

    Amrāvati, Maharashtra, India beBeeDataScientist Full time ₹ 2,72,94,000 - ₹ 3,51,17,000

    Unlock Your Potential in Data ScienceAs a seasoned Machine Learning Engineer, you have the unique opportunity to drive innovation and value for clients across industries. Our team is comprised of talented professionals who balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical...