Skilled Data Architect Wanted

1 day ago

Aurangabad, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

Overview

We are seeking a skilled Data Architect to develop and optimize automated data pipelines supporting business intelligence initiatives. This role will focus on building scalable workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration primarily using Azure Databricks, Azure Data Lake, and Microsoft Purview.

Key Responsibilities
  • Pipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks.
  • Granular Data Quality Capture – Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.
  • Governance Metrics Automation – Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.
  • Microsoft Purview Integration – Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.
  • Data Retention & Policy Enforcement – Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  • Job & Query Monitoring – Build pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.
  • Metadata Storage & Optimization – Maintain curated Delta tables for governance metrics, structured for efficient dashboard consumption.
  • Testing & Troubleshooting – Monitor pipeline execution, optimize performance, and resolve issues quickly.
  • Collaboration – Work closely with the engineering team, QA, and reporting teams to validate metrics and resolve data quality issues.
  • Security & Compliance – Ensure all pipelines meet organizational governance, privacy, and security standards.

Requirements

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field
  • 4+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake
  • Proficiency in PySpark, SQL, and ETL/ELT pipeline design
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines
  • Working knowledge of Microsoft Purview for metadata management, lineage capture, and classification
  • Experience with Azure Data Factory or equivalent orchestration tools
  • Understanding of data modeling, metadata structures, and data cataloging concepts
  • Strong debugging, performance tuning, and problem-solving skills
  • Ability to document pipeline logic and collaborate with cross-functional teams

Preferred Qualifications

  • Microsoft certification in Azure Data Engineering
  • Experience in governance-heavy or regulated environments
  • Exposure to Power BI or other BI tools as a data source consumer
  • Familiarity with DevOps/CI-CD for data pipelines in Azure
  • Experience integrating both cloud and on-premises data sources into Azure

  • Data Architect

    2 days ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleAs a seasoned Data Architect, you will play a crucial role in designing and implementing scalable, secure, and high-performance data solutions on Databricks. Key Responsibilities include developing and maintaining data pipelines, collaborating with stakeholders, and optimizing data workflows for performance, cost-efficiency, and reliability.Key...

  • Database Data Architect

    2 days ago

    Aurangabad, Maharashtra, India beBeeDataArchitect Full time ₹ 24,50,000 - ₹ 31,00,000

    We're seeking a highly skilled Database Data Architect to design and implement our data warehouse architecture.About the Role:As a Database Data Architect, you'll work closely with our development team to develop and maintain ETL processes using RDBMS such as MySQL and Oracle SQL. You'll also be responsible for designing and implementing data pipelines using...

  • Senior Data Architect Position

    1 day ago

    Aurangabad, Maharashtra, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleA seasoned data architect is sought after to develop, deploy, and maintain scalable data pipelines for our organization.Data Architecture: Design and engineer a data warehousing strategy utilizing AWS services such as Lambda, DMS, and Glue for seamless data ingestion and transformation processes.StoredProcedure Optimization: Develop and refine...

  • Cloud Data Architect

    2 days ago

    Aurangabad, Maharashtra, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Our organization is seeking an experienced Engineering Manager to lead our Big Data and Azure teams.About the Role:As a seasoned professional, you will be responsible for designing and delivering scalable data pipelines and analytics platforms on Microsoft Azure and Databricks.The ideal candidate will have expertise in cloud-native architecture, data...

  • Highly Skilled AWS Redshift Engineer Wanted

    2 days ago

    Aurangabad, Maharashtra, India beBeeRedshift Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled Senior Redshift Engineer to support our clients in architecting, optimizing, and scaling AWS Redshift environments.

  • Highly Skilled Senior Data Professional Wanted

    13 hours ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Role Summary">We are seeking a highly skilled professional to fill the role of Senior Data Engineer. This is a remote-first opportunity that requires 4–5 years of experience in designing and implementing high-quality, secure, and scalable data pipelines and systems.">This position involves working with various tools such as Snowflake, Fivetran, DBT, and...

  • Chief Data Architect

    1 day ago

    Aurangabad, Maharashtra, India beBeeDataArchitect Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled and innovative Data Architect to lead our data ecosystem strategy. As a key member of the team, you will be responsible for designing and implementing scalable and secure enterprise data architecture solutions that meet business needs.Key Responsibilities:Design and develop end-to-end data pipelines using ETL/ELT...

  • Highly Skilled Software Developer Wanted

    1 day ago

    Aurangabad, Maharashtra, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Highly Skilled Software Developer WantedKey Responsibilities:Design and implement scalable software applications using Java and related technologies.Develop high-quality software systems that meet client expectations.Collaborate with cross-functional teams to identify project requirements and prioritize tasks effectively.Implement unit tests and...

  • Azure Data Solutions Architect

    2 days ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Lead Azure Data Engineer">We are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have deep hands-on expertise in designing, developing, and optimizing data pipelines using Azure and Databricks.">About the Role:">This is a senior technical role with high expectations. The consultant must be...

  • Advanced Data Architect

    9 hours ago

    Aurangabad, Maharashtra, India beBeeDataLeader Full time ₹ 2,00,00,000 - ₹ 2,34,00,000

    About Foodsmart:We're a leading provider of innovative nutrition solutions, empowering individuals to make informed food choices. Our robust network of Registered Dietitians delivers tailored guidance for healthier living.Our platform seamlessly integrates dietary assessments, nutrition counseling, and cost-effective meal planning, catering to diverse needs...