Data Architect

7 hours ago

Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

We are seeking a skilled Data Architect to develop, optimize and maintain data pipelines that drive business growth and analytics initiatives. This role will focus on building robust workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration primarily using Azure Databricks, Azure Data Lake and Microsoft Purview.

Key Responsibilities
  1. Pipeline Development: Design, build and deploy ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform and curate governance and operational metadata from multiple sources landed in Databricks.
  2. Granular Data Quality Capture: Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.
  3. Governance Metrics Automation: Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.
  4. Microsoft Purview Integration: Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.
  5. Data Retention & Policy Enforcement: Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  6. Job & Query Monitoring: Build pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.
  7. Metadata Storage & Optimization: Maintain curated Delta tables for governance metrics, structured for efficient dashboard consumption.
  8. Testing & Troubleshooting: Monitor pipeline execution, optimize performance, and resolve issues quickly.
  9. Collaboration: Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues.
  10. Security & Compliance: Ensure all pipelines meet organizational governance, privacy, and security standards.
Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
  • 4+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL, and ETL/ELT pipeline design.
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines.
  • Working knowledge of Microsoft Purview for metadata management, lineage capture, and classification.
  • Experience with Azure Data Factory or equivalent orchestration tools.
  • Understanding of data modeling, metadata structures, and data cataloging concepts.
  • Strong debugging, performance tuning, and problem-solving skills.
  • Ability to document pipeline logic and collaborate with cross-functional teams.
Preferred Qualifications
  • Microsoft certification in Azure Data Engineering.
  • Experience in governance-heavy or regulated environments (e.g., finance, healthcare, hospitality).
  • Exposure to Power BI or other BI tools as a data source consumer.
  • Familiarity with DevOps/CI-CD for data pipelines in Azure.
  • Experience integrating both cloud and on-premises data sources into Azure.

  • Azure Data Engineer

    2 days ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 26,00,000

    Job TitleAzure Data Engineer (Data Architect)We are seeking a seasoned Data Engineer to join our team. This is an exciting opportunity for a professional with expertise in Azure DataBricks and Pyspark to drive data-driven decision making.

  • Senior Databricks Data Architect

    10 hours ago

    Erode, Tamil Nadu, India beBeeDatabricks Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Databricks Data ArchitectWe are seeking a highly skilled and experienced Senior Databricks Data Architect to join our dynamic data engineering team. The ideal candidate will be well-versed in designing, developing, and maintaining scalable and high-performance data pipelines using Databricks and PySpark.Lead the development of innovative...

  • Data Architect Specialist

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Architect SpecialistWe are seeking a seasoned data professional to craft and refine large-scale data architectures. The ideal candidate will be responsible for facilitating seamless data integration, transformation, and analytics to support strategic business initiatives.Key Responsibilities:Craft and maintain scalable data pipelines using AWS services...

  • Chief Data Platform Architect

    7 hours ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect with deep expertise in Microsoft Azure to design, build and optimize scalable data architectures and Lakehouse solutions.This role involves working closely with cross-functional teams to provide thought leadership and deliver robust secure and high-performance data solutions that...

  • Senior Data Engineer

    2 days ago

    Erode, Tamil Nadu, India beBeeEngineering Full time ₹ 25,00,000 - ₹ 30,00,000

    Strategic Data Engineering ManagerThis is a senior-level data engineering management position that requires extensive experience in Big Data platforms, cloud architecture, and team leadership.The ideal candidate will oversee the development of end-to-end data solutions using Azure Data Services and Databricks, collaborate with cross-functional teams to...

  • Data Architect

    2 weeks ago

    Erode, Tamil Nadu, India InvokHR Solutions Full time

    About the client A boutique AI and data engineering firm, founded in 2018 and headquartered in Gurgaon, India, that empowers Fortune 1000 companies through AI-powered decision intelligence—especially in finance and supply chain transformation—delivering over US $2 billion in financial benefits while fostering a highly developed people-first culture...

  • Chief Data Officer

    2 days ago

    Erode, Tamil Nadu, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Roles and Responsibilities">We are seeking a skilled Data Architect to lead the design, development, and maintenance of data systems. This role requires proactive collaboration with cross-functional teams to ensure high standards of data quality and performance.The successful candidate will be responsible for:

  • Senior Enterprise Data Strategist

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 24,00,000

    Job Title:Data ArchitectAbout the Role:We're seeking a skilled Data Architect to design, develop and govern our data architecture and pipelines.Key Responsibilities:Design scalable and robust data architectures for data warehousing and enterprise data platforms.Develop and optimize data pipelines using tools such as Fivetran and Cloud Composer.Collaborate...

  • Data Transformation Expert

    3 days ago

    Erode, Tamil Nadu, India beBeeDataArchitect Full time ₹ 1,70,00,000 - ₹ 2,10,00,000

    Discover a world of opportunity as a Data ArchitectUnlock your potential in this exciting role where you will play a key part in helping clients transform their finance functions through the power of advanced analytics

  • Chief Data Architect

    23 hours ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionA Data Engineer is responsible for designing, developing, and maintaining robust data pipelines and ETL processes using data platforms for the organization's centralized data warehouse.Key responsibilities include conceptualizing and owning the build out of problem-solving data marts for consumption by data science and BI teams, evaluating...