Senior Data Architect

11 hours ago

Kolkata, West Bengal, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

Job Title: Azure Data Engineer

About the Role:

We are seeking an experienced Data Engineer to develop, optimize and maintain automated data pipelines. The role will focus on building production-ready workflows for ingestion, transformation and quality checks.

The successful candidate will have a strong background in designing, building and deploying robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake). They will also have experience with Azure Data Factory or equivalent orchestration tools.

Key Responsibilities:

  1. Pipeline Development – Design, build and deploy robust ETL/ELT pipelines to ingest, transform and curate governance and operational metadata from multiple sources landed in Databricks.
  2. Granular Data Quality Capture – Implement profiling logic to capture issue-level metadata to support drill-down from dashboards into specific records and enable targeted remediation.
  3. Governance Metrics Automation – Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.
  4. Microsoft Purview Integration – Automate asset onboarding, metadata enrichment, classification tagging and lineage extraction for integration into governance reporting.
  5. Data Retention & Policy Enforcement – Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).
  6. Job & Query Monitoring – Build pipelines to track job performance, SLA adherence and query costs for cost and performance optimization.
  7. Metadata Storage & Optimization – Maintain curated Delta tables for governance metrics, structured for efficient dashboard consumption.
  8. Testing & Troubleshooting – Monitor pipeline execution, optimize performance and resolve issues quickly.
  9. Collaboration – Work closely with the lead engineer, QA and reporting teams to validate metrics and resolve data quality issues.
  10. Security & Compliance – Ensure all pipelines meet organizational governance, privacy and security standards.
Required Qualifications:
  • Bachelor's degree in Computer Science, Engineering, Information Systems or related field.
  • 4+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL and ETL/ELT pipeline design.
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines.
  • Working knowledge of Microsoft Purview for metadata management, lineage capture and classification.
  • Experience with Azure Data Factory or equivalent orchestration tools.
  • Understanding of data modeling, metadata structures and data cataloging concepts.
  • Strong debugging, performance tuning and problem-solving skills.
  • Ability to document pipeline logic and collaborate with cross-functional teams.

  • Senior Data Architect

    2 days ago

    Kolkata, West Bengal, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000

    Job Summary:We are seeking a highly skilled Data Architect to design, build, and maintain complex data pipelines using AWS Glue, Lambda, and DBT.About the Role:Develop and optimize data models in Snowflake for scalability and performance.Write efficient and optimized SQL queries for data extraction, transformation, and loading.Collaborate with business...

  • Data Platform Architect

    14 hours ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data EngineerWe are seeking a skilled Senior Data Engineer to design, build, and maintain our modern data platform. This role is perfect for someone with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a fast-paced environment.You will work across the full data stack from ingestion and...

  • Senior Solution Architect

    1 day ago

    Kolkata, West Bengal, India Esko Full time

    Job DescriptionWe are seeking a Senior Solution Architect to lead the end-to-end design and implementation of enterprise software. This role is a perfect fit for an experienced professional with a strong development background who can provide thought leadership and technical guidance to both internal teams and customers. You will work on a hybrid model, with...

  • Senior Snowflake Architect

    3 weeks ago

    Kolkata, West Bengal, India Nazztec Private Limited Full time

    Job Title : Senior Snowflake ArchitectExperience : 13 20 YearsLocation : Bangalore, Pune, Chennai, Kolkata, GurugramJob Type : Full-TimeWork Mode : On-siteRole Overview :We are seeking a highly experienced Snowflake Architect / Data Engineering Lead with deep technical expertise in Snowflake, DBT, SQL, and cloud data engineering. The ideal candidate should...

  • Data Architect

    2 weeks ago

    Kolkata, West Bengal, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for Data architect Job Description: Skills: AWS, Glue, Redshift, PySpark Location: Pune / Kolkata Experience: 10 to 12 Years Strong hands-on experience in Python programming and PySpark. Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache Spark and Hadoop ecosystem. ...

  • Senior Freelance Data Architect

    2 days ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    As a Freelance Data Architect, you will be responsible for designing and implementing data models that support the growth of our business. This role involves working with various stakeholders to understand their data needs and creating solutions that meet those requirements.Key Responsibilities:Design and deliver conceptual, logical, and physical data models...

  • Senior Cloud Data Architect

    14 hours ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Main Responsibilities:Develop and maintain scalable and high-performance data pipelines using Databricks and PySpark.Implement and...

  • Chief Data Architect

    2 days ago

    Kolkata, West Bengal, India beBeeDatabase Full time

    Database Architect Job DescriptionAbout the Role:The Database Architect will be responsible for designing and implementing database solutions that meet the needs of our organization.Key Responsibilities:Design and implement database architectures that are scalable, secure, and efficient.Develop and maintain database schema, including table relationships and...

  • Senior Enterprise Data Specialist

    5 days ago

    Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Architect IWe are seeking a highly skilled Data Architect to join our team.The ideal candidate will have a strong background in data architecture principles, data modeling techniques, and best practices. They will be proficient in SQL and have experience with database platforms such as Snowflake, SQL Server, or MySQL.The successful candidate...

  • Data Integration Architect

    5 days ago

    Kolkata, West Bengal, India beBeeDataIntegrator Full time

    Job Description:We are seeking an experienced BODS professional to lead the design and architecture of our data integration solutions. As a Senior Consultant, you will be responsible for guiding the development and implementation of projects, ensuring alignment with client requirements and industry best practices.