Cloud-Optimized Data Architect

1 week ago

Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000
Data Engineering Expert Sought

Job Summary:

A seasoned Data Engineer is required to design, develop, and maintain scalable data pipelines using Azure Databricks, Azure Data Lake, and Microsoft Purview.

Responsibilities:

  • Pipeline Development: Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) for ingestion, transformation, and metadata integration.
  • Granular Data Quality Capture: Implement profiling logic to capture issue-level metadata for targeted remediation.
  • Governance Metrics Automation: Develop pipelines for generating metrics on data quality, lineage, job monitoring, access permissions, query cost, usage, retention, and policy enforcement.
  • Microsoft Purview Integration: Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for governance reporting.
  • Retention & Policy Enforcement: Implement logic for retention tracking and policy compliance monitoring.
  • Job & Query Monitoring: Build pipelines for tracking job performance, SLA adherence, and query costs.
  • Metadata Storage & Optimization: Maintain curated Delta tables for efficient dashboard consumption.
  • Testing & Troubleshooting: Monitor pipeline execution, optimize performance, and resolve issues quickly.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • 4+ years of hands-on data engineering experience with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL, and ETL/ELT pipeline design.
  • Demonstrated experience building granular data quality checks and integrating governance logic into pipelines.
  • Working knowledge of Microsoft Purview for metadata management and lineage capture.
  • Experience with Azure Data Factory or equivalent orchestration tools.

We offer a competitive salary package and opportunities for growth and professional development. Join our team of experienced professionals who are passionate about delivering innovative solutions. If you are a motivated and detail-oriented individual who is looking for a new challenge, we encourage you to apply.

Please note that only candidates with the required skills and qualifications will be contacted for further consideration. We appreciate your interest in this opportunity and look forward to reviewing your application.

  • Cloud Data Architect

    45 minutes ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data ArchitectAbout the Role:As a Cloud Data Architect, you will be responsible for designing and implementing scalable data solutions on cloud platforms.Design and implement data pipelines, warehouses, and data lakes.Work on data modeling, ETL/ELT processes, and performance tuning.Collaborate with business and technical teams to deliver...

  • Cloud Data Systems Architect

    3 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data EngineerWe are seeking a skilled professional with expertise in designing, implementing and maintaining robust data pipelines and building scalable data lakes.The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like...

  • Cloud Data Architect

    3 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a highly skilled Cloud Data Architect to design and build scalable data pipelines in the cloud. This role requires experience with AWS EMR, Glue, PySpark, Airflow, and Python.Key ResponsibilitiesDesigning and developing efficient data pipelines using cloud-based technologies.Collaborating with data analysts, scientists, and engineers to...

  • Advanced Cloud Architect

    16 hours ago

    Hubli, Karnataka, India beBeeData Full time ₹ 18,96,000 - ₹ 25,20,000

    We are seeking a Senior Data Engineer with extensive experience in designing and optimizing data pipelines, cloud and big data solutions, and leadership skills to mentor junior engineers.Key ResponsibilitiesData Pipeline Design & Optimization: Develop ETL/ELT workflows using AWS Glue, Airflow, Databricks, StreamSets, and Snowflake.Cloud & Big Data Solutions:...

  • Cloud Solutions Architect

    5 days ago

    Hubli, Karnataka, India beBeeCloudArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Solutions ArchitectDescription:We are seeking a skilled Cloud Solutions Architect to design, develop, and deploy cloud-based solutions for our organization.As a Cloud Solutions Architect, you will be responsible for creating cloud strategies, defining technical requirements, and ensuring scalability, security, and reliability of cloud...

  • Cloud Solutions Architect

    2 weeks ago

    Hubli, Karnataka, India beBeeSolution Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Overview:A leading technology firm is seeking a Cloud Solutions Architect to spearhead the design, deployment, and continuous improvement of CRM solutions that drive business growth, automation, and data-driven decision-making.This role demands advanced technical expertise to manage and optimize cloud platforms across corporate sales and marketing...

  • Enterprise Cloud Architect

    6 days ago

    Hubli, Karnataka, India beBeeCloudArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Enterprise Cloud Architect">We are seeking an experienced cloud architect to lead the design and implementation of our Service Cloud solutions. The ideal candidate will have a deep understanding of Salesforce architecture, data models, and integration frameworks.">Responsibilities:">">Design and own the end-to-end architecture for Salesforce...

  • Cloud Data Engineer

    1 day ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,70,88,000 - ₹ 2,41,12,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled data engineer to join our team.The ideal candidate will be responsible for designing, implementing and optimizing data pipelines on our data platform.Data Pipeline Development: Design, develop and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data...

  • Cloud Data Governance Expert

    6 days ago

    Hubli, Karnataka, India beBeeDataGovernance Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data Governance ExpertWe are seeking a highly skilled Cloud Data Architect with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP).Key Responsibilities:Data Solution Design: Design and architect end-to-end data solutions on GCP, aligning with business and technical requirements.Data...

  • Cloud Data Architect

    1 day ago

    Hubli, Karnataka, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an accomplished Data Architect to lead the design and implementation of our data storage solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage.Data Management and ArchitectureDevelop and Implement Scalable Data Storage Solutions:Utilize Azure services to create highly scalable and performant data...