Chief Data Pipeline Architect

3 days ago

Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000
Job Title:

Azure Data Engineer

Job Description:

We are seeking a skilled data engineer to develop, optimize and maintain automated data pipelines supporting governance and analytics initiatives.

This role involves designing, building and deploying ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform and curate metadata from multiple sources.

The ideal candidate will have expertise in pipeline development, granular data quality capture, governance metrics automation, Microsoft Purview integration, data retention & policy enforcement and job & query monitoring.

Required Skills and Qualifications:
  • Bachelor's degree in Computer Science, Engineering or related field.
  • 4+ years of hands-on data engineering experience with Azure Databricks and Azure Data Lake.
  • Proficiency in PySpark, SQL and ETL/ELT pipeline design.

Key Responsibilities Include:

  • Pipeline Development: Design, build and deploy ETL/ELT pipelines in Databricks.
  • Granular Data Quality Capture: Implement profiling logic to capture issue-level metadata.
  • Governance Metrics Automation: Develop pipelines to generate metrics for dashboards.
  • Microsoft Purview Integration: Automate asset onboarding, metadata enrichment and lineage extraction.
  • Data Retention & Policy Enforcement: Implement logic for retention tracking and policy compliance monitoring.
  • Job & Query Monitoring: Build pipelines to track job performance and SLA adherence.

  • Freelance Data Pipeline Architect

    24 hours ago

    Tirupati, Andhra Pradesh, India beBeeAzureDataFactory Full time ₹ 30,00,000 - ₹ 40,00,000

    We are seeking a highly skilled Freelance Azure Data Factory Specialist to support our data integration and ETL needs.About the RoleThe ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines across multiple sources and destinations using Azure Data Factory (ADF).Key...

  • Chief Data Solutions Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 12,60,000 - ₹ 20,16,000

    Job Opportunity: Data ArchitectOverview:We are seeking a skilled and motivated Data Architect to design, develop, and maintain scalable data systems that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data architecture, cloud technologies, and software development, and will...

  • Chief AI Infrastructure Architect

    1 day ago

    Tirupati, Andhra Pradesh, India beBeescalability Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Chief AI Infrastructure ArchitectAbout the Role:In this pivotal position, you will spearhead the design and implementation of our cutting-edge AI infrastructure. Your primary objective is to ensure seamless scalability while aligning with our overarching technical vision.Key Responsibilities:

  • Data Architect

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 12,01,000 - ₹ 20,10,000

    Job Title: Data ArchitectWe are seeking a skilled professional to design, build and optimize scalable data pipelines.The ideal candidate will be responsible for enabling seamless data integration, transformation and analytics to support business intelligence and advanced analytics initiatives.Main Responsibilities:Design and maintain ETL/ELT pipelines using...

  • Senior AWS Data Pipeline Architect

    3 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking an experienced Data Engineer with expertise in AWS to join our organization. As a Data Engineer, you will design and implement robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making across multiple domains.The ideal candidate will have a strong command of SQL for creating, managing, and...

  • Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeedata Full time US$ 1,80,000 - US$ 2,00,000

    Job Title:Data Architect – Cloud Integration SpecialistWe are seeking an experienced Data Architect to lead our cloud integration strategy, focusing on scalable data pipelines and real-time data integration workflows.

  • Chief Data Architect

    3 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,50,000

    Data Engineering RoleWe are seeking a skilled Data Engineer to develop and implement robust pipelines for transforming large, complex technical datasets into high-quality structured data.

  • Chief Data Architect

    1 day ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to design and optimize data solutions that power analytics, reporting, and strategic initiatives.The ideal candidate will have deep expertise in ETL development, data modeling, and financial data domains, particularly within banking systems.Key Responsibilities:Design, build, and maintain...

  • Cloud Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 24,50,000

    Job Title: Cloud Data ArchitectThe successful candidate will design and build scalable data pipelines to efficiently curate and ingest data.They will work with Azure cloud services to deploy and manage robust data solutions, utilizing CI/CD pipelines for seamless workflows.Cross-functional collaboration is essential to ensure data integrity, security, and...

  • Chief Data Operations Officer

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Senior Data ArchitectJob Description:Data architects play a pivotal role in designing, building and maintaining scalable data systems. As a senior data architect, you will be responsible for extending your expertise in data engineering, data architecture, pipeline creation and big data technologies to ensure highest standards of data quality and...