Principal Data Platform Architect

24 hours ago

Amrāvati, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Senior Azure Data Engineer

We are seeking an experienced Senior Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and managing data pipelines and transformation frameworks.

Job Description:

The role involves working closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern Azure tools and best practices.

  • Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
Key Responsibilities:

• Design data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.

• Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).

• Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.

• Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.

• Support data quality checks, logging, alerting, and observability mechanisms for production workloads.

• Participate in sprint ceremonies and contribute to task estimation and delivery planning.

Required Skills and Qualifications:
  • 5+ years of experience in data engineering roles.
  • Hands-on experience with:
    • Azure Data Factory (ADF) – building pipelines, triggers, linked services.
    • Azure Databricks – building and managing Spark jobs in PySpark.
    • Azure Synapse Analytics – data warehousing, SQL queries, workspace orchestration.
    • Apache Kafka – consuming and processing real-time data streams.
  • Strong in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines).
  • Understanding of data lake architecture and modern data warehousing principles.
Benefits:

This is a unique opportunity to work on challenging projects and collaborate with experienced professionals in the field of data engineering.

Preferred Certifications:

Microsoft Certified: Azure Data Engineer Associate

Databricks Certified Associate Developer for Apache Spark

Azure Fundamentals (AZ-900) – optional but helpful

  • Senior Data Platform Architect

    1 day ago

    Amrāvati, Maharashtra, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned Data Architect to lead the design and implementation of cutting-edge data platforms. This individual will collaborate closely with business and technical stakeholders to deliver scalable, secure, and high-performance solutions that align with organizational objectives.

  • Principal Consultant

    2 weeks ago

    Amrāvati, Maharashtra, India beBeeQuality Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job DescriptionWe are seeking an experienced Principal Consultant to join our team. As a key member of our trading platform, you will be responsible for ensuring the quality, stability, and performance of our trading systems.As a Principal Consultant, you will work closely with development teams, business stakeholders, and QA teams to drive and implement...

  • Solutions Architect

    2 days ago

    Amrāvati, Maharashtra, India beBeecloud architect Full time US$ 15,00,000 - US$ 25,00,000

    Job Opportunity">Cloud Architect PositionSeeking an experienced Cloud Architect to design and implement scalable, resilient, and cost-effective cloud architectures across multiple cloud platforms.

  • Strategic Platform Architect

    4 days ago

    Amrāvati, Maharashtra, India beBeeEnterprise Full time US$ 1,80,000 - US$ 2,50,000

    Job OverviewWe are seeking a seasoned Enterprise Architect to lead our platform's architecture and strategy, ensuring alignment with our business objectives.Key ResponsibilitiesDevelop and maintain the enterprise-wide platform architecture and technical roadmap, ensuring solutions are scalable, maintainable, and aligned with business strategy.Establish and...

  • Data Intelligence Platform Architect

    2 weeks ago

    Amrāvati, Maharashtra, India beBeeAI Full time US$ 1,50,000 - US$ 2,00,000

    About the RoleOur organization is creating a next-generation data intelligence platform built on microservices architecture. We are seeking an experienced architect to lead the development of our Entity Resolution and Network Generation services.The PlatformWe leverage cloud-native technology with Kubernetes orchestration, Apache Spark for distributed...

  • Senior Distributed Systems Architect

    4 days ago

    Amrāvati, Maharashtra, India beBeePrincipal Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionAs a seasoned Principal Engineer, you will design and build distributed systems that form the backbone of our platform. Your primary focus will be on architecting and developing foundational backend services that ensure high-quality, scalable solutions.

  • Principal Data Architect

    3 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Roles and Responsibilities:">Design, build, and operate scalable data infrastructure to support distributed computing and data orchestration for large language model research.Develop high-throughput systems for data ingestion, processing, and transformation to support model development.Collaborate with research teams to deliver critical data assets for...

  • Principal Data Engineering Professional

    1 week ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Business Data ArchitectWe are seeking a skilled Business Data Architect to design, build, and optimize scalable data platforms. The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design, build, and maintain ETL/ELT pipelines using...

  • Principal Data Professional

    6 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a highly skilled data professional to join our organization. The ideal candidate will bring deep expertise in cloud-based data engineering, healthcare data modeling, and consulting.Responsibilities:Design and develop scalable data pipelines using Azure Data Factory, Databricks, and Kafka.Architect and implement robust data...

  • Data Architect Opportunity

    1 week ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Cloud Data Architect RoleWe are seeking an experienced Cloud Data Architect to work remotely on designing, governing, and implementing conceptual, logical, and physical data models across modern cloud platforms.The ideal candidate will have strong experience with SQL Data Warehouses, Databricks Delta Lakehouse, and other MPP databases, combined with domain...