Chief Data Pipeline Architect

3 days ago

Rajkot, Gujarat, India beBeeData Full time US$ 80,000 - US$ 1,50,000
Job Title: Azure Data Engineer

We are seeking a skilled data engineer to design and implement scalable data pipelines using Azure Databricks.

The ideal candidate will have strong experience with Azure Databricks and Apache Spark, as well as proficiency in developing Azure Function Apps using C#, Python, or JavaScript.

Key Responsibilities:

  • Design and implement scalable data pipelines using Azure Databricks (PySpark/Scala).
  • Develop and deploy Azure Function Apps for event-driven data processing and automation.
  • Integrate Databricks with other Azure services like Data Lake Storage, Synapse, Event Hubs, Key Vault, etc.
  • Optimize Spark jobs for performance and cost-efficiency.
  • Implement CI/CD pipelines using Azure DevOps for Databricks notebooks and Function Apps.
  • Monitor and troubleshoot production workloads, ensuring high availability and reliability.

Required Skills & Qualifications:

  • Strong experience with Azure Databricks and Apache Spark (PySpark or Scala).
  • Proficiency in developing Azure Function Apps using C#, Python, or JavaScript.
  • Solid understanding of Azure Data Lake, Event Hubs, Blob Storage, and Key Vault.
  • Experience with CI/CD pipelines, Git, and Infrastructure as Code (ARM/Bicep/Terraform).
  • Familiarity with data modeling, ETL/ELT processes, and data governance.

Benefits:

  • Microsoft Certified: Azure Data Engineer Associate or similar certifications.
  • Experience with Delta Lake, MLflow, or Unity Catalog.
  • Knowledge of monitoring tools like Azure Monitor, Log Analytics, and Application Insights.

  • Strategic Data Architect

    1 day ago

    Rajkot, Gujarat, India beBeeData Full time US$ 15,00,000 - US$ 18,00,000

    Job TitleChief Data ArchitectKey Responsibilities:Design and optimize complex data pipelines using scalable architectures.Develop high-performance data solutions using distributed computing frameworks.Define and enforce data quality standards, ensuring timely, accurate, and complete data delivery.Maintain enterprise-grade data models using star and snowflake...

  • Chief Data Pipeline Architect

    21 hours ago

    Rajkot, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewA Data Engineer plays a pivotal role in our analytics division, responsible for designing and developing robust data pipelines and ETL processes using data platforms for the organization's centralized data warehouse.

  • Chief Data Architect

    2 days ago

    Rajkot, Gujarat, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job TitleAzure Data Engineering is a high-growth career opportunity for experienced data professionals looking to work on large-scale data engineering projects.About the RoleThis position involves designing and developing scalable data pipelines, implementing efficient data processing techniques using Spark, and collaborating with cross-functional teams to...

  • Chief Backend Technology Architect

    17 hours ago

    Rajkot, Gujarat, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking an expert Chief Backend Technology Architect to lead the design and development of our digital real estate platform. This is a complex initiative to build a comprehensive ecosystem integrating long-term sales, short-term stays, and advanced technologies including AI/ML, data analytics, Web3/blockchain, and conversational AI.This...

  • Chief Data Architect

    1 day ago

    Rajkot, Gujarat, India beBeeDataInsight Full time ₹ 15,00,000 - ₹ 30,00,000

    Unlock Data InsightsSapaad's unified commerce platforms deliver world-class software solutions for the food and beverage industry.A passionate team of experts drives innovation, introducing cutting-edge features that set the benchmark for F&B tech.As a Data Engineer, you will design and optimize data pipelines, infrastructure, and tools that power insights...

  • Data Pipeline Architect

    1 day ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About this role:We are seeking an experienced Data Engineer to join our team.This is a great opportunity for someone who wants to design, build and maintain robust data pipelines using Azure cloud services.The ideal candidate will have strong SQL skills, experience with Fabric, and hands-on experience with Azure Data Services.Responsibilities include...

  • Data Pipeline Architect

    1 week ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock Data Engineering PotentialThis role presents an exciting opportunity to leverage technical expertise in designing, developing, and maintaining robust data pipelines, warehouses, and analytics platforms. The successful candidate will collaborate with cross-functional teams to ensure seamless data flow from various marketing channels, ad platforms, and...

  • Chief Data Architect

    1 day ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,90,000

    Senior Data Engineer RoleWe are seeking an experienced Senior Data Engineer to fill a critical position in our organization.This role requires a strong background in building and scaling enterprise-grade data platforms, with expertise in ETL, Cloud, Data Warehousing, and Big Data ecosystems.The ideal candidate will have experience in designing and optimizing...

  • Build Data Pipelines

    3 days ago

    Rajkot, Gujarat, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,00,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled data architect to join our team.Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data.Work on AWS cloud infrastructure (including services like Pyspark, Glue, EMR, Lambda, Redshift, Athena, and other...

  • Chief Data Architect

    1 day ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are looking for a highly skilled and experienced data engineer to lead our team's data strategy.In this role, you will be responsible for designing and implementing scalable, high-performance data pipelines using Snowflake and dbt. You will also define architectural best practices and drive data transformation at scale.Key...