Master Azure Data Engineer

3 days ago

Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Title: Azure Data Engineer (5-9 years)

We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have hands-on experience in the Microsoft Azure data ecosystem, designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.

The successful candidate will work closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern Azure tools and best practices.

  • Key Responsibilities:
  • Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  • Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
  • Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).
  • Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.
  • Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.
  • Support data quality checks, logging, alerting, and observability mechanisms for production workloads.
  • Participate in sprint ceremonies and contribute to task estimation and delivery planning.
Required Skills and Qualifications:
  • Must-Have Skills:
  • 5+ years of experience in data engineering roles.
  • Hands-on experience with:
    • Azure Data Factory (ADF) – building pipelines, triggers, linked services.
    • Azure Databricks – building and managing Spark jobs in PySpark.
    • Azure Synapse Analytics – data warehousing, SQL queries, workspace orchestration.
    • Apache Kafka – consuming and processing real-time data streams.
  • Strong in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines).
  • Understanding of data lake architecture and modern data warehousing principles.
Benefits:
  • Nice-to-Have Skills:
  • Experience with Delta Lake, Event Hub, or Azure Stream Analytics.
  • Familiarity with infrastructure-as-code tools like Terraform or ARM templates.
  • Exposure to Data Governance, Data Quality frameworks, or metadata management.
  • Understanding of networking, security, and access control in Azure data services.
Preferred Certifications:
  • Microsoft Certified: Azure Data Engineer Associate.
  • Databricks Certified Associate Developer for Apache Spark.
  • Azure Fundamentals (AZ-900) – optional but helpful.

  • Azure Data Solutions Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Azure Data Engineer Position OverviewWe are seeking an experienced Azure data engineer to take on a key role in our organization. This position involves building end-to-end data pipelines and delivering scalable data solutions on the Azure platform.This is an exciting opportunity for a skilled professional to contribute to the growth of our business by...

  • Azure Cloud Data Architect

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Azure Data Engineer JobWe're seeking a highly skilled Azure data engineer to join our team. In this role, you will be responsible for designing, building, and maintaining large-scale data processing systems on the Azure platform.Requirements:Expertise in AWS/Azure/SAP: You should have a deep understanding of cloud-based technologies and be able to leverage...

  • Azure Data Solutions Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleWe are seeking an experienced Azure Data Engineer to join our hybrid development + support team.The successful candidate will be responsible for building, maintaining, and supporting data & analytics solutions using Azure Data Engineering technologies with a strong focus on performance, scalability, and reliability.

  • Azure Cloud Data Migration Specialist

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 26,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team and contribute to the design, development, and management of large-scale data pipelines using modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and...

  • Lead Azure Data Strategist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Azure Data & AI SpecialistWe are seeking a highly skilled Senior Azure Data & AI Specialist to drive the technical depth, accuracy, and instructional value of our training content. You will lead the definition and review of presentations, labs, and real-world scenarios on Azure's modern data and AI stack, working closely with content creators to shape...

  • Azure Data Systems Engineer

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Description:\As a data professional, you will be responsible for designing, implementing, and maintaining large-scale data systems on Azure.\\\\

  • Chief Data Engineering Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Opportunity:Azure Data EngineerAbout the Role:As a key member of our team, you will be responsible for designing and implementing data engineering solutions using Microsoft Azure.Key Responsibilities: Create scalable data processing systems, including data ingestion, processing, storage, and analytics. Develop real-time and close-to-real-time data...

  • Azure Data Factory Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job DescriptionThreatXIntel, a leading cybersecurity firm, is seeking an experienced Freelance Azure Data Factory Specialist to support data integration and ETL needs. The ideal consultant will have expertise in Azure ADF pipelines, data orchestration, and transformations.Key Responsibilities:Design, build, and maintain Azure Data Factory pipelines for ETL...

  • Master Data Management Specialist

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewOxford client is seeking a skilled data management professional to join their team. The ideal candidate will have hands-on experience implementing, customizing, and supporting Master Data Management (MDM) solutions.Key Responsibilities:Designing, configuring, and integrating Reltio with enterprise systems.Ensuring data quality, governance, and...

  • Data Engineer

    7 days ago

    Thiruvananthapuram, Kerala, India Sentient Scripts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a skilled and proactive Data Engineer with 3-6 years of hands-on experience in building robust data solutions on the Azure platform. The ideal candidate will have expertise in Azure Data Factory, Azure Data Lake, Azure Databricks, SQL, and Python, with additional experience in Power BI or Tableau considered a plus. You will be instrumental in...