Data Engineer

Key Responsibilities include:Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows.POC Support: Implement optimized data pipelines for Agentic AI POCs using realistic or synthetic data sources.API & Microservices Development: Build RESTful APIs and Fast API-based microservices for data access and model interaction within Azure-hosted environments.Model Deployment Support: Enable end-to-end deployment of AI models usingAzure Machine Learning, Azure Kubernetes Service (AKS), and Azure DevOps.Data Governance & Compliance: Ensure data quality, lineage, and compliance with responsible AI and enterprise data standards.Skills & Experience Required:Minimum YoE: 5 YearsData Engineering & Azure Ecosystem: Strong hands-on experience withAzure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure BlobStorageAzure Machine Learning, Azure DevOps, Azure Kubernetes Service (AKS) Agentic AI Enablement: Experience supportingGPT model fine-tuning, data preparation for LLMs, synthetic data generationVector/Graph DBs (neo4j), Azure AI Search, LangChain data loadersContext engineering for agent memory and tool chainingResponsible AI principles, model explainability, data privacy controlsProgramming & Micro Services Architecture: Strong skills inPython, PySpark, SQL, Fast API (Pydantic, REST APIs)ETL/ELT workflows, data modeling, schema design, feature engineeringContainerization using Docker/Kubernetes, and CI/CD automationSoft SkillsAbility to collaborate effectively with AI Consultants, Architects, and Business AnalystsStrong communication skills to explain data engineering concepts to non- technical stakeholders & ability to transfer industry knowledge to peersPreferred CertificationsMicrosoft Certified: Azure Data Engineer Associate (DP-203)Microsoft Certified: Azure AI Engineer Associate (AI-102)SnowPro Data Engineer or other relevant specialization in Data Engineering, Generative AI, or Agentic AI frameworksData Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.AI Data Enablement: Collaborate with AI Consultants to prepare and managedatasets for supervised, unsupervised, and synthetic learning workflows.POC Support: Implement optimized data pipelines for Agentic AI POCs using realistic or synthetic data sources.API & Microservices Development: Build RESTful APIs and Fast API-based microservices for data access and model interaction within Azure-hosted environments.Model Deployment Support: Enable end-to-end deployment of AI models using Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure DevOps.Data Governance & Compliance: Ensure data quality, lineage, and compliance with responsible AI and enterprise data standards.Skills & Experience Required:Minimum YoE: 5 YearsData Engineering & Azure Ecosystem: Strong hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Blob StorageAzure Machine Learning, Azure DevOps, Azure Kubernetes Service (AKS) Agentic AI Enablement: Experience supporting GPT model fine-tuning, data preparation for LLMs, synthetic data generationVector/Graph DBs (neo4j), Azure AI Search, LangChain data loadersContext engineering for agent memory and tool chainingResponsible AI principles, model explainability, data privacy controlsProgramming & Micro Services Architecture: Strong skills inPython, PySpark, SQL, Fast API (Pydantic, REST APIs)ETL/ELT workflows, data modeling, schema design, feature engineeringContainerization using Docker/Kubernetes, and CI/CD automationSoft SkillsAbility to collaborate effectively with AI Consultants, Architects, and Business AnalystsStrong communication skills to explain data engineering concepts to non-technical stakeholders & ability to transfer industry knowledge to peersPreferred CertificationsMicrosoft Certified: Azure Data Engineer Associate (DP-203)Microsoft Certified: Azure AI Engineer Associate (AI-102)SnowPro Data Engineer or other relevant specialization in Data Engineering, Generative AI, or Agentic AI frameworks