Data Engineer

Key Responsibilities include: Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows. POC Support: Implement optimized data pipelines for Agentic AI POCs using realistic or synthetic data sources. API & Microservices Development: Build RESTful APIs and Fast API-based microservices for data access and model interaction within Azure-hosted environments. Model Deployment Support: Enable end-to-end deployment of AI models using Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure DevOps. Data Governance & Compliance: Ensure data quality, lineage, and compliance with responsible AI and enterprise data standards. Skills & Experience Required: Minimum YoE: 5 Years Data Engineering & Azure Ecosystem: Strong hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Blob Storage Azure Machine Learning, Azure DevOps, Azure Kubernetes Service (AKS) Agentic AI Enablement: Experience supporting GPT model fine-tuning, data preparation for LLMs, synthetic data generation Vector/Graph DBs (neo4j), Azure AI Search, LangChain data loaders Context engineering for agent memory and tool chaining Responsible AI principles, model explainability, data privacy controls Programming & Micro Services Architecture: Strong skills in Python, PySpark, SQL, Fast API (Pydantic, REST APIs) ETL/ELT workflows, data modeling, schema design, feature engineering Containerization using Docker/Kubernetes, and CI/CD automation Soft Skills Ability to collaborate effectively with AI Consultants, Architects, and Business Analysts Strong communication skills to explain data engineering concepts to non- technical stakeholders & ability to transfer industry knowledge to peers Preferred Certifications Microsoft Certified: Azure Data Engineer Associate (DP-203) Microsoft Certified: Azure AI Engineer Associate (AI-102) SnowPro Data Engineer or other relevant specialization in Data Engineering, Generative AI, or Agentic AI frameworks Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows. POC Support: Implement optimized data pipelines for Agentic AI POCs using realistic or synthetic data sources. API & Microservices Development: Build RESTful APIs and Fast API-based microservices for data access and model interaction within Azure-hosted environments. Model Deployment Support: Enable end-to-end deployment of AI models using Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure DevOps. Data Governance & Compliance: Ensure data quality, lineage, and compliance with responsible AI and enterprise data standards. Skills & Experience Required: Minimum YoE: 5 Years Data Engineering & Azure Ecosystem: Strong hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Blob Storage Azure Machine Learning, Azure DevOps, Azure Kubernetes Service (AKS) Agentic AI Enablement: Experience supporting GPT model fine-tuning, data preparation for LLMs, synthetic data generation Vector/Graph DBs (neo4j), Azure AI Search, LangChain data loaders Context engineering for agent memory and tool chaining Responsible AI principles, model explainability, data privacy controls Programming & Micro Services Architecture: Strong skills in Python, PySpark, SQL, Fast API (Pydantic, REST APIs) ETL/ELT workflows, data modeling, schema design, feature engineering Containerization using Docker/Kubernetes, and CI/CD automation Soft Skills Ability to collaborate effectively with AI Consultants, Architects, and Business Analysts Strong communication skills to explain data engineering concepts to non- technical stakeholders & ability to transfer industry knowledge to peers Preferred Certifications Microsoft Certified: Azure Data Engineer Associate (DP-203) Microsoft Certified: Azure AI Engineer Associate (AI-102) SnowPro Data Engineer or other relevant specialization in Data Engineering, Generative AI, or Agentic AI frameworks