Product Architect

Product Architect - AI/ML Location: India/Offshore Experience: 12-15 years (Minimum 6-7 years in AI/ML Product Architecture) Location: -Pune preferred / Hyderabad (4 Days WFO) Role Overview Define and drive the technical product vision for enterprise AI/ML platforms in healthcare, translating business requirements into scalable architectures while ensuring delivery excellence and long-term product sustainability. This role requires hands-on leadership, flexible collaboration across time zones, and the ability to mentor engineering teams. Product & Technical Strategy • Architect end-to-end product solutions for processing clinical records, claims, and healthcare documentation • Design hybrid Azure/on-premises architectures supporting multi-tenant SaaS and enterprise deployment models • Establish product architecture principles, design patterns, and technology stack decisions • Evaluate build-vs-buy decisions for AI capabilities, Drive technical feasibility assessments and rapid prototyping for new product features • Own non-functional requirements: performance, security, compliance (HIPAA), scalability, reliability • Present architectural proposals and technical roadmaps to leadership through clear presentations and documentation AI/ML Product Engineering • Design and implement fine-tuning pipelines for domain-specific LLMs (e.g. Llama, Mistral, Phi-3) on medical datasets • Architect MLOps frameworks enabling continuous model improvement: training, evaluation, deployment, monitoring • Build "built-in-intelligence-products" using advanced AI models. • Implement distributed training infrastructure on Azure ML with GPU optimization (RTX5090/4090/A100/H100 clusters) • Create model evaluation frameworks with domain-specific metrics and quality benchmarks • Develop synthetic data generation capabilities for model training and testing • Establish model versioning, A/B testing, and rollback strategies for production deployments Platform & Infrastructure • Design microservices architectures with Azure Kubernetes Service, Service Bus, Event Hubs for event-driven workflows • Build scalable data pipelines using Azure Data Factory, Synapse Analytics, Databricks for high-volume processing • Implement CI/CD automation through Azure DevOps with comprehensive testing and deployment gates • Architect observability solutions: monitoring, logging, alerting, performance analytics • Design hybrid cloud integration patterns connecting Azure services with on-premises systems • Manage data architecture: Azure SQL, Cosmos DB, blob storage, data lakes with lifecycle policies Delivery Excellence & Hands-On Leadership • Lead proof-of-concept execution from inception to production-ready solutions within defined timelines • Conduct rigorous code reviews ensuring adherence to standards, performance optimization, and maintainability • Roll up sleeves for critical implementation work: debugging production issues, optimizing model performance, refactoring complex modules • Deliver technical demos to internal stakeholders and customers showcasing product capabilities • Establish engineering excellence standards: code quality, testing frameworks, peer reviews, documentation • Create comprehensive technical documentation: architecture decision records, API contracts, deployment guides • Identify and systematically address technical debt across AI models, infrastructure, and codebase Team Development & Collaboration • Mentor and develop junior engineers and fresh graduates through pair programming, and technical guidance • Review and provide constructive feedback on designs, code, and technical approaches from team members • Foster engineering culture emphasizing quality, innovation, and continuous learning • Collaborate with US-based teams requiring flexibility for meetings during early morning or late evening IST hours • Bridge communication between offshore development teams and US-based product/business stakeholders • Translate business requirements from US teams into actionable technical tasks for India-based engineers • Participate in cross-timezone planning, sprint reviews, and architecture discussions Required Qualifications • Non Negotiable Expert Python development with PyTorch, Transformers, production ML frameworks • Non Negotiable Comfortable handling NVIDIA/CUDA variants and their inner workings. • Non Negotiable Proven experience fine-tuning LLMs and deploying custom models in regulated environments • Non Negotiable Track record of shipping production AI products with measurable business impact • Non Negotiable Core Software Engineering skills. AI/ ML expertise, DevOps. • Non Negotiable Flexibility to work with US hours overlap Key Competencie • Hands-on technical leadership and a user-centric approach to technical architecture • Ownership mindset with accountability for outcomes and the ability to balance innovation with pragmatic engineering • Effective communicator capable of engaging both technical and non-technical audiences • Comfortable operating at multiple levels: strategy, architecture, and implementation