Generative AI Architect

Sonata Software OverviewIn today's market, there is a unique duality in technology adoption. On one side, extreme focus on cost containment by clients, and on the other, deep motivation to modernize their Digital storefronts to attract more consumers and B2B customers.As a leading Modernization Engineering company, we aim to deliver modernization-driven hypergrowth for our clients based on the deep differentiation we have created in Modernization Engineering, powered by our Lightening suite and 16-step Platformation™ playbook. In addition, we bring agility and systems thinking to accelerate time to market for our clients.Headquartered in Bengaluru, India, Sonata has a strong global presence, including key regions in the US, UK, Europe, APAC, and ANZ. We are a trusted partner of world-leading companies in BFSI (Banking, Financial Services, and Insurance), HLS (Healthcare and Lifesciences), TMT (Telecom, Media, and Technology), Retail & CPG, and Manufacturing space. Our bouquet of Modernization Engineering Services cuts across Cloud, Data, Dynamics, Contact Centers, and around newer technologies like Generative AI, MS Fabric, and other modernization platforms.About the Role:The Generative AI Architect is responsible for defining, designing, and governing end-to-end GenAI solution architectures across business functions and delivery projects. The role involves working with data, AI, and application teams to conceptualize and deliver AI-powered copilots, agents, and automation platforms that enhance productivity, decision-making, and customer experience.This individual will drive architecture blueprints, reference implementations, and governance frameworks for the enterprise GenAI ecosystem — ensuring scalability, compliance, security, and business value realization.Key Responsibilities:1. Solution Architecture & DesignDefine enterprise-level GenAI reference architectures encompassing LLMs, RAG pipelines, vector databases, and integration layers.Design and oversee Copilot, AI Agent, and Chatbot architectures leveraging frameworks like Azure AI Studio, OpenAI APIs, LangChain, Semantic Kernel, or AWS Bedrock.Architect data grounding strategies, prompt orchestration, context management, and hybrid retrieval flows.Evaluate and recommend LLMs (OpenAI, Anthropic, Mistral, Meta, Gemini, etc.) based on use case, compliance, and performance.2. Integration & Platform EngineeringIntegrate GenAI services with enterprise applications (e.g., Microsoft 365 Copilot, Dynamics 365, SAP, Salesforce, custom apps).Architect multi-modal AI solutions using text, image, audio, and document inputs.Collaborate with Data Engineering and MLOps teams to operationalize AI pipelines using Azure ML, SageMaker, or Vertex AI.Design API-first architectures and AI microservices for reusable components.3. Governance, Security & ComplianceEstablish and enforce Responsible AI guidelines covering data privacy, hallucination management, prompt security, and model transparency.Define policies for model selection, fine-tuning, data retention, and safety evaluation.Partner with cybersecurity and legal teams to ensure adherence to organizational and regulatory frameworks (GDPR, SOC2, ISO 27001).4. Performance Optimization & MonitoringDefine KPIs and monitoring frameworks for GenAI models (e.g., accuracy, latency, cost, feedback loops).Implement model observability, prompt analytics, and feedback-driven retraining pipelines.Drive continuous improvement through experimentation, A/B testing, and cost-performance optimization.5. Leadership & CollaborationCollaborate with Product Owners, Solution Architects, Data Scientists, and Engineering Teams to deliver end-to-end GenAI initiatives.Provide technical leadership and mentorship to AI engineers and developers.Support business development by contributing to RFPs, solution proposals, and PoCs.Represent the organization in AI CoE and innovation forums to define strategic roadmaps.Required Skills & Experience:10–18 years in IT, with strong experience in AI/ML architecture, cloud solutions, or enterprise applications.Hands-on expertise in Generative AI frameworks and LLM orchestration (LangChain, Semantic Kernel, LlamaIndex, PromptFlow).Proficiency with Azure OpenAI, OpenAI API, AWS Bedrock, or Google Vertex AI.Strong understanding of RAG architecture, vector databases (Pinecone, Chroma, Weaviate, FAISS), and embedding models.Proficiency in Python, C#, or TypeScript for AI integration and orchestration.Knowledge of MLOps / LLMOps practices and tooling.Deep familiarity with Azure, AWS, or GCP AI services and DevOps pipelines.Experience designing secure, scalable, multi-tenant architectures for AI workloads.Good-to-Have Skills:Experience integrating Copilot Studio, Power Platform, or Fabric AI with enterprise systems.Exposure to enterprise data ecosystems (Data Lake, Synapse, Snowflake, Databricks).Knowledge of knowledge graphs, vector retrieval optimization, or multi-agent AI systems.Familiarity with cost governance, AI model licensing, and fine-tuning frameworks (LoRA, PEFT, RAG-Fusion).Microsoft / AWS / Google AI certifications.Education:Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Engineering, or related fields.Soft Skills:Strong leadership and cross-functional collaboration skills.Strategic thinking and ability to align technical design with business outcomes.Excellent communication and presentation abilities for executive and technical audiences.Passion for innovation, experimentation, and continuous learning.Why join Sonata Software? At Sonata, you´ll have an outstanding opportunity. The chance to use your skills and imagination to push the boundaries of what´s possible. To build never seen before solutions to some of the world’s toughest problems. You´ll be challenged, but you will not be alone. You´ll be joining a team of diverse innovators, all driven to go beyond the status quo to craft what comes next.