Architect - Application & Gen AI Systems

Job Title:
Architect – Application & GenAI Systems

Location:
Bangalore | Hybrid

Reporting To:
Chief Technology Officer

Organization
: Startup AI based Product company.

Type:
Senior Individual Contributor Role

About the Opportunity

We are on a mission to redefine how decisions are made at the intersection of demand and supply. Our intelligent platform enables organizations to unlock growth and adaptability through interconnected, automated decisioning systems. As an Architect – Application & GenAI Systems, you'll play a pivotal role in designing the next generation of scalable SaaS platforms and intelligent agent-based solutions.

This is a high-impact, hands-on architecture leadership role, ideal for someone who thrives at the cutting edge of distributed systems and GenAI applications.

Why Join Us?

• Innovate at Scale:
  Build impactful solutions that transform how industries operate.
• Work with Purpose:
  Contribute to AI-driven technology that solves real-world challenges.
• Grow with Us:
  Experience a fast-paced, stable start-up environment that values both performance and empathy.
• Collaborative Culture:
  Be part of a team that's smart, driven, and genuinely supportive — where you can do your best work and have fun doing it.
• Future-Ready Tech Stack:
  Get hands-on with the latest GenAI frameworks, LLM APIs, and scalable cloud-native architecture.

Your Responsibilities

Application Architecture

• Define and evolve a modern, scalable application architecture blueprint, focusing on performance, maintainability, and modularity.
• Guide engineering teams on microservices, clean architecture, and integration best practices.
• Lead architectural governance through Architecture Review Boards and engineering standards.
• Champion strong API design principles (REST, GraphQL) with emphasis on security, versioning, and discoverability.
• Ensure high system availability, resilience, observability, and cost-efficiency.

AI & Agentic Systems

• Architect modular and intelligent GenAI agent systems using frameworks such as LangGraph, CrewAI, and AutoGen.
• Design reusable components for memory management, agent orchestration, and RAG pipelines.
• Build reliable LLM-powered workflows with mechanisms for fallback, retries, and human-in-the-loop support.
• Collaborate closely with AI scientists to bring prompt design, LLM observability, and production reliability together.

Cross-Functional Leadership

• Align architecture decisions with strategic product direction and AI roadmap.
• Mentor senior engineers and guide critical design and code reviews.
• Own documentation and long-term technical planning across platform and AI systems.

What We're Looking For

Must-Have

• 12+ years of experience in backend and distributed system architecture.
• Strong foundation in microservices, service decomposition, and scalable system design.
• Expertise in API architecture (REST, GraphQL), containerization (Docker, Kubernetes), and IaC tools.
• Experience integrating GenAI/LLM APIs (OpenAI, Anthropic, etc.) into production-grade systems.
• Hands-on experience with agentic frameworks like LangGraph, CrewAI, AutoGen, or custom orchestrators.
• Deep understanding of RAG, prompt chaining, context windows, and session memory.
• Familiarity with vector databases like Pinecone, FAISS, or Weaviate.

Nice to Have

• Understanding of LLM behaviors, limitations, and prompt tuning in live systems.
• Experience with prompt evaluation tools such as LangSmith or feedback loops for LLMs.
• Background in SDK/tooling development for internal GenAI platforms.
• Previous experience with large-scale enterprise SaaS products.

The Culture

We believe in empowering people, not just building technology. Our environment encourages continuous learning, cross-functional collaboration, and agile innovation. It's a place where you'll be supported to grow, while making a real impact at scale.