AI Systems Architect

4 days ago

Mumbai, Maharashtra, India beBeeInfrastructure Full time ₹ 1,80,00,000 - ₹ 2,52,00,000
Job Title: Scalable AI Infrastructure Engineer

Role Overview:

We are seeking a seasoned Senior AI Infrastructure Engineer to lead the design, implementation, and scaling of our AI infrastructure. This individual will partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Key Responsibilities:

  • Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models.
  • Lead efforts in model serving, versioning, automated CI/CD, and real-time monitoring of AI workflows.
  • Build and optimize GPU-backed serving infrastructure targeting p99 latency < 100 ms, 99.9% uptime, and > 80% GPU utilization.
  • Drive initiatives on model governance, automated drift detection (&leq;10% false positives), and data-management best practices.
  • Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.
  • Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations.
  • Design Prometheus/Grafana dashboards, ELK/Fluentd logging pipelines, and alerting for all ML workloads.
  • Maintain CI/CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.
  • Define and track SLAs/SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at > 80% utilization.
  • Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
  • Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers/quarter), and publish ≥ 1 open-source contribution or talk annually.

Requirements:

  • 9–14 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure.
  • Strong expertise in cloud platforms (AWS/GCP/Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow.
  • Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe).
  • Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration.
  • Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.).
  • Proven track record building reliable, scalable ML systems in production.

Critical Skills:

  • Vector DB integration (Qdrant, Pinecone)
  • Agent orchestration (LangChain, LlamaIndex)
  • Multi-tenant security and RBAC
  • Observability stacks (Prometheus/Grafana, ELK)
  • CI/CD for FastAPI/NestJS services

Preferred:

  • Master's/PhD in CS/AI and certifications such as AWS ML Specialty, Google Cloud Professional ML Engineer, or CNCF CKA/CKAD.
  • Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.
  • Understanding of low-latency streaming inference or agent-based LLM systems.
  • Excellent written and verbal communication, and a proven ability to drive consensus across functions.

  • AI & Data Architect

    1 week ago

    Mumbai, Maharashtra, India CloudFronts - AI First Microsoft Solutions Partner Full time

    AI & Data Architect Job Summary: AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics. The role involves designing, configuring, and managing BI services, aggregating data from multiple sources into a data warehouse,...

  • AI & Data Architect

    3 days ago

    Mumbai, Maharashtra, India CloudFronts - AI First Microsoft Solutions Partner Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    AI & Data ArchitectJob Summary:AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics. The role involves designing, configuring, and managing BI services, aggregating data from multiple sources into a data warehouse,...

  • AI & Data Architect

    1 week ago

    Mumbai, Maharashtra, India CloudFronts - AI First Microsoft Solutions Partner Full time

    AI & Data ArchitectJob Summary:AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics. The role involves designing, configuring, and managing BI services, aggregating data from multiple sources into a data warehouse,...

  • AI Solution Architect

    3 days ago

    Mumbai, Maharashtra, India Alassa Technology Solutions Private Limited Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Company DescriptionWe suggest you enter details hereRole DescriptionThis is a full-time remote role for an AI Solution Architect at Alassa Technology Solutions Private Limited located in Mumbai. The AI Solution Architect will be responsible for designing and implementing advanced AI solutions, consulting with internal and external stakeholders, performing...

  • AI Expert Architect

    4 days ago

    Mumbai, Maharashtra, India beBeeArchitecture Full time ₹ 1,04,000 - ₹ 1,30,878

    Expert Architect for AI SolutionsAt our organization, we are looking for a seasoned AI expert to spearhead the development of cutting-edge solutions. As an AI Architect, you will be responsible for designing and implementing end-to-end architectures for AI applications, ensuring seamless integration with existing systems and infrastructure.Key...

  • AI Solutions Architect

    6 days ago

    Mumbai, Maharashtra, India beBeeGenerative Full time US$ 15,00,000 - US$ 20,00,000

    Job Title: AI Solutions ArchitectWe are seeking an experienced AI Solutions Architect to lead our generative AI initiatives.Responsibilities:Develop and implement end-to-end AI solutions leveraging generative AI technologies.Leverage strong technical expertise in backend development, ML/GenAI engineering, and Python programming.Collaborate with...

  • 04/09/2025 AI & Data Architect

    1 week ago

    Mumbai, Maharashtra, India CloudFronts - AI First Microsoft Solutions Partner Full time

    AI & Data ArchitectJob Summary:AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics. The role involves designing, configuring, and managing BI services, aggregating data from multiple sources into a data warehouse,...

  • AI Solutions Architect

    5 days ago

    Mumbai, Maharashtra, India beBeeSolutions Full time US$ 1,00,000 - US$ 1,20,000

    AI Solutions Architect JobWe are seeking a skilled professional to join our team as an AI Solutions Architect. This is a dynamic role that requires expertise in designing and implementing cutting-edge AI solutions.About the RoleThis position involves working closely with cross-functional teams to develop and deploy AI-powered solutions that drive business...

  • AI Solutions Architect

    2 days ago

    Mumbai, Maharashtra, India beBeeArtificialIntelligence Full time ₹ 15,000 - ₹ 28,00,000

    Job Title: AI Solutions ArchitectOur team is seeking an exceptional AI Solutions Architect to lead the design and implementation of innovative AI solutions across various domains. This role requires a unique blend of technical expertise, business acumen, and strategic thinking.Responsibilities:Develop and implement AI strategies that drive business growth...

  • AI Architect

    3 days ago

    Mumbai, Maharashtra, India SSA Architects Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    A leading Architectural, Interior Design and Project Management Consultancy firm with 300+ strong team is looking for an Architect with AI background. Detail Role and Responsibility;1. Research and adopt the AI that is being used in Architectural Office for increasing productivity in day to day office work. It will include Microsoft Office AI which can be...