Senior AI Platform DevOps Engineer

1 week ago

bangalore, India Cloudely, Inc Full time

AI Platform DevOpes/ SRE Engineer Location: India - 100% Remote Fulltime Permanent Position Responsibilities/What You’ll Do Platform Design and Architecture: building and operating a highly available, scalable, modular AI platform using technologies such as Qdrant, Anyscale, and Ray to support LLM orchestration, vector search, and multi-agent frameworks. Core Infrastructure Development: Build essential APIs and infrastructure to power conversational applications, AI agents, and analytics tools. LLM Operational Solutions: Implement workflows for Large Language Models, including inference pipelines, fine-tuning, caching, and evaluation for open-weight and hosted models. Deployment & Performance Optimization: Deploy AI services on AWS with Kubernetes (EKS), Lambda, and ECS, ensuring scalability and resilience while optimizing vector databases and model runtimes for cost and performance. Collaboration, Governance, & Mentorship: Partner with engineering teams, research teams to deliver production-grade, self-healing, and performance-optimized services for AI/RAG pipelines , establish governance/security standards, and mentoring junior engineers in AI infrastructure best practices & reviews. What We’re Looking for (Minimum Qualifications): 8+ years of experience as Platform Engineer ( Site Reliability / DevOps Engineer) , with at least 3+ years in AI/ML platform development ( MLOps ). Deep expertise in Python, with strong design and debugging skills. Ability to work independently and lead complex projects with Excellent problem-solving, analytical, and communication skills. Proficiency working with cloud platforms such as AWS, GCP, or Azure and familiarity with MLOps/AI DevOps tools like MLflow or Kubeflow, proficient in CI/CD , infrastructure as code (Terraform / CloudFormation). Hands-on expertise with CI/CD pipelines, model observability, and incident response for AI/ML services. Preferred Qualification: Experience implementing and optimizing Platforms supporting large language model (LLM) pipelines with frameworks such as LangChain, LlamaIndex, Hugging Face Transformers, or similar. Hands-on knowledge of Scaling & Setting up Vector DB platforms such as Qdrant (or other vector DBs like Pinecone, Weaviate) for semantic search and embeddings management. Exposure to MLOps tools, Ray.io , Anyscale or other distributed orchestration & inference frameworks. Experience with developing and deploying containerized applications using Docker and Kubernetes, including Helm charts and automated scaling. Understanding of LLMOps patterns — model registry, prompt versioning, and feedback loops.

  • Senior AI Platform DevOps Engineer

    1 week ago

    bangalore, India Cloudely, Inc Full time

    AI Platform DevOpes/ SRE Engineer Location: India - 100% RemoteFulltime Permanent PositionResponsibilities/What You’ll DoPlatform Design and Architecture: building and operating a highly available, scalable, modular AI platform using technologies such as Qdrant, Anyscale, and Ray to support LLM orchestration, vector search, and multi-agent frameworks.Core...

  • Senior AI Platform DevOps Engineer

    1 week ago

    bangalore, India Cloudely, Inc Full time

    AI Platform DevOpes/ SRE Engineer Location: India - 100% Remote Fulltime Permanent Position Responsibilities/What You’ll Do Platform Design and Architecture: building and operating a highly available, scalable, modular AI platform using technologies such as Qdrant, Anyscale, and Ray to support LLM orchestration, vector search, and multi-agent frameworks....

  • DevOps Engineer and Cloud Platform Engineer

    2 weeks ago

    Bangalore, India Enterprise Minds, Inc Full time

    We’re Hiring – Senior DevOps Engineer (Platform Engineering) | Apna &## ; Experience: 6+ years &##Employment Type: Full-time We’re looking for a hands-on Senior DevOps Engineer (SDE-2 – Platform Engineering) who thrives in automation-heavy environments and loves solving infrastructure challenges. You’ll help modernize our platform, implement...

  • Senior DevOps Platform Engineer

    3 weeks ago

    Bangalore Division, India apna Full time

    Job Title: Senior engineer (SDE-2)– Platform Engineering Location: Bengaluru Employment Type: Full-time Team: Platform Engineering About the Role: We are looking for a passionate and hands-on DevOps Engineer to join our Platform Engineering team and accelerate our platform modernization journey. This role is ideal for engineers who thrive in...

  • Senior Software Engineer –DevOps Platform

    5 days ago

    bangalore, India Zywave Full time

    Senior Software Engineer – DevOps Platform Location: Pune, Maharashtra, India Work Mode: Hybrid Experience: 4–8 years Team: DevOps Platform About Zywave Zywave is a global leader in innovative SaaS solutions that are transforming the insurance industry. Our engineering culture thrives on automation, collaboration and continuous improvement. As we scale...

  • DevOps/Platform Engineer

    2 weeks ago

    bangalore, India Tritonium Full time

    About Tritonium:Tritonium is an AI-powered SaaS platform that transforms app store reviews into actionable insights for mobile product teams. Our infrastructure processes millions of reviews, orchestrates AI analysis pipelines, and delivers real-time intelligence to customers globally. We're looking for a DevOps/Platform Engineer to own our infrastructure,...

  • DevOps/Platform Engineer

    1 week ago

    bangalore, India Tritonium Full time

    About Tritonium:Tritonium is an AI-powered SaaS platform that transforms app store reviews into actionable insights for mobile product teams. Our infrastructure processes millions of reviews, orchestrates AI analysis pipelines, and delivers real-time intelligence to customers globally. We're looking for a DevOps/Platform Engineer to own our infrastructure,...

  • AI Platform Engineer

    2 weeks ago

    bangalore, India Societe Generale Global Solution Centre Full time

    We are looking for an experienced Senior AI Platform Engineer to join our team and lead the development of our core AI execution infrastructure. This role is central to our strategy, focusing on designing, building, and scaling a robust, high-performance platform capable of deploying and managing thousands of concurrent AI agents. You will be responsible for...

  • Platform / DevOps Engineer

    1 week ago

    Bangalore, India Huron Full time

    Huron is a global consultancy that collaborates with clients to drive strategic growth, ignite innovation and navigate constant change. Through a combination of strategy, expertise and creativity, we help clients accelerate operational, digital and cultural transformation, enabling the change they need to own their future. Join our team as the expert you...

  • DevOps Engineer

    2 weeks ago

    bangalore, India RagaAI Inc Full time

    About Us RagaAI is a VC-backed, rapidly growing AI startup on a mission to build a world-class GenAI evaluation and observability platform—making AI applications more secure, reliable, and production-ready. We’re scaling quickly and looking for a Senior DevOps Engineer who is passionate about infrastructure, automation, reliability, and deploying...