Senior AI Platform DevOps Engineer

1 week ago


India Cloudely, Inc Full time

AI Platform DevOpes/ SRE Engineer Location: India - 100% Remote Fulltime Permanent Position Responsibilities/What You’ll Do - Platform Design and Architecture: building and operating a highly available, scalable, modular AI platform using technologies such as Qdrant, Anyscale, and Ray to support LLM orchestration, vector search, and multi-agent frameworks. - Core Infrastructure Development: Build essential APIs and infrastructure to power conversational applications, AI agents, and analytics tools. - LLM Operational Solutions: Implement workflows for Large Language Models, including inference pipelines, fine-tuning, caching, and evaluation for open-weight and hosted models. - Deployment & Performance Optimization: Deploy AI services on AWS with Kubernetes (EKS), Lambda, and ECS, ensuring scalability and resilience while optimizing vector databases and model runtimes for cost and performance. - Collaboration, Governance, & Mentorship: Partner with engineering teams, research teams to deliver production-grade, self-healing, and performance-optimized services for AI/RAG pipelines , establish governance/security standards, and mentoring junior engineers in AI infrastructure best practices & reviews. What We’re Looking for (Minimum Qualifications): - 8+ years of experience as Platform Engineer ( Site Reliability / DevOps Engineer) , with at least 3+ years in AI/ML platform development ( MLOps ). - Deep expertise in Python, with strong design and debugging skills. - Ability to work independently and lead complex projects with Excellent problem-solving, analytical, and communication skills. - Proficiency working with cloud platforms such as AWS, GCP, or Azure and familiarity with MLOps/AI DevOps tools like MLflow or Kubeflow, proficient in CI/CD , infrastructure as code (Terraform / CloudFormation). - Hands-on expertise with CI/CD pipelines, model observability, and incident response for AI/ML services. Preferred Qualification: - Experience implementing and optimizing Platforms supporting large language model (LLM) pipelines with frameworks such as LangChain, LlamaIndex, Hugging Face Transformers, or similar. - Hands-on knowledge of Scaling & Setting up Vector DB platforms such as Qdrant (or other vector DBs like Pinecone, Weaviate) for semantic search and embeddings management. - Exposure to MLOps tools, Ray.io , Anyscale or other distributed orchestration & inference frameworks. - Experience with developing and deploying containerized applications using Docker and Kubernetes, including Helm charts and automated scaling. - Understanding of LLMOps patterns — model registry, prompt versioning, and feedback loops.



  • India Cloudely, Inc Full time

    AI Platform DevOpes/ SRE Engineer Location: India - 100% RemoteFulltime Permanent PositionResponsibilities/What You’ll DoPlatform Design and Architecture: building and operating a highly available, scalable, modular AI platform using technologies such as Qdrant, Anyscale, and Ray to support LLM orchestration, vector search, and multi-agent frameworks.Core...


  • India Cloudely, Inc Full time

    AI Platform DevOpes/ SRE Engineer Location: India - 100% Remote Fulltime Permanent Position Responsibilities/What You’ll Do Platform Design and Architecture: building and operating a highly available, scalable, modular AI platform using technologies such as Qdrant, Anyscale, and Ray to support LLM orchestration, vector search, and multi-agent frameworks....


  • india beBeeDevops Full time

    Senior AI Platform EngineerAs a highly skilled platform engineer, you will be responsible for building and operating a scalable and modular AI platform using technologies such as Qdrant, Anyscale, and Ray.The ideal candidate will have 8+ years of experience in platform engineering, with expertise in Python, cloud platforms, and MLOps/AI DevOps tools. They...


  • Bengaluru, Karnataka, India, Karnataka apna Full time

    Job Title: Senior engineer (SDE-2)– Platform EngineeringLocation: BengaluruEmployment Type: Full-timeTeam: Platform EngineeringAbout the Role:We are looking for a passionate and hands-on DevOps Engineer to join our PlatformEngineering team and accelerate our platform modernization journey. This role is ideal forengineers who thrive in automation-heavy...

  • DevOps Engineer III

    2 weeks ago


    India (Remote) Interface AI Full time US$ 70,000 - US$ 1,40,000 per year

    Banking is being reimagined—and customers expect every interaction to be easy, personal, and instant. We are building a universal banking assistant that millions of U.S. consumers can use to transact across all financial institutions and, over time, autonomously drive their financial goals. Powered by our proprietary BankGPT platform, this assistant is...

  • Senior AI/ML Engineer

    2 weeks ago


    Gurugram, Haryana, India, IN NextDimension AI Full time

    Compensation: INR 12-30 LPA Base + Bonus + EquityLocation: GurgaonAbout UsNextDimension is a US-based technology startup building AI Agents in Healthcare, established by a team of distinguished AI/ML Scientists and Engineers from Google, Amazon, and Snowflake. We're empowering Enterprises by building sophisticated, high-impact AI agents that automate sales,...


  • India Tritonium Full time

    About Tritonium:Tritonium is an AI-powered SaaS platform that transforms app store reviews into actionable insights for mobile product teams. Our infrastructure processes millions of reviews, orchestrates AI analysis pipelines, and delivers real-time intelligence to customers globally. We're looking for a DevOps/Platform Engineer to own our infrastructure,...


  • India Tritonium Full time

    About Tritonium:Tritonium is an AI-powered SaaS platform that transforms app store reviews into actionable insights for mobile product teams. Our infrastructure processes millions of reviews, orchestrates AI analysis pipelines, and delivers real-time intelligence to customers globally. We're looking for a DevOps/Platform Engineer to own our infrastructure,...


  • India Tritonium Full time

    About Tritonium: Tritonium is an AI-powered SaaS platform that transforms app store reviews into actionable insights for mobile product teams. Our infrastructure processes millions of reviews, orchestrates AI analysis pipelines, and delivers real-time intelligence to customers globally. We're looking for a DevOps/Platform Engineer to own our infrastructure,...

  • Senior Data Engineer

    3 weeks ago


    India DataOrbit AI Full time

    Company Description DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, we enable organizations to adopt AI solutions that unlock growth opportunities and operational efficiencies. With expertise in AI strategy,...