MLOps Engineer

3 weeks ago

Mumbai, Maharashtra, India Yotta Data Services Private Limited Full time

Location: Mumbai, India

Experience Level: 9 Plus Years

Minimum Qualification: Master's Degree in Computer Science, Engineering, or related field.

About the Role:

We're looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You'll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Responsibilities:


• Core MLOps Pipelines: Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .


• Model Serving & CI/CD: Lead efforts in model serving, versioning, automated CI/CD, and real-time monitoring of AI workflows .


• Inference-as-a-Service: Build and optimize GPU-backed serving infrastructure targeting p99 latency < 100 ms, 99.9% uptime, and > 80% GPU utilization .


• Governance & Drift Detection: Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices .


• Vector Search & Agent Orchestration: Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.


• Enterprise Multi-Tenancy: Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations.

Observability & Logging: Design Prometheus/Grafana dashboards, ELK/Fluentd logging pipelines, and alerting for all ML workloads.


• CI/CD for Inference APIs: Maintain CI/CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.


• Metrics & Cost Optimization: Define and track SLAs/SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at > 80% utilization.


• Cross-Functional Leadership: Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.


• Mentorship & Community: Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers/quarter), and publish ≥ 1 open-source contribution or talk annually.

Requirements:


• 9–14 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure


• Strong expertise in cloud platforms (AWS/GCP/Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow


• Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)

Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration


• Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)


• Proven track record building reliable, scalable ML systems in production.

Plus These Critical Skills:


• Vector DB integration (Qdrant, Pinecone)


• Agent orchestration (LangChain, LlamaIndex)


• Multi-tenant security and RBAC


• Observability stacks (Prometheus/Grafana, ELK)


• CI/CD for FastAPI/NestJS services

Preferred:


• Master's/PhD in CS/AI and certifications such as AWS ML Specialty, Google Cloud Professional ML Engineer, or CNCF CKA/CKAD.


• Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.


• Understanding of low-latency streaming inference or agent-based LLM systems.


• Excellent written and verbal communication, and a proven ability to drive consensus across functions.

  • MLOps Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Yotta Data Services Private Limited Full time

    Job DescriptionLocation: Mumbai, IndiaExperience Level: 9 Plus YearsMinimum Qualification: Masters Degree in Computer Science, Engineering, or related field.About the Role:Were looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. Youll partner with researchers, product teams, and...

  • DevOps / MLOps Engineer

    1 day ago

    Mumbai, Maharashtra, India Mindspace Software Technologies Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Description:We are seeking a DevOps/MLOps Engineer to streamline deployment pipelines, automate infrastructure, and support scalable machine learning workflows. The role focuses on CI/CD, containerization, cloud infrastructure, monitoring, and ML model lifecycle management.Responsibilities:Build and manage CI/CD pipelines for applications and ML...

  • MLOps Engineer

    4 days ago

    Navi Mumbai, Maharashtra, India Bolt-on Global Solutions Pvt Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Requirement : MLOps EngineerTechnology : MLOps, LLM, Machine Learning, Docker, KubernetesExperience : 5+ yearsWork Location : Western Suburb, MumbaiClient Location : Navi MumbaiCANDIDATES FROM / IN Western Suburb /MUMBAI LOCATION SHALL ONLY APPLY. This role is open exclusively to candidates based in Western Suburb/ MUMBAI. Applications from candidates...

  • Lead MLOps Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Zyoin Group Full time

    Job Title: MLOps LeadLocation: Mumbai (Mahape)Work Mode: 4 Days WFO & 1 Day WFHNotice Period: Immediate – 30 DaysAbout the RoleWe are looking for a Lead MLOps Engineer to spearhead the design, deployment, monitoring, and optimization of machine learning and AI-driven applications across cloud platforms. This role requires a strong technical leader who can...

  • Lead MLOps Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Zyoin Group Full time

    Job DescriptionJob Title: MLOps LeadLocation: Mumbai (Mahape)Work Mode: 4 Days WFO & 1 Day WFHNotice Period: Immediate 30 DaysAbout the RoleWe are looking for a Lead MLOps Engineer to spearhead the design, deployment, monitoring, and optimization of machine learning and AI-driven applications across cloud platforms. This role requires a strong technical...

  • Lead MLOps Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Zyoin Group Full time

    Job Title: MLOps Lead Location: Mumbai (Mahape) Work Mode: 4 Days WFO & 1 Day WFH Notice Period: Immediate – 30 DaysAbout the RoleWe are looking for a Lead MLOps Engineer to spearhead the design, deployment, monitoring, and optimization of machine learning and AI-driven applications across cloud platforms. This role requires a strong technical leader who...

  • Lead MLOps Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Zyoin Group Full time

    Job Title: MLOps Lead Location: Mumbai (Mahape) Work Mode: 4 Days WFO & 1 Day WFH Notice Period: Immediate – 30 Days About the Role We are looking for a Lead MLOps Engineer to spearhead the design, deployment, monitoring, and optimization of machine learning and AI-driven applications across cloud platforms. This role requires a strong technical...

  • Lead MLOps Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Zyoin Group Full time

    Position : Lead MLOps : 9+ : Mumbai, the Role :We are looking for a Lead MLOps Engineer who will lead and support the end-to-end deployment, monitoring, and optimization of machine learning and data-driven applications across cloud platforms. You will collaborate with data scientists, engineers, and business stakeholders to ensure scalable, secure, and...

  • MLOPS/Machine Learning Operations Engineer

    1 day ago

    Mumbai, Maharashtra, India HR Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Urgent Opening - MLOPS Engineer -Mumbai for one of the service Based MNC -Hybrid ModeApply Immediately on or call on on whats app CV or call to arrange the Interview .What Youll Do:Develop, and manage efficient MLOps pipelines tailored for Large Language Models, automating the deployment and lifecycle management of models in production.Deploy, scale, and...

  • AI/ ML Engineer- MLOPS

    1 day ago

    Mumbai, Maharashtra, India Giggso Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About GiggsoGiggso is an award-winning, Michigan-based AI startup, recognized in the Top 50 Michigan Startups of 2023 & 2024. Founded in 2017, we deliver a unified platform for AI agent orchestration, governance, and observability, simplifying complex enterprise workflows.Our solutions extend to model risk management, security, and blockchain enablement,...