MLOps Engineer
2 days ago
Location: Mumbai, India
Experience Level: 9 Plus Years
Minimum Qualification: Masters Degree in Computer Science, Engineering, or related field.
About the Role:
Were looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. Youll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.
Responsibilities:
Core MLOps Pipelines: Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
Model Serving & CI/CD: Lead efforts in model serving, versioning, automated CI/CD, and real-time monitoring of AI workflows .
Inference-as-a-Service: Build and optimize GPU-backed serving infrastructure targeting p99 latency 80% GPU utilization .
Governance & Drift Detection: Drive initiatives on model governance, automated drift detection (10% false positives), and data-management best practices .
Vector Search & Agent Orchestration: Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.
Enterprise Multi-Tenancy: Architect RBAC-driven, isolated ML services to securely serve 100500+ organizations.
Observability & Logging: Design Prometheus/Grafana dashboards, ELK/Fluentd logging pipelines, and alerting for all ML workloads.
CI/CD for Inference APIs: Maintain CI/CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.
Metrics & Cost Optimization: Define and track SLAs/SLOs, optimize cloud spend by 20% year-over-year, and ensure GPU clusters operate at > 80% utilization.
Cross-Functional Leadership: Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
Mentorship & Community: Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers/quarter), and publish 1 open-source contribution or talk annually.
Requirements:
914 years in software engineering, including 4 years in MLOps or ML infrastructure
Strong expertise in cloud platforms (AWS/GCP/Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow
Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)
Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration
Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)
Proven track record building reliable, scalable ML systems in production.
Plus These Critical Skills:
Vector DB integration (Qdrant, Pinecone)
Agent orchestration (LangChain, LlamaIndex)
Multi-tenant security and RBAC
Observability stacks (Prometheus/Grafana, ELK)
CI/CD for FastAPI/NestJS services
Preferred:
Masters/PhD in CS/AI and certifications such as AWS ML Specialty, Google Cloud Professional ML Engineer, or CNCF CKA/CKAD.
Prior experience at AI-focused startups or enterprises scaling ML for 100500 orgs.
Understanding of low-latency streaming inference or agent-based LLM systems.
Excellent written and verbal communication, and a proven ability to drive consensus across functions.
-
Mlops engineer
2 weeks ago
Mumbai, Maharashtra, India Yotta Data Services Private Limited Full timeLocation: Mumbai, IndiaExperience Level: 9 Plus Years Minimum Qualification: Master's Degree in Computer Science, Engineering, or related field.About the Role: We're looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You'll partner with researchers, product teams, and Dev Ops to...
-
MLOps Engineer
2 weeks ago
Mumbai, Maharashtra, India Yotta Data Services Private Limited Full timeLocation: Mumbai, India Experience Level: 9 Plus Years Minimum Qualification: Master's Degree in Computer Science, Engineering, or related field. About the Role: We're looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You'll partner with researchers, product teams, and DevOps...
-
DevOps / MLOps Engineer
12 hours ago
Mumbai, Maharashtra, India Mindspace Software Technologies Pvt. Ltd. Full time US$ 90,000 - US$ 1,20,000 per yearJob Description:We are seeking a DevOps/MLOps Engineer to streamline deployment pipelines, automate infrastructure, and support scalable machine learning workflows. The role focuses on CI/CD, containerization, cloud infrastructure, monitoring, and ML model lifecycle management.Responsibilities:Build and manage CI/CD pipelines for applications and ML...
-
Lead MLOps Engineer
1 week ago
Mumbai, Maharashtra, India Zyoin Group Full timeJob Title: MLOps LeadLocation: Mumbai (Mahape)Work Mode: 4 Days WFO & 1 Day WFHNotice Period: Immediate – 30 DaysAbout the RoleWe are looking for a Lead MLOps Engineer to spearhead the design, deployment, monitoring, and optimization of machine learning and AI-driven applications across cloud platforms. This role requires a strong technical leader...
-
Lead MLOps Engineer
6 days ago
Mumbai, Maharashtra, India Zyoin Group Full timeJob Title: MLOps LeadLocation: Mumbai (Mahape)Work Mode: 4 Days WFO & 1 Day WFHNotice Period: Immediate – 30 DaysAbout the RoleWe are looking for a Lead MLOps Engineer to spearhead the design, deployment, monitoring, and optimization of machine learning and AI-driven applications across cloud platforms. This role requires a strong technical leader who can...
-
Lead MLOps Engineer
4 days ago
Mumbai, Maharashtra, India Zyoin Group Full timeJob Title: MLOps Lead Location: Mumbai (Mahape) Work Mode: 4 Days WFO & 1 Day WFH Notice Period: Immediate – 30 Days About the Role We are looking for a Lead MLOps Engineer to spearhead the design, deployment, monitoring, and optimization of machine learning and AI-driven applications across cloud platforms. This role requires a strong technical...
-
Senior MLOps Engineer
4 weeks ago
Mumbai, Maharashtra, India Saint-Gobain International IT Delivery Centre Full timeJob DescriptionAbout the Company:Saint-Gobain group through its group company Grindwell Norton Limited has established INDEC - an International Delivery Center in Mumbai to provide IT solutions and services to the groups businesses GloballyINDEC is currently organized into INDEC Application Development, INDEC Infrastructure Management and Cyber Security...
-
MLOps Technical Director
5 days ago
Mumbai, Maharashtra, India beBeeMachine Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Key Position: Machine Learning Engineering LeaderJob Description:The ideal candidate for this position is a seasoned technical expert with extensive knowledge of machine learning and AI-driven applications. As the MLOps Lead, you will be responsible for spearheading the design, deployment, monitoring, and optimization of ML applications across cloud...
-
MLOPS/Machine Learning Operations Engineer
13 hours ago
Mumbai, Maharashtra, India HR Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per yearUrgent Opening - MLOPS Engineer -Mumbai for one of the service Based MNC -Hybrid ModeApply Immediately on or call on on whats app CV or call to arrange the Interview .What Youll Do:Develop, and manage efficient MLOps pipelines tailored for Large Language Models, automating the deployment and lifecycle management of models in production.Deploy, scale, and...
-
Mumbai, Maharashtra, India Glauben Technologies Full time US$ 1,25,000 - US$ 1,75,000 per yearOnly Face to Face Interview at Mumbai Mahape L&T Finance officeAbout the Role:We are looking for a Lead MLOps Engineer who will lead and support the end-to-end deployment, monitoring, and optimization of machine learning and data-driven applications across cloud platforms. You will collaborate with data scientists, engineers, and business stakeholders to...
