MLOps Engineer

3 weeks ago

Mumbai India Yotta Data Services Private Limited Full time

Job Description

Location: Mumbai, India

Experience Level: 9 Plus Years

Minimum Qualification: Masters Degree in Computer Science, Engineering, or related field.

About the Role:

Were looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. Youll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Responsibilities:

Core MLOps Pipelines: Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .

Model Serving & CI/CD: Lead efforts in model serving, versioning, automated CI/CD, and real-time monitoring of AI workflows .

Inference-as-a-Service: Build and optimize GPU-backed serving infrastructure targeting p99 latency 80% GPU utilization .

Governance & Drift Detection: Drive initiatives on model governance, automated drift detection (10% false positives), and data-management best practices .

Vector Search & Agent Orchestration: Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.

Enterprise Multi-Tenancy: Architect RBAC-driven, isolated ML services to securely serve 100500+ organizations.

Observability & Logging: Design Prometheus/Grafana dashboards, ELK/Fluentd logging pipelines, and alerting for all ML workloads.

CI/CD for Inference APIs: Maintain CI/CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.

Metrics & Cost Optimization: Define and track SLAs/SLOs, optimize cloud spend by 20% year-over-year, and ensure GPU clusters operate at > 80% utilization.

Cross-Functional Leadership: Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.

Mentorship & Community: Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers/quarter), and publish 1 open-source contribution or talk annually.

Requirements:

914 years in software engineering, including 4 years in MLOps or ML infrastructure

Strong expertise in cloud platforms (AWS/GCP/Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow

Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)

Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration

Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)

Proven track record building reliable, scalable ML systems in production.

Plus These Critical Skills:

Vector DB integration (Qdrant, Pinecone)

Agent orchestration (LangChain, LlamaIndex)

Multi-tenant security and RBAC

Observability stacks (Prometheus/Grafana, ELK)

CI/CD for FastAPI/NestJS services

Preferred:

Masters/PhD in CS/AI and certifications such as AWS ML Specialty, Google Cloud Professional ML Engineer, or CNCF CKA/CKAD.

Prior experience at AI-focused startups or enterprises scaling ML for 100500 orgs.

Understanding of low-latency streaming inference or agent-based LLM systems.

Excellent written and verbal communication, and a proven ability to drive consensus across functions.

  • MLops Engineer

    1 week ago

    Pune, India Peoplefy Full time

    Job Description Hi Techies, I am on lookout for MLOps engineer for a leading MNC based in Pune, Yerwada. About the Role We are looking for an experienced MLOps Engineer to support our AI and ML initiatives, including GenAI platform development, deployment automation, and infrastructure optimization. Please share your resume on [Confidential...

  • Senior MLOps Engineer

    7 days ago

    Pune, India Solace Manpower Full time

    Job Description Company Description We suggest you enter details here. Role Description This is a full-time hybrid role for a Senior MLOps Engineer located in Pune, with some work from home options available. The Senior MLOps Engineer will be responsible for overseeing the deployment and maintenance of machine learning models, collaborating with data...

  • MLOps Engineer

    3 days ago

    Bengaluru, Karnataka, India, Karnataka C5i Full time

    Job descriptionWe are looking for an experienced MLOps Engineer to join our team in Bengaluru. The ideal candidate will design, implement, and manage robust MLOps pipelines, enabling seamless deployment and monitoring of machine learning models. This role offers the opportunity to work on cutting-edge AI solutions and drive efficiency in ML workflows.Job...

  • MLOps Engineer 4+ Years

    1 week ago

    Mumbai, India Rangam Infotech Private Limited Full time

    Job Description Job Description Job Title: MLOps Engineer Experience: 4+ Years Location: Mumbai Must-Have Skills: - MLOps, Model Deployment & Monitoring - Azure Cloud (Azure ML, ADF, AKS, etc.) - Databricks (Delta Lake, MLflow, Notebooks, Jobs) - CI/CD, GitOps, Infrastructure as Code (Terraform, ARM) - Python, PySpark, MLflow, REST APIs - Stakeholder &...

  • MLOps Engineer

    3 weeks ago

    Mumbai, India Yotta Data Services Private Limited Full time

    Location: Mumbai, India Experience Level: 9 Plus Years Minimum Qualification: Master’s Degree in Computer Science, Engineering, or related field. About the Role: We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and...

  • Mlops engineer

    3 weeks ago

    Mumbai, India Yotta Data Services Private Limited Full time

    Location: Mumbai, India Experience Level: 9 Plus Years Minimum Qualification: Master’s Degree in Computer Science, Engineering, or related field. About the Role: We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and...

  • MLOps Engineer

    2 weeks ago

    Mumbai, India Yotta Data Services Private Limited Full time

    Location: Mumbai, IndiaExperience Level: 9 Plus YearsMinimum Qualification: Master’s Degree in Computer Science, Engineering, or related field.About the Role:We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps...

  • MLOps Engineer

    2 weeks ago

    mumbai, India Yotta Data Services Private Limited Full time

    Location: Mumbai, India Experience Level: 9 Plus Years Minimum Qualification: Master’s Degree in Computer Science, Engineering, or related field. About the Role: We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams,...

  • MLOps Engineer

    3 weeks ago

    Mumbai, India Yotta Data Services Private Limited Full time

    Location: Mumbai, IndiaExperience Level: 9 Plus Years Minimum Qualification: Master’s Degree in Computer Science, Engineering, or related field.About the Role: We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and...

  • MLOps Engineer

    3 weeks ago

    Mumbai, India Yotta Data Services Private Limited Full time

    Location: Mumbai, India Experience Level: 9 Plus Years Minimum Qualification: Master’s Degree in Computer Science, Engineering, or related field. About the Role: We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and...