LLM & ML Ops Engineer Job Details | LLC

7 days ago

Chennai, Tamil Nadu, India Gainwell Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Job Description

LLM & ML Ops Engineer

Date: Mar 28, 2025

Location: Bangalore, KA, IN, 560100; Chennai, TN, IN, 600032

Req ID: 30248

Summary

Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists and DevOps.

Your role in our mission Core LLM Ops Responsibilities:
  • Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.).
  • Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines.
  • Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines.
  • Manage vector databases, embedding stores, and document stores used in conjunction with LLMs.
  • Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments.
  • Continuously monitor models for their performance and ensure alert systems are in place.
  • Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows.
Core ML Ops Responsibilities:
  • Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring.
  • Implement version control, model registry, and reproducibility strategies for ML models.
  • Automate data ingestion, feature engineering, and model retraining workflows.
  • Monitor model performance, drift, and ensure proper alerting systems are in place.
  • Implement security, compliance, and governance protocols for model deployment.
  • Collaborate with Data Scientists to streamline model development and experimentation.
What we're looking for
  • Bachelor's/Masters degree in computer science, Engineering, or related fields.
  • Strong experience with ML Ops tools (Kubeflow, MLflow, TFX, SageMaker, etc.).
  • Experience with LLM-specific tools and frameworks (LangChain, Lang Graph, LlamaIndex, Hugging Face, OpenAI APIs, Vector DBs like Pinecone, FAISS, Weavite, Chroma DB etc.).
  • Solid experience in deploying models in cloud (AWS, Azure, GCP) and on-prem environments.
  • Proficient in containerization (Docker, Kubernetes) and CI/CD practices.
  • Familiarity with monitoring tools like Prometheus, Grafana, and ML observability platforms.
  • Strong coding skills in Python, Bash, and familiarity with infrastructure-as-code tools (Terraform, Helm, etc.). Knowledge of healthcare AI applications and regulatory compliance (HIPAA, CMS) is a plus.
  • Strong skills in Giskard, Deepeval etc.
What you should expect in this role
  • Fully Remote Opportunity Work from anywhere in India.
  • Minimal Travel Required Occasional travel opportunities (0-10 PERCENT ).
  • Opportunity to Work on Cutting-Edge AI Solutions in a mission-driven healthcare technology environment.

  • Senior AI/ML Engineer Job Details

    7 days ago

    Chennai, Tamil Nadu, India Gainwell Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description Senior AI/ML Engineer Date: Mar 28, 2025 Location: Bangalore, KA, IN, 560100; Chennai, TN, IN, 600032 Req ID: 30247Summary Gainwell Technologies is seeking a highly skilled AI Engineer to design, develop, and deploy advanced AI and Generative AI (Gen AI) solutions across our healthcare technology platforms. This role involves building...

  • LLM Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Hexacorp Technical Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary: We are seeking an experienced and highly motivated LLM Engineer with 5+ years of experience in AI/ML, NLP, and deep learning. The ideal candidate will have hands-on expertise in working with large language models (LLMs) such as GPT, LLaMA, Mistral, Claude, or similar, and a strong understanding of model ne-tuning, prompt engineering,...

  • ML Ops Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Ixceed Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role- ML Engineer / ML Ops EngineerLocation: Thoraipakkam, ChennaiWork mode: Work from OfficeTask Description:University Degree in Computer Science, Information Technology, or related field5+ years of experience in the Machine Learning Operations roleDesign the data pipelines and engineering infrastructure to support our clients' enterprise machine learning...

  • ML / Dev OPS, ML Senior Engineer and PX-Gen AI Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India DHI Consultancy Full time ₹ 2,40,000 - ₹ 3,60,000 per year

    Company DescriptionDHI Consultancy specializes in providing recruitment solutions for clients across various industries. With expertise in creative & design services, and investment advisory services, DHI Consultancy leads end-to-end recruitment processes to meet the unique needs of each client. Our dedicated team ensures we deliver tailored solutions that...

  • Engineer - AI OPS Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Sutherland Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company Description About Sutherland Artificial Intelligence. Automation.Cloud engineering. Advanced analytics.For business leaders, these are key factors of success. For us, they're our core expertise. We work with iconic brands worldwide. We bring them a unique value proposition through market-leading technology and business process excellence. ...

  • Software Engineer – LLM, ML, Python

    4 weeks ago

    Chennai, Tamil Nadu, India HID Full time

    Who are we? HID powers the trusted identities of the world's people, places, and things, allowing people to transact safely, work productively and travel freely. We are a high-tech software company headquartered in Austin, TX, with over 4,500 worldwide employees. Check us out here: and this video. As our Machine Learning Engineer, you'll support HID's...

  • Software Engineer – LLM, ML, Python

    1 week ago

    Chennai, Tamil Nadu, India HID Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Who are we?HID powers the trusted identities of the world's people, places, and things, allowing people to transact safely, work productively and travel freely.We are a high-tech software company headquartered in Austin, TX, with over 4,500 worldwide employees. Check us out here: and this video.As our Machine Learning Engineer, you'll support HID's success...

  • ML Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Infogrowth Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are hiring an ML Engineer/ML Ops Engineer with 5+ years' experience to design scalable ML pipelines, deploy production-ready models, and implement CI/CD for enterprise AI systems. Strong skills in ML algorithms, MLOps, & data engineering required. Required Candidate profileExperienced ML/MLOps Engineer with expertise in ML pipelines,scalable model...

  • AI/ML Engineer

    1 week ago

    Chennai, Tamil Nadu, India INTINERI INFOSOL PRIVATE LIMITED Full time ₹ 1,20,00,000 - ₹ 2,00,00,000 per year

    Job Title: AI/ML EngineersLocation: Kerala / Tamil NaduExperience: 5+ yearsSalary(CTC): Up to 20,00000 per annumImmediate Joining RequiredKey Requirements: Minimum 5+ years of experience as an AI/ML Engineer, with strong expertise in Python andAI/ML frameworks (TensorFlow, PyTorch, etc.). Proven experience in developing AI/ML solutions for banking, cloud...

  • AI/ML Engineer

    1 week ago

    Chennai, Tamil Nadu, India INTINERI INFOSOL PRIVATE LIMITED Full time ₹ 1,60,00,000 - ₹ 2,00,00,000 per year

    Job Title: AI/ML EngineersLocation: Remote / Kerala / Tamil NaduExperience: 5+ yearsSalary(CTC): Up to 20,00000 per annumImmediate Joining RequiredKey Requirements: Minimum 5+ years of experience as an AI/ML Engineer, with strong expertise in Python andAI/ML frameworks (TensorFlow, PyTorch, etc.). Proven experience in developing AI/ML solutions for banking,...