LLMOps Engineer

5 days ago

Bengaluru, Karnataka, India Tekskills Inc. Full time US$ 1,25,000 - US$ 1,75,000 per year

Role: LLM Ops Engineer

Location
:
Bengaluru

Experience: 3+ Years

Work Mode: Onsite

Employment Type: Full-time

About the Role:

We are looking for a forward-thinking LLMOps Engineer to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing governance, security, and operational best practices while enabling development teams to build high-performing GenAI applications. You will also work closely with GenAI agents and integrate LLMs from multiple providers to support diverse use cases.

Key Responsibilities:

  • Design and implement governance frameworks for GenAI platforms, ensuring compliance with internal policies and external regulations (e.g., GDPR, AI Act).
  • Define and enforce responsible AI practices including fairness, transparency, explain ability, and auditability.
  • Implement robust security protocols including IAM, data encryption, secure API access, and model sandboxing.
  • Collaborate with security teams to conduct risk assessments and ensure secure deployment of LLMs.
  • Build and maintain scalable LLMOps pipelines for model training, fine-tuning, evaluation, deployment, and monitoring.
  • Automate model lifecycle management with CI/CD, versioning, rollback, and observability.
  • Develop and manage GenAI agents capable of reasoning, planning, and tool use.
  • Integrate and orchestrate LLMs from multiple providers (e.g., OpenAI, Anthropic, Cohere, Google, Azure OpenAI) to support hybrid and fallback strategies.
  • Optimize prompt engineering, context management, and agent memory for production use.
  • Ensure high availability, low latency, and cost-efficiency of GenAI workloads across cloud and hybrid environments.
  • Implement monitoring and alerting for model drift, hallucinations, and performance degradation.
  • Partner with GenAI developers to embed best practices and reusable components (SDKs, templates, APIs).
  • Provide technical guidance and documentation to accelerate development and ensure platform consistency.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 4+ years of experience in MLOps, DevOps, or platform engineering, with 1–2 years in LLM/GenAI environments.
  • Deep understanding of LLMs, GenAI agents, prompt engineering, and inference optimization.
  • Experience with Lang Chain, LlamaIndex, Langraph or similar agent frameworks.
  • Hands-on with MLflow, or equivalent tools.
  • Proficient in Python, containerization (Docker) and cloud platforms (AWS/GCP/Azure).
  • Familiarity with AI governance frameworks and responsible AI principles.
  • Experience with vector databases (e.g., FAISS, Pinecone), RAG pipelines, and model evaluation frameworks.
  • Knowledge of Responsible AI, red-teaming, and OWASP security principles.

  • Senior LLMOps Engineer

    5 days ago

    Bengaluru, Karnataka, India Kong Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Are you ready to power the World's connections?If you don't think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we're looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.About The RoleKong's API Management suite including the...

  • LLMOps Architect

    5 days ago

    Bengaluru, Karnataka, India Enterpret Full time US$ 1,50,000 - US$ 2,50,000 per year

    About EnterpretEnterpret is at the forefront ofAI-nativeapplications, unlocking the power of customer feedback for businesses. We centralize feedback from every channel and transform it into actionable insights that drive customer-centric decisions for teams at the world's leading companies like Perplexity, Notion, Canva, and Figma. Backed by investors such...

  • LLMOps Engineer

    3 days ago

    Bengaluru, Karnataka, India Uplers Full time

    Job DescriptionResponsibilities- Deploy and scale LLM inference workloads on Kubernetes (K8s) with 99.9% uptime.- Build agentic tools and services for fraud investigations with complex reasoning capabilities.- Work with Platform Engineers to set up monitoring and observability (e.g., Prometheus, Grafana) to track model performance and system health.-...

  • Machine Learning Engineer – LLMOps

    1 day ago

    Bengaluru, Karnataka, India Delphi Consulting Middle East Full time

    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values.At Delphi Consulting Pvt. Ltd., we foster a thriving environment with a hybrid work model that lets you prioritize what matters most. Interviews and onboarding are conducted virtually, reflecting...

  • AI Engineering Lead

    6 days ago

    Bengaluru, Karnataka, India beBeeMachineLearning Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    Job Description:We are seeking a seasoned Machine Learning Operations expert to spearhead the development and maintenance of our Data and AI/ML engineering platform.As a Sr. Engineer, you will be responsible for building automation frameworks, leading-edge architecture, and ensuring AI platforms are reliable, scalable, and resilient.Design and implement...

  • Machine Learning Engineer

    5 days ago

    Bengaluru, Karnataka, India Adecco Group Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Position : Machine Learning Engineer - Generative AI / LLMs (Onsite - Bengaluru)Experience : 3+ years of industry experience in ML, software engineering, and data engineering.Education : Masters degree or equivalent experience in Machine Learning.Location : Bangalore (HSR Layout)Job Description:We are looking for a talented Machine Learning Engineer to join...

  • AI/ML Deployment Engineer

    2 days ago

    Bengaluru, Karnataka, India IndiHire Consultants Full time

    AI/ML Deployment EngineerLocation : PAN India (Hybrid options)Joiners : Immediate to 30 DaysExperience : 6- 14 YearsContract-to-Hire | 1+ Years (Extendable)Do you have the expertise to take GenAI & ML models from experiment secure, production-ready deploymentThis role is all about embedding AI features like :- Smart Assistants- RAG Search- Summarisation-...

  • MLOps Engineer

    5 days ago

    Bengaluru, Karnataka, India Doelsoft IT Services Private Limited Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Required Skills & Qualifications : Education & Experience :Master's or PhD in Computer Science, Data Science, Engineering, or related field. 12 years of combined experience in data science and software/ML engineering, with 5 years in a leadership capacity. Technical Expertise : Proven track record inMLOps : CI/CD pipelines, model versioning,...

  • Lead AI/ML Engineer

    13 hours ago

    Bengaluru, Karnataka, India Optum Full time

    Job DescriptionOptum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion,...

  • SDE 2, Full Stack Machine Learning Engineer

    1 week ago

    Bengaluru, Karnataka, India Poppulo Full time

    Job DescriptionIntroduction:Are you looking to make a significant impact in a thriving software company At Poppulo, we are shaping the future of communications and workplace technology. We recognize the challenges of effectively reaching every employee, managing hybrid office spaces, and enhancing customer experiences. Our mission is to simplify these...