LLMOps Engineer

3 weeks ago

Bengaluru, Karnataka, India Recursive Softpro Full time

About the Role:

---------------------

We are looking for 3-5 years of experience, forward-thinking LLMOps Engineers to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing monitoring, governance, security, and operational best practices while enabling development teams to build high-performing GenAI applications. You will also work closely with GenAI agents and integrate LLMs from multiple providers to support diverse use cases.

Key Responsibilities:

-------------------------

  • Design and implement governance frameworks for GenAI platforms, ensuring compliance with internal policies and external regulations (e.g., GDPR, AI Act).
  • Define and enforce responsible AI practices including fairness, transparency, explainability, and auditability.
  • Implement robust security protocols including IAM, data encryption, secure API access, and model sandboxing.
  • Collaborate with security teams to conduct risk assessments and ensure secure deployment of LLMs.
  • Build and maintain scalable LLMOps pipelines for model training, fine-tuning, evaluation, deployment, and monitoring.
  • Automate model lifecycle management with CI/CD, versioning, rollback, and observability.
  • Develop and manage GenAI agents capable of reasoning, planning, and tool use.
  • Integrate and orchestrate LLMs from multiple providers (e.g., OpenAI, Anthropic, Cohere, Google, Azure OpenAI) to support hybrid and fallback strategies.
  • Optimize prompt engineering, context management, and agent memory for production use.
  • Ensure high availability, low latency, and cost-efficiency of GenAI workloads across cloud and hybrid environments.
  • Implement monitoring and alerting for model drift, hallucinations, and performance degradation.
  • Partner with GenAI developers to embed best practices and reusable components (SDKs, templates, APIs).
  • Provide technical guidance and documentation to accelerate development and ensure platform consistency.

Qualifications:

------------------

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 3-5 years of experience in MLOps, DevOps, or platform engineering, with 2+ years in LLM/GenAI environments.
  • Deep understanding of LLMs, GenAI agents, prompt engineering, and inference optimization.
  • Experience with LangChain, LlamaIndex, Langraph or similar agent frameworks.
  • Hands-on with MLflow, or equivalent tools.
  • Proficient in Python, containerization (Docker) and cloud platforms (AWS/GCP/Azure).
  • Familiarity with AI governance frameworks and responsible AI principles.
  • Experience with vector databases (e.g., FAISS, Pinecone), RAG pipelines, and model evaluation frameworks.
  • Knowledge of Responsible AI,  red-teaming, and OWASP security principles.

Joining:

----------

  • We must fill this position urgently. Candidates who can start within 2 weeks will be our priority.

Location:

-----------

  • Bangalore Hybrid

  • LLMOps Engineer

    3 weeks ago

    Bengaluru, Karnataka, India TEKNIKOZ Full time

    Greetings from Teknikoz Experience : 6+ Years Job Profile: We are looking for a forward-thinking LLMOps Engineer to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing governance, security, and operational best practices while enabling development teams...

  • LLMOps Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Recursive Softpro Full time

    Job DescriptionAbout the Role:---------------------We are looking for 3-5 years of experience, forward-thinking LLMOps Engineers to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing monitoring, governance, security, and operational best practices while...

  • High Salary: LLMOps Engineer

    4 weeks ago

    Bengaluru, Karnataka, India TEKNIKOZ Full time

    Greetings from TeknikozExperience : 6+ YearsJob Profile:We are looking for a forward-thinking LLMOps Engineer to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing governance, security, and operational best practices while enabling development teams to...

  • Urgent Search LLMOps Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Recursive Softpro Full time

    About the Role:---------------------We are looking for 3-5 years of experience, forward-thinking LLMOps Engineers to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing monitoring, governance, security, and operational best practices while enabling...

  • Artificial Intelligence Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd. Full time

    We are early stage Tech startup company setting up team in India.AI Engineer (LLM)Location : Bengaluru, IndiaAbout the Role :As an AI Engineer (LLM) you'll lead end-to-end ML developmentdesigning, implementing, and optimizing AI/ML systems. Collaborate with cross-functional teams to build scalable, production-grade models and pipelines that power...

  • Generative AI Engineer

    3 days ago

    Bengaluru, Karnataka, India Infogain Full time

    Core SkillsResponsibilities:Design and develop Generative AI applications and solutions using LLMs and open-source frameworks.Understand the business requirements and translate into Gen AI solution design that successfully meets the business objectivesPrototype and experiment with new GenAI techniques and approaches.Contribute to the development,...

  • Sr. staff data engineer

    1 day ago

    Bengaluru, Karnataka, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer)Location: Bengaluru, IndiaExperience: 5+ years Role Summary: Aurigo is leading the charge in transforming enterprise Saa S for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks, driving smarter,...

  • Sr. Staff Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer)Location: Bengaluru, IndiaExperience: 7+ yearsRole Summary: Aurigo is leading the charge in transforming enterprise SaaS for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks, driving smarter,...

  • Sr. Staff Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer)Location: Bengaluru, IndiaExperience: 9+ yearsRole Summary:Aurigo is leading the charge in transforming enterprise SaaS for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks, driving smarter,...

  • High-Tech Software Engineering Leadership Position

    2 days ago

    Bengaluru, Karnataka, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Technical Lead Software EngineerJob Description Summary:We are seeking a highly skilled technical lead software engineer with 6-10 years of experience in platform engineering, cloud infrastructure, or AI/ML system development.Key Responsibilities:Design and develop scalable SaaS products in the Data Platform using strong leadership skills to...