High Salary: LLMOps Engineer

4 weeks ago

Bengaluru, Karnataka, India TEKNIKOZ Full time
Greetings from Teknikoz

Experience : 6+ Years

Job Profile:

We are looking for a forward-thinking LLMOps Engineer to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing governance, security, and operational best practices while enabling development teams to build high-performing GenAI applications. You will also work closely with GenAI agents and integrate LLMs from multiple providers to support diverse use cases.

Key Responsibilities:

- Design and implement governance frameworks for GenAI platforms, ensuring compliance with internal policies and external regulations (e.g., GDPR, AI Act).
- Define and enforce responsible AI practices including fairness, transparency, explainability, and auditability.
- Implement robust security protocols including IAM, data encryption, secure API access, and model sandboxing.
- Collaborate with security teams to conduct risk assessments and ensure secure deployment of LLMs.
- Build and maintain scalable LLMOps pipelines for model training, fine-tuning, evaluation, deployment, and monitoring.
- Automate model lifecycle management with CI/CD, versioning, rollback, and observability.
- Develop and manage GenAI agents capable of reasoning, planning, and tool use.
- Integrate and orchestrate LLMs from multiple providers (e.g., OpenAI, Anthropic, Cohere, Google, Azure OpenAI) to support hybrid and fallback strategies.
- Optimize prompt engineering, context management, and agent memory for production use.
- Ensure high availability, low latency, and cost-efficiency of GenAI workloads across cloud and hybrid environments.
- Implement monitoring and alerting for model drift, hallucinations, and performance degradation.
- Partner with GenAI developers to embed best practices and reusable components (SDKs, templates, APIs).
- Provide technical guidance and documentation to accelerate development and ensure platform consistency.

Qualifications:

- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 4+ years of experience in MLOps, DevOps, or platform engineering, with 1–2 years in LLM/GenAI environments.
- Deep understanding of LLMs, GenAI agents, prompt engineering, and inference optimization.
- Experience with LangChain, LlamaIndex, Langraph or similar agent frameworks.
- Hands-on with MLflow, or equivalent tools.
- Proficient in Python, containerization (Docker) and cloud platforms (AWS/GCP/Azure).
- Familiarity with AI governance frameworks and responsible AI principles.
- Experience with vector databases (e.g., FAISS, Pinecone), RAG pipelines, and model evaluation frameworks.
- Knowledge of Responsible AI, red-teaming, and OWASP security priciples.

  • LLMOps Engineer

    4 weeks ago

    Bengaluru, Karnataka, India TEKNIKOZ Full time

    Greetings from Teknikoz Experience : 6+ Years Job Profile: We are looking for a forward-thinking LLMOps Engineer to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing governance, security, and operational best practices while enabling development teams...

  • LLMOps Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Recursive Softpro Full time

    Job DescriptionAbout the Role:---------------------We are looking for 3-5 years of experience, forward-thinking LLMOps Engineers to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing monitoring, governance, security, and operational best practices while...

  • LLMOps Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Recursive Softpro Full time

    About the Role:---------------------We are looking for 3-5 years of experience, forward-thinking LLMOps Engineers to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing monitoring, governance, security, and operational best practices while enabling...

  • Urgent Search LLMOps Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Recursive Softpro Full time

    About the Role:---------------------We are looking for 3-5 years of experience, forward-thinking LLMOps Engineers to join our team and help build the next generation of secure, scalable, and responsible Generative AI (GenAI) platforms. This role will focus on establishing monitoring, governance, security, and operational best practices while enabling...

  • High Salary AI/ML Engineer

    3 weeks ago

    Bengaluru, Karnataka, India GyanSys Inc. Full time

    Role: AI/ML EngineerLocation: BangaloreImmediate Joiners Preferred.Exp: 3–5 years of experience working Machine Learning / Artificial IntelligentAI Agent Development & LLM Integration- Build AI agents using frameworks like LangGraph, Autogen, Crew, or PydanticAI.- Design and optimize prompt engineering workflows for LLMs (e.g., GPT, Claude, LLaMA).-...

  • High-Tech Software Engineering Leadership Position

    4 days ago

    Bengaluru, Karnataka, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Technical Lead Software EngineerJob Description Summary:We are seeking a highly skilled technical lead software engineer with 6-10 years of experience in platform engineering, cloud infrastructure, or AI/ML system development.Key Responsibilities:Design and develop scalable SaaS products in the Data Platform using strong leadership skills to...

  • Artificial Intelligence Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd. Full time

    We are early stage Tech startup company setting up team in India.AI Engineer (LLM)Location : Bengaluru, IndiaAbout the Role :As an AI Engineer (LLM) you'll lead end-to-end ML developmentdesigning, implementing, and optimizing AI/ML systems. Collaborate with cross-functional teams to build scalable, production-grade models and pipelines that power...

  • Database Engineer High Salary

    1 day ago

    Bengaluru, Karnataka, India ACL Digital Full time

    Job Title: Database EngineerLocation: Bangalore, KAWork Mode: Hybrid – 3 Days onsite in officeJob type: Contract 12+ Months with a possibility of extensionAbout the Role:Our client is seeking a skilled Database Engineer with strong expertise in PostgreSQL to join the Performance Automation and SRE team. In this role, you will design, optimize, and manage...

  • High Salary) Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India BCE Global Tech Full time

    About BCEGTC:BCEGTC is a forward-thinking technology company specializing in cloud-native solutions, data engineering, and digital transformation. We empower enterprises to harness the full potential of cloud platforms, with a strong focus on innovation, scalability, and performanceExp: 5 to 15+ yrsWork Location: Bangalore(Electronic City)Work Mode:...

  • High Salary: Electrical Engineer I

    4 weeks ago

    Bengaluru, Karnataka, India Yield Engineering Systems Full time

    YES (Yield Engineering Systems, Inc.) is a leading manufacturer of reliable, high-tech, cost-effective capital equipment that transforms materials and surfaces at the nanoscale. From startups to the Fortune 50, our customers rely on YES to help them unleash products that change lives – from cellphones and IoT devices, to AI and virtual reality, to...