LLM Engineer

7 days ago

Bengaluru, Karnataka, India Factspan Analytics Full time US$ 1,50,000 - US$ 2,00,000 per year

Job Description

As an LLM (Large Language Model) Engineer, you will be responsible for designing, optimizing, and standardizing the architecture, codebase, and deployment pipelines of LLM-based systems. Your primary mission will focus on modernizing legacy machine learning codebases (including 40+ models) for a major retail clientenabling consistency, modularity, observability, and readiness for GenAI-driven innovation. You'll work at the intersection of ML, software engineering, and MLOps to enable seamless experimentation, robust infrastructure, and production-grade performance for language-driven systems.

This role requires deep expertise in NLP, transformer-based models, and the evolving ecosystem of LLM operations (LLMOps), along with a hands-on approach to debugging, refactoring, and building unified frameworks for scalable GenAI workloads.

Responsibilities:

Lead the standardization and modernization of legacy ML codebases by aligning to current LLM architecture best practices.

Re-architect code for 40+ legacy ML models, ensuring modularity, documentation, and consistent design patterns.

Design and maintain pipelines for fine-tuning, evaluation, and inference of LLMs using Hugging Face, OpenAI, or opensource stacks (e.g., LLaMA, Mistral, Falcon).

Build frameworks to operationalize prompt engineering, retrieval-augmented generation (RAG), and few-shot/incontext learning methods.

Collaborate with Data Scientists, MLOps Engineers, and Platform teams to implement scalable CI/CD pipelines, feature stores, model registries, and unified experiment tracking.

Benchmark model performance, latency, and cost across multiple deployment environments (on-premise, GCP, Azure).

Develop governance, access control, and audit logging mechanisms for LLM outputs to ensure data safety and compliance.

Mentor engineering teams in code best practices, versioning, and LLM lifecycle maintenance.

Key Skills:

Deep understanding of transformer architectures, tokenization, attention mechanisms, and training/inference optimization

Proven track record in standardizing ML systems using OOP design, reusable components, and scalable service APIs

Hands-on experience with MLflow, LangChain, Ray, Prefect/Airflow, Docker, K8s, Weights & Biases, and modelserving platforms.

Strong grasp of prompt tuning, evaluation metrics, context window management, and hybrid search strategies using vector databases like FAISS, pgvector, or Milvus

Proficient in Python (must), with working knowledge of shell scripting, YAML, and JSON schema standardization

Experience managing compute, memory, and storage requirements of LLMs across GCP, Azure, or AWS environments

Qualifications & Experience:

5+ years in ML/AI engineering with at least 2 years working on LLMs or NLP-heavy systems.

Able to reverse-engineer undocumented code and reimagine it with strong documentation and testing in mind.

Clear communicator who collaborates well with business, data science, and DevOps teams.

Familiar with agile processes, JIRA, GitOps, and confluence-based knowledge sharing.

Curious and future-facing—always exploring new techniques and pushing the envelope on GenAI innovation.

Passionate about data ethics, responsible AI, and building inclusive systems that scale

  • LLM Engineer

    6 days ago

    Bengaluru, Karnataka, India Net Connect Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Notice Period: Immediate to 15 DaysRole Overview:We are seeking a skilled and innovative LLM Engineer to design, implement, and optimize advanced GenAI solutions across drug discovery, clinical development, and manufacturing. The ideal candidate will have hands-on experience with LLMs, deep learning, MLOps, and agentic frameworks, with a strong focus on...

  • AI Engineer with LLM

    7 days ago

    Bengaluru, Karnataka, India Recex Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position OverviewWe are seeking a highly skilled and forward-thinkingAI Engineer specialized in Large Language Models (LLMs)to design, develop, and deploy innovative AI-powered applications and intelligentagents. The ideal candidate will possess deep expertise inLLM engineering, including advanced prompt engineering strategies,fine-tuning, evaluation...

  • LLM AI Engineer

    2 days ago

    Bengaluru, Karnataka, India Gainwell Technologies LLC Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    SummaryGainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance...

  • GEN AI Engineer-LLM

    2 days ago

    Bengaluru, Karnataka, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Sr. LLM Engineer: Gen AI Location-Work from Office - Hyderabad/Gurgaon - 3 days hybridYoE-5 - 9 YearsStart Date: Immediate/Full timeMust Have Skills:Machine Learning models & systemsGenerative AI (LLM) / LLM prompt engineeringBuilding LLM RAGExperience in using langchain or similar toolTuring is looking for people with LLM experience to join us in solving...

  • LLM & ML Ops Engineer

    7 days ago

    Bengaluru, Karnataka, India Gainwell Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    SummaryGainwell is seekingLLM Ops Engineers and ML Ops Engineersto join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance...

  • LLM Engineer

    6 days ago

    Bengaluru, Karnataka, India i4 Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    2-5 years Hands on experience with - building Voice Bots, - Building LLM models, Speech based models- Develop algorithms for NLP

  • LLM Engineer

    7 days ago

    Bengaluru, Karnataka, India TIFIN Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    ResponsibilitiesWork closely with the design and product teams to help craft conversational experiences for our users.Ability to work independently to deliver features that the team designs.You need to own outcomes without someone watching over you.Understand the data we have and identify how we could leverage it to create more personalized experiences for...

  • LLM Scientist

    2 days ago

    Bengaluru, Karnataka, India Prana Tree Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job description Pranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative...

  • Senior Professional Llm Ai Engineer

    1 week ago

    Bengaluru, Karnataka, India Gainwell Technologies Full time

    SummaryGainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI ML team This role is responsible for developing deploying and maintaining scalable infrastructure and pipelines for Machine Learning ML models and Large Language Models LLMs You will play a critical role in ensuring smooth model lifecycle management performance...

  • Llm Optimization Expert

    2 weeks ago

    Bengaluru, Karnataka, India beBeeLLM Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    We are looking for an expert in Large Language Models (LLMs) to enhance our brand's presence, accuracy, and authority in AI-powered environments.Key ResponsibilitiesDevelop a comprehensive strategy for optimizing LLMs to align with business objectives.Analyze LLM query patterns, AI search trends, and knowledge ingestion sources to identify optimization...