LLM Engineer

4 days ago

Bengaluru, India Factspan Analytics Full time

Job Description

As an LLM (Large Language Model) Engineer, you will be responsible for designing, optimizing, and standardizing the architecture, codebase, and deployment pipelines of LLM-based systems. Your primary mission will focus on modernizing legacy machine learning codebases (including 40+ models) for a major retail clientenabling consistency, modularity, observability, and readiness for GenAI-driven innovation. You'll work at the intersection of ML, software engineering, and MLOps to enable seamless experimentation, robust infrastructure, and production-grade performance for language-driven systems.

This role requires deep expertise in NLP, transformer-based models, and the evolving ecosystem of LLM operations (LLMOps), along with a hands-on approach to debugging, refactoring, and building unified frameworks for scalable GenAI workloads.

Responsibilities:

Lead the standardization and modernization of legacy ML codebases by aligning to current LLM architecture best practices.

Re-architect code for 40+ legacy ML models, ensuring modularity, documentation, and consistent design patterns.

Design and maintain pipelines for fine-tuning, evaluation, and inference of LLMs using Hugging Face, OpenAI, or opensource stacks (e.g., LLaMA, Mistral, Falcon).

Build frameworks to operationalize prompt engineering, retrieval-augmented generation (RAG), and few-shot/incontext learning methods.

Collaborate with Data Scientists, MLOps Engineers, and Platform teams to implement scalable CI/CD pipelines, feature stores, model registries, and unified experiment tracking.

Benchmark model performance, latency, and cost across multiple deployment environments (on-premise, GCP, Azure).

Develop governance, access control, and audit logging mechanisms for LLM outputs to ensure data safety and compliance.

Mentor engineering teams in code best practices, versioning, and LLM lifecycle maintenance.

Key Skills:

Deep understanding of transformer architectures, tokenization, attention mechanisms, and training/inference optimization

Proven track record in standardizing ML systems using OOP design, reusable components, and scalable service APIs

Hands-on experience with MLflow, LangChain, Ray, Prefect/Airflow, Docker, K8s, Weights & Biases, and modelserving platforms.

Strong grasp of prompt tuning, evaluation metrics, context window management, and hybrid search strategies using vector databases like FAISS, pgvector, or Milvus

Proficient in Python (must), with working knowledge of shell scripting, YAML, and JSON schema standardization

Experience managing compute, memory, and storage requirements of LLMs across GCP, Azure, or AWS environments

Qualifications & Experience:

5+ years in ML/AI engineering with at least 2 years working on LLMs or NLP-heavy systems.

Able to reverse-engineer undocumented code and reimagine it with strong documentation and testing in mind.

Clear communicator who collaborates well with business, data science, and DevOps teams.

Familiar with agile processes, JIRA, GitOps, and confluence-based knowledge sharing.

Curious and future-facing—always exploring new techniques and pushing the envelope on GenAI innovation.

Passionate about data ethics, responsible AI, and building inclusive systems that scale

  • LLM Engineer

    4 days ago

    Bengaluru, India Net Connect Full time

    Notice Period: Immediate to 15 Days Role Overview: We are seeking a skilled and innovative LLM Engineer to design, implement, and optimize advanced GenAI solutions across drug discovery, clinical development, and manufacturing. The ideal candidate will have hands-on experience with LLMs, deep learning, MLOps, and agentic frameworks, with a strong focus on...

  • AI Engineer with LLM

    4 days ago

    Bengaluru, India Recex Full time

    Position OverviewWe are seeking a highly skilled and forward-thinkingAI Engineer specialized in Large Language Models (LLMs)to design, develop, and deploy innovative AI-powered applications and intelligentagents. The ideal candidate will possess deep expertise inLLM engineering, including advanced prompt engineering strategies,fine-tuning, evaluation...

  • LLM AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Gainwell Technologies LLC Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    SummaryGainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance...

  • Artificial Intelligence Engineer

    6 days ago

    Bengaluru, India Virtue Sources LLP Full time

    AI Engineer (LLM Focus) Job Description : Position Overview : We are seeking a highly skilled and forward-thinking AI Engineer specialized in Large Language Models (LLMs) to design, develop, and deploy innovative AI-powered applications and intelligent agents. The ideal candidate will possess deep expertise in LLM engineering, including advanced prompt...

  • GEN AI Engineer-LLM

    2 weeks ago

    Bengaluru, Karnataka, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Sr. LLM Engineer: Gen AI Location-Work from Office - Hyderabad/Gurgaon - 3 days hybridYoE-5 - 9 YearsStart Date: Immediate/Full timeMust Have Skills:Machine Learning models & systemsGenerative AI (LLM) / LLM prompt engineeringBuilding LLM RAGExperience in using langchain or similar toolTuring is looking for people with LLM experience to join us in solving...

  • Senior LLM Engineer

    5 days ago

    Bengaluru, Karnataka, India Prodigy Placement LLP Full time ₹ 1,20,000 - ₹ 12,00,000 per year

    Position: Senior LLM EngineerExperience: Overall 7+YrsRelevant : 4+YrsLocation: Hyderabad(Onsite)Budget: 1.40LPM+GSTSalary Range : 10-12 LPAGood to Have:Experience with LLM observability tools and monitoring pipelines.Exposure to cloud platforms (AWS, GCP, Azure) for scalable model deployment.Knowledge of MLOps practices for model lifecycle management.Job...

  • Senior LLM Engineer

    4 days ago

    Bengaluru, India Prodigy Placement LLP Full time

    Position: Senior LLM Engineer Experience: Overall 7+Yrs Relevant : 4+Yrs Location: Hyderabad(Onsite) Budget: 1.40LPM+GST Salary Range : 10-12 LPA Good to Have: Experience with LLM observability tools and monitoring pipelines. Exposure to cloud platforms (AWS, GCP, Azure) for scalable model deployment. Knowledge of MLOps practices for model lifecycle...

  • Agentic AI Engineer

    7 days ago

    Bengaluru, India Winpra Full time

    Winpra is revolutionizing the real estate industry through advanced AI-powered analytics. We're building cutting-edge solutions that combine Large Language Models (LLMs) with real estate expertise to deliver unprecedented insights and automation capabilities.Position OverviewWe're seeking an Agentic AI Engineer to join our innovative team and help shape the...

  • GenAI Engineer

    6 days ago

    Bengaluru, India Amantya Technolgies Full time

    Location : Bangalore - Zeiss Office Job Title : GenAI Engineer (LLM Applications)Company : Carl Zeiss India Pvt LtdAbout the Role : We are looking for an enthusiastic and motivated AI Engineer to join our team. In this role, will contribute to the design and implementation of production-grade applications powered by Large Language Models (LLMs). You will be...

  • Prompt Engineer

    6 days ago

    Bengaluru, India Impacteers Full time

    About the Role : We are seeking a curious, creative, and technically strong Prompt Engineer to work on designing, testing, and optimizing natural language prompts that interface with Large Language Models (LLMs). Youll play a critical role in building intelligent, context-aware, and human-like AI applications across domains such as customer support, content...