LLM Engineer

4 days ago


Remote, India Jobbycart technologies private limited Full time ₹ 7,00,000 - ₹ 14,00,000 per year

The Principal LLM Engineer will lead the design, fine-tuning, and optimization of large language model (LLM) systems that capture, contextualize, and deliver organizational expertise at scale. This role focuses on turning unstructured and tacit knowledge into intelligent, context-aware reasoning systems that support diagnostics, decision-making, and automation across the enterprise.

Key Responsibilities:

  • LLM Architecture & Optimization
  • Design and implement LLM-based reasoning frameworks for domain-specific knowledge activation and expert support.
  • Architect Retrieval-Augmented Generation (RAG) pipelines integrating structured, semi-structured, and unstructured enterprise knowledge sources.
  • Fine-tune and optimize foundation models for specific enterprise use cases (diagnostics, troubleshooting, process guidance, etc.).
  • Develop prompt orchestration frameworks, including hierarchical prompts, context injection, and adaptive prompt tuning.
  • Evaluate new LLM modalities (multimodal, reasoning-augmented, tool-using models) for continuous system improvement.

Knowledge Engineering & Representation:

  • Collaborate with knowledge engineers to structure and embed expert content from documents, logs, and SME interviews.
  • Develop semantic embedding strategies, vector stores, and hybrid retrieval methods combining symbolic and statistical reasoning.
  • Create and maintain domain ontologies and entity graphs to ground model outputs in factual, validated enterprise data.
  • Ensure model interpretability through citation, provenance tracking, and source-grounded responses.

Agentic & Multi-Model Integration:

  • Integrate LLMs within multi-agent architectures, enabling autonomous reasoning and tool-assisted execution.
  • Work with Agentic AI architects to design LLM–tool interaction schemas and context handoff mechanisms.
  • Build adaptive memory systems combining vector, relational, and graph storage to support contextual continuity and learning loops.

Performance, Safety & Evaluation:

  • Establish evaluation pipelines for accuracy, coherence, grounding, and bias mitigation.
  • Implement reinforcement learning from human feedback (RLHF) or in-context learning feedback loops.
  • Design A/B testing frameworks for comparing model prompts, architectures, and retrieval performance.
  • Partner with governance and security teams to ensure compliance with data privacy and ethical AI standards.

Required Skills & Expertise:

  • Core (LLM Engineering & Optimization)
  • Deep expertise with transformer architectures, LLM fine-tuning, and instruction optimization.
  • Strong experience with RAG systems, embedding models, and retrieval pipelines.
  • Familiarity with multi-agent orchestration frameworks (AutoGen, Semantic Kernel, LangChain Agents).
  • Proficiency in Python, PyTorch, and distributed inference optimization.
  • Understanding of prompt engineering, context window management, and token efficiency strategies.

Knowledge Systems & Data Foundations:

  • Experience building and maintaining knowledge graphs, vector databases, and context retrieval APIs.
  • Ability to structure domain-specific taxonomies and embeddings for technical and industrial use cases.
  • Familiarity with knowledge provenance, explainability, and citation generation mechanisms.

Evaluation & Experimentation:

  • Expertise in designing model evaluation metrics, including factual accuracy, reasoning depth, and human preference modeling.
  • Strong analytical background for evaluating LLM performance across complex domain-specific tasks.

Preferred Qualifications:

  • 7+ years of experience in applied NLP, ML, or AI systems engineering.
  • 2+ years hands-on with LLM fine-tuning, retrieval-augmented systems, or enterprise AI copilots.
  • Graduate degree in Computer Science, Machine Learning, Computational Linguistics, or related field.
  • Background in industrial, engineering, or diagnostics-related domains preferred.

Job Type: Full-time

Pay: ₹700, ₹1,400,000.00 per year

Benefits:

  • Health insurance
  • Life insurance

Application Question(s):

  • Are you comfortable working in the EST time zone?

Experience:

  • AI/ML : 5 years (Preferred)

Work Location: Remote


  • LLM Engineer

    1 week ago


    Remote, India SAPLING INFOSYSTEMS Full time ₹ 14,40,000 - ₹ 15,60,000 per year

    Experience: 6+ YearsLocation: Remote________________________________________Job SummaryConcertIDC is seeking an experienced LLM Engineer to lead the design, development, and integration of LLM capabilities within our automation platform. The ideal candidate will have strong backend expertise in Python, a solid understanding of enterprise system integrations,...


  • Remote, India TriDevSofts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    LLM Engineering Manager8+ yearsEngagement Type Full Time Contract (10 months+)Role Overview:As a Delivery Leader for our LLM Training business, you will play a pivotal role in leading our efforts to develop high-quality, foundational LLMs. This position requires managing large teams of software engineers and data scientists dedicated to performing various...

  • LLM Expertise

    3 days ago


    Remote, India Development Logics Full time ₹ 2,99,000 - ₹ 13,69,799 per year

    We are seeking a motivated and detail-oriented professional to join our team as an LLM Expertise & Strategy Engineer. You will be responsible for managing the full lifecycle of Large Language Models (LLMs) and their applications.Responsibilities:· Maintain broad knowledge of LLM capabilities, limitations, and emerging best practices.· Recommend and...


  • Remote, India Manysphere Technologies Pvt Ltd Full time

    **Role Overview**: This role is for an experienced and high-caliber engineer with strong proficiency in Python and hands-on expertise integrating Large Language Models (LLMs) into production systems. This individual contributor (IC) role focuses on designing robust backend services and orchestrating LLM workflows. YoE 5+ years Start Date Immediate - 2 weeks...

  • LLM Data Scientist

    5 days ago


    Remote, India Thinglogix Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're looking for a data-driven professional to design, optimize, and evaluate large language model (LLM) workflows. The ideal candidate will combine expertise in data science, NLP, and AI engineering to enhance system performance, develop effective prompts, and integrate advanced AI solutions across applications.ResponsibilitiesDesign, develop, and...


  • Pacific Remote Islands Marine National Monument, India Albireo Tech System Full time

    :We are Looking for candidate having 5+ Yrs of Experience in Database for Below Requirement We are looking for an experienced Palantir AIP Logic Specialist (not AIP Assistant) who can demonstrate hands-on expertise with LLMs and prompt engineering. Duration: 2 Hours (Demo Session)Time: Flexible (Immediate) What we need:Proven working experience with Palantir...


  • Remote, India FullStackTechies Full time ₹ 24,00,000 - ₹ 36,00,000 per year

    Agentic AI Developer – LLM Systems & AutomationExperience: 3–5 YearsLocation: Remote (WFH)Mode of Engagement: Full-timeNo of Positions: 4Educational Qualification: B.E./B.Tech/M.E./M.Tech in Computer Science, AI/ML, or relatedIndustry: IT – AI/ML & Automation ServicesNotice Period: Immediate JoinerWhat We Are Looking ForAI & LLM Development: Strong...


  • Remote, India ASYVA INFOTECH Full time

    ServiceNow LLM Trainer Position: Contractor (no medical/paid leave) - Engagement: Full-time (40 hours/week) - Time Zone Overlap: Minimum 3 hours with CST We are seeking experienced professionals with deep functional expertise in ServiceNow products, including Customer Service Management (CSM), IT Service Management (ITSM), or HR Service Delivery (HRSD), to...


  • Remote, India Chipmonk Technologies Pvt. Full time ₹ 3,00,000 - ₹ 3,60,000 per year

    URGENT HIRING: LLM-Focused Python Engineer (Machine Learning)Contract Duration: 3 Months (Short-Term)Open Positions: 100Experience: 3+ YearsAbout the Role:We're on the lookout for highly skilled Machine Learning Engineers with a passion for solving real-world challenges using Python and cutting-edge ML frameworks. You'll be part of an innovative team...


  • Remote, India TriDevSofts Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    ServiceNow LLM TrainerPosition: Contractor (no medical/paid leave)Engagement: Full-time (40 hours/week)Time Zone Overlap: Minimum 3 hours with CSTWe are seeking experienced professionals with deep functional expertise in ServiceNow products, including Customer Service Management (CSM), IT Service Management (ITSM), or HR Service Delivery (HRSD), to...