Current jobs related to LLM Reliability - Mohali, Punjab - Xenonstack

  • LLM Engineer/ Prompt Engineer

    2 weeks ago

    Mohali, Punjab, India Girl Power Talk Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key ResponsibilitiesDesign, develop, and deploy machine learning modelsto address real-world challenges.- Build and optimize data pipelinesfor training, testing, and inference.- Train, evaluate, and fine-tune models across supervised, unsupervised, and deep learning techniques.- Collaborate with product managers, engineers, and designers to integrate AI...

  • Prompt Engineer

    4 days ago

    Mohali, Punjab, India Webdigitalblog Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a Prompt Engineer to design, test, and refine prompts that enhance the performance of Large Language Models (LLMs) such as OpenAI GPT, Anthropic Claude, and Google Gemini. The ideal candidate will combine analytical thinking with creativity to build effective, reliable, and engaging AI interactions across our products and workflows.Key...

  • Sr. AI Engineer

    7 days ago

    Mohali, Punjab, India Chic Mic Studios Full time ₹ 16,00,000 - ₹ 32,00,000 per year

    Senior AI EngineerLocation: Mohali, Punjab (Work From Office)Experience: 5+ YearsQualification: B.Tech / MCA / M.Tech / Equivalent in Computer Science or related fieldOverviewWe are seeking a highly skilled and experienced Senior AI Engineer to join our innovation-driven team at ChicMic Studios. The ideal candidate will have deep expertise in Python, AI/ML...

  • GenAI Developer

    1 week ago

    Mohali, Punjab, India Backspacce Technologies Full time ₹ 20,00,000 - ₹ 40,00,000 per year

    About the RoleWe're hiring a GenAI Developer with deep Python expertise and a proven track record in building intelligent chatbots powered by LLMs (Large Language Models). You'll design, train, and deploy production-grade conversational agents that deliver hyper-personalized, context-aware interactions at scale.What You'll DoArchitect and develop end-to-end...

  • AI Researcher

    7 days ago

    Mohali, Punjab, India Xenonstack Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job InformationDate Opened10/06/2025Job TypeFull timeIndustryTechnologyWork Experience1-3 yearsCityMohaliState/ProvincePunjabCountryIndiaZip/Postal Code160075Job DescriptionABOUT XENONSTACKXenonStack is the fastest-growing Data and AI Foundry for Agentic Systems, enabling enterprises to gain real-time, intelligent business insights and operational...

  • Developer

    6 days ago

    Mohali, Punjab, India Delta4 Infotech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    AtDelta4 Infotech, we are building next-gen AI products likeYourGPT, a powerful platform that helps businesses automate, engage, and scale using Generative AI.We are looking for Developerand you will be responsible for building and maintaining high-performance, scalable backend systems that serve as the backbone of our AI-driven products.You will work...

  • Backend Developer()

    6 days ago

    Mohali, Punjab, India Delta4 Infotech Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Delta4 Infotech Pvt. Ltd., the team behindYourGPT, is buildingAI-drivensolutions to help businesses automate and scale. We are looking for aBackend)to join our team in Mohali, who will be responsible for developing and maintain high-performance, scalable backend systems that power our AI-driven products. In this role, you will work closely with the AI and...

  • Artificial Intelligence/Machine Learning Engineer

    4 days ago

    Mohali, Punjab, India Bluebash Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : We are seeking a skilled AI/ML Engineer to design, develop, and optimize AI-driven solutions. The role requires expertise in machine learning algorithms, model training, and leveraging state-of-the-art tools to build scalable, efficient systems. The ideal candidate will have practical experience with frameworks like LangChain, Baby...

  • ai/ml

    2 weeks ago

    Mohali, Punjab, India Matrix Marketers Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Summary:We are looking for an AI/ML Engineer with 4 years of experience in designing, developing, and deploying machine learning and artificial intelligence solutions. The right candidate will have a solid background in algorithms, data pipelines, and model optimization, along with practical experience in production-level ML systems.Key...

  • AI Agentic

    1 week ago

    Mohali, Punjab, India RChilli Inc. Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Location: Mohali, PBJob Type: Full-TimeExp: 1- 2 years of experience in advanced AI development.Shift Timings: 12-10pm ISTAbout RChilliRChilli is a leader in AI-driven HR technology, powering next-generation recruitment solutions globally. We thrive on innovation, agility, and a mission to revolutionize the way HR teams work with intelligent automation....

LLM Reliability

2 weeks ago

Mohali, Punjab, India Xenonstack Full time US$ 1,04,000 - US$ 1,30,878 per year
Job Information

Date Opened

09/04/2025

Job Type

Full time

Industry

Technology

Work Experience

2-4 years

City

Mohali

State/Province

Punjab

Country

India

Zip/Postal Code

160075

Job Description
ABOUT XENONSTACK

XenonStack is the fastest-growing Data and AI Foundry for Agentic Systems, enabling enterprises to gain real-time and intelligent business insights.

We deliver innovation through:

  • Agentic Systems for AI Agents
  • Vision AI Platform
  • Inference AI Infrastructure for Agentic Systems

Our mission is to accelerate the world's transition to AI + Human Intelligence by making AI agents reliable, explainable, and enterprise-ready.

THE OPPORTUNITY

We are seeking an LLM Reliability & Evaluation Engineer to ensure that large language models (LLMs) and agentic AI systems meet enterprise-grade standards of accuracy, safety, and trustworthiness.

This role focuses on evaluating, benchmarking, and stress-testing LLMs in real-world workflows, building frameworks for reliability, robustness, and continuous improvement. If you thrive at the intersection of AI research, applied testing, and responsible deployment, this is the role for you.

KEY RESPONSIBILITIES

  • Evaluation Frameworks

  • Design and implement LLM evaluation pipelines covering accuracy, robustness, safety, and bias.

  • Develop automated systems for benchmarking models on enterprise-relevant tasks.

  • Reliability Engineering

  • Conduct stress tests, adversarial testing, and edge-case evaluations.

  • Build tools to measure latency, consistency, and error recovery in multi-turn interactions.

  • Metrics & Monitoring

  • Define KPIs such as factual accuracy, hallucination rate, toxicity, and compliance alignment.

  • Establish real-time monitoring for drift, anomalies, and performance regressions.

  • Collaboration & Alignment

  • Partner with ML engineers, product managers, and domain experts to align evaluation with business objectives.

  • Work with Responsible AI teams to implement ethical, explainable, and compliant evaluation practices.

  • Continuous Improvement

  • Feed insights from evaluation into fine-tuning, RLHF/RLAIF pipelines, and model selection.

  • Maintain a central repository of test cases, benchmarks, and evaluation results.

  • Research & Innovation

  • Stay current with state-of-the-art LLM evaluation techniques, from academic benchmarks to applied enterprise metrics.

  • Explore automated evaluation using agentic test harnesses and synthetic data generation.
SKILLS & QUALIFICATIONS

Must-Have

  • 3–6 years in AI/ML, NLP, or applied model evaluation.
  • Strong understanding of LLM architectures, prompt engineering, and failure modes.
  • Hands-on with evaluation frameworks (Eval harnesses, Ragas, OpenAI Evals, DeepEval).
  • Proficiency in Python and libraries like LangChain, LangGraph, LlamaIndex, Hugging Face.
  • Experience with vector databases, RAG pipelines, and knowledge graph integration.
  • Familiarity with bias/fairness testing and Responsible AI frameworks.

Good-to-Have

  • Experience with reinforcement learning (RLHF, RLAIF) and reward modeling.
  • Exposure to agentic evaluation frameworks (multi-agent stress testing, synthetic user simulators).
  • Knowledge of compliance and safety requirements for BFSI, GRC, or SOC use cases.
  • Contributions to open-source evaluation libraries or research papers.
WHY SHOULD YOU JOIN US?
  • Agentic AI Product Company

Ensure reliability in cutting-edge AI platforms that are redefining enterprise adoption.
- A Fast-Growing Category Leader

Be part of one of the fastest-growing AI Foundries, powering Fortune 500 enterprises with trustworthy AI.
- Career Mobility & Growth

Grow into roles such as AI Systems Architect, Responsible AI Engineer, or Reliability Engineering Lead.
- Global Exposure

Work on enterprise-scale evaluation challenges across BFSI, Healthcare, Telecom, and GRC.
- Create Real Impact

Your evaluations will directly shape production-grade AI agents used in mission-critical systems.
- Culture of Excellence

Our values — Agency, Taste, Ownership, Mastery, Impatience, and Customer Obsession — empower you to innovate fearlessly.
- Responsible AI First

Join a company that prioritizes trustworthy, explainable, and compliant AI.

XENONSTACK CULTURE – JOIN US & MAKE AN IMPACT

At XenonStack, we believe in shaping the future of intelligent systems. We foster a culture of cultivation built on bold, human-centric leadership principles, where deep work, simplicity, and adoption define everything we do.

Our Cultural Values

  • Agency – Be self-directed and proactive.
  • Taste – Sweat the details and build with precision.
  • Ownership – Take responsibility for outcomes.
  • Mastery – Commit to continuous learning and growth.
  • Impatience – Move fast and embrace progress.
  • Customer Obsession – Always put the customer first.

Our Product Philosophy

  • Obsessed with Adoption – Making AI accessible, reliable, and enterprise-ready.
  • Obsessed with Simplicity – Turning complex evaluation challenges into seamless, automated frameworks.

Be part of our mission to accelerate the world's transition to AI + Human Intelligence — by making AI agents not just powerful, but trustworthy and reliable.