AI Engineer-LLM Integration/Platform Observability

1 week ago

Hyderabad, Telangana, India Kiash Solutions LLP Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Exp -- 4+ Years

Shift PM to 11:30 PM IST

Mandatory-- Python with LLM Ops

Job Description--

We are looking for a hands-on AI Engineer with strong expertise in LLM integration, platform observability, performance optimization, and API development. The ideal candidate will work on critical platform enhancements, including LLM API integrations, observability pipelines, structured search algorithms, and performance scaling for customer's AI platform and related components.

You will collaborate with cross-functional teams to develop robust, scalable solutions, modernize our logging and monitoring infrastructure, and integrate advanced AI capabilities into production workflows.

Key Responsibilities:

1. LLM Integration & API Development

  • Develop and maintain LLM API integration test cases for core model availability.
  • Refactor and reorganize LLM API code (e.g., ) for better maintainability.
  • Add support for Vertex AI batch generation and batch transcription processing.
  • Implement multi-step structured search algorithms and tie model IDs to relevant endpoints.
  • Explore and integrate emerging technologies like LightRAG, SurrealDB, Neo4j, and Puppygraph for structured search.

2. Platform Observability & Performance

  • Implement Splunk OpenTelemetry (OTel) integration for monitoring and metrics.
  • Evaluate and integrate Arize AI for observability and model evaluation frameworks.
  • Optimize logging decorators, memory profiling for unit tests, and enhance APM (Application Performance Monitoring) solutions.
  • Drive scaling and performance optimization for the JedAI platform.

3. Platform Integration & Testing

  • Implement platform integration and availability testing frameworks.
  • Centralize Postman test cases for integration testing.
  • Clean up outdated tests and modernize Docker Compose setups for KB API development.
  • Develop harness configurations for automated testing pipelines.

4. Architecture & Research Spikes

  • Support JedAI architecture consulting efforts.
  • Conduct spike investigations on new technologies and frameworks for performance and scalability.
  • Explore MCP design options for multi-agent orchestration and AI-enhanced workflows.

Required Skills & Experience:

  • Programming: Python (must-have), (good to have)
  • AI/ML Integration: Hands-on experience with LLM APIs (OpenAI, Vertex AI, etc.)
  • Observability & Logging: Experience with Splunk, OpenTelemetry (OTel), Arize AI
  • Testing & CI/CD: Proficiency with Postman, Pytest, Docker Compose
  • Data & Search: Exposure to structured search techniques (Neo4j, LightRAG, Graph DBs)
  • Performance Tuning: Familiarity with memory profiling, performance optimization, and scaling techniques
  • Cloud Platforms: GCP (Vertex AI), Azure, or AWS experience preferred
  • Collaboration Tools: GitHub, Jira, Confluence

Preferred Qualifications:

  • Bachelor's or Master's in Computer Science, AI/ML, or related fields
  • 36 years of experience in AI/ML engineering or platform development
  • Prior experience in AI observability or model evaluation pipelines
  • Knowledge of Agentic AI frameworks and multi-step reasoning systems

  • AI Engineer-LLM Integration/Platform Observability

    1 week ago

    Hyderabad, Telangana, India Kiash Solutions LLP Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Exp -- 4+ YearsShift--2.00 PM to 11:30 PM ISTMandatory--Python with LLM OpsJob Description--We are looking for ahands-on AI Engineerwith strong expertise inLLM integration, platform observability, performance optimization, and API development. The ideal candidate will work on critical platform enhancements, includingLLM API integrations, observability...

  • AI Engineer LLM Fine-Tuning

    6 days ago

    Hyderabad, Telangana, India Zysec Ai Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the job AI Engineer LLM Fine-Tuning & Reasoning Systems We're building the future of Autonomous Data Intelligence at CyberPod AIand were looking for a deeply technical, hands-on AI Engineer to push the boundaries of whats possible with Large Language Models (LLMs). This role is for someone whos already been in the trenches: fine-tuned foundation...

  • GEN AI Engineer-LLM

    3 hours ago

    Hyderabad, Telangana, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Sr. LLM Engineer: Gen AI Location-Work from Office - Hyderabad/Gurgaon - 3 days hybrid YoE-5 - 9 Years Start Date: Immediate/Full time Must Have Skills: Machine Learning models & systems Generative AI (LLM) / LLM prompt engineering Building LLM RAG Experience in using langchain or similar tool Turing is looking for people with LLM experience to join us in...

  • GEN AI Engineer-LLM

    3 days ago

    Hyderabad, Telangana, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Sr. LLM Engineer: Gen AI Location-Work from Office - Hyderabad/Gurgaon - 3 days hybrid YoE-5 - 9 Years Start Date: Immediate/Full time Must Have Skills: Machine Learning models & systems Generative AI (LLM) / LLM prompt engineering Building LLM RAG Experience in using langchain or similar tool Turing is looking for people with LLM...

  • LLM Engineer

    7 days ago

    Hyderabad, Telangana, India Ampstek Full time

    Job Role : Sr. LLM Engineer : Gen AILocation : the Role :LLM Engineer : Gen AI. Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers. You will be a key member of the Turing GenAI delivery organization and part of a GenAI project. You will be required to work with a team of other Turing...

  • AI LLM Engineer

    1 week ago

    Hyderabad, Telangana, India Huemn Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job OverviewWe are seeking a Senior AI LLM Engineer to join our team at Huemn in Hyderabad. This is a full-time position that requires expertise in large language models and natural language processing. The ideal candidate will have a strong background in advanced AI technologies, with a focus on retrieval-augmented generation. You will work closely with our...

  • Senior Gen AI Engineer

    1 week ago

    Hyderabad, Telangana, India Soothsayer Analytics Full time US$ 1,20,000 - US$ 2,00,000 per year

    We seek a Senior Gen AI Engineer with strong ML fundamentals and data engineering expertise to lead scalable AI/LLM solutions. This role focuses on integrating AI models into production, optimizing machine learning workflows, and creating scalable AI-driven systems. You will design, fine-tune, and deploy models (e.g., LLMs, RAG architectures) while ensuring...

  • Senior AI Engineer

    3 weeks ago

    Hyderabad, Telangana, India DeepForrest AI Full time

    Job Summary We are seeking a skilled AI Engineer with over 3 years of experience to join our team in Hyderabad. The candidate will play a key role in designing, developing, and optimising AI-driven solutions for our pharmaceutical products, leveraging expertise in Python, Generative AI, and prompt engineering. This role involves close collaboration with...

  • Senior AI Engineer

    3 weeks ago

    Hyderabad, Telangana, India DeepForrest AI Full time

    Job SummaryWe are seeking a skilled AI Engineer with over 3 years of experience to join our team in Hyderabad. The candidate will play a key role in designing, developing, and optimising AI-driven solutions for our pharmaceutical products, leveraging expertise in Python, Generative AI, and prompt engineering. This role involves close collaboration with our...

  • Lead AI Engineer

    2 weeks ago

    Hyderabad, Telangana, India Weekday AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    This role is for Weekday's client.Role OverviewAs the Lead AI Engineer, you will be responsible for spearheading the design, development, and deployment of AI solutions. You will work with various large language models (LLMs)—both open-source and proprietary—optimizing them through fine-tuning, prompt engineering, agentic frameworks, and...