
AI Engineer-LLM Integration/Platform Observability
5 days ago
Exp -- 4+ Years
Shift PM to 11:30 PM IST
Mandatory-- Python with LLM Ops
Job Description--
We are looking for a hands-on AI Engineer with strong expertise in LLM integration, platform observability, performance optimization, and API development. The ideal candidate will work on critical platform enhancements, including LLM API integrations, observability pipelines, structured search algorithms, and performance scaling for customer's AI platform and related components.
You will collaborate with cross-functional teams to develop robust, scalable solutions, modernize our logging and monitoring infrastructure, and integrate advanced AI capabilities into production workflows.
Key Responsibilities:
1. LLM Integration & API Development
- Develop and maintain LLM API integration test cases for core model availability.
- Refactor and reorganize LLM API code (e.g., ) for better maintainability.
- Add support for Vertex AI batch generation and batch transcription processing.
- Implement multi-step structured search algorithms and tie model IDs to relevant endpoints.
- Explore and integrate emerging technologies like LightRAG, SurrealDB, Neo4j, and Puppygraph for structured search.
2. Platform Observability & Performance
- Implement Splunk OpenTelemetry (OTel) integration for monitoring and metrics.
- Evaluate and integrate Arize AI for observability and model evaluation frameworks.
- Optimize logging decorators, memory profiling for unit tests, and enhance APM (Application Performance Monitoring) solutions.
- Drive scaling and performance optimization for the JedAI platform.
3. Platform Integration & Testing
- Implement platform integration and availability testing frameworks.
- Centralize Postman test cases for integration testing.
- Clean up outdated tests and modernize Docker Compose setups for KB API development.
- Develop harness configurations for automated testing pipelines.
4. Architecture & Research Spikes
- Support JedAI architecture consulting efforts.
- Conduct spike investigations on new technologies and frameworks for performance and scalability.
- Explore MCP design options for multi-agent orchestration and AI-enhanced workflows.
Required Skills & Experience:
- Programming: Python (must-have), (good to have)
- AI/ML Integration: Hands-on experience with LLM APIs (OpenAI, Vertex AI, etc.)
- Observability & Logging: Experience with Splunk, OpenTelemetry (OTel), Arize AI
- Testing & CI/CD: Proficiency with Postman, Pytest, Docker Compose
- Data & Search: Exposure to structured search techniques (Neo4j, LightRAG, Graph DBs)
- Performance Tuning: Familiarity with memory profiling, performance optimization, and scaling techniques
- Cloud Platforms: GCP (Vertex AI), Azure, or AWS experience preferred
- Collaboration Tools: GitHub, Jira, Confluence
Preferred Qualifications:
- Bachelor's or Master's in Computer Science, AI/ML, or related fields
- 36 years of experience in AI/ML engineering or platform development
- Prior experience in AI observability or model evaluation pipelines
- Knowledge of Agentic AI frameworks and multi-step reasoning systems
-
Hyderabad, Telangana, India Kiash Solutions LLP Full time ₹ 15,00,000 - ₹ 25,00,000 per yearExp -- 4+ YearsShift--2.00 PM to 11:30 PM ISTMandatory--Python with LLM OpsJob Description--We are looking for ahands-on AI Engineerwith strong expertise inLLM integration, platform observability, performance optimization, and API development. The ideal candidate will work on critical platform enhancements, includingLLM API integrations, observability...
-
GEN AI Engineer-LLM
3 weeks ago
Hyderabad, Telangana, India GEMRAJ TECHNOLOGIES LIMITED Full timeSr. LLM Engineer: Gen AI Location-Work from Office - Hyderabad/Gurgaon - 3 days hybrid YoE-5 - 9 Years Start Date: Immediate/Full time Must Have Skills: Machine Learning models & systems Generative AI (LLM) / LLM prompt engineering Building LLM RAG Experience in using langchain or similar tool Turing is looking for people with LLM experience to join us in...
-
Senior Gen AI Engineer
7 days ago
Hyderabad, Telangana, India Soothsayer Analytics Full time US$ 1,20,000 - US$ 2,00,000 per yearWe seek a Senior Gen AI Engineer with strong ML fundamentals and data engineering expertise to lead scalable AI/LLM solutions. This role focuses on integrating AI models into production, optimizing machine learning workflows, and creating scalable AI-driven systems. You will design, fine-tune, and deploy models (e.g., LLMs, RAG architectures) while ensuring...
-
AI LLM Engineer
7 days ago
Hyderabad, Telangana, India Huemn Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob OverviewWe are seeking a Senior AI LLM Engineer to join our team at Huemn in Hyderabad. This is a full-time position that requires expertise in large language models and natural language processing. The ideal candidate will have a strong background in advanced AI technologies, with a focus on retrieval-augmented generation. You will work closely with our...
-
Agentic AI Intern
7 days ago
Hyderabad, Telangana, India Centella AI Therapeutics Full time ₹ 9,00,000 - ₹ 12,00,000 per yearCentella AI is an AI-first organization addressing the critical challenges of drug discovery such as cost and time. Our AI platform, CASCADE utilizes Large Language Models (LLMs) to design drug-like molecules with improved safety and efficacy while significantly reducing costs. We are looking for passionate Agentic AI intern interested to work at the...
-
LLM Engineer
4 weeks ago
Hyderabad, Telangana, India Ampstek Full timeJob Role : Sr. LLM Engineer : Gen AILocation : the Role :LLM Engineer : Gen AI. Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers. You will be a key member of the Turing GenAI delivery organization and part of a GenAI project. You will be required to work with a team of other Turing...
-
Lead AI Engineer
2 weeks ago
Hyderabad, Telangana, India Weekday AI Full time ₹ 5,00,000 - ₹ 8,00,000 per yearThis role is for Weekday's client.Role OverviewAs the Lead AI Engineer, you will be responsible for spearheading the design, development, and deployment of AI solutions. You will work with various large language models (LLMs)—both open-source and proprietary—optimizing them through fine-tuning, prompt engineering, agentic frameworks, and...
-
Senior AI Engineer
2 weeks ago
Hyderabad, Telangana, India Backbase Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAt Backbase, we're redefining how banks deliver customer experiences by embedding intelligence into every digital interaction. Our Engagement Banking Platform puts the customer first — and behind the scenes, our AI team powers the intelligence that makes it personal, predictive, and responsive.As a Senior AI Engineer – Consultant, you'll be part of our...
-
llm
2 weeks ago
Hyderabad, Telangana, India procallisto solutions pvt Full time ₹ 15,60,000 - ₹ 18,00,000 per yearob Title: Senior AI/ML Engineer – LLMsExperience: 6+ yearsLocation: [ Bangalore / HyderabadWork Mode: OnsiteRole Overview:We are seeking a highly skilled Senior AI/ML Engineer with expertise in Large Language Models (LLMs), Artificial Intelligence, and Machine Learning. The candidate will design, develop, and optimize AI-driven solutions, with a strong...
-
AI Engineer
7 days ago
Hyderabad, Telangana, India Deccan AI Full time ₹ 15,00,000 - ₹ 20,00,000 per yearLocation:Hyderabad (On-site/Hybrid)Company:Deccan AIEmployment Type:Full-TimeExperience:1–3 YearsAbout Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and work...