AI Platform Engineer

21 hours ago

Puducherry, Puducherry, India Guardian management services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

Job Specification: AI Platform Engineer

About the Role

We are seeking an AI Platform Engineer to build and scale the infrastructure that powers

our production AI services. You will take cutting-edge models—ranging from speech

recognition (ASR) to large language models (LLMs)—and deploy them into highly

available, developer-friendly APIs.

You will be responsible for creating the bridge between the R&D team, who train models,

and the applications that consume them. This means developing robust APIs, deploying

and optimizing models on Triton Inference Server (or similar frameworks), and ensuring

real-time, scalable inference.

Responsibilities

● API Development

○ Design, build, and maintain production-ready APIs for speech, language, and

other AI models.

○ Provide SDKs and documentation to enable easy developer adoption.

● Model Deployment

○ Deploy models (ASR, LLM, and others) using Triton Inference Server or

similar systems.

○ Optimize inference pipelines for low-latency, high-throughput workloads.

● Scalability & Reliability

○ Architect infrastructure for handling large-scale, concurrent inference

requests.

○ Implement monitoring, logging, and auto-scaling for deployed services.

● Collaboration

○ Work with research teams to productionize new models.

○ Partner with application teams to deliver AI functionality seamlessly through

APIs.

● DevOps & Infrastructure

○ Automate CI/CD pipelines for models and APIs.

○ Manage GPU-based infrastructure in cloud or hybrid environments.

Requirements

● Core Skills

○ Strong programming experience in Python (FastAPI, Flask) and/or

for API services.

○ Hands-on experience with model deployment using Triton Inference Server,

TorchServe, or similar.

○ Familiarity with both ASR frameworks and LLM frameworks (Hugging

Face Transformers, TensorRT-LLM, vLLM, etc.).

● Infrastructure

○ Experience with Docker, Kubernetes, and managing GPU-accelerated

workloads.

○ Deep knowledge of real-time inference systems (REST, gRPC, WebSockets,

streaming).

○ Cloud experience (AWS, GCP, Azure).

● Bonus

○ Experience with model optimization (quantization, distillation, TensorRT,

ONNX).

○ Exposure to MLOps tools for deployment and monitoring

Job Types: Full-time, Permanent

Pay: From ₹50,000.00 per month

Experience:

  • total work: 3 years (Preferred)

Work Location: In person

  • Full Stack Data Scientist

    17 hours ago

    Puducherry, Puducherry, India Decision Minds Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Data Engineering FoundationsDesign & Development: Design and implement scalable data architectures and datasets that support the organization's evolving data needs, providing the technical foundations for our analytics team and business users.Data Engineering: Support and implement large datasets in batch/real-time analytical solutions leveraging data...

  • Software Developer and Trainer

    15 hours ago

    Puducherry, Puducherry, India Technovahub Full time ₹ 150 - ₹ 185 per year

    We are looking for a dynamic professional who can develop software solutions while also taking the lead in training and mentoring learners in the areas of software development, AI, and related technologies.Key ResponsibilitiesDesign, develop, and deploy software applications as part of Technovahub's projects.Deliver training sessions on programming, software...

  • Digital Content Manager

    1 week ago

    Puducherry, Puducherry, India Sadhisha Homes Full time ₹ 3,60,000 - ₹ 7,20,000 per year

    Digital Content Manager at Sadhisha AI SolutionsCompany OverviewSadhisha AI Solutions is an online marketplace dedicated to connecting property owners with travelers seeking unique accommodations. We use cutting-edge technology to provide an easy-to-use platform that features high-quality listings and exceptional user experiences. We are a fast-growing,...

  • Senior Quality Assurance Automation Engineer

    2 weeks ago

    Puducherry, Puducherry, India Techy Geeks Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Title :QA Automation Engineer Python, Shell Scripting & API Testing.Experience :4 to 8 years.Location :Chennai.Mode :5 days WFO.Job SummaryWe are looking for a passionate and detail-oriented API Test Engineer with strong expertise in Python, Shell scripting, and API testing using open-source tools.The ideal candidate will have hands-on experience with...

  • Senior Quality Assurance Automation Engineer

    2 weeks ago

    Puducherry, Puducherry, India TECHY GEEKS Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Title : QA Automation Engineer Python, Shell Scripting & API Testing.Experience : 4 to 8 years.Location : Chennai.Mode : 5 days WFO.Job Summary : We are looking for a passionate and detail-oriented API Test Engineer with strong expertise in Python, Shell scripting, and API testing using open-source tools. The ideal candidate will have hands-on...

  • Engineer - Technical Support

    15 hours ago

    Puducherry, Puducherry, India Charles Technologies Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Charles Technologies is a dynamic startup based in Chennai, focused on building innovative mobile and web applications that elevate user experiences. We are seeking a skilled and passionateTechnical Support Engineerto join our growing team in Puducherry to ensure the quality and reliability of our cutting-edge digital products.Key Responsibilities:6 Months...

  • DevOps Engineer

    4 days ago

    Puducherry, Puducherry, India xpertconexions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description : - Maintaining the driver and handling bug fixes in the driver - Part take in develop and ownership of the Automation process for benchmarking. - Work on onboarding of new capabilities in benchmarking - Collaborate with other teams on Benchmarking capability additions. - Run the CI/CD pipeline - Expertise in cloud platforms...

  • General Manager

    3 days ago

    Puducherry, Puducherry, India The Balified Villa Full time

    Role & responsibilities1. OTA (Online Travel Agency) ManagementManage villa listings and performance across , Airbnb, and Maps.Update pricing, availability, and monitor guest reviews and ratings.Ensure property visibility and online reputation management.2. Stayflexi Software OperationsOversee villa operations using the Stayflexi platform.Attend Stayflexi...

  • Marketing Director

    2 weeks ago

    Puducherry, Puducherry, India Boostmyshop International Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About BoostmyshopBoostmyshop is a leading provider of tailored SaaS solutions designed to perfect pricing and monitor competitors, empowering e-commerce businesses to optimize their performance and drive growth. As we enter our next phase of expansion, we are looking for a key leader to scale our marketing efforts from our hub in Pondicherry.The...

  • Vice President of Sales

    2 weeks ago

    Puducherry, Puducherry, India Bevolve Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    See yourself at Bevolve.Join the team as ourVP, SalesAbout BevolveOur purpose is to enable organizations towards conscious micro-transformations using research & AI (technology) to create measurable impact. We do that by building an Impact Creation platform that aims to democratize impact measurement, impact communication, and impact creation. Our  team is...