LLM Backend Engineer

1 day ago

India Sparsa AI Full time

Sparsa AI is a Singapore and Germany based Industrial-AI Startup, building the next generation of agentic AI platform to transform how physical industries—such as manufacturing and logistics—make decisions and optimize their operations. Our AI agents orchestrate complex workflows across business functions and enterprise applications including ERP, MES, CRM and supply chain environments to resolve real-world constraints and unlock productivity.

We're hiring an LLM Backend Engineer to own the complete LLM application lifecycle - from prompt engineering and model management to evaluation frameworks and production monitoring - while developing and maintaining our core agentic SDK.

What you'll do:

  • Design and implement prompt engineering systems, evaluation frameworks, and LLM performance monitoring for production agent deployments
  • Develop and maintain our agentic SDK that powers multi-agent orchestration and tool-calling capabilities across enterprise systems
  • Build LLM operations infrastructure including model serving, version control, A/B testing, and performance optimization pipelines
  • Create comprehensive testing and evaluation suites to ensure agent reliability and measure model performance against business KPIs
  • Work closely with the innovation team to integrate new model capabilities and optimize agent behavior for customer use cases

What we're looking for:

  • 3–5 years of software engineering experience with strong Python proficiency, asynchronous programming (Async IO), and API development skills
  • Hands-on experience building, productionising and maintaining LLM applications including RAG systems, prompt engineering frameworks, evaluation pipelines and preferably, agentic systems.
  • Strong understanding of LLM software development patterns, multi-agent orchestration, and tool-calling frameworks
  • Experience with LLM operations - model serving, monitoring, version control, and performance optimization
  • Familiarity with evaluation methodologies, A/B testing, and metrics collection for ML systems in production
  • Bonus: experience with agentic frameworks (LangChain, Semantic Kernel, CrewAI, AutoGen), MLOps tools, enterprise system integrations

Benefits

  • A core engineering role in a fast-scaling Industrial-AI startup with operations in Singapore and Germany.
  • End-to-end ownership of LLM application development — from prompt engineering to production monitoring — with direct impact on real-world, mission-critical enterprise workflows.
  • Opportunities to work at the intersection of agentic AI, enterprise integrations, and large-scale production systems, shaping the capabilities of our next-generation Agentic SDK.
  • Collaboration with a deeply technical founding team and innovation specialists to integrate cutting-edge model capabilities and deploy them in high-value customer environments.

Join Us at Sparsa AI

If you are passionate about building transformative products at the intersection of AI and industrial operations, we invite you to shape the future with us. This is your opportunity to learn and execute in a fast-growing company that is redefining how the real economy works. At Sparsa AI, you'll work alongside an exceptional team, solve real-world problems, and leave a lasting impact on global industries.

Let's build the future of Industrial AI-Agents—together. If you have the chops, let's connect

  • Backend Ai Engineer

    4 weeks ago

    India Coderbotics AI Full time

    Company Description Coderbotics AI is a team of passionate tech enthusiasts dedicated to revolutionizing the way software evolves.We specialize in AI-powered code migration solutions—helping businesses seamlessly transition legacy systems, refactor codebases, and manage technical debt with speed and precision.Our advanced technology and expert team ensure...

  • Senior Backend Engineer

    3 weeks ago

    India Infinite Possibilities Full time

    About UsAt GenAI Labs IP India Pvt Ltd, we're reimagining how Private Equity and consulting teams work—by building intelligent AI-native workflows and agentic platforms tailored to the real-world needs of high-performance teams. Our mission is to accelerate value creation through cutting-edge AI, system design, and product craftsmanship. We're a...

  • Backend Engineer

    5 days ago

    India beBeeBackend Full time US$ 1,96,500 - US$ 2,91,500

    Job OverviewWe are seeking a skilled Backend Engineer to contribute to the development of our search product. The ideal candidate will have experience in designing, building, and deploying large-scale distributed backend systems with a focus on scalability, availability, and fault tolerance.As a key member of our team, you will work closely with applied ML...

  • Senior Backend Engineer

    3 weeks ago

    India Infinite Possibilities Full time

    About UsAt GenAI Labs IP India Pvt Ltd, we're reimagining how Private Equity and consulting teams work—by building intelligent AI-native workflows and agentic platforms tailored to the real-world needs of high-performance teams. Our mission is to accelerate value creation through cutting-edge AI, system design, and product craftsmanship. We're a...

  • Principal Python Backend Engineer 32425

    4 weeks ago

    India Stealth AI Startup Full time

    Compensation: Up to $300,000 USD annually + Equity Type: Full-time | Remote A cutting-edge AI company is seeking a Principal Python Backend Engineer to lead backend architecture for distributed AI systems.You'll design scalable infrastructure supporting real-time inference, model management, and AI application workflows.Responsibilities: Architect and scale...

  • Senior Backend Python Engineer 32426

    3 weeks ago

    India Stealth AI Startup Full time

    Compensation: Up to $300,000 USD annually + Equity Type: Full-time | Remote We're looking for a Senior Python Backend Engineer to help build infrastructure powering real-time AI workflows and ML pipelines.You'll work on high-availability systems and collaborate with a global team of engineers and researchers.Responsibilities: Build and optimize backend APIs...

  • Fullstack Product Engineer – AI, RAG, LLMs

    2 days ago

    India Umbrella Micro Enterprises Full time

    Fullstack Product Engineer – AI-Powered Products (Langchain/ RAG /LLM applications, Ruby, React)We're looking for a high-ownership Fullstack Product Engineer to join our team in building and shipping cutting-edge AI-powered products at serious speed. Must-Haves:- Product-driven mindset: You make tactical decisions fast and care deeply about product...

  • Software Engineer

    4 weeks ago

    India PiHex Labs Full time

    Job DescriptionJob TitleSoftware Engineer (LLM Applications & AI Tools)CompanyPiHex LabsWebsite | LinkedInRemote | Full-Time / InternshipAbout PiHex LabsPiHex Labs is a modern tech firm focused on AI, software engineering, and scalable backend systems. We work with global clients to create robust, high-performance platforms that are secure, efficient, and...

  • Backend Engineer

    4 weeks ago

    India Grow Your Staff Full time

    Grow Your Staff is looking for a Backend Engineer for a Computer Software firm in Germany. The position is a full-time remote opportunity.The role will have excellent growth opportunities. You will work directly with the team based in Germany.Experience required: 5 years+ CTC: 15-20 LPALocation: RemoteResponsibilities:Develop and maintain backend services...

  • Backend Engineer

    4 weeks ago

    India Zendr Business Full time

    Backend Developer (Node.js & Express.js) - Full-Time (Remote, India)Company: Zendr ltd, UK.Location: Remote (India-based candidates only)Experience Required: Minimum 3 years Salary: To be discussed About Zendr: Zendr is a UK-based startup on a mission to transform how businesses manage payments, invoicing, and operations.We're building the future of business...