LLM Integration Engineer

11 hours ago

Chennai, Tamil Nadu, India Umanist NA Full time

LLM Integration Engineer,34701

Location:
Chennai (Onsite)

Employment Type:
Full-Time

Compensation:
Up to 30 LPA

Role Overview

We are seeking a highly experienced LLM Integration Engineer with a strong background in
Full Stack Java development
and hands-on exposure to
AI/LLM-driven application integration
. This role focuses on building
scalable, production-grade enterprise systems
where AI capabilities are leveraged to enhance functionality, efficiency, and user experience—not on training AI models from scratch.

The ideal candidate is a seasoned engineer with deep expertise in software architecture, microservices, and cloud-native development, who embraces AI as an accelerator within modern enterprise solutions.

Key Responsibilities

  • Design, develop, test, and maintain enterprise-grade full-stack applications
  • Build and enhance microservices-based architectures using Spring Boot and REST APIs
  • Integrate LLM and GenAI capabilities into business applications
  • Collaborate with cross-functional teams to define technical solutions and system designs
  • Provide technical guidance and mentorship to junior engineers
  • Ensure best practices in code quality, scalability, performance, and security
  • Participate in Agile ceremonies and contribute to continuous improvement initiatives

Required Skills

  • Strong experience as a Full Stack Java Developer
  • Expertise in Java, Spring Boot, Microservices, and REST APIs
  • Frontend development experience with Angular
  • Hands-on experience with Cloud Architecture, preferably Google Cloud Platform (GCP)
  • Exposure to LLM and Generative AI integrations within applications
  • Solid understanding of software design patterns and enterprise architecture

Preferred / Nice-to-Have Skills
AI & Python Ecosystem

  • Python programming experience
  • Familiarity with AI/ML libraries: TensorFlow, PyTorch, Scikit-learn
  • Experience with Python-based agent frameworks: CrewAI, LangChain, AutoGen

Advanced AI Integrations

  • Google Agent Development Kit (ADK)
  • Model Context Protocol (MCP)
  • AI agent orchestration patterns
  • Understanding of open-source and proprietary LLMs, including reasoning models, token limits, and context windows

Data & Cloud Technologies

  • Data processing frameworks: Apache Spark, Kafka
  • RDBMS: Oracle, PostgreSQL, MySQL
  • NoSQL databases: MongoDB, Cassandra, Redis
  • Vector databases and RAG (Retrieval-Augmented Generation) systems
  • GCP services: BigQuery, Cloud Run, Cloud Functions, Vertex AI

Enterprise & DevOps

  • Enterprise SSO technologies: ADFS, Azure AD, SAML
  • Infrastructure as Code using Terraform
  • Familiarity with DevOps practices and CI/CD pipelines
  • Frontend frameworks: Angular or React
  • Strong understanding of Agile methodologies

Experience Requirements

  • 10+ years of overall IT experience
  • 8+ years of hands-on development experience
  • Practical experience in two or more programming languages, or advanced expertise in one
  • Proven ability to guide, mentor, and influence technical teams

Education

  • Bachelor's Degree in Engineering, Computer Science, or a related field

Additional Information

This role is ideal for a senior engineer who combines
strong traditional software engineering expertise
with a forward-looking mindset toward
AI-enabled applications
. The focus is on delivering robust, scalable systems where AI enhances business capabilities, productivity, and decision-making.

Skills: cloud architecture,angular,rest apis,spring boot,microservices,llm and generative ai integrations,java,gcp

  • LLM Integration Engineer

    9 hours ago

    Chennai, Tamil Nadu, India Umanist Staffing Full time

    LLM Integration Engineer,34701 Location: Chennai (Onsite)Employment Type: Full-TimeCompensation: Up to 30 LPARole OverviewWe are seeking a highly experienced LLM Integration Engineer with a strong background in Full Stack Java development and hands-on exposure to AI/LLM-driven application integration. This role focuses on building scalable, production-grade...

  • AI/LLM Developer

    2 days ago

    Chennai, Tamil Nadu, India Cloudious Full time

    AI model/LLM development, Python (with LLMs), Data processing using AI TechniquesExperience - 4 To 7 Year(s)Location : ChennaiBudget : Based on the current CTCNotice period : 0-30 daysSkill set   - AI model/LLM development, Python (with LLMs), Data processing using AI TechniquesJob Description:Develop, deploy, and refine AI models, including Large...

  • AI Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Krato Solutions Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Hiring GenAI EngineersJob Title: GenAI Engineer (1–3 Years)Location: Chennai (Onsite Only)Experience: 1–3 YearsEmployment Type: Full-timeJob Description:We are looking for a GenAI Engineer with strong skills in Python and SQL to join our onsite team in Chennai. The candidate should have hands-on experience working with LLMs, Generative AI frameworks, and...

  • Ai Ml Engineer

    4 days ago

    Chennai, Tamil Nadu, India iOPEX Full time

    We are seeking a highly skilled and innovative AI/Generative AI Engineer to join our dynamic team. This pivotal role involves designing, developing, and deploying cutting-edge Large Language Model (LLM)-based solutions, driving significant impact through advanced AI capabilities and strategic prompt engineering.Detailed Roles:This role will primarily focus...

  • AI/ML Engineer

    11 hours ago

    Chennai, Tamil Nadu, India iOPEX Technologies Full time

    Role : AI ML EngineerExperience : 5- 10 yrsLocation : ChennaiJob DescriptionWe are seeking a highly skilled and innovative AI/Generative AI Engineer to join our dynamic team. This pivotal role involves designing, developing, and deploying cutting-edge Large Language Model (LLM)-based solutions, driving significant impact through advanced AI capabilities and...

  • AI ML Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India TekValue IT Solutions Full time US$ 7,50,000 - US$ 15,00,000 per year

    Role Overview:We are seeking a highly skilled AI Engineer to design and implement intelligent systems using agentic AI capable of autonomous decision-making and task execution. This role involves integrating advanced machine learning models with reasoning, planning, and interaction capabilities to build scalable, intelligent applications. The ideal candidate...

  • AI Engineer

    2 days ago

    Chennai, Tamil Nadu, India Disprz Full time

    About The AI Engineer RoleDisprz is looking for an AI Engineer to design, build, and deploy scalable AI systems that power intelligent features across our product ecosystem. You will work closely with cross-functional teams to transform real business problems into production-ready AI solutions ranging from model development and optimization to integration...

  • Junior Gen Ai Engineer

    6 days ago

    Chennai, Tamil Nadu, India Prodapt Solutions Full time

    We are looking for talented Junior Engineers with 1 to 3 years of experience who are passionate about AI-driven applications and modern software development. The ideal candidate will have strong programming skills, basic knowledge of generative AI, and an eagerness to learn and implement innovative solutions using LLMs, APIs, and caching techniques.Key...

  • AI Engineer

    2 days ago

    Chennai, Tamil Nadu, India Mako IT Lab Full time

    About MAKOFounded in 2013, Mako IT Lab is a global software development company with a strong presence across the USA, UK, India, and Nepal. Over the years, we've partnered with companies globally helping them solve complex challenges and build meaningful digital experiences.What truly defines Mako is our culture. We believe in creating an environment where...

  • Integration Engineer

    2 days ago

    Chennai, Tamil Nadu, India Transact Campus Full time

    Who We Are: CBORD and Transact have come together as industry leaders in integrated technology solutions, powering housing, access, foodservice, nutrition, eCommerce, card systems, and innovative payment, mobile credential, and commerce solutions. Our technology supports K-12 and higher education, healthcare, senior living, and business campuses, creating...