LLM Engineer

2 months ago


Bengaluru, India Mazenet solution Full time

LLM Engineer

We are seeking a highly skilled LLM Engineer with a minimum of 5 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Azure, GCP), and DevOps tools. They will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.


Responsibilities:

  • Take ownership of architecture design and development of scalable and distributed software systems.
  • Translate business to technical requirements
  • Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation
  • Data driven decision making skills with focus on achieving product goals
  • Design, develop and deploy LLM based pipelines involving patterns like RAG, Agentic workflows, PEFT (e.g. LORA, QLORA, etc.)
  • Responsible for the complete software development lifecycle, including requirements analysis, design, coding, testing, and deployment.
  • Utilize AWS services/ Azure services like IAM, Monitoring, Load Balancing, Autoscaling, Database, Networking, storage, ECR, AKS, ACR etc.
  • Implement DevOps practices using tools like Docker, Kubernetes to ensure continuous integration and delivery. Develop DevOps scripts for automation and monitoring.
  • Collaborate with cross-functional teams, conduct code reviews, and provide guidance on software design and best practices.


Qualifications (essentials in bold):

  • Bachelors degree in computer science, Information Technology, or a related field (or equivalent work experience).
  • At least 5 years of experience in software development, with relevant work experience in LLM app development.
  • Strong coding skills with proficiency in Python and Javascript
  • Experience with API frameworks both stateless and stateful such as Fast API, Django
  • Well versed in implementation of web sockets, gRPC, access management using JWT (Azure AD, IDM preferred)
  • Proficient in cloud platforms, specifically AWS, Azure, or GCP
  • Knowledge and hands-on experience with front-end development (React JS, Next JS, Tailwind CSS) preferred
  • Strong experience in LLM patterns like RAG, Vector DB, Hybrid Search, Agent development, Agentic workflows, prompt engineering, etc.
  • Strong experience with LLM APIs (Open AI, Anthropic, AWS Bedrock), SDKs (Langchain, DSPy)
  • Hands-on experience with DevOps tools including Docker, Kubernetes, and AWS services (Redshift, RDS, S3).
  • Experience in production deployments involving thousands of users
  • Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations.
  • Good knowledge of software engineering practices like version control (GIT), DevOps (Azure DevOps preferred) and Agile or Scrum.
  • Strong communication skills, with the ability to effectively convey complex technical concepts to a diverse audience.
  • Experience of SDLC and best practices while development
  • Experience with Agile methodology for continuous product development and delivery


Fluency in English is required, additional fluency in at least one European or Asian language is desirable.





  • LLM Engineer

    7 days ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    4 days ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.- Translate business to technical requirements- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation- Data driven decision making skills with focus on achieving product goals- Design, develop and deploy LLM...


  • Bengaluru, India gnani.ai Full time

    We are seeking a Senior Natural Language Processing (NLP) Engineer with a robust background in developing multilingual voice bots and chatbots. The ideal candidate will possess knowledge of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Expertise in fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...

  • LLM Engineer

    2 weeks ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM based...

  • LLM Engineer

    2 weeks ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    2 weeks ago


    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • Llm scientist

    4 days ago


    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...


  • Bengaluru, Karnataka, India Orison Solutions Full time

    Job Title: LLM Hardware Design DeveloperJob Summary:We are seeking an exceptional hardware design developer to play a pivotal role in using the hardware design platform to generate training data for enterprise LLMs. This unique position offers the chance to directly contribute to the sophistication of enterprise LLMs, ensuring they operate with unparalleled...


  • Bengaluru, Karnataka, India Orison Solutions Full time

    Job DescriptionOrison Solutions is seeking an exceptional hardware design developer to play a pivotal role in utilizing the hardware design platform to generate vital training data for enterprise LLMs. This unique position offers the chance to directly contribute to the sophistication of enterprise LLMs, ensuring they operate with unparalleled efficiency and...


  • Bengaluru, India gnani.ai Full time

    We are seeking a Associate NLP Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...

  • LLM Model Developer

    3 weeks ago


    Bengaluru, Karnataka, India Magna Hire Full time

    Job Title: LLM EngineerAbout the Role:Magna Hire is seeking an experienced LLM Engineer to join our team. As an LLM Engineer, you will be responsible for designing, developing, and implementing advanced LLM applications using state-of-the-art models and techniques.Key Responsibilities:Design and develop LLM applications using transformer-based models and...

  • LLM Scientist

    6 days ago


    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...

  • LLM Scientist

    6 days ago


    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...

  • LLM Scientist

    5 days ago


    Bengaluru, India Prana Tree Full time

    Job Overview Pranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative...

  • LLM Scientist

    5 days ago


    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...


  • Bengaluru, Karnataka, India Mazenet solution Full time

    Job Title: LLM EngineerMazenet solution is seeking a highly skilled LLM Engineer to join our team. As an LLM Engineer, you will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.Key Responsibilities:Design and develop scalable software solutions...


  • Bengaluru, India gnani.ai Full time

    We are seeking a Associate NLP Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...


  • Bengaluru, Karnataka, India THOUGHTSPOT INDIA PRIVATE LIMITED Full time

    ThoughtSpot Senior ML and LLM EngineerAt ThoughtSpot India Private Limited, we are seeking a talented Senior ML and LLM Engineer to join our team in Bengaluru. This role will play a key part in developing and implementing innovative machine learning and large language model solutions to enhance user experiences and improve search accuracy, relevance, and...

  • LLM Developer

    3 months ago


    Bengaluru, India Edge In Asia Recruitment Private Limited Full time

    Bangalore: RemoteHyderabad: Hybrid (2 days in the office)Role Overview:Join our innovative IT services firm, where you'll contribute to cutting-edge AI and machine learning projects. We're looking for experienced LLM Developers to develop, fine-tune, and integrate large language models (LLMs) within our cloud-based AI platforms.Some of the key...


  • Bengaluru, India gnani.ai Full time

    We are seeking a Associate NLP Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...