LLM Engineer

3 months ago

Bengaluru, India PrepAiro Full time

As an AI Pipelines Engineer specializing in advanced Retrieval-Augmented Generation (RAG) frameworks, you will have the exciting opportunity to work with cutting-edge technology and contribute to the development of sophisticated AI-powered features. Your role will be pivotal in driving innovation and enhancing our AI capabilities through advanced methodologies and frameworks.


Key Responsibilities


1 Develop, Optimize, and Fine-Tune AI Pipelines

  • Utilize advanced RAG frameworks, incorporating:
  • Knowledge graph integration for enhanced context understanding.
  • Hybrid retrieval methods combining dense and sparse representations.
  • Adaptive retrieval strategies based on query complexity.


2. Implement and Experiment with State-of-the-Art RAG Architectures

  • Integrate Hierarchical Navigable Small World (HNSW) indexes for efficient similarity search.
  • Apply cross-encoder reranking for improved relevance.
  • Explore query expansion techniques using large language models.


3. Enhance RAG Systems with Advanced Capabilities

  • Implement few-shot in-context learning.
  • Optimize prompts through engineering and refinement techniques.
  • Incorporate self-reflection and reasoning capabilities into pipelines.


4. Collaborate to Optimize Pipeline Efficiency and Performance

  • Implement distributed retrieval and processing for large-scale datasets.
  • Explore quantization and pruning techniques for model compression.
  • Develop caching strategies for frequently accessed information.


5. Assist in Debugging and Troubleshooting Pipeline Issues:

  • Develop robust evaluation metrics for RAG performance.
  • Implement logging and monitoring systems to ensure pipeline transparency and reliability.


6. Preprocess and Analyze Large Datasets:

  • Utilize advanced text processing techniques (e.g., named entity recognition, coreference resolution).
  • Develop strategies for handling out-of-distribution queries and content.


Impact and Opportunities

As part of the AI team, your work will directly contribute to the development of an AI content generation system for our gamified learning app. You’ll play a crucial role in creating adaptive, personalized learning experiences by leveraging RAG frameworks to generate high-quality, contextually relevant content that enhances user engagement and learning outcomes. Your innovations will help shape how educational content is delivered, making learning interactive and fun for users.


Required Skills

Technical Skills

  • Strong programming skills in Python with familiarity with relevant AI/ML libraries.
  • Proficiency in data processing, analysis, and debugging within AI pipeline contexts.


RAG Frameworks Expertise

  • Proficiency in working with RAG frameworks such as LangChain, LlamaIndex, HayStack, and RAGatouille.
  • Experience in implementing and fine-tuning RAG pipelines for content generation.


Open Source Models

  • Familiarity with open-source language models and their integration into RAG systems.
  • Experience using models like GPT-3, GPT-4, BERT, or other transformers-based models in RAG workflows.


Retrieval Operations (RAGOps)

  • Knowledge of RAGOps frameworks and practices for efficient retrieval-augmented generation.
  • Experience with vector databases and embedding techniques for dense and sparse retrieval (e.g., Faiss, Pinecone, Weaviate).


Research and Innovation

  • Ability to research and experiment with emerging technologies in RAG, including knowledge graphs and hybrid retrieval methods.
  • Enthusiasm for staying updated on the latest advancements in the field and applying them to practical challenges.


Preferred Qualifications

  • Experience with graph databases and knowledge graph construction.
  • Familiarity with semantic search and dense retrieval methods.
  • Understanding of prompt engineering and few-shot learning concepts.
  • Experience with distributed computing frameworks (e.g., Ray, Dask).
  • Familiarity with MLOps practices and tools.


Join Our Team at PrepAiro


At PrepAiro , we are revolutionizing the learning experience through our gamified learning app, which leverages cutting-edge AI technologies to deliver personalized and engaging educational content. As part of our AI team, you’ll have the opportunity to work on advanced RAG frameworks and contribute to the development of our AI-driven content generation system.


Our mission is to make learning interactive, adaptive, and accessible for everyone. By joining PrepAiro, you will be at the forefront of transforming education through technology, directly impacting how learners engage with content and achieve their academic goals. We foster a collaborative and innovative environment where your ideas and expertise will help shape the future of learning.

  • LLM Engineer

    2 months ago

    Bengaluru, India Mazenet solution Full time

    LLM EngineerWe are seeking a highly skilled LLM Engineer with a minimum of 5 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Azure, GCP), and DevOps...

  • LLM Engineer

    4 weeks ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    3 weeks ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.- Translate business to technical requirements- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation- Data driven decision making skills with focus on achieving product goals- Design, develop and deploy LLM...

  • LLM application engineer

    4 weeks ago

    Bengaluru, India gnani.ai Full time

    We are seeking a Senior Natural Language Processing (NLP) Engineer with a robust background in developing multilingual voice bots and chatbots. The ideal candidate will possess knowledge of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Expertise in fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...

  • LLM Engineer

    1 month ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    1 month ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems.Translate business to technical requirementsOwn technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocationData driven decision making skills with focus on achieving product goalsDesign, develop and deploy LLM based...

  • LLM Engineer

    1 month ago

    Bengaluru, India ITC Infotech Full time

    Take ownership of architecture design and development of scalable and distributed software systems. Translate business to technical requirements Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation Data driven decision making skills with focus on achieving product goals Design, develop and deploy LLM based...

  • GenAI and LLM Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Divas Consulting Full time

    Job Title: GenAI and LLM Engineer (PyTorch)Job Summary:We are seeking a highly skilled GenAI and LLM Engineer with expertise in PyTorch to join our AI research and development team. This role is ideal for someone passionate about advancing the capabilities of Generative AI, building and fine-tuning large language models (LLMs), and implementing solutions...

  • Llm scientist

    3 weeks ago

    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...

  • Associate NLP engineer

    4 weeks ago

    Bengaluru, India gnani.ai Full time

    We are seeking a Associate NLP Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...

  • LLM Scientist

    3 weeks ago

    Bengaluru, India Prana Tree Full time

    Job Overview Pranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative...

  • LLM Scientist

    4 weeks ago

    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...

  • LLM Scientist

    4 weeks ago

    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...

  • LLM Scientist

    3 weeks ago

    Bengaluru, India Prana Tree Full time

    Job OverviewPranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative solutions...

  • Associate NLP engineer

    3 weeks ago

    Bengaluru, India gnani.ai Full time

    We are seeking a Associate NLP Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...

  • PureCode AI

    2 weeks ago

    Bengaluru, India PURECODE SOFTWARE R&D INDIA PRIVATE LIMITED Full time

    LLM & Prompt Engineer About PureCode AI :PureCode is a front-end developer tool where engineers can use text to describe and generate or customize software user interfaces - (and soon entire projects). Our goal is tobuild a must use developer tool for front-end engineers to build web software 100x faster! We are headquartered in Austin, TX, USA with...

  • ML Engineer

    4 days ago

    Bengaluru, India Awign Expert Full time

    Job DescriptionAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing...

  • ThoughtSpot Senior ML and LLM Engineer

    4 weeks ago

    Bengaluru, Karnataka, India THOUGHTSPOT INDIA PRIVATE LIMITED Full time

    ThoughtSpot Senior ML and LLM EngineerAt ThoughtSpot India Private Limited, we are seeking a talented Senior ML and LLM Engineer to join our team in Bengaluru. This role will play a key part in developing and implementing innovative machine learning and large language model solutions to enhance user experiences and improve search accuracy, relevance, and...

  • Associate NLP engineer

    1 month ago

    Bengaluru, India gnani.ai Full time

    We are seeking a Associate NLP Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...

  • Associate NLP engineer

    1 month ago

    Bengaluru, India gnani.ai Full time

    We are seeking a Associate NLP Engineer with a foundational background in developing multilingual voice bots and chatbots. The ideal candidate will have a basic understanding of pretraining and continual pretraining of large language models (LLMs) for multiple languages. Familiarity with fine-tuning LLMs using Parameter Efficient Fine-Tuning (PEFT)...