Software Development Expert for LLM Evaluation

5 days ago

Bengaluru, Karnataka, India beBeeDevelopment Full time US$ 80,000 - US$ 1,00,000

About the Projects

We are building large-scale datasets to train AI models on realistic software engineering problems. Our goal is to improve the interaction between these models and real code.

Job Description

We are looking for experienced software engineers to contribute to this project. The role involves hands-on software development, including automation, issue triaging, and evaluating test coverage and quality.

Day-to-Day Work

  • Analyze and prioritize GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluate unit test coverage and assess the quality of existing codebases.
  • Run local experiments to assess AI performance in bug-fixing scenarios.
  • Collaborate with researchers to design and identify relevant repositories and issues.
  • Opportunities to lead a team of junior engineers.

Required Skills

  • Strong experience with one or more programming languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
  • Experience working with well-maintained, widely-used repositories (500+ stars).
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to navigate complex codebases.
  • Comfortable running and testing real-world projects locally.
  • Previous contribution to or evaluation of open-source projects is a plus.

Nice to Have

  • Participation in AI research or evaluation projects.
  • Experience building developer tools or automation agents.

About the Role

You will be part of a leading AI company accelerating the advancement and deployment of powerful AI systems. This role gives you the opportunity to influence the future of AI-assisted software development.

  • AI Engineer with LLM

    6 days ago

    Bengaluru, Karnataka, India Recex Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position OverviewWe are seeking a highly skilled and forward-thinkingAI Engineer specialized in Large Language Models (LLMs)to design, develop, and deploy innovative AI-powered applications and intelligentagents. The ideal candidate will possess deep expertise inLLM engineering, including advanced prompt engineering strategies,fine-tuning, evaluation...

  • LLM Engineer

    5 days ago

    Bengaluru, Karnataka, India Net Connect Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Notice Period: Immediate to 15 DaysRole Overview:We are seeking a skilled and innovative LLM Engineer to design, implement, and optimize advanced GenAI solutions across drug discovery, clinical development, and manufacturing. The ideal candidate will have hands-on experience with LLMs, deep learning, MLOps, and agentic frameworks, with a strong focus on...

  • Llm Optimization Expert

    2 weeks ago

    Bengaluru, Karnataka, India beBeeLLM Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    We are looking for an expert in Large Language Models (LLMs) to enhance our brand's presence, accuracy, and authority in AI-powered environments.Key ResponsibilitiesDevelop a comprehensive strategy for optimizing LLMs to align with business objectives.Analyze LLM query patterns, AI search trends, and knowledge ingestion sources to identify optimization...

  • LLM Specialist

    6 days ago

    Bengaluru, Karnataka, India Emperen Technologies Full time US$ 1,50,000 - US$ 2,00,000 per year

    Location: Remote Timings: Full Time (As per company timings) Notice Period: (Immediate Joiner - Only) Experience: 4 Years Key Responsibilities:Fine-tune and optimize Large Language Models (LLMs) for mid-to-large-scale live production-quality applications.Host and deploy LLMs on custom infrastructure, ensuring high availability and...

  • Expert Software Developer

    7 days ago

    Bengaluru, Karnataka, India beBeeDevelopment Full time ₹ 10,00,000 - ₹ 20,00,000

    Backend Software Development ExpertWe are seeking a highly skilled Backend Software Development Expert to lead our team in optimizing the product roadmap strategy, implementing solutions with speed and precision.Responsibilities:">Collaborate with stakeholders, project managers, QA teams, and fellow developers to ensure alignment with the long-term tech...

  • Expert AI and LLM Systems Developer

    1 week ago

    Bengaluru, Karnataka, India beBeeSystems Full time ₹ 25,00,000 - ₹ 40,00,000

    AI and Large Language Model Systems EngineerWe are seeking a highly skilled AI and large language model systems engineer to join our fast-moving team. As an expert in building and maintaining complex systems, you will play a crucial role in developing and deploying cutting-edge technology.Key Responsibilities:Design, develop, and maintain scalable backend...

  • LLM Engineer

    6 days ago

    Bengaluru, Karnataka, India Factspan Analytics Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job DescriptionAs an LLM (Large Language Model) Engineer, you will be responsible for designing, optimizing, and standardizing the architecture, codebase, and deployment pipelines of LLM-based systems. Your primary mission will focus on modernizing legacy machine learning codebases (including 40+ models) for a major retail clientenabling consistency,...

  • Expert Software Developer

    7 days ago

    Bengaluru, Karnataka, India beBeeSoftware Full time ₹ 1,04,000 - ₹ 1,30,878

    Software Development ExpertWe are seeking a highly skilled and experienced Software Development Expert to join our team. As a key member of our team, you will be responsible for designing, developing, and maintaining high-quality software solutions.In this role, you will work collaboratively with cross-functional teams to design and implement new features...

  • LLM, Python Developer

    1 day ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role: LLM, Python DeveloperExperience range: 6-8 yearsLocation: Hyderabad and BangaloreNOTE: 1-Notice period must be up to 45 days2- Candidate must have 6 years of relevant experience in PythonJob description:6+ years of professional experience in Python development.Strong understanding of LLMs, transformer architectures, and NLP techniques.Hands-on...

  • LLM Scientist

    1 day ago

    Bengaluru, Karnataka, India Prana Tree Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job description Pranatree LLC is seeking an experienced LLM Scientist to join our team, focusing on the development, fine-tuning, and deployment of cutting-edge Large Language Models (LLMs) and Generative AI solutions. This role requires a strong foundation in data science, AI, and software engineering, with a particular emphasis on building innovative...