Python Systems Engineer – LLM Evaluation

5 days ago

India Supercoder Full time

Greetings and thank you for visiting our job post. Supercoder is an AI-powered career development platform connecting developers worldwide to remote job opportunities with competitive payment. - Type of work: 100% Remote Overview: The client is hiring Python/Linux Engineers to design complex system-level evaluation tasks for LLMs. Design advanced benchmark tasks that evaluate the capabilities of modern Large Language Models (LLMs) such as ChatGPT, Claude, and other AI systems. This role focuses on building realistic, technically challenging engineering scenarios that test model reasoning, debugging, and problem-solving abilities. What You Will Do - Design complex, realistic engineering tasks to evaluate LLM reasoning, coding, debugging, and system understanding. - Build Python- and Linux-based workflows, pipelines, and multi-step scenarios. - Create reproducible environments using Python, Shell, and CLI tools. - Develop tasks that measure code comprehension, debugging, refactoring, and optimization. - Write clear technical documentation: problem statements, constraints, expected outputs, and detailed edge cases. - Use LLM tools (ChatGPT, Claude, etc.) to validate tasks and analyze model performance. Must-Have Qualifications - 5+ years of professional software development experience. - Strong Python: modular code design, debugging complex programs, structured codebases. - Proficiency with Linux, Shell scripting, Bash, and command-line tools. - Solid technical English writing ability. - Strong reasoning, analytical thinking, and problem-solving skills. - Ability to design logical multi-step engineering scenarios. Nice-to-Have Skills - Experience creating benchmark datasets, online judge problems, coding tests, or technical challenges. - Background with ICPC, Codeforces, Kaggle, or competitive programming. - Familiarity with Docker, Git, and CI/CD pipelines. - Experience with ML/AI or data-intensive engineering environments. Who Will Excel in This Role - Engineers who enjoy designing difficult problems rather than simple feature development. - Developers who are strong at debugging, identifying subtle issues, and understanding complex system interactions. - Engineers who work well independently and can define their own approach. - Individuals interested in LLM evaluation, AI reliability, and technical task design.

  • Python Systems Engineer – LLM Evaluation

    6 days ago

    India Supercoder Full time

    Greetings and thank you for visiting our job post.Supercoder is an AI-powered career development platform connecting developers worldwide to remote job opportunities with competitive payment.Type of work: 100% RemoteOverview:The client is hiring Python/Linux Engineers to design complex system-level evaluation tasks for LLMs. Design advanced benchmark tasks...

  • Python Systems Engineer – LLM Evaluation

    3 days ago

    India Supercoder Full time

    Greetings and thank you for visiting our job post. Supercoder is an AI-powered career development platform connecting developers worldwide to remote job opportunities with competitive payment. Type of work: 100% Remote Overview: The client is hiring Python/Linux Engineers to design complex system-level evaluation tasks for LLMs. Design advanced benchmark...

  • LLM Engineer

    2 weeks ago

    India Insight Global Full time

    Position : GenAI LLM Engineer Location : Remote in India Working hours: 11am-7pm IST Pay range: $18-$20 USD per hour JOB DESCRIPTION Insight Global is sourcing for an AI/LLM Engineer to sit remotely in India, joining a global consulting firm. This position will support various Digital Products Teams in the AI Center of Excellence, to support building key...

  • LLM Engineer

    2 weeks ago

    India Insight Global Full time

    Position: GenAI LLM EngineerLocation: Remote in IndiaWorking hours: 11am-7pm ISTPay range: $18-$20 USD per hourJOB DESCRIPTIONInsight Global is sourcing for an AI/LLM Engineer to sit remotely in India, joining a global consulting firm. This position will support various Digital Products Teams in the AI Center of Excellence, to support building key...

  • Principal LLM

    2 weeks ago

    India Oracle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionWe are looking for a senior engineer who specializes in LLM systems, prompt engineering, and agentic application deployment, combined with strong MLOps and cloud platform engineering experience.You will design, deploy, and scale Generative AI models, retrieval-augmented generation (RAG) pipelines, and autonomous agent frameworks on OCI.In this...

  • Senior Python with LLM Developer

    1 week ago

    India MillionLogics Full time

    Company Description As a trusted Oracle Partner, MillionLogics stands as a global powerhouse in IT solutions, merging innovation, expertise, and strategic vision. With offices in London, UK, and a development hub in Hyderabad, India, MillionLogics bridges sharp business foresight with world-class technical talent. Our mission is to transform enterprises...

  • Senior Python with LLM Developer

    1 week ago

    India MillionLogics Full time

    Company Description As a trusted Oracle Partner, MillionLogics stands as a global powerhouse in IT solutions, merging innovation, expertise, and strategic vision. With offices in London, UK, and a development hub in Hyderabad, India, MillionLogics bridges sharp business foresight with world-class technical talent. Our mission is to transform enterprises...

  • Senior Python with LLM Developer

    1 week ago

    India MillionLogics Full time

    Company Description As a trusted Oracle Partner, MillionLogics stands as a global powerhouse in IT solutions, merging innovation, expertise, and strategic vision. With offices in London, UK, and a development hub in Hyderabad, India, MillionLogics bridges sharp business foresight with world-class technical talent. Our mission is to transform enterprises...

  • Apply Now! Principal LLM

    2 weeks ago

    India Oracle Full time

    Job Description We are looking for a senior engineer who specializes in LLM systems, prompt engineering, and agentic application deployment, combined with strong MLOps and cloud platform engineering experience. You will design, deploy, and scale Generative AI models, retrieval-augmented generation (RAG) pipelines, and autonomous agent frameworks on OCI. In...

  • Senior LLM Engineers

    2 weeks ago

    India MillionLogics Full time

    Company DescriptionMillionLogics, a trusted Oracle Partner, is an IT solutions provider with a global presence, blending innovation and strategic vision. With offices in London, UK, and a development hub in Hyderabad, India, we offer a diverse range of services, including Data & AI, Cloud Solutions, and IT Consulting. Our mission is to transform enterprises...