Python Systems Engineer – LLM Evaluation

11 hours ago


Kozhikode, India Supercoder Full time

Greetings and thank you for visiting our job post.Supercoder is an AI-powered career development platform connecting developers worldwide to remote job opportunities with competitive payment.Type of work: 100% RemoteOverview:The client is hiring Python/Linux Engineers to design complex system-level evaluation tasks for LLMs. Design advanced benchmark tasks that evaluate the capabilities of modern Large Language Models (LLMs) such as ChatGPT, Claude, and other AI systems.This role focuses on building realistic, technically challenging engineering scenarios that test model reasoning, debugging, and problem-solving abilities.What You Will DoDesign complex, realistic engineering tasks to evaluate LLM reasoning, coding, debugging, and system understanding.Build Python- and Linux-based workflows, pipelines, and multi-step scenarios.Create reproducible environments using Python, Shell, and CLI tools.Develop tasks that measure code comprehension, debugging, refactoring, and optimization.Write clear technical documentation: problem statements, constraints, expected outputs, and detailed edge cases.Use LLM tools (ChatGPT, Claude, etc.) to validate tasks and analyze model performance.Must-Have Qualifications5+ years of professional software development experience.Strong Python: modular code design, debugging complex programs, structured codebases.Proficiency with Linux, Shell scripting, Bash, and command-line tools.Solid technical English writing ability.Strong reasoning, analytical thinking, and problem-solving skills.Ability to design logical multi-step engineering scenarios.Nice-to-Have SkillsExperience creating benchmark datasets, online judge problems, coding tests, or technical challenges.Background with ICPC, Codeforces, Kaggle, or competitive programming.Familiarity with Docker, Git, and CI/CD pipelines.Experience with ML/AI or data-intensive engineering environments.Who Will Excel in This RoleEngineers who enjoy designing difficult problems rather than simple feature development.Developers who are strong at debugging, identifying subtle issues, and understanding complex system interactions.Engineers who work well independently and can define their own approach.Individuals interested in LLM evaluation, AI reliability, and technical task design.


  • AI Engineer

    2 weeks ago


    Kozhikode, Kerala, India Codely Ai Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for an experienced AI Engineer with hands-on experience in AI/ML, including LLMs, STT, TTS, and real-time AI applications. Strong Expertise in Python. You will develop scalable AI solutions and integrate them into production systems.


  • Kozhikode, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Artificial Intelligence EngineerRequired Skillset: Senior Full Stack & AI Engineer (AWS | Node.js | React | LLM | Cloud AI)Location: Delhi/ Bangalore/ Hyderabad/ Pune/ MumbaiExperience Range: 6-8 yearsJob Description:About the Role:We are looking for an experienced Senior Full Stack & AI Engineer with strong expertise in AWS...

  • AI/ML Engineer

    7 days ago


    Kozhikode, Kerala, India Core Cognitics Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    About the RoleWe are seeking a passionate and motivatedAI/ML Engineer (Entry-Level)to join our team. The ideal candidate should have strong foundational knowledge ofMachine Learning, Deep Learning, and Large Language Models (LLMs), along with hands-on experience in Python programming. This role involves contributing toAI-driven solutions, includingLLM...


  • Kozhikode, India Kumaran Systems Full time

    Required QualificationsBachelor’s degree in computer science, Information Technology, or related field5+ years of experience in software testing and quality assuranceStrong proficiency in Python and Python-based test automation frameworks, particularly Robot Framework or pytestExperience implementing UI automation using Selenium/Playwright within Python...

  • Junior Ai Engineer

    1 week ago


    Kozhikode, India Whatjobs IN C2 Full time

    1. Junior AI Engineer – India (Remote) Role: Junior AI Engineer Location: India Remote Employment Type: Full-time About the Role We’re looking for a motivated Junior AI Engineer to join our AI & ML team. You’ll assist in developing and deploying AI-powered features, support prompt engineering and RAG workflows, and collaborate with product and...

  • Senior Data Analyst

    3 weeks ago


    Kozhikode, India Appfabs Incorporation Full time

    We are looking for a versatile and highly skilled Data Analyst / AI Engineer (Immediate Joiner) to join our innovative team. This unique role combines the strengths of a data scientist with the capabilities of an AI engineer, allowing you to dive deep into data, extract meaningful insights, and then build and deploy cutting-edge Machine Learning, Deep...


  • Kozhikode, India Whatjobs IN C2 Full time

    We are looking for a visionary and technically skilled Lead AI Engineer – Machine Learning to spearhead the design, development, and deployment of advanced machine learning solutions. In this leadership role, you will guide a team of AI/ML engineers, contribute hands-on to critical technical challenges, and collaborate with cross-functional teams to...

  • Ai engineer intern

    4 days ago


    Kozhikode, India Mandrake Bioworks Full time

    Experience: 0–3 yearsType: Full-time, On-site (Bengaluru)About Mandrake Bioworks Mandrake Bioworks is an AI-first biotechnology company reimagining how we design and engineer life itself. Our mission is to build intelligent systems that make biology programmable . We’re unlocking a new generation of gene editing technologies that will power breakthroughs...


  • Kozhikode, Kerala, India Quest Innovative solutions Pvt ltd Kochi Full time ₹ 2,00,000 - ₹ 2,40,000 per year

    Job Description:We are looking for a skilled Junior Embedded systems Engineer / Trainer to join our dynamic team. In this role, you will provide advanced-level training in Embedded systems to students with technical backgrounds and working professionals seeking to transition into the field. After training, you will support them in developing academic...


  • Kozhikode, India High Volt Analytics Full time

    Role Overview We're seeking a sharp, forward-thinking AI-Powered Analytics Engineer to join our growing team. In this role, you'll design, build, and deploy advanced analytics solutions using machine learning, LLMs, and automation to turn raw data into actionable business insights. You’ll work closely with clients, developers, and business strategists to...