LLM Python
3 days ago
Role Overview:
This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models.
One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models.
For example, for SFT data generation, you might have to put together or be provided a prompt which contains provided code and questions, you will then provide the model responses, and write corresponding Python code to solve the questions. A collection of 5k-10k such samples could form the dataset for model fine-tuning.
For RLHF data generation, you might have to put together or be provided a prompt by the customer, ask the model questions, and evaluate the outputs generated by two versions of the LLM model. You'd compare these outputs and provide feedback, which is then used to fine-tune the models. Please note that this role does not require you to build LLMs or fine-tune them.
What does day-to-day look like:
- Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
- Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
- Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
- Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
- Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
- Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
- Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
- Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
- Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
- Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
- Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.
Requirements:
- 3+ years of experience in software development, with a strong focus on Python
- Advanced problem-solving and analytical skills
- Ability to deconstruct complex problems into structured steps
- Strong written communication skills in English
- Meticulous attention to detail and creativity in task design
- Demonstrated experience via LeetCode, HackerRank, GitHub, or similar platforms
- We need public profile link of any DSA platform - LeetCode, HackerRank, Codechef, geeksForGeeks, CodeForces, TopCoder
Evaluation Process (approximately 90 mins) :
Offline Technical Assessment
-
Lead Python LLM Developer
3 days ago
New Delhi, India KPI Partners Full timeKPI Partners is seeking a highly skilled and experiencedLeadPython Developer (LLM)to join our dynamic team. In this role, you will be responsible for leading the development and implementation of large language model applications, driving innovation and efficiency through advanced programming and data processing techniques.Location : Bengaluru, Hyderabad,...
-
LLM Agentic Trainer
3 days ago
Delhi, NCR, India Codefeast Full time ₹ 9,00,000 - ₹ 12,00,000 per yearRole OverviewWe are seeking a Python Engineer to validate and ensure the quality of training data used in developing agentic AI systems. This role involves working with Python and JSON function-calling methods to create structured tasks, ensuring data workflows remain consistent, accurate, and aligned with cutting-edge AI requirements.What does day-to-day...
-
Python LLM Developer
4 weeks ago
NCR, India Codefeast Full timeWhat does day-to-day look like: Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models. Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement. Familiarity with Python frameworks and libraries Evaluate and rank AI model responses to user queries across diverse...
-
Software Engineer – LLM, ML, Python
1 week ago
New Delhi, India HID Full timeWho are we? HID powers the trusted identities of the world’s people, places, and things, allowing people to transact safely, work productively and travel freely. We are a high-tech software company headquartered in Austin, TX, with over 4,500 worldwide employees. Check us out here: www.hidglobal.com and this video.As our Machine Learning Engineer, you’ll...
-
Software Engineer
5 days ago
New Delhi, India HID Full timeWho are we?HID powers the trusted identities of the world’s people, places, and things, allowing people to transact safely, work productively and travel freely. We are a high-tech software company headquartered in Austin, TX, with over 4,500 worldwide employees. Check us out here:and this video.As our Machine Learning Engineer, you’ll support HID’s...
-
LLM Data Scientist
2 days ago
Delhi, India Insight Global Full timeRequired Technical Skills- Experience building out LLM platforms (must have platform level integration experience)- Advanced proficiency in Python, especially with data science and machine learning libraries.- Experience in developing and deploying machine learning models, particularly LLMs.- Strong background in data integration and managing large...
-
Llm data scientist
3 days ago
Delhi, India Insight Global Full timeRequired Technical Skills- Experience building out LLM platforms (must have platform level integration experience)- Advanced proficiency in Python, especially with data science and machine learning libraries.- Experience in developing and deploying machine learning models, particularly LLMs.- Strong background in data integration and managing large...
-
LLM Data Scientist
4 days ago
Delhi, India Insight Global Full timeRequired Technical SkillsExperience building out LLM platforms (must have platform level integration experience)Advanced proficiency in Python, especially with data science and machine learning libraries.Experience in developing and deploying machine learning models, particularly LLMs.Strong background in data integration and managing large...
-
Python Developer
5 days ago
New Delhi, India Emergetech Full timeJob Description We’re an early-stage AI initiative building cutting-edge agent-based architectures, includingLangChain,MCP (Multi-agent Coordination Protocol), andA2A (Agent-to-Agent)frameworks. We are looking for someone who is both astrong Python developerand hashands-on experience with LLM frameworks. This role is not just about experimenting with...
-
LLM Data Scientist
3 days ago
New Delhi, India Insight Global Full timeRequired Technical Skills- Experience building out LLM platforms (must have platform level integration experience) - Advanced proficiency in Python, especially with data science and machine learning libraries. - Experience in developing and deploying machine learning models, particularly LLMs. - Strong background in data integration and managing large...
