LLM Python
3 days ago
Role Overview:
This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models.
One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models.
For example, for SFT data generation, you might have to put together or be provided a prompt which contains provided code and questions, you will then provide the model responses, and write corresponding Python code to solve the questions. A collection of 5k-10k such samples could form the dataset for model fine-tuning.
For RLHF data generation, you might have to put together or be provided a prompt by the customer, ask the model questions, and evaluate the outputs generated by two versions of the LLM model. You'd compare these outputs and provide feedback, which is then used to fine-tune the models. Please note that this role does not require you to build LLMs or fine-tune them.
What does day-to-day look like:
- Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
- Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
- Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
- Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
- Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
- Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
- Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
- Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
- Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
- Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
- Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.
Requirements:
- 3+ years of experience in software development, with a strong focus on Python
- Advanced problem-solving and analytical skills
- Ability to deconstruct complex problems into structured steps
- Strong written communication skills in English
- Meticulous attention to detail and creativity in task design
- Demonstrated experience via LeetCode, HackerRank, GitHub, or similar platforms
- We need public profile link of any DSA platform - LeetCode, HackerRank, Codechef, geeksForGeeks, CodeForces, TopCoder
Evaluation Process (approximately 90 mins) :
Offline Technical Assessment
-
LLM - Python
23 hours ago
Delhi, Delhi, India ProEchoes Technology Full time ₹ 5,00,000 - ₹ 15,00,000 per yearCompany DescriptionProEchoes Technology is a dynamic and innovative team driven to deliver exceptional value by leveraging a blend of technologists, domain experts, architects, quality assurers, and managers. Our commitment to excellence ensures successful deliverables and fosters long-term client relationships. With a strong focus on disruptive technologies...
-
Lead Python LLM Developer
3 weeks ago
New Delhi, India KPI Partners Full timeKPI Partners is seeking a highly skilled and experienced Lead Python Developer (LLM) to join our dynamic team. In this role, you will be responsible for leading the development and implementation of large language model applications, driving innovation and efficiency through advanced programming and data processing techniques.Location: Bengaluru, Hyderabad,...
-
Lead Python LLM Developer
3 weeks ago
New Delhi, India KPI Partners Full timeKPI Partners is seeking a highly skilled and experiencedLeadPython Developer (LLM)to join our dynamic team. In this role, you will be responsible for leading the development and implementation of large language model applications, driving innovation and efficiency through advanced programming and data processing techniques.Location : Bengaluru, Hyderabad,...
-
Python Developer with ML and LLM
2 weeks ago
Delhi, India DXC Technology Full timeAbout the CompanyDXC Technology is a world leader in IT services for large corporations. We are a family of over 170,000 people in 70 offices worldwide. At DXC we enjoy working in a warm, open-minded, understanding, and friendly environment. We live by the values of Equality, Respect, Inclusion, and Diversity every day across all offices and countries. We...
-
Python Developer with ML and LLM
2 weeks ago
Delhi, India DXC Technology Full timeAbout the CompanyDXC Technology is a world leader in IT services for large corporations. We are a family of over 170,000 people in 70 offices worldwide. At DXC we enjoy working in a warm, open-minded, understanding, and friendly environment. We live by the values of Equality, Respect, Inclusion, and Diversity every day across all offices and countries. We...
-
Python developer with ml and llm
2 weeks ago
Delhi, India DXC Technology Full timeAbout the CompanyDXC Technology is a world leader in IT services for large corporations. We are a family of over 170,000 people in 70 offices worldwide. At DXC we enjoy working in a warm, open-minded, understanding, and friendly environment. We live by the values of Equality, Respect, Inclusion, and Diversity every day across all offices and countries. We...
-
Python developer with ml and llm
2 weeks ago
Delhi, India DXC Technology Full timeAbout the CompanyDXC Technology is a world leader in IT services for large corporations. We are a family of over 170,000 people in 70 offices worldwide. At DXC we enjoy working in a warm, open-minded, understanding, and friendly environment. We live by the values of Equality, Respect, Inclusion, and Diversity every day across all offices and countries. We...
-
Python Developer with ML and LLM
2 weeks ago
New Delhi, India DXC Technology Full timeAbout the CompanyDXC Technology is a world leader in IT services for large corporations. We are a family of over 170,000 people in 70 offices worldwide. At DXC we enjoy working in a warm, open-minded, understanding, and friendly environment. We live by the values of Equality, Respect, Inclusion, and Diversity every day across all offices and countries. We...
-
DS with Python
2 days ago
Delhi, India DeepLLMData Full timeCompany DescriptionDeepLLMData focuses on coding SFT, RLHF, STEM, PhD, Maths, Image and Video data annotators and provisioning.Role DescriptionThis is a Part-time remote role for LLM Model training. The task needs LLM Trainers to create Classical ML Models e.g. Classification, Regression, Forecasting, Clustering, Neural Networks.. etc. in Finance, Retail,...
-
DS with Python
16 hours ago
Delhi, India DeepLLMData Full timeCompany DescriptionDeepLLMData focuses on coding SFT, RLHF, STEM, PhD, Maths, Image and Video data annotators and provisioning.Role DescriptionThis is a Part-time remote role for LLM Model training. The task needs LLM Trainers to create Classical ML Models e.g. Classification, Regression, Forecasting, Clustering, Neural Networks.. etc. in Finance, Retail,...
