Stem Rater

2 days ago

Bellary, Karnataka, India Aceolution Full time

STEM Raters for GenAI Data

Role Overview

As a STEM Rater for [Maths/Physics/Chemistry/Biology/Coding/Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity, and pedagogical effectiveness, ensuring they are insightful, well-structured, and tailored to the learner's level. You will apply your deep subject matter expertise to provide critical feedback that directly enhances the AI's ability to teach millions at scale through technology.

Profile of the Ideal Candidate

I. Core Responsibilities

High-Quality Data Creation & Curation:

  • Meticulously create and refine high-quality data, including detailed solutions, explanations, and step-by-step derivations for STEM problems across various difficulty levels.
  • Ensure all content adheres strictly to established quality rubrics, style guides, and pedagogical standards, focusing on accuracy, clarity, and effectiveness.
  • Integrate subject matter expertise to provide comprehensive and insightful explanations that anticipate common student misconceptions.

AI Response Evaluation & Feedback:

  • Rigorously evaluate AI-generated responses for correctness, coherence, pedagogical soundness, and adherence to specific instructions.
  • Provide clear, constructive, and actionable feedback to the AI model, identifying errors, inaccuracies, or areas for improvement in its reasoning and presentation.
  • Participate in creating "ground truth" solutions and evaluation datasets to benchmark AI model performance.

Subject Matter Expertise Application:

  • Apply deep knowledge in [Maths/Physics/Chemistry/Biology/Coding/Finance] to assess complex problems, verify solutions, and develop alternative approaches.
  • Stay updated with advancements and common curriculum standards in your respective STEM field to ensure content relevance and accuracy.

Collaboration & Workflow Adherence:

  • Work closely with the STEM Lead and fellow raters to ensure consistency in data creation and evaluation processes.
  • Adhere to established workflows, deadlines, and project requirements set by the STEM Lead.
  • Communicate clearly about challenges encountered in data creation or AI evaluation to facilitate timely resolution.

II. Required Qualifications & Experience

  • Educational Background: A Master's degree (M.Sc./M.Tech) in [Maths/Physics/Chemistry/Biology/Coding/Finance] or a closely related field from a premier Tier-1institution (e.g., IIT, BITS, NIT,IISER, IISc, TIFR, CMI, eminent central universities) is required. A Ph.D. is a plus. Demonstrable academic excellence is very important, either during the course or in a national level competitive examination at any level
  • Deep Subject Expertise: Demonstrable, strong expertise across a wide range of topics within your subject, covering syllabi for competitive exams (e.g., JEE Mains & Advanced/NEET/GATE) and major undergraduate curricula. Excellent conceptual understanding with the ability to solve all Previous Years' Questions (PYQs) of JEE Advanced/NEET/GATE as well as generally tough undergraduate, graduate level problems in your subject.
  • Teaching/Content Creation Experience: Proven experience (7+ years) in teaching, tutoring, content writing, or academic research in your specialized STEM field. Experience with competitive exam preparation is highly valued.
  • Exceptional Communication Skills: Excellent written communication skills with the ability to explain complex concepts clearly, concisely, and accurately.

III. Preferred Qualifications (The "Ideal" Candidate)

  • Proven track record of producing top 100 rankers in JEE Advanced or NEET or GATE
  • Content Development: Expertise in developing high-quality, original problems of JEE Advanced and/or Olympiad level and/or GATE. Experience authoring personal teaching materials, notes, and question banks is highly desirable
  • Experience with AI/ML Feedback: Familiarity with providing structured feedback for AI models or large language models.

IV. Personal Attributes & Soft Skills

  • Meticulous & Detail-Oriented: An unwavering commitment to accuracy, a keen eye for minute details, and a high standard for quality.
  • Pedagogical Aptitude: A natural ability to explain concepts in an easy-to-understand, step-by-step manner, considering different learning styles.
  • Analytical & Critical Thinker: Capable of critically evaluating information, identifying logical flaws, and applying analytical reasoning to solve problems.
  • Organized, Efficient & Proactive: Able to manage time effectively, prioritize tasks, and consistently meet deadlines in a fast-paced environment. Be a proactive self starter who can problem solve to resolve roadblocks rather than (largely) relying on external support
  • Collaborative & Dynamic: Works well in a team setting, is open to receiving and incorporating feedback, and is dedicated to continuous improvement. Comfortably to execute in a continuously changing environment
  • Tech-Savvy: Be extremely comfortable using Google Workspace and collaborate real-time with other stakeholders to deliver the end-goal (data points). Highly amenable to working with new tools and platforms for content creation and AI interaction.