Psychometrist

Job Title: Senior Research Scientist - Psychometrics

Job Overview : The Senior Research Scientist in Psychometrics will lead and contribute to the design, development, and analysis of psychometric assessments and tools, particularly in the area of adaptive assessment and learning. This role involves implementing and conducting advanced statistical analysis, developing new assessment methodologies, and ensuring the reliability and validity of psychological measures. The ideal candidate will have extensive experience in psychometrics, data analysis, and applied statistics, with a strong background in psychological theory and testing. The Senior Research Scientist will work closely with cross-functional teams to provide insights that inform decision-making in research, product development, and organizational strategies.

Key Responsibilities :

Research & Development:

Design, implement, and oversee psychometric research projects.

Develop and validate new assessment tools and scales in areas such as educational testing and employee selection.

Lead research efforts in item response theory (IRT), classical test theory (CTT), and more modern psychometric methods such as network psychometrics.

Investigate and improve the reliability, validity, and fairness of assessments across diverse populations.

Data Analysis & Modeling:

Apply advanced statistical techniques to analyze psychometric data at scale.

Perform complex data manipulations, exploratory data analysis, and simulations to optimize test construction and scoring.

Design and interpret predictive models related to test outcomes, using techniques such as machine learning and generative artificial intelligence.

Provide recommendations based on psychometric data insights and trends to customers.

Test Development & Evaluation:

Evaluate items for large-scale assessments, ensuring content appropriateness and psychometric quality to inform customer subject matter experts on how and where to improve their assessment.

Oversee test design, and the calibration of assessment items.

Conduct analyses and ensure assessments meet ethical and legal standards for fairness and accessibility.

Collaborate on innovative approaches to measuring latent constructs and performance.

Leadership & Collaboration:

Mentor and supervise junior researchers and data analysts.

Work collaboratively with cross-functional teams, including psychologists, educators, data scientists, and software engineers, to translate research findings into actionable products and strategies.

Serve as a subject matter expert on psychometric methods, providing guidance and consultation to other teams within the organization.

Reporting & Dissemination:

Present research findings to internal stakeholders, scientific audiences, and external clients through reports, publications, and presentations.

Publish research in peer-reviewed journals and present at industry conferences.

Stay updated on industry trends, emerging methodologies, and advancements in psychometric theory and technology.

Qualifications:

Education:

Ph.D. in Psychometrics, Quantitative Psychology, Educational Measurement, Applied Statistics, or a related field.

Experience:

Minimum of 5-7 years of experience in psychometrics or a related field, with proven success in research and statistical analysis.

Experience in developing, validating, and analyzing large-scale assessments or psychological measures.

Technical Skills:

Proficiency in statistical software (e.g., R, Python) and programming (e.g., C, C++, fortran).

Expertise in modern psychometric techniques such as IRT, CTT, and structural equation modeling (SEM).

Strong understanding of data management, statistical modeling, and experimental design.

Hands on experience with developing and implementing statistical algorithms.

Soft Skills:

Strong communication and presentation skills, with the ability to explain complex concepts to non-experts.

Excellent problem-solving and critical-thinking abilities.

Ability to work independently and in collaboration with multi-disciplinary teams.

Preferred Qualifications:

Experience in machine learning applications or data science in relation to psychometrics.

Knowledge of adaptive testing, computer-based assessment, or automated scoring systems.

A strong publication record in the field of psychometrics or related areas.