AI Scientist, Psychometrics & Fairness

About This Role

Responsibilities

• Evaluate and calibrate AI and psychometric scoring models using CTT, IRT, CFA, DIF, fairness, and model-evaluation methods.
• Design human-AI comparison studies for structured interviews, open-ended answers, voice evidence, and language scoring.
• Build fairness dashboards, validation memos, technical-manual inputs, and compliance documentation for internal and customer use.
• Investigate anomalies, scoring drift, subgroup differences, and model robustness issues.
• Collaborate with Engineering to turn research workflows into production monitoring and evidence pipelines.
• Translate scientific findings into clear guidance for product, GTM, customer success, and enterprise reviewers.

Requirements

• Advanced degree or equivalent applied experience in psychometrics, data science, machine learning, computational linguistics, psychology, statistics, or related fields.
• Strong statistical analysis skills in Python or R.
• Practical knowledge of psychometric validation, reliability, construct validity, fairness, and model evaluation.
• Familiarity with LLMs, NLP, automated scoring, or AI evaluation.
• Ability to communicate clearly to both scientific and business audiences.
• Strong grounding in ethical AI, data protection, and responsible assessment practices.