Psychometric evaluation of the AI-based career matching platform meinBeruf.ch. Evidence for reliability, construct validity, and gender fairness
Loading...
Author (Corporation)
Publication date
2026
Type of student thesis
Course of study
Collections
Type
01A - Journal article
Editors
Editor (Corporation)
Supervisor
Parent work
Psychological Test Adaptation and Development
Special issue
DOI of the original publication
Link
Related research data
Series
Series number
Volume
7
Issue / Number
Pages / Duration
289-295
Patent number
Publisher / Publishing institution
Hogrefe
Place of publication / Event location
Edition
Version
Programming language
Assignee
Practice partner / Client
Abstract
Abstract: Objective: This study examined the preliminary psychometric quality and construct validity of the meinBeruf.ch assessment system and evaluated gender-related fairness at the level of input variables and algorithmic recommendations. Methods: The sample comprised 914 users of the meinBeruf.ch platform. Participants completed standardized personality (BFI-2), interest (RIASEC), cognitive (HMT), and domain-specific skill measures, followed by algorithmic career recommendations. Reliability and construct validity were assessed using internal consistency coefficients and correlations between psychological scales and industry-fit scores. Gender fairness was examined by testing whether self-reported gender added incremental predictive value beyond psychological profiles, and by reporting supplementary input-variable analyses of gender differences, DIF, measurement invariance, and a technical counterfactual audit of the ranking layer. Results: The psychological scales demonstrated adequate to high internal consistencies, and correlations with algorithmic recommendations showed theoretically consistent patterns. Adding gender to random-forest prediction models changed predictive accuracy only minimally ( M | ΔR 2| = .011), indicating that gender provided little systematic predictive value beyond the psychological profile. Supplementary analyses documented expected gender differences in some input variables and no counterfactual rank changes when only the gender label was varied. Limitations: The study used a self-selected online sample, relied primarily on cross-sectional platform data, and lacked long-term criterion outcomes such as later career choice, satisfaction, or persistence. Conclusion: The meinBeruf.ch assessment system provides preliminary evidence for psychometric quality and construct validity. The algorithmic ranking layer behaved technically gender-fair, while gender-related differences in personality, interests, and self-estimated skills remain important for interpretation and future research, especially in STEM-related vocational guidance.
Keywords
Subject (DDC)
Event
Exhibition start date
Exhibition end date
Conference start date
Conference end date
Date of the last check
ISBN
ISSN
2698-1866
Language
English
Created during FHNW affiliation
Yes
Strategic action fields FHNW
Publication status
Published
Review
peer-reviewed
Open access category
Gold
License
Citation
Steppan, M., Jogho, G., Ruchti, I., & Hell, B. (2026). Psychometric evaluation of the AI-based career matching platform meinBeruf.ch. Evidence for reliability, construct validity, and gender fairness. Psychological Test Adaptation and Development, 7, 289–295. https://doi.org/10.1027/2698-1866/a000147