Agenda

Seminar held by  Prof.Joan Manuel Batista-Foguet, Full Professor at Department of People Management and Organisation in ESADE Business School, University Ramón Llull 

"Revisiting the methodology of Analysis in Multisource Assessment"

Joan Manuel Batista-Foguet ¹ Willem E. Saris,² Richard E. Boyatzis,³ Ricard Serlavós ⁴

1 & 4 Leadership Development Research Centre, ESADE Business School, Department of People Management and Organization. Ramón Llull University. Barcelona, Spain. 2 Visiting Professor at Pompeu Fabra University. Barcelona, Spain 3 Weatherhead School of Management, Department of Organizational Behavior, Case Western Reserve University. Cleveland, OH, USA.

Abstract: Multisource assessment is based on the belief that assessments are valid inferences about an individual’s behavior. We propose that differences in perspectives among raters are an integral element of the assessment, with the trait–rater dyad being an actual latent variable. The analysis requires checking factorial invariance before making any comparison between self and other raters’ assessments. When MSA is used for development purposes data analysis usually aggregates rater scores, which is different than that used for performance. Using a 360º survey on a sample of 1194 MBA students enrolled in a leadership development course, results show: (a) observed differences in the underlying competencies measured by external raters and by self-assessments can be attributable to different meanings attached to those competencies; (b) item reliability depends on the criteria homogeneity of the evaluators group; (c) loadings within the dyads of rater-competency provide reasons for improving item wording or selection; and (d) some competencies can be better assessed by one specific category of raters than by another. This allows for shortening questionnaires by customizing them to a specific context. Keywords: Multisource assessment; factorial invariance; leadership development; multi-trait multi-method models