Psychometrics in Behavioral Software Engineering: A Methodological Introduction with Guidelines

• A meaningful and deep understanding of the human aspects of software engineering (SE) requires psychological constructs to be considered. Psychology theory can facilitate the systematic and sound development as well as the adoption of instruments (e.g., psychological tests, questionnaires) to assess these constructs. In particular, to ensure high quality, the psychometric properties of instruments need evaluation. In this article, we provide an introduction to psychometric theory for the evaluation of measurement instruments for SE researchers. We present guidelines that enable using existing instruments and developing new ones adequately. We conducted a comprehensive review of the psychology literature framed by the Standards for Educational and Psychological Testing. We detail activities used when operationalizing new psychological constructs, such as item pooling, item review, pilot testing, item analysis, factor analysis, statistical property of items, reliability, validity, and fairness in testing and test bias. We provide an openly available example of a psychometric evaluation based on our guideline. We hope to encourage a culture change in SE research towards the adoption of establishedmethods from psychology. To improve the quality of behavioral research in SE, studies focusing on introducing, validating, and then using psychometric instruments need to be more common.

Ämnesord

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Sciences (hsv//eng)

SAMHÄLLSVETENSKAP  -- Psykologi -- Psykologi (hsv//swe)

SOCIAL SCIENCES  -- Psychology -- Psychology (hsv//eng)

TEKNIK OCH TEKNOLOGIER  -- Samhällsbyggnadsteknik -- Byggproduktion (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Civil Engineering -- Construction Management (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Programvaruteknik (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Software Engineering (hsv//eng)

Nyckelord

Empirical software engineering

psychology

behavioral software

engineering

methodology

questionnaire design

exploratory factor-analysis

analytic rotation

psychology

personality

design

number

instruments

knowledge

cognition

question

Computer Science

Empirical software engineering

Publikations- och innehållstyp

ref (ämneskategori)

art (ämneskategori)