| 1. |
- Vestin, Magnus, et al.
(author)
-
Psychometric validity of the Montgomery and Åsberg depression rating scale for youths (MADRS-Y)
- 2023
-
In: Nordic Journal of Psychiatry. - : Taylor & Francis. - 0803-9488 .- 1502-4725. ; 77:5, s. 421-431
-
Journal article (peer-reviewed)abstract
- Background: Because of all the serious consequences of major depressive disorder (MDD), it is important to screen for MDD in adolescents. The aim of this study was to test the psychometric properties of the newly developed self-report depression scale MADRS-Y for adolescents in a normative Swedish sample.Methods: The study included 620 adolescents in the age range of 12–20 years old. The normative sample was randomly split into two equal parts, to perform principal component analysis (PCA) on sample one and confirmatory factor analysis (CFA) on sample two. We investigated the psychometrics.Results: The result from the PCA suggested that all 12 potential items should be used, and the items loaded on the same construct of depression. The CFA supported the one-factor structure with good fit indices. Measurement invariance was confirmed, allowing interpretation regardless of gender or age differences. Reliability was good, α.89, for both samples separately. Test-retest reliability was good to excellent (intraclass correlation coefficients =.87 and.91). Evidence of convergent and discriminant validity was shown.Conclusions: The results in the current study suggest that the MADRS-Y is a brief, reliable, and valid self-report questionnaire of depressive symptoms for adolescents in the general population.
|
|
| 2. |
- Wiberg, Britt, et al.
(author)
-
Balanced time perspective : developing empirical profile and exploring its stability over time
- 2017
-
In: Time perspective. - London : Palgrave Macmillan. - 9781137601902 - 9781137601919 ; , s. 63-95
-
Book chapter (peer-reviewed)abstract
- Balanced time perspective (BTP) is characterized by flexible switching between a person's past, present and future time orientations, depending on situational demands, personal resources, experiences, and social evaluations. The present study aimed to explore the psychological characteristics of people with a BTP profile and attain a deeper understanding of the BTP construct. Seven people with BTP profiles were investigated using in-depth interviews, self-report instruments, and a projective test. By testing the participants on two occasions within an 18-month interval, we investigated the stability of BTP. Analyses showed that participants were aware of the "now" and had a synchronicity between the present and the past, and also between the present and the future. Results indicated a degree of temporal stability in the BTP profile and that people's interpretations and interactions within the surrounding context of events influences their time perspectives.
|
|
| 3. |
- Wiberg, Marie, 1976-, et al.
(author)
-
Operationalizing balanced time perspective in a Swedish sample
- 2012
-
In: The International Journal of Educational and Psychological Assessment. - : Time Taylor Academic Journals. - 2094-0734. ; 12:1, s. 95-107
-
Journal article (peer-reviewed)abstract
- Past research suggests that biases in temporal orientation may have systematic effects ongoal-directed behavior and that physical and mental well-being is associated with balanced time perspective (BTP, Zimbardo and Boyd, 1999). The aim of this study was to examine different operationalizations of the BTP, and to present an alternative proposal in which BTP is measured as a multidimensional, rather than a binary, construct. Two versions of the Zimbardo Time Perspective Inventory (ZTPI) were administered to a sample of 502 individuals. The proposed operationalization shows important advantages in terms of ecological validity of the multidimensional definition, sample independency and possibility to adjust for country differences. Our proposal may also have practical implications both for individuals and groups, e.g. in working teams, psychological counseling, psychotherapy and when recruiting personal forleading positions.
|
|
| 4. |
- Wiberg, Marie, 1976-, et al.
(author)
-
Relationship between students’ test results and their performance in higher education using different test scores
- 2022
-
In: Quantitative psychology. - Cham : Springer. - 9783031045714 - 9783031045721 ; , s. 39-49
-
Conference paper (peer-reviewed)abstract
- The aim of this study is to examine the relationship between students’ college admissions test results and their performance in higher education using sum scores and optimal full-data scores. We used students from four university programs to examine predictive validity in terms of how the students performed on their studies in terms of obtained credits, as compared with their college admissions test results. The students’ test results were calculated using the commonly used sum scores and the recently proposed optimal scores. We also examined the predictive validity of the test scores while controlling for the student backgrounds in terms of educational background, migration background, and gender. The results show that using optimal scores or sum scores yields slightly different test score distributions, especially the score distribution among the highest test performers differed. Practical implications of which test scores to use in college admissions testing in the future are discussed.
|
|
| 5. |
- Wiberg, Marie, 1976-, et al.
(author)
-
Schools, Universities and Large-Scale Assessment Responses to COVID-19 : The Swedish Example
- 2021
-
In: Education Sciences. - : MDPI. - 2227-7102. ; 11:4
-
Journal article (peer-reviewed)abstract
- The aim of this paper is to describe, analyze, and discuss how Swedish schools and the national tests in schools, university teaching and examination, and the college admissions test, Swedish Scholastic Aptitude Test (SweSAT), have been affected by the COVID-19 situation. A further aim is to discuss the challenges in schools, universities and in the admissions test process in Sweden which are due to the COVID-19 situation. Contrary to many other countries, Swedish schools remained open, except for upper secondary school and universities where teaching went online. However, the spring administrations of the national tests and the high-stake college admission test, SweSAT, were cancelled, which had impact on admissions to universities in the fall. By using documentation from the news, school, and university authorities, as well as governmental reports of the events and a student survey, challenges are discussed. The novelty of this study includes a discussion of the events and their upcoming challenges. A discussion of what could be learned and what to expect in the close future is included, as well as conclusions which can be drawn from this situation.
|
|
| 6. |
- Åström, Elisabeth, 1982-, et al.
(author)
-
Insights into features of anxiety through multiple aspects of psychological time
- 2014
-
In: Journal of Integrative Psychology and Therapeutics. - : Herbert Publications Ltd. - 2054-4723. ; 2
-
Journal article (peer-reviewed)abstract
- Background: It is well-recognized that emotions and emotional disorders may alter the experience of time. Yet relatively little is known about different aspects of psychological time in relation to anxiety. The purpose of the present study was to explore several aspects of temporal processing, including time perspective, prospective and retrospective time estimation, in persons with anxiety symptoms.Methods: A total of 110 individuals with varying degrees of anxiety participated in two studies. They were assigned to two groups (anxiety–control) based on their scores on anxiety measurements. Participants also completed an inventory of time perspective and several time estimation tasks which were analyzed on a group-level. Depressive symptoms were assessed and used as a covariate in the second study.Results: Anxiety was significantly associated with Past Negative and Future Negative time perspectives as measured by the Swedish Zimbardo Time Perspective Inventory (S-ZTPI), even when controlling for the effect of depressive symptoms. No other significant differences were found.Conclusion: Exploring time perspective in persons with anxious symptoms may provide important insights into features of anxiety. These findings may offer new ways of conceptualizing anxiety and provide suggestions for treatment strategies.
|
|
| 7. |
- Adolfsson, Lena, et al.
(author)
-
Gapet har minskat : skillnader mellan hög- och lågpresterande flickors och pojkars attityder till biologi, fysik och kemi 1995 och 2007
- 2011
-
In: NorDiNa. - 1504-4556 .- 1894-1257. ; 7:1, s. 3-16
-
Journal article (peer-reviewed)abstract
- This article explores the change over time of boys’ and girls’ attitudes towards biology, physics and chemistry. We use data from the TIMSS studies for grade 8 in Sweden to investigate how the attitudes for high- and low performing pupils have changed between 1995 and 2007. The attitude is measured by four questions from the student questionnaire in the TIMSS study. The results indicate that there have been some changes in attitudes between 1995 and 2007. High-achieving pupils and especially boys have a more negative attitude towards all three subjects, biology, physics and chemistry, in 2007 compared to 1995. The low-achieving students think that they are performing better in all three subjects 2007 compared to 1995. The difference between the group that are most positive to physics and chemistry and the least positive group has diminished between the two years. The results are discussed in relation to the changes in Swedish schools during the period.
|
|
| 8. |
- Albano, Anthony D., et al.
(author)
-
Linking With External Covariates : Examining Accuracy by Anchor Type, Test Length, Ability Difference, and Sample Size
- 2019
-
In: Applied psychological measurement. - : Sage Publications. - 0146-6216 .- 1552-3497. ; 43:8, s. 597-610
-
Journal article (peer-reviewed)abstract
- Research has recently demonstrated the use of multiple anchor tests and external covariates to supplement or substitute for common anchor items when linking and equating with nonequivalent groups. This study examines the conditions under which external covariates improve linking and equating accuracy, with internal and external anchor tests of varying lengths and groups of differing abilities. Pseudo forms of a state science test were equated within a resampling study where sample size ranged from 1,000 to 10,000 examinees and anchor tests ranged in length from eight to 20 items, with reading and math scores included as covariates. Frequency estimation linking with an anchor test and external covariate was found to produce the most accurate results under the majority of conditions studied. Practical applications of linking with anchor tests and covariates are discussed.
|
|
| 9. |
- Andersson, Björn, 1984-, et al.
(author)
-
Item response theory observed-score kernel equating
- 2017
-
In: Psychometrika. - : Springer Science and Business Media LLC. - 0033-3123 .- 1860-0980. ; 82:1, s. 48-66
-
Journal article (peer-reviewed)abstract
- Item response theory (IRT) observed-score kernel equating is introduced for the non-equivalent groups with anchor test equating design using either chain equating or post-stratification equating. The equating function is treated in a multivariate setting and the asymptotic covariance matrices of IRT observed-score kernel equating functions are derived. Equating is conducted using the two-parameter and three-parameter logistic models with simulated data and data from a standardized achievement test. The results show that IRT observed-score kernel equating offers small standard errors and low equating bias under most settings considered.
|
|
| 10. |
- Andersson, Björn, 1984-, et al.
(author)
-
Performing the Kernel Method of Test Equating with the Package kequate
- 2013
-
In: Journal of Statistical Software. - : The American Statistical Association. - 1548-7660. ; 55:6, s. 1-25
-
Journal article (peer-reviewed)abstract
- In standardized testing it is important to equate tests in order to ensure that the test takers, regardless of the test version given, obtain a fair test. Recently, the kernel method of test equating, which is a conjoint framework of test equating, has gained popularity. The kernel method of test equating includes five steps: (1) pre-smoothing, (2) estimation of the score probabilities, (3) continuization, (4) equating, and (5) computing the standard error of equating and the standard error of equating difference. Here, an implementation has been made for six different equating designs: equivalent groups, single group, counter balanced, non-equivalent groups with anchor test using either chain equating or post- stratification equating, and non-equivalent groups using covariates. An R package for the kernel method of test equating called kequate is presented. Included in the package are also diagnostic tools aiding in the search for a proper log-linear model in the pre-smoothing step for use in conjunction with the R function glm.
|
|
| 11. |
- Andersson, Carolyn J., et al.
(author)
-
Stories of successful careers in psychometrics and what we can learn from them
- 2020
-
In: Quantitative psychology. - New York : Springer. - 9783030434687 - 9783030434694 ; , s. 1-17
-
Book chapter (peer-reviewed)abstract
- This paper was inspired by the presentations and discussions from the panel "Successful Careers in Academia and Industry and What We Can Learn from Them”" that took place at the IMPS meeting in 2019. In this paper, we discuss what makes a career successful in academia and industry and we provide examples from the past to the present. We include education and career paths as well as highlights of achievements as researchers and teachers. The paper provides a brief historical context for the representation of women in psychometrics and an insight into strategies for success for publishing, for grant applications and promotion. The authors outline the importance of interdisciplinary work, the inclusive citation approaches, and visibility of research in academia and industry. The personal stories provide a platform for considering the needs for a supportive work environment for women and for work-life balance. The outcome of these discussions and reflections of the panel members are included in the paper.
|
|
| 12. |
- Boman, Björn, 1984-, et al.
(author)
-
The influence of SES, migration background, and non-cognitive abilities on PISA reading and mathematics achievement : evidence from Sweden
- 2024
-
In: European Journal of Psychology of Education. - : Springer Science+Business Media B.V.. - 0256-2928 .- 1878-5174.
-
Journal article (peer-reviewed)abstract
- The current study analysed the relationships between socio-economic status, migration background, and non-cognitive factors and PISA reading and mathematics achievement. The results from multi-level analyses on Sweden’s PISA survey from 2018 indicate that both mathematics achievement and reading achievement are affected by SES, migration background, reading abilities, growth mindset, and the ability to master the content. Between-school level differences are explained by reading motivation and the mother’s educational level. Our findings stress the importance of both socio-demographic, socio-economic, and non-cognitive factors such as reading self-concept and growth mindset for both mathematics achievement and reading achievement.
|
|
| 13. |
- Bränberg, Kenny, et al.
(author)
-
Observed score linear equating with covariates
- 2011
-
In: Journal of educational measurement. - East Lansing, Mich. : National Council on Measurement in Education. - 0022-0655 .- 1745-3984. ; 48:4, s. 419-440
-
Journal article (peer-reviewed)abstract
- This paper examined observed score linear equating in two different data collection designs, the equivalent groups design and the nonequivalent groups design, when information from covariates (i.e. background variables correlated with the test scores) was included. The main purpose of the study was to examine the effect (i.e. bias, variance, and mean square error) on the estimators of including this additional information. A model for observed-score linear equating with covariates first was suggested. As a second step, the model was used in a simulation study to show that the use of covariates such as gender and education can increase the accuracy of an equating by reducing the mean squared error of the estimators. Finally, data from two administrations of the Swedish Scholastic Assessment Test were used to illustrate the use of the model.
|
|
| 14. |
- Bränberg, Kenny, 1956-, et al.
(author)
-
The effect on equating of using background variables
-
Other publication (other academic/artistic)abstract
- In this paper observed score linear equating with two different data collection designs, the equivalent groups design and the non-equivalent groups design, is examined when including information from background variables. The purpose of the study is to examine the effect (i.e., bias, variance and mean squared error) on the estimators of including this additional information. In a simulation study, we show that the use of background variables, such as gender and education, can increase the accuracy of an equating by reducing the mean squared error (MSE) of the estimators.
|
|
| 15. |
- Carlberg Rindestig, Frida, et al.
(author)
-
Psychometrics of three Swedish physical pediatric item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS)(R): pain interference, fatigue, and physical activity
- 2021
-
In: Journal of Patient-Reported Outcomes. - : Springer Science and Business Media LLC. - 2509-8020. ; 5:1
-
Journal article (peer-reviewed)abstract
- Background The Patient-Reported Outcomes Measurement Information System (PROMIS (R)) aims to provide self-reported item banks for several dimensions of physical, mental and social health. Here we investigate the psychometric properties of the Swedish pediatric versions of the Physical Health item banks for pain interference, fatigue and physical activity which can be used in school health care and other clinical pediatric settings. Physical health has been shown to be more important for teenagers' well-being than ever because of the link to several somatic and mental conditions. The item banks are not yet available in Sweden. Methods 12- to 19-year-old participants (n = 681) were recruited in public school settings, and at a child- and psychiatric outpatient clinic. Three one-factor models using CFA were performed to evaluate scale dimensionality. We analyzed monotonicity and local independence. The items were calibrated by fitting the graded response model. Differential Item analyses (DIF) for age, gender and language were calculated. Results As part of the three one-factor models, we found support that each item bank measures a unidimensional construct. No monotonicity or local dependence were found. We found that 11 items had significant lack of fit in the item response theory (IRT) analyses. The result also showed DIF for age (seven items) and language (nine items). However, the differences on item fits and effect sizes of McFadden were negligible. After considering the analytic results, graphical illustration, item content and clinical relevance we decided to keep all items in the item banks. Conclusions We translated and validated the U.S. PROMIS item banks pain interference, fatigue and physical activity into Swedish by applying CFA, IRT and DIF analyses. The results suggest adequacy of the translations in terms of their psychometrics. The questionnaires can be used in school health and other pediatric care. Future studies can be to use Computerized Adaptive Testing (CAT), which provide fewer but reliable items to the test person compared to classical testing.
|
|
| 16. |
-
Ett bibliotek i takt med tiden : Linköpings universitetsbibliotek under 50 år
- 2022
-
Artistic workabstract
- Utställningen Ett bibliotek i takt med tiden: Linköpings universitetsbibliotek under 50 år skildrade bibliotekets historia och biblioteksteknikens utveckling från 1970-talet till idag.Utställningen fokuserade på olika teman som varit signifikativa för Linköpings universitetsbibliotek, som etablerades 1969 som Linköpings högskolas bibliotek. Dessa teman var den så kallade Linköpingsmodellen och dess kvartersbibliotek, försöksverksamheten med bibliotekssystemet Libris i början av 1970-talet, de första databaserna för att söka vetenskapliga publikationer, högskolereformen 1977 och dess betydelse för universitetsbiblioteket, tillkomsten av Hälsouniversitetets bibliotek 1986, datoriseringen under 1980-talet, användarundervisningens utveckling, tillkomsten av det elektroniska förlaget LiU E-Press 1996, skapande av Campus Norrköpings bibliotek 1998, den tilltagande digitaliseringen under 2000-talet, bibliometrins ökande betydelse samt utvecklingen under 2010-talet med bland annat byte av klassifikationssystem, flyttar och sammanslagningar av bibliotek.
|
|
| 17. |
- Fahlén, Jessica, et al.
(author)
-
KU-dag som möjlighet till erfarenhetsutbyte
- 2016
-
Conference paper (other academic/artistic)abstract
- Många lärare på högskolor och universitet har kompetensutveckling (KU) i sin tjänst vilket är reglerade i lokala avtal. Enligt Umeå universitets avtal innebär det att alla universitetslektorer ska under en treårs period ges utrymme om minst 20 procent. Vidare framgår att avrapporteringen av genomförda uppgifter ska ske på lämpligt sätt. Avstämning och revidering av lärarens kompetensutvecklingsplan sker vanligtvis på de flesta institutionerna/enheterna vid återkommande utvecklingssamtal. På vår Enhet har det vanliga varit har lärarna har genomfört sin KU utifrån sin plan och rapporterat en gång per år vid utvecklingssamtalet. Vid detta tillfälle har även planen reviderats. Tyvärr sker då inte ett erfarenhetsutbyte mellan kollegor utan enbart en avrapportering mot närmaste chef. För att förändra det här införde vi för tre år sedan på försök en KU-dag. Inspirationen till en KU-dag kom från Enhetens doktoranddag som ges en gång per år och där alla doktorander presenterar vad de har gjort det gångna året samt blickar framåt vad de ska göra det kommande året. Idén med en KU-dag är att alla som har KU-tid i sin bemanning presenterar vad de har gjort på sin tid samt en kort framåtblick på 10-15 minuter. För att engagera fler personer att delta så uppmanade vi även alla projektledare med externa medel att presentera vad de gör på sin forskningstid. Vårt huvudsakliga syfte med KU-dagen var att synliggöra vad alla gör samt att öppna upp för att lära oss av varandra men också för att öka medvetenheten om vad alla gör på Enheten. Erfarenheterna efter tre år med en årlig KU-dag har varit många. Första året så upplevde vi en viss osäkerhet bland deltagarna. Vad leder egentligen införandet av en KU-dag till? Är den till för att kontrollera ens arbete eller kan man lära sig något? Redan andra året så uttryckte flera av deltagarna att de ville delta och det pratades om det i positiva termer både inför och efter genomförandet. Detta beror troligtvis på att vi arbetat aktivt med att det inte ska kännas som en kontroll utan mer till för att dela erfarenheter. Nu efter att ha genomfört det ett tredje år så ses det som ett självklart inslag i vår verksamhet. Lärdomar vi har dragit under de här åren inkluderar betydelsen av hur man lanserar KU-dagen, när på terminen den ges för att säkerställa att så många som möjligt kan delta, samt hur värdefullt det är att vara medveten om vad andra gör för att skapa nya projekt och ett inkluderande arbetsklimat på Enheten.
|
|
| 18. |
- Franco, Vithor Rosa, et al.
(author)
-
Chain graph reduction into power chain graphs
- 2022
-
In: Quantitative and Computational Methods in Behavioral Sciences. - : PshycOpen. - 2699-8432. ; 2:1
-
Journal article (peer-reviewed)abstract
- Reduction of graphs is a class of procedures used to decrease the dimensionality of a given graphin which the properties of the reduced graph are to be induced from the properties of the largeroriginal graph. This paper introduces both a new method for reducing chain graphs to simplerdirected acyclic graphs (DAGs), that we call power chain graphs (PCG), as well as a procedure forstructure learning of this new type of graph from correlational data of a Gaussian graphical model.Adefinitionfor PCGs is given, directly followed by the reduction method. The structure learningprocedure is a two-step approach:first,the correlation matrix is used to cluster the variables; andthen, the averaged correlation matrix is used to discover the DAGs using the PC-stable algorithm.The results of simulations are provided to illustrate the theoretical proposal, which demonstrateinitial evidence for the validity of our procedure to recover the structure of power chain graphs.The paper ends with a discussion regarding suggestions for future studies as well as some practicalimplications
|
|
| 19. |
- Franco, Víthor Rosa, et al.
(author)
-
How to Think Straight About Psychometrics : Improving Measurement by Identifying its Assumptions
- 2022
-
In: Trends in Psychology. - : Springer. - 2358-1883.
-
Journal article (peer-reviewed)abstract
- The aim of the current study is to introduce three assumptions common to psychometric theory and psychometric practice, and to show how alternatives to traditional psychometric approaches can be used to improve psychological measurement. These alternatives are developed by adapting each of these three assumptions. The assumption of structural validity relates to the implementation of mathematical models. The process assumption regards the underlying process generating the observed data. The construct assumption implies that the observed data on its own do not constitute a measurement, but the latent variable that originates the observed data. Nonparametric item response modeling and cognitive psychometric modeling are presented as alternatives for relaxing the first two assumptions, respectively. Network psychometrics is the alternative for relaxing the third assumption. Final remarks sum up the most important conclusions of the study.
|
|
| 20. |
- Franco, Vithor Rosa, et al.
(author)
-
Nondecomposable item response theory models : fundamental measurement in psychometrics
- 2023
-
In: Journal of mathematical psychology (Print). - : Academic Press. - 0022-2496 .- 1096-0880. ; 114
-
Journal article (peer-reviewed)abstract
- The main aim of the current paper is to propose Item Response Theory (IRT) models derived from the nondecomposable measurement theories presented in Fishburn (1974). More specifically, we aim to: (i) present the theoretical basis of the Rasch model and its relations to psychophysics’ models of utility; (ii) give a brief exposition on the measurement theories presented in Fishburn (1974, 1975), some of which do not require an additive structure; and (iii) derive IRT models from these measurement theories, as well as Bayesian implementations of these models. We also present two empirical examples to compare how well these IRT models fit to real data. In addition to deriving new IRT models, we also discuss theoretical interpretations regarding the models’ capability of generating fundamental measures of the true scores of the respondents. The manuscript ends with prospects for future studies and practical implications.
|
|
| 21. |
|
|
| 22. |
- Franco, Vithor Rosa, et al.
(author)
-
Situational optimization function analysis : An ideal performance analysis inspired on Lewin’s equation
- 2022
-
In: Psychological methods. - : American Psychological Association (APA). - 1082-989X .- 1939-1463. ; 27:6, s. 917-929
-
Journal article (peer-reviewed)abstract
- This study presents the situational optimization function analysis (SOFA) and has three aims. First, to develop a Bayesian implementation of SOFA. Second, to compare this implementation with three other maximum likelihood-based models in their accuracy to estimate true scores. The third aim is to show how joint modeling can be used for validity research. A simulation study was used to examine the second aim, while an empirical example was used to illustrate the third aim. The simulation study used three data generating processes, with varying degrees of deviation from linear models and with different sample sizes. Results of the simulation study showed that the Bayesian implementation supersedes the other models. In the empirical example, data collected from 66 participants using an iterated prisoner dilemma and a scale measuring cooperation-competition attitudes were used. Results showed that joint modeling is the best fitting model, also increasing the correlation between the true scores of both measures (deviations from the iterated prisoner dilemma and the scale). Finally, implications, limitations and future studies are discussed.
|
|
| 23. |
- González, Jorge, et al.
(author)
-
A family of discrete kernels for presmoothing test score distributions
- 2024
-
In: Quantitative psychology. - Cham : Springer. - 9783031555473 - 9783031555503 - 9783031555480 ; , s. 1-12
-
Conference paper (peer-reviewed)abstract
- In the fields of educational measurement and testing, score distributions are often estimated by the sample relative frequency distribution. As many score distributions are discrete and may have irregularities, it has been common practice to use presmoothing techniques to correct for such irregularities of the score distributions. A common way to conduct presmoothing has been to use log-linear models. In this chapter, we introduce a novel class of discrete kernels that can effectively estimate the probability mass function of scores, providing a presmoothing solution. The chapter includes an empirical illustration demonstrating that the proposed discrete kernel estimates perform as well as or better than the existing methods like log-linear models in presmoothing score distributions. The practical implications of this finding are discussed, highlighting the potential benefits of using discrete kernels in educational measurement contexts. Additionally, the chapter identifies several areas for further research, indicating opportunities for advancing the field’s methodology and practices.
|
|
| 24. |
- González, Jorge, et al.
(author)
-
A note on the Poisson's binomial distribution in Item Response Theory
- 2016
-
In: Applied psychological measurement. - : SAGE Publications. - 0146-6216 .- 1552-3497. ; 40:2, s. 302-310
-
Journal article (peer-reviewed)abstract
- The Poisson's binomial (PB) is the probability distribution of the number of successes in independent but not necessarily identically distributed binary trials. The independent non-identically distributed case emerges naturally in the field of item response theory, where answers to a set of binary items are conditionally independent given the level of ability, but with different probabilities of success. In many applications, the number of successes represents the score obtained by individuals, and the compound binomial (CB) distribution has been used to obtain score probabilities. It is shown here that the PB and the CB distributions lead to equivalent probabilities. Furthermore, one of the proposed algorithms to calculate the PB probabilities coincides exactly with the well-known Lord and Wingersky (LW) algorithm for CBs. Surprisingly, we could not find any reference in the psychometric literature pointing to this equivalence. In a simulation study, different methods to calculate the PB distribution are compared with the LW algorithm. Providing an exact alternative to the traditional LWapproximation for obtaining score distributions is a contribution to the field.
|
|
| 25. |
- González, Jorge, et al.
(author)
-
Applying test equating methods : using R
- 2017. - 1
-
Book (peer-reviewed)abstract
- This book describes how to use test equating methods in practice. The non-commercial software R is used throughout the book to illustrate how to perform different equating methods when scores data are collected under different data collection designs, such as equivalent groups design, single group design, counterbalanced design and non equivalent groups with anchor test design. The R packages equate, kequate and SNSequate, among others, are used to practically illustrate the different methods, while simulated and real data sets illustrate how the methods are conducted with the program R. The book covers traditional equating methods including, mean and linear equating, frequency estimation equating and chain equating, as well as modern equating methods such as kernel equating, local equating and combinations of these. It also offers chapters on observed and true score item response theory equating and discusses recent developments within the equating field. More specifically it covers the issue of including covariates within the equating process, the use of different kernels and ways of selecting bandwidths in kernel equating, and the Bayesian nonparametric estimation of equating functions. It also illustrates how to evaluate equating in practice using simulation and different equating specific measures such as the standard error of equating, percent relative error, different that matters and others.
|
|
| 26. |
|
|
| 27. |
- Handing, Elizabeth P., et al.
(author)
-
Heterogeneity in association between cognitive function and gait speed among older adults : an integrative data analysis study
- 2021
-
In: The journals of gerontology. Series A, Biological sciences and medical sciences. - : Oxford University Press. - 1079-5006 .- 1758-535X. ; 6:4, s. 710-715
-
Journal article (peer-reviewed)abstract
- Background: Increasing evidence shows that cognition and gait speed are associated and are important measures of health among older adults. However, previous studies have used different methods to assess these 2 outcomes and lack sufficient sample size to examine heterogeneity among subgroups. This study examined how the relationship between global cognitive function and gait speed are influenced by age, gender, and race utilizing an integrated data analysis approach.Method: Data on cognition (Montreal Cognitive Assessment [MoCA], Mini-Mental Status Examination [MMSE], and Modified Mini-Mental State Examination [3MSE]) and gait speed (range: 4–400 m) were acquired and harmonized from 25 research studies (n = 2802) of adults aged 50+ from the Wake Forest Older American Independence Center. Multilevel regression models examined the relationship between predicted values of global cognitive function (MoCA) and gait speed (4-m walk), including heterogeneity by age, race, and gender.Results: Global cognitive function and gait speed exhibited a consistent positive relationship among whites with increasing age, while this was less consistent for African Americans. That is, there was a low correlation between global cognitive function and gait speed among African Americans aged 50–59, a positive correlation in their 60s and 70s, then a negative correlation thereafter.Conclusion: Global cognition and gait speed exhibited a curvilinear U-shaped relationship among whites; however, the association becomes inverse in African Americans. More research is needed to understand this racial divergence and could aid in identifying interventions to maintain cognitive and gait abilities across subgroups.
|
|
| 28. |
- Henje Blom, Eva, 1962-, et al.
(author)
-
Translation and validation of the Swedish version of the self-compassion scale for youth
- 2024
-
In: Australian psychologist. - : Taylor & Francis. - 0005-0067 .- 1742-9544. ; 59:1, s. 24-35
-
Journal article (peer-reviewed)abstract
- Objective: Compassion-focused interventions for young people have started to emerge to treat depressive symptoms, and reliable and valid measures of the construct “self-compassion” is needed for this age-group in Swedish. This study aims to validate the Swedish translation of the Self-Compassion Scale for Youth (SCS-Y).Method: Self-report questionnaires were collected from students (N = 316) aged 15–20 recruited from schools in Sweden, in a cross-sectional design. Confirmatory factor analyses, internal consistency, test-retest reliability, measurement invariance and convergent and divergent validity were calculated.Results: A model with one general bi-factor and six specific factors had the best fit and confirmed the factor structure of SCS-Y. Internal consistencies were good, except for the subscale mindfulness for boys which was questionable. Three-week test-retest reliability was good. We found measurement invariance for age and no equivalence for sex. Evidence was found for convergent and divergent validity using correlations. Sex differences were found: girls scored higher on self-judgement, feelings of isolation and showed more over-identification, than boys.Conclusions: The Swedish version of SCS-Y (SCS-Y-SE) is a reliable and valid self-report questionnaire, with some limitations, to assess self-compassion in clinical practice and research.
|
|
| 29. |
|
|
| 30. |
- Henriksson, Widar, 1943-, et al.
(author)
-
The Swedish driving-license test : A summary of studies from the department of educational measurement
- 2004
-
Reports (other academic/artistic)abstract
- Since 1990, the Department of Educational Measurement at Umeå University has been commissioned to study the Swedish drivinglicense test by the Swedish National Road Administration, SNRA. Over the past few years several studies have been conducted in order to develop and improve the Swedish driving-license test. The focus of the majority of the studies has been the theory test. The aims of this paper were threefold: firstly to describe the development of the driver education and the driving-license test in Sweden during the past century; secondly, to summarize the findings of our research, which is related to important issues in test development; and finally, to make some suggestions for further research.
|
|
| 31. |
- Häggström, Jenny, et al.
(author)
-
Optimal Bandwidth Selection in Observed-Score Kernel Equating
- 2014
-
In: Journal of educational measurement. - : Wiley. - 0022-0655 .- 1745-3984. ; 51:2, s. 201-211
-
Journal article (peer-reviewed)abstract
- The selection of bandwidth in kernel equating is important because it has a direct impact on the equated test scores. The aim of this article is to examine the use of double smoothing when selecting bandwidths in kernel equating and to compare double smoothing with the commonly used penalty method. This comparison was made using both an equivalent groups design and a nonequivalent group with anchor test design. The performance of the methods was evaluated through simulation studies using both symmetric and skewed score distributions. In addition, the bandwidth selection methods were applied to real data from a college admissions test. The results show that the traditional penalty method works well although double smoothing is a viable alternative because it performs reasonably well compared to the traditional method.
|
|
| 32. |
- Jonasson, Maria, et al.
(author)
-
Sexual harassment and patterns of symptoms and functional abilities in a psychiatric sample of adolescents
- 2024
-
In: Nordic Journal of Psychiatry. - : Taylor & Francis Group. - 0803-9488 .- 1502-4725. ; 78:4, s. 290-300
-
Journal article (peer-reviewed)abstract
- PURPOSE: To investigate how commonly adolescent psychiatric outpatients with symptoms of depression and anxiety report having been subjected to sexual harassment, and to explore how symptoms and functional abilities differ between adolescent psychiatric outpatients with symptoms of depression and anxiety who do report and those who do not report having been subjected to sexual harassment.METHODS: Swedish adolescent psychiatric outpatients with symptoms of depression or anxiety (n = 324; 66 boys and 258 girls, aged 12-19 years, M = 15.6, SD = 1.7) answered the PROMIS paediatric measures. Logistic regression analyses were performed to assess differences between the respondents classified as 'Sexually harassed' and 'Not sexually harassed' based on these self-report questionnaires.RESULTS: About 60% of the adolescents reported having been subjected to sexual harassment, and reported higher levels of suicidal ideation, disturbed sleep, fatigue, anxiety, depression, anger, and pain interference, as well as lower functional ability in terms of school problems, alcohol consumption, and poor family relationships. Logistic regression analyses showed that the strongest associations were with suicidal ideation, disturbed sleep, anger, and alcohol consumption.CONCLUSIONS: About 60% of the adolescents in the studied psychiatric cohort reported having been subjected to sexual harassment. Reported experiences were high in all three subtypes, with the most reports on having been subjected to verbal harassment. Clinicians should ask about experiences of sexual harassment and give information about the consequences of sexual violence and treatment options. Alcohol consumption should be addressed and tested for. Structured assessment of suicidality should always be done.
|
|
| 33. |
- Laukaityte, Inga, 1980-, et al.
(author)
-
Impacts of differences in group abilities and anchor test features on three non-IRT test equating methods
- 2024
-
In: Practical Assessment, Research, and Evaluation. - : University of Massachusetts Press. - 1531-7714. ; 29:5
-
Journal article (peer-reviewed)abstract
- The overall aim was to examine effects of differences in group ability and features of the anchor test formon equating bias and the standard error of equating (SEE) using both real and simulated data. Chainedkernel equating, Postratification kernel equating, and Circle-arc equating were studied. A collegeadmissions test with four different anchor test forms administered at three test administrations was used.The simulation study examined the differences in ability of the test groups, and differences in the anchortest form with respect to item difficulty and discrimination. In the empirical study, the equated valuesfrom the three methods only slightly differed. The simulation study indicated that an easier anchor testform and/or an easier regular test form, and anchor items with a wider spread in difficulty, negativelyaffected the SEE and bias. The ability level of groups was also important. Equating with only less or morecapable groups resulted in high SEEs at higher and lower test scores, respectively. The discussion includespractical recommendations to whom an anchor test should be given if there is a choice and how to selectan anchor test form which have equating as primary purpose.
|
|
| 34. |
- Laukaityte, Inga, 1980-, et al.
(author)
-
TIMSS vs. PISA: what can they tell us about student success?—a comparison of Swedish and Norwegian TIMSS and PISA 2015 results with a focus on school factors
- 2024
-
In: Frontiers in Education. - : Frontiers Media S.A.. - 2504-284X. ; 9
-
Journal article (peer-reviewed)abstract
- This paper explores the measurement capabilities of the Trends in International Mathematics and Science Study (TIMSS) and the Program for International Student Assessment (PISA) in assessing school factors that influence student performance. We specifically focus on the 2015 assessments of the science performance of eighth graders in Sweden and Norway. This was the latest year when the two assessments were conducted in the same year and science was the major subject area in the PISA assessment, which was essential for maximizing the assessments’ comparability. Using multilevel models, the study identifies common and unique factors across the assessments and investigates the factors that influence student performance at different proficiency levels. The findings highlight the importance of school-level factors, which are significant in both assessments. Moreover, both assessments provide information on overlapping sets of factors that have varying influence on the performance of students with different proficiency levels. Overall, there are limited common factors between TIMSS and PISA. School factors vary between low-performing and high-performing schools, with differing significance in Norway and Sweden. The results indicate that TIMSS and PISA assessments offer complementary information, particularly for low-performing schools. Our findings suggest that different school types may benefit or suffer from distinct school factors. The findings are relevant for both educational professionals and policy-makers.
|
|
| 35. |
- Leôncio, Waldir, et al.
(author)
-
Evaluating equating transformations from different frameworks
- 2018
-
In: Quantitative psychology. - Cham, Switzerland : Springer. - 9783319772486 - 9783319772493 ; , s. 101-110
-
Book chapter (peer-reviewed)abstract
- Test equating is used to ensure that test scores from different test forms can be used interchangeably. This paper aims to compare the statistical and computational properties from three equating frameworks: item response theory observed-score equating (IRTOSE), kernel equating and kernel IRTOSE. The real data applications suggest that IRT-based frameworks tend to providemore stable and accurate results than kernel equating. Nonetheless, kernel equating can provide satisfactory results if we can find a good model for the data, while also being much faster than the IRT-based frameworks. Our general recommendation is to try all methods and examine how much the equated scores change, always ensuring that the assumptions are met and that a good model for the data can be found.
|
|
| 36. |
- Leôncio, Waldir, et al.
(author)
-
Evaluating equating transformations in IRT observed-score and Kernel Equating methods
- 2023
-
In: Applied psychological measurement. - : Sage Publications. - 0146-6216 .- 1552-3497. ; 47:2, s. 123-140
-
Journal article (peer-reviewed)abstract
- Test equating is a statistical procedure to ensure that scores from different test forms can be used interchangeably. There are several methodologies available to perform equating, some of which are based on the Classical Test Theory (CTT) framework and others are based on the Item Response Theory (IRT) framework. This article compares equating transformations originated from three different frameworks, namely IRT Observed-Score Equating (IRTOSE), Kernel Equating (KE), and IRT Kernel Equating (IRTKE). The comparisons were made under different data-generating scenarios, which include the development of a novel data-generation procedure that allows the simulation of test data without relying on IRT parameters while still providing control over some test score properties such as distribution skewness and item difficulty. Our results suggest that IRT methods tend to provide better results than KE even when the data are not generated from IRT processes. KE might be able to provide satisfactory results if a proper pre-smoothing solution can be found, while also being much faster than IRT methods. For daily applications, we recommend observing the sensibility of the results to the equating method, minding the importance of good model fit and meeting the assumptions of the framework.
|
|
| 37. |
- Li, Juan, et al.
(author)
-
TestGardener : a program for optimal scoring and graphical analysis
- 2019
-
In: Quantitative psychology. - New York : Springer. - 9783030013097 - 9783030013103 ; , s. 87-94
-
Book chapter (peer-reviewed)abstract
- The aim of this paper is to demonstrate how to use TestGardener to analyze testing data with various item types and explain some main displays. TestGardener is a software designed to aid the development, evaluation, and use of multiple choice examinations, psychological scales, questionnaires, and similar types of data. This software implements the optimal scoring of binary and multi-option items, and uses spline smoothing to obtain item characteristics curves (ICCs) that better fit the real data. Using TestGardner does not require any programming skill or formal statistical knowledge, which will make optimal scoring and item response theory more approachable for test analysts, test developers, researchers, and general public.
|
|
| 38. |
- Lyrén, Per-Erik, 1976-
(author)
-
A perfect score : Validity arguments for college admission tests
- 2009
-
Doctoral thesis (other academic/artistic)abstract
- College admission tests are of great importance for admissions systems in general and for candidates in particular. The SweSAT (Högskoleprovet in Swedish) has been used for college admission in Sweden for more than 30 years, and today it is alongside with the upper-secondary school GPA the most widely used instrument for selection of college applicants. Because of the importance that is placed on the SweSAT, it is essential that the scores are reliable and that the interpretations and uses of the scores are valid. The main purpose of this thesis was therefore to examine some assumptions that are of importance for the validity of the interpretation and use of SweSAT scores. The argument-based approach to validation was used as the framework for the evaluation of these assumptions.The thesis consists of four papers and an extensive introduction with summaries of the papers. The first three papers examine assumptions that are relevant for the use of SweSAT scores for admission decisions, while the fourth paper examines an assumption that is relevant for the use of SweSAT scores for providing diagnostic information. The first paper is a review of predictive validity studies that have been performed on the SweSAT. The general conclusion from the review is that the predictive validity of SweSAT scores varies greatly among study programs, and that there are many problematic issues related to the methodology of the predictive validity studies. The second paper focuses on an assumption underlying the current SweSAT equating design, namely that the groups taking different forms of the test have equal abilities. The results show that this assumption is highly problematic, and consequently a more appropriate equating design should be applied when equating SweSAT scores. The third paper examines the effect of textual item revisions on item statistics and preequating outcomes, using data from the SweSAT data sufficiency subtest. The results show that most kinds of revisions have a significant effect on both p-values and point-biserial correlations, and as a consequence the preequating outcomes are affected negatively. The fourth paper examines whether there is added value in reporting subtest scores rather than just the total score to the test-takers. Using a method derived from classical test theory, the results show that all observed subscores are better predictors of the true subscores than is the observed total score, with the exception of the Swedish reading comprehension subtest. That is, the subscores contain information that the test-takers can use for remedial studies and hence there is added value in reporting the subscores. The general conclusion from the thesis as a whole is that the interpretations and use of SweSAT scores are based on several questionable assumptions, but also that the interpretations and uses are supported by a great deal of validity evidence.
|
|
| 39. |
-
Medborgarskap & digitalisering : en utställning om vardagslivets digitala utmaningar
- 2023
-
Artistic workabstract
- Utställningen ”Medborgarskap & digitalisering” gestaltar i olika media de digitala utmaningar vi som medborgare möter i vardagen och har hämtat inspiration från forskning som bedrivs vid LiU av forskargruppen DINO. DINO - Digitalisering i nya offentligheter vid Institutionen för ekonomisk och industriell utveckling (IEI) - studerar hur digitalisering av offentliga tjänster påverkar oss som samhällsmedborgare. Forskargruppen undersöker digitaliseringens effekter på det offentliga samtalet och hur offentliga tjänster görs tillgängliga på nya sätt. En viktig del av deras forskning är också att studera vilka som riskerar att hamna utanför och varför. I många fall blir folkbibliotek ett slags stödfunktion i vardagliga situationer när teknik inte fungerar eller inte är tillgänglig så att medborgare kan agera som aktiva aktörer i samhället. DINO:s studier av de frågor om digitala problem som besökare på biblioteken kommer med har visat att dessa problem påverkar människors möjligheter att agera som medborgare. Det kan till exempel handla om att hantera olika e-tjänster, såsom att boka en tid på vårdcentralen, att betala räkningar, att söka jobb, eller att hantera sitt busskort för att åka kollektivtrafik. Med utgångspunkt i denna forskning presenterar utställningen olika situationer och händelser kopplade till vardagens digitala utmaningar.
|
|
| 40. |
|
|
| 41. |
-
Quantitative psychology : the 82nd annual meeting of the Psychometric Society, Zurich, Switzerland, 2017
- 2018
-
Editorial proceedings (peer-reviewed)abstract
- This proceedings book highlights the latest research and developments in psychometrics and statistics. Featuring contributions presented at the 82nd Annual Meeting of the Psychometric Society (IMPS), organized by the University of Zurich and held in Zurich, Switzerland from July 17 to 21, 2017, its 34 chapters address a diverse range of psychometric topics including item response theory, factor analysis, causal inference, Bayesian statistics, test equating, cognitive diagnostic models and multistage adaptive testing. The IMPS is one of the largest international meetings on quantitative measurement in psychology, education and the social sciences, attracting over 500 participants and 250 paper presentations from around the world every year. This book gathers the contributions of selected presenters, which were subsequently expanded and peer-reviewed.
|
|
| 42. |
|
|
| 43. |
|
|
| 44. |
|
|
| 45. |
-
Quantitative psychology : the 85th annual meeting of the Psychometric Society, virtual
- 2021
-
Editorial proceedings (peer-reviewed)abstract
- This proceedings volume highlights the latest research and developments in psychometrics and statistics. It represents selected and peer-reviewed presentations given at the 85th Annual International Meeting of the Psychometric Society (IMPS), held virtually on July 13-17, 2020. The IMPS is one of the largest international meetings on quantitative measurement in education, psychology and the social sciences. It draws approximately 500 participants from around the world, featuring paper and poster presentations, symposiums, workshops, keynotes, and invited presentations. Leading experts and promising young researchers have written the included chapters. The chapters address a wide variety of topics including but not limited to item response theory, adaptive testing, Bayesian estimation, propensity scores, and cognitive diagnostic models. This volume is the 9th in a series of recent works to cover research presented at the IMPS.
|
|
| 46. |
-
Quantitative psychology research : the 80th annual meeting of the psychometric society, Beijing, 2015
- 2016
-
Editorial proceedings (peer-reviewed)abstract
- The research articles in this volume cover timely quantitative psychology topics, including new methods in item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Topics within general quantitative methodology include structural equation modeling, factor analysis, causal modeling, mediation, missing data methods, and longitudinal data analysis. These methods will appeal, in particular, to researchers in the social sciences. The 80th annual meeting took place in Beijing, China, between the 12th and 16th of July, 2015.
|
|
| 47. |
- Ramsay, James, et al.
(author)
-
Full Information Optimal Scoring
- 2020
-
In: Journal of educational and behavioral statistics. - : Sage Publications. - 1076-9986 .- 1935-1054. ; 45:3, s. 297-315
-
Journal article (peer-reviewed)abstract
- Ramsay and Wiberg used a new version of item response theory that represents test performance over nonnegative closed intervals such as [0, 100] or [0, n] and demonstrated that optimal scoring of binary test data yielded substantial improvements in point-wise root-mean-squared error and bias over number right or sum scoring. We extend these results by showing that optimal scoring of the full information in option choices produces about as much further improvement in these measures of score performance as was achieved by going from sum scoring to optimal binary scoring.
|
|
| 48. |
- Ramsay, James O., et al.
(author)
-
Better rating scale scores with information–based psychometrics
- 2020
-
In: Psych. - : MDPI. - 2624-8611. ; 2:4, s. 347-369
-
Journal article (peer-reviewed)abstract
- Diagnostic scales are essential to the health and social sciences, and to the individuals that provide the data. Although statistical models for scale data have been researched for decades, it remains nearly universal that scale scores are sums of weights assigned a priori to question choice options (sum scores), respectively. We propose several modifications of psychometric testing theory that together demonstrate remarkable improvements in the quality of rating scale scores. Our model represents performance as a space with a metric structure by transforming probability into surprisal or information. The estimation algorithm permits the analysis of data from tens and hundreds of thousands of test takers in a few minutes on consumer level computing equipment. Standard errors of performance estimates are shown to be as small as a quarter of those of sum scores. Open access software resources are presented.
|
|
| 49. |
- Ramsay, James O., et al.
(author)
-
Breaking through the sum scoring barrier
- 2017
-
In: Quantitative Psychology. - Cham : Springer. - 9783319562933 - 9783319562940 ; , s. 151-158
-
Conference paper (peer-reviewed)abstract
- The aim of this paper is to reflect around what would be needed in order to replace sum scoring, including technical advances, communivation with both test constructors and examinees, and organizational strategy. Sum scoring are proposed to be replaces by smart scoring and a brief description, and some theoretical support for smart scoring and methods for achieving it are given together with an example from a large-scale assessment test.
|
|
| 50. |
- Ramsay, James, et al.
(author)
-
Workshop: Learning More from Test Data: New Tools for Test Scoring
- 2019
-
Conference paper (other academic/artistic)abstract
- The aim of scoring a test is to give as best estimate of an examinee’s ability as possible. The goals of this training session are for the attendees to be able to understand and implement optimal test scoring, and to interpret the results of optimal scoring in a reasonable way. In this training session, we will demonstrate and guide the attendees to use the web-based software TestGardener to implement optimal test scoring on real educational test data. Most of the outputs of this software are in graphical form, and the software is used interactively. The main part of the training session is devoted to practical exercises in how to analyze test data. Optimal scoring will also be compared with the traditional sum scoring, and recent developments in test scoring will be discussed. Expected audience include researchers, graduate students and practitioners. An introductory statistical background is recommended but not required. Please note, programming knowledge is not required.
|
|
