| 1. |
- Bränberg, Kenny, et al.
(författare)
-
Observed score linear equating with covariates
- 2011
-
Ingår i: Journal of educational measurement. - East Lansing, Mich. : National Council on Measurement in Education. - 0022-0655 .- 1745-3984. ; 48:4, s. 419-440
-
Tidskriftsartikel (refereegranskat)abstract
- This paper examined observed score linear equating in two different data collection designs, the equivalent groups design and the nonequivalent groups design, when information from covariates (i.e. background variables correlated with the test scores) was included. The main purpose of the study was to examine the effect (i.e. bias, variance, and mean square error) on the estimators of including this additional information. A model for observed-score linear equating with covariates first was suggested. As a second step, the model was used in a simulation study to show that the use of covariates such as gender and education can increase the accuracy of an equating by reducing the mean squared error of the estimators. Finally, data from two administrations of the Swedish Scholastic Assessment Test were used to illustrate the use of the model.
|
|
| 2. |
- Wiberg, Marie, 1976-, et al.
(författare)
-
Local linear observed-score equating
- 2011
-
Ingår i: Journal of educational measurement. - : Wiley. - 0022-0655 .- 1745-3984. ; 48:3, s. 229-254
-
Tidskriftsartikel (refereegranskat)abstract
- Two methods of local linear observed-score equating for use with anchor-test and single-group designs are introduced. In an empirical study, the two methods were compared with the current traditional linear methods for observed-score equating. As a criterion, the bias in the equated scores relative to true equating based on Lord’s (1980) definition of equity was used. The local method for the anchor-test design yielded minimum bias, even for considerable variation of the relative difficulties of the two test forms and the length of the anchor test. Among the traditional methods, the method of chain equating performed best. The local method for singlegroup designs yielded equated scores with bias comparable to the traditional methods. This method, however, appears to be of theoretical interest because it forces us to rethink the relationship between score equating and regression.
|
|
| 3. |
- Andersson, Björn, 1984-, et al.
(författare)
-
Improving the Bandwidth Selection in Kernel Equating
- 2014
-
Ingår i: Journal of educational measurement. - : Blackwell Publishing. - 0022-0655 .- 1745-3984. ; 51:3, s. 223-238
-
Tidskriftsartikel (refereegranskat)abstract
- We investigate the current bandwidth selection methods in kernel equating and propose a method based on Silverman's rule of thumb for selecting the bandwidth parameters. In kernel equating, the bandwidth parameters have previously been obtained by minimizing a penalty function. This minimization process has been criticized by practitioners for being too complex and that it does not offer sufficient smoothing in certain cases. In addition, the bandwidth parameters have been treated as constants in the derivation of the standard error of equating even when they were selected by considering the observed data. Here, the bandwidth selection is simplified, and modified standard errors of equating (SEEs) that reflect the bandwidth selection method are derived. The method is illustrated with real data examples and simulated data.
|
|
| 4. |
- Häggström, Jenny, et al.
(författare)
-
Optimal Bandwidth Selection in Observed-Score Kernel Equating
- 2014
-
Ingår i: Journal of educational measurement. - : Wiley. - 0022-0655 .- 1745-3984. ; 51:2, s. 201-211
-
Tidskriftsartikel (refereegranskat)abstract
- The selection of bandwidth in kernel equating is important because it has a direct impact on the equated test scores. The aim of this article is to examine the use of double smoothing when selecting bandwidths in kernel equating and to compare double smoothing with the commonly used penalty method. This comparison was made using both an equivalent groups design and a nonequivalent group with anchor test design. The performance of the methods was evaluated through simulation studies using both symmetric and skewed score distributions. In addition, the bandwidth selection methods were applied to real data from a college admissions test. The results show that the traditional penalty method works well although double smoothing is a viable alternative because it performs reasonably well compared to the traditional method.
|
|
| 5. |
- Ul Hassan, Mahmood, 1979-, et al.
(författare)
-
Optimal Calibration of Items for Multidimensional Achievement Tests
- 2024
-
Ingår i: Journal of educational measurement. - : WILEY. - 0022-0655 .- 1745-3984.
-
Tidskriftsartikel (refereegranskat)abstract
- Multidimensional achievement tests are recently gaining more importance in educational and psychological measurements. For example, multidimensional diagnostic tests can help students to determine which particular domain of knowledge they need to improve for better performance. To estimate the characteristics of candidate items (calibration) for future multidimensional achievement tests, we use optimal design theory. We generalize a previously developed exchange algorithm for optimal design computation to the multidimensional setting. We also develop an asymptotic theorem saying which item should be calibrated by examinees with extreme abilities. For several examples, we compute the optimal design numerically with the exchange algorithm. We see clear structures in these results and explain them using the asymptotic theorem. Moreover, we investigate the performance of the optimal design in a simulation study.
|
|
| 6. |
- Wiberg, Marie, 1976-, et al.
(författare)
-
Local Observed-Score Kernel Equating
- 2014
-
Ingår i: Journal of educational measurement. - : Wiley. - 0022-0655 .- 1745-3984. ; 51:1, s. 57-74
-
Tidskriftsartikel (refereegranskat)abstract
- Three local observed-score kernel equating methods that integrate methods from the local equating and kernel equating frameworks are proposed. The new methods were compared with their earlier counterparts with respect to such measures as biasas defined by Lord's criterion of equityand percent relative error. The local kernel item response theory observed-score equating method, which can be used for any of the common equating designs, had a small amount of bias, a low percent relative error, and a relatively low kernel standard error of equating, even when the accuracy of the test was reduced. The local kernel equating methods for the nonequivalent groups with anchor test generally had low bias and were quite stable against changes in the accuracy or length of the anchor test. Although all proposed methods showed small percent relative errors, the local kernel equating methods for the nonequivalent groups with anchor test design had somewhat larger standard error of equating than their kernel method counterparts.
|
|
| 7. |
- Wiberg, Marie, 1976-, et al.
(författare)
-
Statistical Assessment of Estimated Transformations in Observed-Score Equating
- 2016
-
Ingår i: Journal of educational measurement. - : John Wiley & Sons. - 0022-0655 .- 1745-3984. ; 53:1, s. 106-125
-
Tidskriftsartikel (refereegranskat)abstract
- Equating methods make use of an appropriate transformation function to map the scores of one test form into the scale of another so that scores are comparable and can be used interchangeably. The equating literature shows that the ways of judging the success of an equating (i.e., the score transformation) might differ depending on the adopted framework. Rather than targeting different parts of the equating process and aiming to evaluate the process from different aspects, this article views the equating transformation as a standard statistical estimator and discusses how this estimator should be assessed in an equating framework. For the kernel equating framework, a numerical illustration shows the potentials of viewing the equating transformation as a statistical estimator as opposed to assessing it using equating-specific criteria. A discussion on how this approach can be used to compare other equating estimators from different frameworks is also included.
|
|
