| 1. |
|
|
| 2. |
- Bernard, Olivier, et al.
(author)
-
Standardized evaluation system for left ventricular segmentation algorithms in 3D echocardiography.
- 2016
-
In: IEEE Transactions on Medical Imaging. - : Institute of Electrical and Electronics Engineers (IEEE). - 0278-0062 .- 1558-254X. ; 35:4, s. 967-977
-
Journal article (peer-reviewed)abstract
- Real-time 3D Echocardiography (RT3DE) has been proven to be an accurate tool for left ventricular (LV) volume assessment. However, identification of the LV endocardium remains a challenging task, mainly because of the low tissue/blood contrast of the images combined with typical artifacts. Several semi and fully automatic algorithms have been proposed for segmenting the endocardium in RT3DE data in order to extract relevant clinical indices, but a systematic and fair comparison between such methods has so far been impossible due to the lack of a publicly available common database. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms developed to segment the LV border in RT3DE. A database consisting of 45 multivendor cardiac ultrasound recordings acquired at different centers with corresponding reference measurements from 3 experts are made available. The algorithms from nine research groups were quantitatively evaluated and compared using the proposed online platform. The results showed that the best methods produce promising results with respect to the experts' measurements for the extraction of clinical indices, and that they offer good segmentation precision in terms of mean distance error in the context of the experts' variability range. The platform remains open for new submissions.
|
|
| 3. |
|
|
| 4. |
|
|
| 5. |
- Yang, Dazhi, et al.
(author)
-
Verification of deterministic solar forecasts
- 2020
-
In: Solar Energy. - : PERGAMON-ELSEVIER SCIENCE LTD. - 0038-092X .- 1471-1257. ; 210, s. 20-37
-
Journal article (peer-reviewed)abstract
- The field of energy forecasting has attracted many researchers from different fields (e.g., meteorology, data sciences, mechanical or electrical engineering) over the last decade. Solar forecasting is a fast-growing sub-domain of energy forecasting. Despite several previous attempts, the methods and measures used for verification of deterministic (also known as single-valued or point) solar forecasts are still far from being standardized, making forecast analysis and comparison difficult. To analyze and compare solar forecasts, the well-established Murphy-Winkler framework for distribution-oriented forecast verification is recommended as a standard practice. This framework examines aspects of forecast quality, such as reliability, resolution, association, or discrimination, and analyzes the joint distribution of forecasts and observations, which contains all time-independent information relevant to verification. To verify forecasts, one can use any graphical display or mathematical/statistical measure to provide insights and summarize the aspects of forecast quality. The majority of graphical methods and accuracy measures known to solar forecasters are specific methods under this general framework. Additionally, measuring the overall skillfulness of forecasters is also of general interest. The use of the root mean square error (RMSE) skill score based on the optimal convex combination of climatology and persistence methods is highly recommended. By standardizing the accuracy measure and reference forecasting method, the RMSE skill score allows-with appropriate caveats-comparison of forecasts made using different models, across different locations and time periods.
|
|
