| 1. |
- Jones, Grace, et al.
(författare)
-
Relating estimates of wood properties of birch to stem form, age and species
- 2024
-
Ingår i: Journal of Forestry Research. - : Springer. - 1007-662X .- 1993-0607. ; 35:1
-
Tidskriftsartikel (refereegranskat)abstract
- Birch has long suffered from a lack of active forest management, leading many researchers to use material without a detailed management history. Data collected from three birch (Betula pendula Roth, B. pubescens Ehrh.) sites in southern Sweden were analyzed using regression analysis to detect any trends or differences in wood properties that could be explained by stand history, tree age and stem form. All sites were genetics trials established in the same way. Estimates of acoustic velocity (AV) from non-destructive testing (NDT) and predicted AV had a higher correlation if data was pooled across sites and other stem form factors were considered. A subsample of stems had radial profiles of X-ray wood density and ring width by year created, and wood density was related to ring number from the pith and ring width. It seemed likely that wood density was negatively related to ring width for both birch species. Linear models had slight improvements if site and species were included, but only the youngest site with trees at age 15 had both birch species. This paper indicated that NDT values need to be considered separately, and any predictive models will likely be improved if they are specific to the site and birch species measured.
|
|
| 2. |
- Ulan, Maria, et al.
(författare)
-
Aggregation as Unsupervised Learning and its Evaluation
-
Annan publikation (övrigt vetenskapligt/konstnärligt)abstract
- Regression uses supervised machine learning to find a model that combines several independent variables to predict a dependent variable based on ground truth (labeled) data, i.e., tuples of independent and dependent variables (labels). Similarly, aggregation also combines several independent variables to a dependent variable. The dependent variable should preserve properties of the independent variables, e.g., the ranking or relative distance of the independent variable tuples, and/or represent a latent ground truth that is a function of these independent variables. However, ground truth data is not available for finding the aggregation model. Consequently, aggregation models are data agnostic or can only be derived with unsupervised machine learning approaches.We introduce a novel unsupervised aggregation approach based on intrinsic properties of unlabeled training data, such as the cumulative probability distributions of the single independent variables and their mutual dependencies.For assessing this against other aggregation approaches, two perspectives are relevant: (i) how well the aggregation output represents properties of the input tuples, and (ii) how well can aggregated output predict a latent ground truth. We present an empirical evaluation framework that allows to evaluate aggregation approaches from both perspectives. To this end, we use data sets for assessing supervised regression approaches that contain explicit ground truth labels. However, the ground truth is not used for deriving the aggregation models, but it allows for the assessment from a perspective (ii). More specifically, we use regression data sets from the UCI machine learning repository and benchmark several data-agnostic and unsupervised approaches for aggregation against ours.The benchmark results indicate that our approach outperforms the other data-agnostic and unsupervised aggregation approaches. It is almost on par with linear regression.
|
|
| 3. |
- Ulan, Maria
(författare)
-
Aggregation as Unsupervised Learning in Software Engineering and Beyond
- 2021
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Ranking alternatives is fundamental to effective decision making. However, creating an overall ranking is difficult if there are multiple criteria, and no single alternative performs best across all criteria. Software engineering is no exception.Software quality is usually decomposed hierarchically into characteristics, and their quality can be assessed by various direct and indirect metrics. Although such quality models provide a basic understanding of what data to collect and which metrics to use, it is not clear how the metrics should be combined to assess the overall quality. Due to different approaches for aggregation of metrics, the same quality model and the same metrics for assessing the same software artifact could still lead to different assessment results and even to different interpretations.The proposed aggregation approach in this thesis is well-defined, interpretable, and applicable under realistic conditions. This approach can turn the quality- model- and metric-based assessment of (software) quality into a reliable and reproducible process. We express quality as the probability of detecting something with equal or worse quality, based on all software artifacts observed; good and bad quality is expressed in terms of lower and higher probabilities. We validated our approach theoretically and empirically. We conducted empirical studies on Bug prediction, Maintainability assessment, and Information Quality.We used Software Visualization to analyze the usability of aggregation for analyzing multivariate data in general and the effect of different alternative aggregation approaches, i.e., we designed and implemented an exploratory multivariate data visualization tool.Finally, we applied our approach to Multi-criteria Ranking to evaluate its transferability to other domains. We evaluated it on a real-world decision-making problem for assessment and ranking of alternatives. Moreover, we applied our approach to the context of Machine Learning. We created a benchmark from a collection of regression problems, and evaluated how well the aggregation output agrees with a ground truth, and how well it represents the properties of the input variables.The results showed that our approach is not only theoretically sound, it is also accurate, sensitive, identifies anomalies, scales in performance, and can support multi-criteria decision making. Furthermore, our approach is transferable to other domains that require aggregation in hierarchically structured models, and it can be used as an agnostic unsupervised predictor in the absence of a ground truth.
|
|
| 4. |
- Ulan, Maria, et al.
(författare)
-
AI-baserad säkerhet på byggarbetsplatser
- 2023
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- AI-baserad säkerhet på byggarbetsplatser har varit ett ett-årigt projekt som genomförts för att förbättra säkerheten på anläggnings- och byggarbetsplatser genom användning av AI-teknologi. Projektet har varit ett samarbete mellan RISE Research Institutes of Sweden, NCC, Ramirent, Skanska och Viscando. Målet var att identifiera och analysera risker på arbetsplatserna med hjälp av sensorer och AI-modeller för att kunna förutsäga farliga situationer och utveckla lösningar för att förbättra säkerheten. Genom observationer, intervjuer och datainsamling med 3D-sensorer analyserades beteendemönster och riskområden på utvalda byggarbetsplatser. Resultaten användes sedan för att kommunicera och utveckla konkreta lösningar för att minska riskerna. Rapporten ger en översikt av metodologin, datainsamlings- och analysprocessen samt betonar vikten av att förstå både teknologins möjligheter och begränsningar för att skapa en säkrare arbetsmiljö på byggarbetsplatser.
|
|
| 5. |
- Ulan, Maria, et al.
(författare)
-
Artifact: Quality Models Inside Out : Interactive Visualization of Software Metrics by Means of Joint Probabilities
- 2018
-
Annan publikation (mjukvara/multimedium) (refereegranskat)abstract
- Assessing software quality, in general, is hard; each metric has a different interpretation, scale, range of values, or measurement method. Combining these metrics automatically is especially difficult, because they measure different aspects of software quality, and creating a single global final quality score limits the evaluation of the specific quality aspects and trade-offs that exist when looking at different metrics. We present a way to visualize multiple aspects of software quality. In general, software quality can be decomposed hierarchically into characteristics, which can be assessed by various direct and indirect metrics. These characteristics are then combined and aggregated to assess the quality of the software system as a whole. We introduce an approach for quality assessment based on joint distributions of metrics values. Visualizations of these distributions allow users to explore and compare the quality metrics of software systems and their artifacts, and to detect patterns, correlations, and anomalies. Furthermore, it is possible to identify common properties and flaws, as our visualization approach provides rich interactions for visual queries to the quality models’ multivariate data. We evaluate our approach in two use cases based on: 30 real-world technical documentation projects with 20,000 XML documents, and an open source project written in Java with 1000 classes. Our results show that the proposed approach allows an analyst to detect possible causes of bad or good quality.
|
|
| 6. |
- Ulan, Maria, et al.
(författare)
-
Copula-based software metrics aggregation
- 2021
-
Ingår i: Software quality journal. - : Springer. - 0963-9314 .- 1573-1367. ; 29, s. 863-899
-
Tidskriftsartikel (refereegranskat)abstract
- A quality model is a conceptual decomposition of an abstract notion of quality into relevant, possibly conflicting characteristics and further into measurable metrics. For quality assessment and decision making, metrics values are aggregated to characteristics and ultimately to quality scores. Aggregation has often been problematic as quality models do not provide the semantics of aggregation. This makes it hard to formally reason about metrics, characteristics, and quality. We argue that aggregation needs to be interpretable and mathematically well defined in order to assess, to compare, and to improve quality. To address this challenge, we propose a probabilistic approach to aggregation and define quality scores based on joint distributions of absolute metrics values. To evaluate the proposed approach and its implementation under realistic conditions, we conduct empirical studies on bug prediction of ca. 5000 software classes, maintainability of ca. 15000 open-source software systems, and on the information quality of ca. 100000 real-world technical documents. We found that our approach is feasible, accurate, and scalable in performance.
|
|
| 7. |
- Ulan, Maria
(författare)
-
Foundation of Multi-Criteria Quality Scoring
- 2019
-
Licentiatavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Software quality becomes more critical as our dependence on software increases. We need better quality assessment than ever. Comparison and ranking of software artifacts, detection of bad or good quality are important tasks for quality assessment.Software quality models are widely used to support quality assessment. In general, they have a hierarchical structure and defines quality in terms of sub-qualities and metrics in a tree-like structure. Different metrics evaluate different quality criteria, and several metrics often needs to be assessed and aggregated to obtain a total quality score. The quality models standards of today do not enable numerical metrics aggregation. They leave aggregation to decision makers, and different methods of aggregation lead to different assessment results and interpretations. Hence, there is a need to define metrics aggregation formally based on well-known theories.We propose to consider the probabilistic nature of quality as a solution. We consider metrics as random variables and define quality scores based on joint probabilities. The aggregation, and the quality model in extension, express quality as the probability of detecting something with equal or worse quality, based on all software projects observed; good and bad quality is expressed in terms of lower and higher probabilities. We analyze metrics dependencies using Bayesian networks and define quality models as directed acyclic graphs. Nodes correspond to metrics, and edges indicate dependencies. We propose an implementation using multi-threading to improve the efficiency of joint probabilities computations.We validate our approach theoretically and in an empirical study on software quality assessment of approximately 100\,000 real-world software artifacts with approximately 4\,000\,000 measurements in total. The results show that our approach gives likely results and scales in performance to large projects.We also applied our approach to a multi-criteria decision-making task to propose a ranking method to aid evaluation processes. We use a real-world funding allocation problem for a call that attracted approximately 600 applications to evaluate our approach. We compared our approach with the traditional weighted sum aggregation model and found that ranks are similar between the two methods, but our approach provides a more sound basis for a fair assessment.Further, we implemented an exploratory multivariate data visualization tool, which visualizes the similarities between software artifacts based on joint distributions. We illustrate the usability of our tool with two case studies of real-world examples: a set of technical documents and an open source project written in Java.Our overall results show that our approach for multi-criteria quality scoring is well-defined, has a clear interpretation, and is applicable under realistic conditions, generalizable, and transferable to other domains.
|
|
| 8. |
- Ulan, Maria, et al.
(författare)
-
Introducing Quality Models Based On Joint Probabilities : Introducing Quality Models Based On Joint Probabilities
- 2018
-
Ingår i: ICSE '18 Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings. - New York, NY, USA : IEEE. - 9781450356633 ; , s. 216-217
-
Konferensbidrag (refereegranskat)abstract
- Multi-dimensional goals can be formalized in so-called quality models. Often, each dimension is assessed with a set of metrics that are not comparable; they come with different units, scale types, and distributions of values. Aggregating the metrics to a single quality score in an ad-hoc manner cannot be expected to provide a reliable basis for decision making. Therefore, aggregation needs to be mathematically well-defined and interpretable. We present such a way of defining quality models based on joint probabilities. We exemplify our approach using a quality model with 30 standard metrics assessing technical documentation quality and study ca. 20,000 real-world files. We study the effect of several tests on the independence and results show that metrics are, in general, not independent. Finally, we exemplify our suggested definition of quality models in this domain.
|
|
| 9. |
- Ulan, Maria, et al.
(författare)
-
Multi-criteria Ranking Based on Joint Distributions : A Tool to Support Decision Making
- 2019
-
Ingår i: Perspectives in Business Informatics Research.BIR 2019. - Cham : Springer. - 9783030311421 - 9783030311438 ; , s. 74-88
-
Konferensbidrag (refereegranskat)abstract
- Sound assessment and ranking of alternatives are fundamental to effective decision making. Creating an overall ranking is not trivial if there are multiple criteria, and none of the alternatives is the best according to all criteria. To address this challenge, we propose an approach that aggregates criteria scores based on their joint (probability) distribution and obtains the ranking as a weighted product of these scores. We evaluate our approach in a real-world use case based on a funding allocation problem and compare it with the traditional weighted sum aggregation model. The results show that the approaches assign similar ranks, while our approach is more interpretable and sensitive.
|
|
| 10. |
- Ulan, Maria, et al.
(författare)
-
Quality Models Inside Out : Interactive Visualization of Software Metrics by Means of Joint Probabilities
- 2018
-
Ingår i: Proceedings of the 2018 Sixth IEEE Working Conference on Software Visualization, (VISSOFT), Madrid, Spain, 2018. - : IEEE. - 9781538682920 - 9781538682937 ; , s. 65-75
-
Konferensbidrag (refereegranskat)abstract
- Assessing software quality, in general, is hard; each metric has a different interpretation, scale, range of values, or measurement method. Combining these metrics automatically is especially difficult, because they measure different aspects of software quality, and creating a single global final quality score limits the evaluation of the specific quality aspects and trade-offs that exist when looking at different metrics. We present a way to visualize multiple aspects of software quality. In general, software quality can be decomposed hierarchically into characteristics, which can be assessed by various direct and indirect metrics. These characteristics are then combined and aggregated to assess the quality of the software system as a whole. We introduce an approach for quality assessment based on joint distributions of metrics values. Visualizations of these distributions allow users to explore and compare the quality metrics of software systems and their artifacts, and to detect patterns, correlations, and anomalies. Furthermore, it is possible to identify common properties and flaws, as our visualization approach provides rich interactions for visual queries to the quality models’ multivariate data. We evaluate our approach in two use cases based on: 30 real-world technical documentation projects with 20,000 XML documents, and an open source project written in Java with 1000 classes. Our results show that the proposed approach allows an analyst to detect possible causes of bad or good quality.
|
|
