| 1. |
- Avritzer, Alberto A., et al.
(författare)
-
A Multivariate Characterization and Detection of Software Performance Antipatterns
- 2021
-
Ingår i: ICPE 2021 - Proceedings of the ACM/SPEC International Conference on Performance Engineering. - New York, NY, USA : Association for Computing Machinery, Inc. - 9781450381949 ; , s. 61-72
-
Konferensbidrag (refereegranskat)abstract
- Context. Software Performance Antipatterns (SPAs) research has focused on algorithms for the characterization, detection, and solution of antipatterns. However, existing algorithms are based on the analysis of runtime behavior to detect trends on several monitored variables (e.g., response time, CPU utilization, and number of threads) using pre-defined thresholds. Objective. In this paper, we introduce a new approach for SPA characterization and detection designed to support continuous integration/delivery/deployment (CI/CDD) pipelines, with the goal of addressing the lack of computationally efficient algorithms. Method. Our approach includes SPA statistical characterization using a multivariate analysis approach of load testing experimental results to identify the services that have the largest impact on system scalability. More specifically, we introduce a layered decomposition approach that implements statistical analysis based on response time to characterize load testing experimental results. A distance function is used to match experimental results to SPAs. Results. We have instantiated the introduced methodology by applying it to a large complex telecom system. We were able to automatically identify the top five services that are scalability choke points. In addition, we were able to automatically identify one SPA. We have validated the engineering aspects of our methodology and the expected benefits by means of a domain experts' survey. Conclusion. We contribute to the state-of-The-Art by introducing a novel approach to support computationally efficient SPA characterization and detection in large complex systems using performance testing results. We have compared the computational efficiency of the proposed approach with state-of-The-Art heuristics. We have found that the approach introduced in this paper grows linearly, which is a significant improvement over existing techniques. © 2021 ACM.
|
|
| 2. |
- Avritzer, Alberto A., et al.
(författare)
-
PPTAMλ : What, Where, and How of Cross-domain Scalability Assessment
- 2021
-
Ingår i: Proceedings - 2021 IEEE 18th International Conference on Software Architecture Companion, ICSA-C 2021. - : Institute of Electrical and Electronics Engineers Inc.. - 9781665439107 ; , s. 62-69
-
Konferensbidrag (refereegranskat)abstract
- Software development ecosystems vary significantly among different industrial domains. Therefore, it is challenging to establish quality assurance processes that can be deployed seamlessly to multiple domains. In this paper, we extend our previous work on performance and scalability assessment by identifying the architecture variability points in our PPTAM tooling infrastructure. The goal is to design a modifiable software architecture that enables low cost deployment of our performance and scalability assessment approach. We present the scalability assessment context, architecture modifiability, and lessons learned that were derived from our experience with scalability assessment in several business domains. Specifically, we describe our experience with the application of the proposed approach to a large complex telecom system at Ericsson. © 2021 IEEE.
|
|
| 3. |
- Avritzer, Alberto, et al.
(författare)
-
Scalability testing automation using multivariate characterization and detection of software performance antipatterns
- 2022
-
Ingår i: Journal of Systems and Software. - : Elsevier. - 0164-1212 .- 1873-1228. ; 193
-
Tidskriftsartikel (refereegranskat)abstract
- Context: Software Performance Antipatterns (SPAs) research has focused on algorithms for their characterization, detection, and solution. Existing algorithms are based on the analysis of runtime behavior to detect trends on several monitored variables, such as system response time and CPU utilization. However, the lack of computationally efficient methods currently limits their integration into modern agile practices to detect SPAs in large scale systems. Objective: In this paper, we extended our previously proposed approach for the automated SPA characterization and detection designed to support continuous integration/delivery/deployment (CI/CDD) pipelines, with the goal of addressing the lack of computationally efficient algorithms. Method: We introduce a machine learning-based approach to improve the detection of SPA and interpretation of approach's results. The approach is complemented with a simulation-based methodology to analyze different architectural alternatives and measure the precision and recall of our approach. Our approach includes SPA statistical characterization using a multivariate analysis of load testing experimental results to identify the services that have the largest impact on system scalability. Results: To show the effectiveness of our approach, we have applied it to a large complex telecom system at Ericsson. We have built a simulation model of the Ericsson system and we have evaluated the introduced methodology by using simulation-based SPA injection. For this system, we are able to automatically identify the top five services that represent scalability choke points. We applied two machine learning algorithms for the automated detection of SPA. Conclusion: We contributed to the state-of-the-art by introducing a novel approach to support computationally efficient SPA characterization and detection that has been applied to a large complex system using performance testing data. We have compared the computational efficiency of the proposed approach with state-of-the-art heuristics. We have found that the approach introduced in this paper grows linearly, which is a significant improvement over existing techniques. © 2022 Elsevier Inc.
|
|
| 4. |
|
|
