| 1. |
- Baroutsi, Nicoletta, et al.
(författare)
-
A practitioners guide for C2 evaluations : Quantitative measurements of performance and effectiveness
- 2018
-
Ingår i: Proceedings of the 15th ISCRAM Conference. - Rochester, NY, USA : Rochester Institute of Technology. - 9780692127605 ; 2018-May, s. 170-189
-
Konferensbidrag (refereegranskat)abstract
- Quantitative evaluations are valuable in the strive for improvements and asserting quality. However, the field of Command & Control (C2) evaluations are hard to navigate, and it is difficult to find the correct measurement for a specific situation. A comprehensive Scoping Study was made concerning measurements of C2 performance and effectiveness. A lack of an existing appropriate framework for discussing C2 evaluations led to the development of the Crisis Response Management (CRM) Matrix. This is a new analysis tool that assigns measurements into categories, and each category display unique strengths, weaknesses and trends. The analysis yielded results proving to be too rich for a single article, thusly, this is the first of two articles covering the results. In this article, the Practitioners Guide focus on results valuable for someone interested in evaluating C2. Each evaluation has specific requirements to be met, for example, whether it is a real response or an exercise, or what competencies the evaluator has. For best result, these requirements ought to be reflected in the chosen measurement.
|
|
| 2. |
- Baroutsi, Nicoletta, et al.
(författare)
-
Assessing development of team training
- 2014
-
Ingår i: ISCRAM 2014 Conference Proceedings. Book of Papers. - : The Pennsylvania State University, USA. - 9780692211946
-
Konferensbidrag (refereegranskat)
|
|
| 3. |
|
|
| 4. |
- Baroutsi, Nicoletta
(författare)
-
Observing Sensemaking in C2 : Performance Assessment in Multi-Organizational Crisis Response
- 2016
-
Ingår i: Proceedings of the 13th International Conference on Information Systems for Crisis Response and Management. - : ISCRAM. - 9788460879848
-
Konferensbidrag (refereegranskat)abstract
- A crisis can involve multiple organizations during high pressure events, and it is up to the Command & Control (C2) unit to provide direction and coordination for the response (Brehmer, 2006). Hard as this problem is, there is still no ‘one-solution’. Dissimilar organizations with very different methods seem to be able to master the problem. This paper presents the initial development of a new evaluation method for C2 in the context of multi-organizational crisis response. The data is collected at an emergency water exercise series conducted in several cities in Sweden. Each exercise involves multiple agencies and organizations, with up to 76 participants from 15 unique organizations/units. The analysis is brief, but presents the possibility of observing Sensemaking as it unfolds, and that generic behavioral patterns can be found. The existence of generic and observable behavior patterns suggests the possibility of assessing, and maybe even quantifying, Sensemaking performance in C2.
|
|
| 5. |
- Baroutsi, Nicoletta
(författare)
-
To observe and evaluate sensemaking : The development of the sensemaking interaction analysis
- 2023
-
Ingår i: International Journal of Emergency Management. - 1471-4825. ; 18:2, s. 172-201
-
Tidskriftsartikel (refereegranskat)abstract
- Systematic evaluations are vital to support learning and enhance performance in a crisis response. There are quantitative methods available today for evaluating crisis response management (CRM), but there are limiting factors negatively affecting their potential; They often involve techniques difficult to implement in real events, lack reliability testing, provide outcomes questionable from a learning perspective, are often not applicable across professions, and their correlation to effectiveness is rarely investigated. This paper exemplifies how these identified limitations can be addressed through an iterative development process, using a combination of theoretical knowledge and empirical data. The result is the sensemaking interaction analysis (SIA), a new method developed using techniques found in the design sciences. The idea behind SIA is that a crisis management team who collectively make sense of a crisis, its consequences, and possible actions will perform better than a team who fails to do so.
|
|
| 6. |
- Berggren, Peter, et al.
(författare)
-
Assessing team focused behaviors in emergency response teams using the shared priorities measure
- 2014
-
Ingår i: Proceedings of the 11th International ISCRAM Conference. - Pennsylvania, USA : ISCRAM. ; , s. 130-134, s. 130-134
-
Konferensbidrag (refereegranskat)abstract
- The purpose of this work in progress paper is to report on the method development of the Shared Prioritiesmeasure to include content analysis, as a way of gaining a deeper understanding of team work incrisis/emergency response. An experiment is reported where the performance of six trained teams is comparedwith the performance of six non-trained teams. The experiment was performed using an emergency responsemicroworld simulation with a forest fire scenario. Dependent measures were simulation performance, the CrewAwareness Rating Scale (CARS), and content analysis. Trained teams performed better and scored higher onmeasures of team behaviors.
|
|
| 7. |
- Berggren, Peter, 1971-, et al.
(författare)
-
Assessing the quality of Shared Priorities in teams using content analysis in a microworld experiment
- 2017
-
Ingår i: Theoretical Issues in Ergonomics Science. - : Taylor & Francis. - 1463-922X .- 1464-536X. ; 18:2, s. 128-146
-
Tidskriftsartikel (refereegranskat)abstract
- Objective, easy to use, and easy to comprehend assessment methods for measuring shared understanding in teams are hard to find. This paper describes an experiment where a measure called Shared Priorities, which is based on ranking of self-generated strategic items, is assessed. Trained teams were compared to non-trained teams in a dynamic problem-solving task. The maturity of the participating teams was also assessed using a content analysis measure. The Shared Priorities measure was used alongside other well-documented measures of team awareness based on self-rating. Results show that the Shared Priorities measure correlates with task performance and could also distinguish between trained and non-trained teams. However, the Shared Priorities measure did not correlate with the other team measures (cf. CARS – Crew Awareness Rating Scale – and DATMA – Distributed Assessment of Team Mutual Awareness), suggesting that it captures a different quality of teamwork than the self-rating measures. Further, the Shared Priorities measure was found to be easily administered.
|
|
| 8. |
- Berggren, Peter, 1971-, et al.
(författare)
-
Statistical modelling of team training in a microworld study
- 2014
-
Ingår i: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. - : Sage Publications. - 2169-5067. ; , s. 894-898
-
Konferensbidrag (refereegranskat)abstract
- A command and control environment is a dynamic and complex setting with complicated technical systems where teams of operators interact to reach shared goals. This study presents an experiment in which we, by means of Structural Equation Modeling (SEM), explain the relations between basic concepts of command and control environments: mental workload, frustration, situational awareness, and performance. This paper reports a LISREL analysis of the Baroutsi, Berggren, Nählinder, & Johansson (2013) data. From that data, a new latent variable “Frustration” emerges, which now can be included in the model.
|
|
| 9. |
- Berggren, Peter, 1971-, et al.
(författare)
-
The shared priorities measure as a way of assessing team strategic awareness : a bridge between self-assessment and the deep blue sea of field recordings
- 2014
-
Ingår i: Proceedings of the 2014 European Conference on Cognitive Ergonomics. - New York, NY, USA : ACM Digital Library. - 9781450328746 ; , s. 13-
-
Konferensbidrag (refereegranskat)abstract
- Objective, easy to use, easy to comprehend, high face-validity assessment methods for measuring shared awareness in teams are hard to find. This paper describes an experiment where a new measure called Shared Priorities, which is based on ranking of self-generated strategic items, is tested. Trained teams were compared to non-trained teams in a dynamic problem-solving task in terms of performance and shared awareness. The shared priorities measure was used alongside other, well-documented measures of team awareness based on self-rating. The results show that the Shared Priorities measure correlate with performance and could also distinguish between trained and non-trained teams. However, the Shared Priorities measure did not correlate with the other team measures, suggesting that it captures a different quality of team work than the self-rating measures. Further, the shared priorities measure was found to be easily administered and gained a high user acceptance.
|
|
