| 1. |
- Enam, Amia, et al.
(författare)
-
Evidence based evaluation of eHealth interventions: A systematic literature review
- 2018
-
Ingår i: Journal of Medical Internet Research. - : JMIR Publications Inc.. - 1438-8871. ; 20:11
-
Forskningsöversikt (refereegranskat)abstract
- Background: Until now, the use of technology in health care was driven mostly by the assumptions about the benefits of electronic health (eHealth) rather than its evidence. It is noticeable that the magnitude of evidence of effectiveness and efficiency of eHealth is not proportionate to the number of interventions that are regularly conducted. Reliable evidence generated through comprehensive evaluation of eHealth interventions may accelerate the growth of eHealth for long-term successful implementation and help to experience eHealth benefits in an enhanced way. Objective: This study aimed to understand how the evidence of effectiveness and efficiency of eHealth can be generated through evaluation. Hence, we aim to discern (1) how evaluation is conducted in distinct eHealth intervention phases, (2) the aspects of effectiveness and efficiency that are typically evaluated during eHealth interventions, and (3) how eHealth interventions are evaluated in practice. Methods: A systematic literature review was conducted to explore the evaluation methods for eHealth interventions. Preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines were followed. We searched Google Scholar and Scopus for the published papers that addressed the evaluation of eHealth or described an eHealth intervention study. A qualitative analysis of the selected papers was conducted in several steps. Results: We intended to see how the process of evaluation unfolds in distinct phases of an eHealth intervention. We revealed that in practice and in several conceptual papers, evaluation is performed at the end of the intervention. There are some studies that discuss the importance of conducting evaluation throughout the intervention; however, in practice, we found no case study that followed this. For our second research question, we discovered aspects of efficiency and effectiveness that are proposed to be assessed during interventions. The aspects that were recurrent in the conceptual papers include clinical, human and social, organizational, technological, cost, ethical and legal, and transferability. However, the case studies reviewed only evaluate the clinical and human and social aspects. At the end of the paper, we discussed a novel approach to look into the evaluation. Our intention was to stir up a discussion around this approach with the hope that it might be able to gather evidence in a comprehensive and credible way. Conclusions: The importance of evidence in eHealth has not been discussed as rigorously as have the diverse evaluation approaches and evaluation frameworks. Further research directed toward evidence-based evaluation can not only improve the quality of intervention studies but also facilitate successful long-term implementation of eHealth in general. We conclude that the development of more robust and comprehensive evaluation of eHealth studies or an improved validation of evaluation methods could ease the transferability of results among similar studies. Thus, the resources can be used for supplementary research in eHealth.
|
|
| 2. |
- Jurkeviciute, M., et al.
(författare)
-
Identifying the Value of an eHealth Intervention Aimed at Cognitive Impairments: Observational Study in Different Contexts and Service Models
- 2020
-
Ingår i: Journal of Medical Internet Research. - : JMIR Publications Inc.. - 1438-8871. ; 22:10
-
Tidskriftsartikel (refereegranskat)abstract
- Background: Value is one of the central concepts in health care, but it is vague within the field of summative eHealth evaluations. Moreover, the role of context in explaining the value is underexplored, and there is no explicit framework guiding the evaluation of the value of eHealth interventions. Hence, different studies conceptualize and operationalize value in different ways, ranging from measuring outcomes such as clinical efficacy or behavior change of patients or professionals to measuring the perceptions of various stakeholders or in economic terms. Objective: The objective of our study is to identify contextual factors that determine similarities and differences in the value of an eHealth intervention between two contexts. We also aim to reflect on and contribute to the discussion about the specification, assessment, and relativity of the "value" concept in the evaluation of eHealth interventions. Methods: The study concerned a 6-month eHealth intervention targeted at elderly patients (n=107) diagnosed with cognitive impairment in Italy and Sweden. The intervention introduced a case manager role and an eHealth platform to provide remote monitoring and coaching services to the patients. A model for evaluating the value of eHealth interventions was designed as monetary and nonmonetary benefits and sacrifices, based on the value conceptualizations in eHealth and marketing literature. The data was collected using the Mini-Mental State Examination (MMSE), the clock drawing test, and the 5-level EQ-5D (EQ-5D-5L). Semistructured interviews were conducted with patients and health care professionals. Monetary data was collected from the health care and technology providers. Results: The value of an eHealth intervention applied to similar types of populations but differed in different contexts. In Sweden, patients improved cognitive performance (MMSE mean 0.85, SD 1.62, P<.001), reduced anxiety (EQ-5D-5L mean 0.16, SD 0.54, P=.046), perceived their health better (EQ-5D-5L VAS scale mean 2.6, SD 9.7, P=.035), and both patients and health care professionals were satisfied with the care. However, the Swedish service model demonstrated an increased cost, higher workload for health care professionals, and the intervention was not cost-efficient. In Italy, the patients were satisfied with the care received, and the health care professionals felt empowered and had an acceptable workload. Moreover, the intervention was cost-effective. However, clinical efficacy and quality of life improvements have not been observed. We identified 6 factors that influence the value of eHealth intervention in a particular context: (1) service delivery design of the intervention (process of delivery), (2) organizational setup of the intervention (ie, organizational structure and professionals involved), (3) cost of different treatments, (4) hourly rates of staff for delivering the intervention, (5) lifestyle habits of the population (eg, how physically active they were in their daily life and if they were living alone or with family), and (6) local preferences on the quality of patient care. Conclusions: Value in the assessments of eHealth interventions need to be considered beyond economic terms, perceptions, or behavior changes. To obtain a holistic view of the value created, it needs to be operationalized into monetary and nonmonetary outcomes, categorizing these into benefits and sacrifices.
|
|
| 3. |
- Nair, Monika, 1985, et al.
(författare)
-
Exploring the Use of Evidence From the Development and Evaluation of an Electronic Health (eHealth) Trial: Case Study
- 2020
-
Ingår i: Journal of Medical Internet Research. - : JMIR Publications Inc.. - 1438-8871. ; 22:8
-
Tidskriftsartikel (refereegranskat)abstract
- Background: Evidence-based practice refers to building clinical decisions on credible research evidence, professional experience, and patient preferences. However, there is a growing concern that evidence in the context of electronic health (eHealth) is not sufficiently used when forming policies and practice of health care. In this context, using evaluation and research evidence in clinical or policy decisions dominates the discourse. However, the use of additional types of evidence, such as professional experience, is underexplored. Moreover, there might be other ways of using evidence than in clinical or policy decisions. Objective: This study aimed to analyze how different types of evidence (such as evaluation outcomes [including patient preferences], professional experiences, and existing scientific evidence from other research) obtained within the development and evaluation of an eHealth trial are used by diverse stakeholders. An additional aim was to identify barriers to the use of evidence and ways to support its use. Methods: This study was built on a case of an eHealth trial funded by the European Union. The project included 4 care centers, 2 research and development companies that provided the web-based physical exercise program and an activity monitoring device, and 2 science institutions. The qualitative data collection included 9 semistructured interviews conducted 8 months after the evaluation was concluded. The data analysis concerned (1) activities and decisions that were made based on evidence after the project ended, (2) evidence used for those activities and decisions, (3) in what way the evidence was used, and (4) barriers to the use of evidence. Results: Evidence generated from eHealth trials can be used by various stakeholders for decisions regarding clinical integration of eHealth solutions, policy making, scientific publishing, research funding applications, eHealth technology, and teaching. Evaluation evidence has less value than professional experiences to local decision making regarding eHealth integration into clinical practice. Professional experiences constitute the evidence that is valuable to the highest variety of activities and decisions in relation to eHealth trials. When using existing scientific evidence related to eHealth trials, it is important to consider contextual relevance, such as location or disease. To support the use of evidence, it is suggested to create possibilities for health care professionals to gain experience, assess a few rather than a large number of variables, and design for shorter iterative cycles of evaluation. Conclusions: Initiatives to support and standardize evidence-based practice in the context of eHealth should consider the complexities in how the evidence is used in order to achieve better uptake of evidence in practice. However, one should be aware that the assumption of fact-based decision making in organizations is misleading. In order to create better chances that the evidence produced would be used, this should be addressed through the design of eHealth trials.
|
|
