SwePub - sökning: L773:0958 2029 OR L773:1471 54...

Numrering	Referens	Omslagsbild	Hitta
1.	Agasisti, Tommaso, et al. (författare) Evaluating the performance of academic departments: an analysis of research-related output efficiency 2012 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 21:1, s. 2-14 Tidskriftsartikel (refereegranskat)abstract In this article we investigated whether academic departments do experience a trade-off among different research outputs. More specifically, we define four types of academic research outputs: quantity (publications); quality (citation indexes); research funds obtained through research grants; and applied research funds obtained through external orders. Subsequently, we define a department's performance through the concept of efficiency, namely the ability to maximize academic research output given an amount of inputs (facilities and human resources). Using Data Envelopment Analysis (DEA), we measure efficiency for 69 academic departments (focused on scientific subjects) located in the Lombardy Region (Italy), benefiting from a unique data set containing detailed information on research inputs and outputs. The empirical analysis shows that efficiency rankings change significantly when considering different research-related outputs and thus it highlights different research strategies among the academic departments. These different strategies emerge also considering jointly all four types of outputs: the academic departments focus on different outputs in order to obtain the highest overall efficiency scores. In the last section, policy and managerial implications have been discussed.
2.	Ahlgren, Per, et al. (författare) The role of the Chinese Key Labs in the international and national scientific arena revisited 2017 Ingår i: Research Evaluation. - : OXFORD UNIV PRESS. - 0958-2029 .- 1471-5449. ; 26:2, s. 132-143 Tidskriftsartikel (refereegranskat)abstract In this contribution, which builds on and develops a study that was published more than 10 years ago, we address the role of the Chinese Key Labs (KLs) in the international and national scientific arena. We give a short overview of the position of KLs in China, including their budget and manpower. Based on large numbers of Chinese publications obtained from the Web of Science (WoS) and the Chinese Science Citation Database (CSCD), the KLs are compared across publication years to the rest of China (ChRest) with respect to publication output and citation impact. We also look at collaboration in terms of co-publishing between the KLs and the ChRest. As to publications in the WoS, we found that the contribution of KLs compared with the ChRest is slightly and irregularly increasing (using full counting as well as fractional counting), whereas a stronger increasing trend is observed for the corresponding contribution in the CSCD. We observed an increase in the number of collaborations between KLs and Chinese colleagues, regardless of database. For WoS and field normalized citation indicators, we obtained the expected results that researchers at KLs perform considerably better than other Chinese colleagues and, moreover, perform clearly better than database average. As such we may conclude that KLs have lived up to their promise and made real impact on the international arena.
3.	Aparicio, Juan, et al. (författare) The systemic approach as an instrument to evaluate higher education systems : Opportunities and challenges 2021 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 30:3, s. 336-348 Forskningsöversikt (refereegranskat)abstract This article aims to provide a systemic instrument to evaluate the functioning of higher education systems. Despite systemic instruments have had a strong impact on the management of public policy systems in fields such as health and innovation, higher education has not been widely discussed in applying this type of instrument. Herein lies the main gap that we want to close. The ultimate purpose of the evaluation instrument introduced here is thus to provide information for decision-makers, so these can identify the strengths/weaknesses in the functioning of their respective higher education systems from a systemic perspective. To achieve the previous goal, we apply the methodological guidelines of the integrative review of the literature. An integrative review of the literature was chosen because it guides the extraction of quantitative evidence from the literature and its classification, with the purpose of integrating the results into an analytical framework. This resulting analytical framework is what we have labelled as the systemic evaluation instrument. The article makes three contributions to the literature. First, the different types of higher education institutions considered in the literature and the higher education systems analysis scales are evidenced. Second, we identify the capacities and functions examined by the literature so that higher education institutions and higher education systems can fulfil their missions. Third, a systemic evaluation framework for higher education institutions and higher education systems is presented. The article concludes with a discussion of the opportunities and challenges associated to the implementation of such a systemic framework for policymaking.
4.	Bourelos, Evangelos, 1982, et al. (författare) Is the prominent scientist the one who becomes an inventor? A matching of Swedish academic pairs in nanoscience to examine the effect of publishing on patenting 2017 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 26:2, s. 144-156 Tidskriftsartikel (refereegranskat)abstract Nanoscience is an interdisciplinary field in which science, in terms of publications, and technology, in terms of inventions, are closely related. Sweden represents an interesting setting to examine how they are related because a high proportion of the total Swedish academic patents can be classified as nanoscience. Combining bibliometric data from the Web of Science, patent data from European Patent Office and data from Swedish universities, this article identifies all authors and all inventors listed on patents who work at universities in Sweden within nanotechnology. The main question we address is whether prominent academic scientists in terms of scientific publications are also the ones who become academic inventors. The article uses a semiparametric technique, namely a conditional regression in a matched sample, to isolate the effect of publishing on patenting. One novelty of this article is that it applies a conditional logistic regression in matched pairs of academics, to isolate the relationship between patenting and publishing in nanoscience. The empirical results show that academics who both publish and patent have, on average, more publications as well as more citations. Furthermore, having a higher number of citations can increase the probability of having a patent. Interdisciplinarity is also positively correlated with patenting. Thus, by isolating the effects of publishing on patenting, this article demonstrates that scientific prominence, indicated both by the number of articles and citations, positively impacts the propensity to take patents.
5.	Bruno, Karl, et al. (författare) Knowledge production at industrial research institutes : Institutional logics and struggles for relevance in the Swedish Institute for Surface Chemistry, 1980-2005 2017 Ingår i: Research Evaluation. - : OXFORD UNIV PRESS. - 0958-2029 .- 1471-5449. ; 26:4, s. 337-348 Tidskriftsartikel (refereegranskat)abstract This article examines dynamics of knowledge production and discourses of basic-applied science and relevance at the Swedish Institute for Surface Chemistry, a semi-public industrially oriented research institute, from 1980 to 2005. We employ a three-pronged method, consisting of (1) an analysis of how the institute articulated its research priorities and goals in publications primarily directed to stakeholders, (2) an analysis of retrospective narratives by researchers and managers about research ideologies and priorities, and (3) a bibliometric analysis of the institute's scientific publications. Using a theoretical framework centered on the notions of institutional logics and struggles for relevance, we show how the transformations of the institute amount to a substitution of an internalized institutional logic of scientific autonomy with a new logic of industrial utility, and how the institute's knowledge production was managed during this change. We also point out various strategies used by the institute to preserve and advance its own goals while still remaining relevant with regard to changing policy objectives. Another important finding is that although the institute by the end of the study period was fully committed to an industrial service role, parts of the originally deeply entrenched scientific logic were still manifested, although then discussed in the new industrial terminology.
6.	Bölling, Matilda, et al. (författare) Collaboration with society : The future role of universities? Identifying challenges for evaluation 2016 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 25:2, s. 209-218 Tidskriftsartikel (refereegranskat)abstract In order to evaluate who benefits, and how, from collaboration between universities and society, it is necessary to develop solid evaluation models. The Swedish Governmental Agency for Innovation Systems (VINNOVA) has been commissioned by the Swedish government to present an evaluation model for university-society collaboration, which is intended to be included in the future distribution of funding to Swedish universities. This makes Sweden an interesting example of the challenges associated with the implementation of a national evaluation model for university-society collaboration. The objective of this study is to identify challenges for evaluation of university-society collaboration in an academic context. We analyse the actual implementation process of a national evaluation system for university-society collaboration, by putting Swedish policy in relation to international research. The results suggest that there is broad knowledge on the complexity of university-society collaboration, and of the difficulties associated with evaluation, even if certain aspects, like the importance of teaching, networking, and gender aspects, are often overlooked. However, the discussion tends to focus on the construction of relevant indicators, while there is a widespread lack of discussion and agreement on the objectives and goals of university-society collaboration, as well as discussions on how to define the concept. The importance of these aspects is illustrated by the difficulties in Sweden with developing a legitimate assessment system for university-society collaboration.
7.	Charles, Edquist, et al. (författare) On the meaning of innovation performance : Is the synthetic indicator of the Innovation Union Scoreboard flawed? 2018 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; , s. 196-211 Tidskriftsartikel (refereegranskat)abstract The European Union (EU) annually publishes an Innovation Union Scoreboard (IUS) as a tool to measure the innovation performance of EU Member States by means of a composite index, called the Summary Innovation Index (SII). The SII is constituted by an average of 25 indicators. The SII is claimed to rank Member States according to their innovation performance. This means that the higher the average value of the 25 indicators, the better the innovation performance is said to be. The first purpose of this article is to assess whether the SII constitutes a meaningful measure of innovation performance. Our conclusion is that it does not. Our second purpose is to develop alternative, productivity or efficiency-based, measures of innovation system performance based on a simple index number, and complement it with advanced and robust nonparametric Data Envelopment Analysis techniques. By doing so, the article offers a critical review of the SII, and proposes to put more emphasis on the identification of and relation between input and output innovation indicators. The data provided by the 2014 and 2015 editions of the IUS are here used to analyze the innovation performance of all 28 EU national innovation systems. A theoretical background and reasons for selecting the indicators used are presented, and our new ranking of the innovation performance using bias-corrected efficiency scores of all EU countries is calculated. We find that the results differ substantially between the SII and the ranking based on our method, with significant consequences for the design of innovation policies.
8.	Danell, Rickard, 1965-, et al. (författare) The importance of early academic career opportunities and gender differences in promotion rates 2013 Ingår i: Research Evaluation. - : Oxford University Press. - 0958-2029 .- 1471-5449. ; 22:4, s. 210-214 Tidskriftsartikel (refereegranskat)abstract Based on previous studies it has been found that women have a smaller chance than men of attaining professorships. It has also been found that gender differences in career development have been observed in many different countries. This study aims to contribute to these discussions by analyzing the extent to which gender differences in career development can be explained by early career opportunities, specifically the prestigious postdoctoral fellowship which is particular to the Swedish university system. This study concluded that women and men have the same probability to achieve a postdoctoral fellowship and that among men and women who have achieved this we observed that they had equal chances of becoming professors. However, it was also shown that women are substantially worse off than men for the study group of those who have not achieved a postdoctoral fellowship. This indicates that a meritocratic system does not seem do discriminate against women whereas as vacancy system seems to do so.
9.	de Rijcke, Sarah, et al. (författare) Evaluation practices and effects of indicator use : a literature review 2016 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 25:2, s. 1-9 Tidskriftsartikel (refereegranskat)abstract This review of the international literature on evaluation systems, evaluation practices, and metrics (mis)uses was written as part of a larger review commissioned by the Higher Education Funding Council for England (HEFCE) to inform their independent assessment of the role of metrics in research evaluation (2014–5). The literature on evaluation systems, practices, and effects of indicator uses is extremely heterogeneous: it comprises hundreds of sources published in different media, spread over disciplines, and with considerable variation in the nature of the evidence. A condensation of the state-of-the-art in relevant research is therefore highly timely. Our reviewpresents the main strands in the literature, with a focus on empirical materials about possible effects of evaluation exercises, ‘gaming’ of indicators, and strategic responses by scientific communities and others to requirements in research assessments. In order to increase visibility and availability, an adapted and updated review is presented here as a stand-alone—after authorizationby HEFCE.
10.	Diaz-Faes, A. A., et al. (författare) Assessing the variety of collaborative practices in translational research: An analysis of scientists' ego-networks 2023 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 32:2, s. 426-440 Tidskriftsartikel (refereegranskat)abstract Translational research policies aim to reshape how biomedical scientists organize, conceive, and conduct science in order to accelerate healthcare improvements and medical innovations. Yet most analyses and evaluations of these initiatives focus on measuring the outputs generated in the different stages of the research process rather than observing scientists' research practices directly. In this article, we analyze the collaboration networks formed by the biomedical scientists participating in a large translational research initiative. Based on data derived from a large-scale survey, we examine the network configurations established by biomedical scientists to advance their research in the context of the CIBER program-a Spanish flagship initiative aimed at supporting translational research. We adopt an ego-network perspective and draw on three network attributes-network diversity, tie strength, and tie content-to understand how scientists use their interpersonal connections to mobilize tangible and intangible resources and enable the translation of scientific knowledge into practical applications. Our cluster analysis identifies a range of scientist profiles: downstream-oriented scientists, upstream-oriented scientists, and brokering scientists. It shows that the scientists participating in the CIBER program deploy different types of collaborative behavior and engage in a variety of medical innovation activities. This suggests that the results achieved by a research program aimed at supporting collaborative networks will depend on the types of networks in which the participating scientists engage. Consequently, evaluations of these programs need to capture collaboration patterns, and should focus primarily on the collaborative process rather than the outputs that emerge from the collaboration.
11.	Francke, Helena, et al. (författare) Competitive exposure and existential recognition: Visibility and legitimacy on academic social networking sites 2022 Ingår i: Research Evaluation. - : Oxford University Press. - 0958-2029 .- 1471-5449. ; 31:4, s. 429-437 Tidskriftsartikel (refereegranskat)abstract Over the past decade, academic social networking sites, such as ResearchGate and Academia.edu, have become a common tool in academia for accessing publications and displaying metrics for research evaluation and self-monitoring. In this conceptual article, we discuss how these academic social networking sites, as devices of evaluation that build on both traditional values, objects, and metrics in academic publishing and on social media logics and algorithmic metrics, come to fulfil a need in the current academic (publishing) ecosystem. We approach this issue by identifying key affordances that arise in the interaction between platform and user. We then position these affordances in relation to potential needs of academics in today’s publishing landscape by drawing on Hafermalz’s metaphor of the ‘fear of exile’, which provides an alternative way of understanding the importance of visibility in the networked world, as a combination of competitive exposure and existential recognition. We end by considering the grounds on which the platforms may be attributed some level of legitimacy. This is done in order to understand the inherent contradiction between the broad use of the platforms and the fact that their integrity has been questioned repeatedly. We seek an answer to a legitimacy for the platforms in the fact that a pragmatic, mutual benefit exists between them and the research community; a benefit that is enhanced by the audit society influencing current academia.
12.	Ganuza, Natalia, 1977-, et al. (författare) Boundary-work and social closure in academic recruitment : Insights from the transdisciplinary subject area Swedish as a Second Language 2023 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 32:2, s. 515-525 Tidskriftsartikel (refereegranskat)abstract This article explores practices of evaluation in academic recruitment in Swedish as a Second Language (SSL), an expanding and transdisciplinary subject area. As is common elsewhere, Swedish academia relies on a tradition of external expert review intended to ensure a meritocratic pro- cess. Here, we present an analysis of 109 written expert reports concerning recruitment to 57 positions in SSL during 2000–20. Because SSL lacks institutional autonomy, and is spread across several sub-disciplines in the humanities and social sciences, the material encompasses experts with diverse academic backgrounds. The SSL reports are broadly characterized by qualitative assessment. In contrast to other fields, the SSL experts seldom use quantitative proxy measures. Instead, they mainly rely on received conceptions of the boundaries of SSL as a means of justifying their inclusion and exclusion of candidates. This dominant regularity consists of attempts to define and delimit SSL and its core re- search areas, to locate the candidates in a core-to-periphery scheme with respect to these boundaries, and to rank them accordingly. This mech- anism of social closure serves to restrict access to SSL to candidates with qualifications that conform to the experts’ own conceptions of SSL. As we show, the experts’ internally ambiguous conceptions of SSL tend to be constructed in relation to their own scientific habitus and invest- ments. Beyond evaluating applicants’ possession of scientific capital, their distinctive style of reasoning around research qualifications and skills thus involves power-laden boundary-work, which leaves ample room for individual, yet habitus-specific arbitrariness.
13.	Hallonsten, Olof, et al. (författare) Supporting ‘future research leaders’ in Sweden : Institutional isomorphism and inadvertent funding agglomeration 2014 Ingår i: Research Evaluation. - : Oxford University Press. - 0958-2029 .- 1471-5449. ; 23:3, s. 249-260 Tidskriftsartikel (refereegranskat)abstract The most recent fashion in the policy-level promotion of excellence in academic research seems to be the launching of funding programs directed to young and promising (postdoc level) researchers with the purpose of assisting them in establishing their own research profile at this allegedly crucial and fragile career stage. In the Swedish public research funding system, which is rather diversified and also quite recently has been recast, a number of such programs have been launched in recent years by public and private actors alike, all with the stated ambition of providing funding to those typically in lack of the same. In this article, we discuss the rather striking uniformity of these programs on the basis of the concept of institutional isomorphism from neoinstitutional theory, which is a powerful conceptual tool with capacity to explain why organizations in the same field grow alike in their practices despite preconditions that would suggest otherwise. Analyzing qualitatively the stated purposes of the programs and the discursive shift that accompanies them in policy, and analyzing quantitatively the 130 recipients of funding from the programs, we show that there are agglomeration effects that are unintended but also expectable, given the nature of the funding landscape in Sweden and the institutional isomorphism among the organizations in the field.
14.	Hallonsten, Olof (författare) Use and productivity of contemporary, multidisciplinary Big Science 2016 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 25:4, s. 486-495 Tidskriftsartikel (refereegranskat)abstract The use of very large instrumentation, usually called Big Science, became an important part of Western science systems after World War II, with nuclear and particle physics at the center. Throughout the Cold War era, however, science policy priorities and objectives gradually shifted and in parallel therewith, new uses of Big Science emerged that were oriented to the study of materials and later also the life sciences, two areas that grew in global importance toward the end of the 20th century. As the Cold War wound down, the rationale for the old Big Science waned but the new applications of reactors and particle accelerators grew in breadth and importance, and today, dozens of Big Science facilities in Europe and the USA provide neutrons, synchrotron radiation, and free electron laser to a multidisciplinary community of users predominantly from the academic sector. These users visit the facilities temporarily to do experiments as part of their ordinary scientific work, which means that the functional differentiation between facilities and users has been accentuated and institutionalized: facilities provide resources for experimental work, and users do science and produce results. This functional differentiation creates some challenges for the evaluation of the performance and quality of these very expensive facilities, which this article discusses on the basis of qualitative and quantitative data, problematizing the role of contemporary, multidisciplinary Big Science in a science system that is growing more and more reliant on performance evaluation.
15.	Hammarfelt, Björn, et al. (författare) Accountability in context : Effects of research evaluation systems on publication practices, disciplinary norms and individual working routines in the faculty of Arts at Uppsala University 2015 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 24:1, s. 63-77 Tidskriftsartikel (refereegranskat)abstract Given the increased role of bibliometric measures in research evaluation, it is striking that studies of actual changes in research practice are rare. Most studies and comments on ’a metric culture’ in academia focus on the ideological and political level, and there is a clear shortage of empirical studies that analyze how researchers handle demands for accountability in context. In adopting a mixed methods approach involving both bibliometric data and answers form questionnaires we provide an in-depth study of how researchers at the faculty of Arts at Uppsala University (Sweden) respond to the implementation of performance based research evaluation systems. Publication patterns from 2006-2013 show that journal publications, especially English-language ones, is increasing, and the proportion of peer-reviewed publications has doubled. These changes are in line with the incentives of the evaluation systems under study. Answers to the survey confirm that scholars are conscious about this development and several respondents articulate a disagreement between disciplinary norms and external demands. However, disciplinary background as well as career stage or academic age appears to have a significant influence on how individual researchers react to the instigation of evaluation systems. Finally, responses to national and local evaluation regimes are complex, localized and dependent on many factors. In-depth contextualized studies of research practices are needed in order to understand how performance based funding systems influence academic research on the ground.
16.	Hammarfelt, Björn, 1980-, et al. (författare) Indicators as judgment devices : An empirical study of citizen bibliometrics in research evaluation 2017 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 3:1, s. 169-180 Tidskriftsartikel (refereegranskat)abstract A researcher’s number of publications has been a fundamental merit in the competition for academic positions since the late 18th century. Today, the simple counting of publications has been supplemented with a whole range of bibliometric indicators, which supposedly not only measures the volume of research but also its impact. In this study, we investigate how bibliometrics are used for evaluating the impact and quality of publications in two specific settings: biomedicine and economics. Our study exposes the various metrics used in external evaluations of candidates for academic positions at Swedish universities. Moreover, we show how different bibliometric indicators, both explicitly and implicitly, are employed to assess and rank candidates. Our findings contribute to a further understanding of bibliometric indicators as ‘judgment devices’ that are employed in evaluating individuals and their published works within specific fields. We also show how ‘expertise’ in using bibliometrics for evaluative purposes is negotiated at the interface between domain knowledge and skills in using indicators. In line with these results, we propose that the use of metrics we report is best described as a form of ‘citizen bibliometrics’—an underspecified term which we build upon in the article.
17.	Hammarfelt, Björn, 1980-, et al. (författare) The heterogeneous landscape of bibliometric indicators : Evaluating models for allocating resources at Swedish universities 2016 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; , s. 1-16 Tidskriftsartikel (refereegranskat)abstract The use of bibliometric indicators on individual and national levels has gathered considerable interest in recent years, but the application of bibliometric models for allocating resources at the institutional level has so far gathered less attention. This article studies the implementation of bibliometric measures for allocating resources at Swedish universities. Several models and indicators based on publications, citations, and research grants are identified. The design of performance-based resource allocation across major universities is then analysed using a framework from the field of evaluation studies. The practical implementation, the incentives as well as the ‘ethics’ of models and indicators, are scrutinized in order to provide a theoretically informed assessment of evaluation systems. It is evident that the requirements, goals, possible consequences, and the costs of evaluation are scarcely discussed before these systems are implemented. We find that allocation models are implemented in response to a general trend of assessment across all types of activities and organizations, but the actual design of evaluation systems is dependent on size, orientation, and the overall organization of the institution in question.
18.	Hansson, Stina, 1974, et al. (författare) Assessing the impact of transdisciplinary research: The usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact 2018 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 27:2, s. 132-144 Tidskriftsartikel (refereegranskat)abstract There is a call for more transdisciplinary (TD) research, from academia, society, and funding agencies. Consequently, the field of TD research is searching for ways of proving the value and providing evidence to support the effectiveness of such research. The main challenge for evaluating TD research is attribution, that is how to link societal change to the TD research process. However, little attention has been paid to the relationship between the quality of the research process and the effects and impacts that are being evaluated. Building upon earlier attempts at evaluating TD research, this article tests three key aspects of effective sustainability research: its relevance, credibility, and legitimacy. To explore the link between the quality of process and societal effects, we analyze and compare outputs, outcomes, and impact of five TD projects. Overall, our analysis shows that while relevance, credibility, and legitimacy gave important insights regarding the links between process and impacts, they are not adequate for evaluating TD research impact. Process qualities such as practitioner motivation and perceived importance of the project, together with breadth of perspectives, the openness/flexibility of participants, and in-depth exchanges of expertise and knowledge, contributed to producing internally relevant, credible, and legitimate results. However, we also saw a need to develop the relevance, credibility, and legitimacy framework, in relation to the external dynamics of the project process, heterogeneous stakeholder groups, and the credibility of practice-based knowledge, which together with institutional factors and the political context significantly shape the possibility of impact.
19.	Hansson, Stina, 1974, et al. (författare) Comments to Belcher et al. 2018's critique of Hansson and Polk 2018 2019 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 28:2, s. 202-205 Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract Assessing the value of transdisciplinary research is a complex and multifaceted enterprise allowing room for many perspectives. TheBelcher et al. (2018)critique of our paper (Hansson and Polk 2018) seems to be based on different perspectives and different readings of prior work. These differences for us explains the majority of the criticisms raised against our paper. After having critically reread all of the involved texts we conclude that the analysis, overall conclusions and content of our paper are solid. However, the response to our paper raised some very nuanced and important points regarding how we understand and reference each other's work. In this comment we will respond to and explain the most important issues raised in relation to the aim of our paper, the validity of our empirical results and our interpretation of the reference texts. We find that from different perspectives and with different aims and methods our work comes to very similar conclusions regarding the RCL framework and its usefulness in promoting the societal impact of research. © 2018 The Author(s).
20.	Hellström, Tomas, et al. (författare) Center of excellence funding : Connecting organizational capacities and epistemic effects 2018 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 27:2, s. 73-81 Tidskriftsartikel (refereegranskat)abstract This study investigates the relationship between resource concentration/stability and new results/breakthroughs in the context of a Swedish Center of Excellence (CoE) scheme. A common assumption in using the CoE instrument is that there is a scale return to research on concentration of funds. However, the details of how funding connects to such returns are typically assumed rather than empirically investigated. The present qualitative study sets out to identify the mediating mechanisms connecting organizational capacities made possible through the CoE grant (e.g. recruitment/human capital, data/infrastructure and various collaborative arrangements), and epistemic effects such as extension into new problem areas and higher degrees of risk taking in research generally. We conclude that a CoE program theory can be conceived in terms of resource stability yielding research flexibility, and that the common mechanisms connecting the two may be found in organizational arrangements facilitating slack (autonomy), availability of cooperative partners (critical mass) and concomitant cooperation between specialisms. It is our belief that by explicating such mechanisms CoE program theory can be greatly improved.
21.	Heshmati, Almas, et al. (författare) Policy Simulation of Firms’ Cooperation in Innovation 2015 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 24:3, s. 293-311 Tidskriftsartikel (refereegranskat)abstract This study utilizes an agent-based simulation model to conduct a public policy simulation of firms' networking and cooperation in innovation. The simulation game tests the differences in sector responses to internal and external changes, including cross-sector spillovers, when applying three different policy strategies to promote cooperation in innovation. The public policy strategies include clustering to develop certain industries, incentives to encourage cooperative research and development (R&D), and spin-off policies to foster entrepreneurship among R&D personnel. These policies are compared to a 'no-policy' alternative, which serves as a benchmark to verify the gains (or loses) in the number of firms cooperating and networking. The simulation model defines firms' behavior according to empirical findings from an analysis of determinants of the firms' participation in cooperation in innovation with other organizations using a Korean Innovation Survey. The exercise indicates possible appropriate policy strategies that can be applied depending on the target industries. We have applied a few examples and showed how the results may be interpreted. Agent-based models are found to have a great potential in decision-support systems for policy makers.
22.	Hylmö, Anders, 1977-, et al. (författare) The quality landscape of economics : The top five and beyond 2024 Ingår i: Research Evaluation. - Oxford : Oxford University Press. - 0958-2029 .- 1471-5449. Tidskriftsartikel (refereegranskat)abstract Whereas a growing number of studies evidence that research quality notions and evaluative practices are field- and context-specific, many focus on single evaluative practices or moments. This paper introduces the concept of quality landscape to capture dynamics of interrelated quality notions, evaluative moments and practices in a research field. This concept shifts focus to (1) the field-specific universe of practices, devices and notions of research quality; (2) ways that interrelated valuations provide structure and boundeness to a landscape; (3) ways that perspectives on a shared landscape may change with position within the landscape; and (4) ways in which a quality landscape is intertwined with the field's socio-epistemic conditions. With extensive interview data from top ranked departments in three Scandinavian countries, we use economics as a case for exploring the value of a quality landscape lens. We find that the field's journal hierarchy and its 'Top 5' journals dominate the landscape, while other important evaluative practices beyond the top five are interlinked with the journal hierarchy. However, quantitative evaluative metrics common in other fields are virtually absent. We further find that national and local policy reinforce the journal hierarchy emphasis, and that career stages affect quality perspectives. We argue that the quality landscape is structured as a quality hierarchy with a focus on the core 'general interest', and suggest the notion of ordinalization (the process of rank ordering) as an organizing principle linking the quality landscape to the field's socio-epistemic conditions. Finally, we offer suggestions for further research. © The Author(s) 2024. Published by Oxford University Press.
23.	Karlsson, Sara, 1971- (författare) Evaluation as a travelling idea : Assessing the consequences of Research Assessment Exercises 2017 Ingår i: Research Evaluation. - : OXFORD UNIV PRESS. - 0958-2029 .- 1471-5449. ; 26:2, s. 55-65 Tidskriftsartikel (refereegranskat)abstract Research evaluation is widespread in academia, and may result in changes in publication patterns, management structures, and work practices. This study explores a relatively recent phenomenon where university leaders initiate research evaluation projects for internal strategic purposes. Two projects undertaken by KTH Royal Institute of Technology, Sweden, in 2008 and 2012 are taken as cases in point. The study builds on interviews, documents, and statistics. In conclusion, the study finds that the early consequences of the two evaluations relate less to research output, and more to the management of research. The bibliometric data do not indicate a measurable impact on publication patterns. Rather, the evaluations have contributed towards an increased focus on leadership, communication, and good administrative order. A tendency towards game playing is apparent, but so is a revitalized intra-academic discourse on research quality. Further, the study finds variation in how the research evaluations have impacted on different research groups. Importantly, the impact is greatest on those groups that have been identified as least successful according to the specific evaluation criteria. Such groups can undergo major change in response to evaluation results. It is concluded that evaluation exercises carry a strong normative component which can be used for central management purposes to strive for more cultural coherence within the university. In theoretical terms, research evaluation is interpreted as a travelling idea, to which there is substantial pressure to conform but which may also stimulate a critical debate on research quality.
24.	Lewensohn, D, et al. (författare) Applying patent survival analysis in the academic context 2015 Ingår i: RESEARCH EVALUATION. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 24:2, s. 197-212 Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)
25.	Lööf, Hans, et al. (författare) The link between firm-level innovation and aggregate productivity growth : a cross-country examination 2003 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 12:2, s. 131-147 Tidskriftsartikel (refereegranskat)abstract A broad definition of innovation input is used, in which R&D is one of several sources of innovation. A quantitative innovation output measure is used in the analysis, which is based on a large representative sample of firms, including small firms. An econometric framework based on the knowledge-production function accounting for both selectivity and simultaneity bias is employed. The results from Nordic countries show that, given difficulties in pooling the data, it is important to identify country-specific models to account for country-specific effects and differences in countries' national innovation systems.
26.	Nedeva, Maria, et al. (författare) Research governance and the dynamics of science : A framework for the study of governance effects on research fields 2023 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 32:1, s. 116-127 Tidskriftsartikel (refereegranskat)abstract This article offers a framework for the study of research governance effects on scientific fields framed by notions of research quality and the epistemic, organizational, and career choices they entail. The framework interprets the contested idea of 'quality' as an interplay involving notion origins, quality attributes, and contextual sites. We mobilize the origin and site components, to frame organizational-level events where quality notions inform selections, or selection events. Through the dynamic interplay between notions selected at specific sites, we contend, local actors enact research quality cumulatively, by making choices that privilege certain notions over others. In this article, we contribute in four ways. First, we propose an approach to study research governance effects on scientific fields. Second, we introduce first-and second-level effects of research governance paving the way to identify mechanisms through which these different levels of effects occur. Third, we assert that interactions between research spaces and fields leading to effects occur in the context of research organizations, and at nine key selection events. Fourth, and lastly, we discuss an empirical test on an illustration case to demonstrate how this approach can be applied.
27.	Sandin Lompar, Sofie, et al. (författare) Research evaluations for an energy transition? Insights from a review of Swedish research evaluation reports 2021 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 1471-5449 .- 0958-2029. ; 31:1, s. 80-92 Tidskriftsartikel (refereegranskat)abstract Energy efficiency is identified as a vital area for addressing sustainability challenges of our time. Governments throughout the world invest vast amounts of resources in research, for advancing knowledge on energy efficiency, and for fostering innovations that can support a transition towards a more sustainable energy system. Evaluation can be an important component in transition processes, for setting directions, assessing outcomes, and enhancing learning. In Sweden, evaluations are undertaken to assess the contribution of energy research to national goals and are also regularly undertaken for individual research programmes and institutions to assess processes and effects. Thus, in a context where evaluations are conducted at different levels and with different objectives, the connectivity between them becomes complex and often unclear. This study focuses on how research is evaluated and how individual evaluations frame and relate the evaluand to an energy transition. By reviewing 20 Swedish evaluations of research for energy efficiency in buildings, we seek to provide insights on the operationalization, analysis, and assessment of the evaluations. The results reveal that evaluations often deploy a systems perspective that frames the initiatives in a larger societal perspective, crucial for supporting a transition. They also highlight a heterogeneity within the undertaking of the evaluation: from a generally wide operationalization—to a more narrow analysis focusing on programme level outcomes—to a wider assessment of impacts and relevance for society and different actors. In all, the full potential of individual research evaluations is still to be harnessed through deliberate evaluation approaches.
28.	Sandström, Ulf (författare) Combining curriculum vitae and bibliometric analysis : mobility, gender and research performance 2009 Ingår i: RESEARCH EVALUATION. - : BEECH TREE PUBLISHING. - 0958-2029 .- 1471-5449. ; 18:2, s. 135-142 Tidskriftsartikel (refereegranskat)abstract This paper demonstrates the benefits of combining curriculum vitae studies with advanced bibliometrics. Based on data from 326 CVs within one broad medical subject area we perform a Cluster analysis of CV data. Data reduction produces four different groups of scientists: 1) mobile, 2) immobile, 3) excellent and 4) entrepreneurial. While it is clear that the most mobile and the least mobile researchers represent opposites also in citation performance we should acknowledge that for the large majority, with a low and medium mobility, there is no linear pattern of performance. The paper points at a double process where there are on the one hand selection processes at universities picking out the winners and on the other hand self selection processes where researchers enhance their own performance by being mobile.
29.	Sandström, Ulf, 1953-, et al. (författare) The field factor : Towards a Metric for Academic Institutions 2009 Ingår i: Research Evaluation. - : BEECH TREE PUBLISHING. - 0958-2029 .- 1471-5449. ; 18:3, s. 243-250 Tidskriftsartikel (refereegranskat)abstract We present a new model for performance-related funding of universities in Sweden. The model is based oil number of papers in international scientific journals, but relies oil an estimation of field-adjusted production per scientific/technological area Author counts are based oil potential authors using the Waring distribution for 34 areas of science (Schubert and Braun, 1992) We apply this model to the Swedish university system and illustrate with the reallocations that Would follow from a complete implementation. Next, we test the accuracy of the method using publication data from six Swedish universities and four Norwegian universities. In conclusion we discuss advantages and drawbacks with the method.
30.	Sīle, Linda, et al. (författare) Comprehensiveness of national bibliographic databases for social sciences and humanities: Findings from a European survey 2018 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 1:13 Tidskriftsartikel (refereegranskat)abstract This article provides an overview of national bibliographic databases that include data on research output within social sciences and humanities (SSH) in Europe. We focus on the comprehensiveness of the database content. Compared to the data from commercial databases such as Web of Science and Scopus, data from national bibliographic databases (e.g. Flemish Academic Bibliographic Database for the SSH (VABB-SHW) in Belgium, Current Research Information System in Norway (CRISTIN)) are more comprehensive and may, therefore, be better fit for bibliometric analyses. Acknowledging this, several countries within Europe maintain national bibliographic databases; detailed and comparative information about their content, however, has been limited. In autumn 2016, we launched a survey to acquire an overview of national bibliographic databases for SSH in Europe and Israel. Surveying 41 countries (responses received from 39 countries), we identified 21 national bibliographic databases for SSH. Further, we acquired a more detailed description of 13 databases, with a focus on their comprehensiveness. Findings indicate that even though the content of national bibliographic databases is diverse, it is possible to delineate a subset that is similar across databases. At the same time, it is apparent that differences in national bibliographic databases are often bound to differences in country-specific arrangements. Considering this, we highlight implications to bibliometric analyses based on data from national bibliographic databases and outline several aspects that may be taken into account in the development of existing national bibliographic databases for SSH or the design of new ones.
31.	Sotudeh, Hajar, et al. (författare) Gender differences in scientific productivity and visibility in core neurosurgery journals: Citations and social media metrics 2018 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 27:3, s. 262-269 Tidskriftsartikel (refereegranskat)abstract Social media has provided new opportunities for both female and male academics to disseminate their research results, and presence on the Internet is found to increase the visibility of scholars. Thus, this study examined whether there were differences in terms of scientific productivity or the visibility (both in terms of citations and social media metrics) of female and male scholars in the field of neurosurgery. To do this, 11,127 articles and reviews from 2012 to 2014 were extracted from the Thomson Reuters Web of Science database. This accounted for 14,944 unique authors. To study the visibility of neurosurgery scholars in terms of social media metrics, the following altmetric indicators were used: Mendeley readers, the post count of news, tweets, blogs, LinkedIn, and Facebook. The methodology and procedures employed included descriptive statistics, chi-square test, two-sample proportion test, and analysis of covariance. The results demonstrated that the number of female scholars was significantly lower compared to their male counterparts. Additionally, female neurosurgery scientists were found to be slightly less prolific in terms of scientific productivity. However, women were slightly more visible with regard to citations, readership, and tweets. Finally, both genders were similarly successful in terms of receivingmentions from blogs, news, Facebook, or LinkedIn.
32.	Sörlin, Sverker, 1956- (författare) Humanities of Transformation : From Crisis and Critique towards the Emerging Integrative Humanities 2018 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 27:4, s. 287-297 Tidskriftsartikel (refereegranskat)abstract This article draws on the efforts to enhance and incentivize the humanities in the Nordic countries in the last quarter century, with a main focus on Sweden. During this period, bibliometric methodologies and a series of ‘crisis debates’ have formed an image of Nordic humanities as provincial, parochial, and not performing on a par with relatively high levels of achievement in most other science and knowledge fields in the Nordic countries. However, over a period of many years, a parallel collective learning experience has occurred through which the basic evaluation dimensions and criteria have been debated and also deepened. There is now an ongoing move away from the ambition of finding easy-to-operate knowledge management tools, such as performance indicators strictly related to funding systems. In this article it is argued that these tendencies can be linked to the emergence of a new transformations regime of research policy that has gradually taken shape over the past decade and is framing a new generation of humanities knowledge, here called the humanities of transformation, the contours of which are now visible, not least in the Nordic countries. Ultimately, it is possible to identify a far richer and more complex image of quality in the humanities and their performance in the Nordic countries than the one we had when the period of major, structural reform of higher education institutions in the Nordic countries started around 1990.
33.	Thomas, Duncan A., et al. (författare) Changing research on research evaluation : A critical literature review to revisit the agenda 2020 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 29:3, s. 275-288 Forskningsöversikt (refereegranskat)abstract The current range and volume of research evaluation-related literature is extensive and incorporates scholarly and policy/practice-related perspectives. This reflects academic and practical interest over many decades and trails the changing funding and reputational modalities for universities, namely increased selectivity applied to institutional research funding streams and the perceived importance of university rankings and other reputational devices. To make sense of this highly diverse body of literature, we undertake a critical review of over 350 works constituting, in our view, the 'state-of-the-art' on institutional performance-based research evaluation arrangements (PREAs). We focus on PREAs because they are becoming the predominant means worldwide to allocate research funds and accrue reputation for universities. We highlight the themes addressed in the literature and offer critical commentary on the balance of scholarly and policy/ practice-related orientations.We then reflect on five limitations to the state-of-the-art and propose a new agenda, and a change of perspective, to progress this area of research in future studies.
34.	van den Besselaar, Peter, et al. (författare) Counterintuitive effects of incentives? 2017 Ingår i: Research Evaluation. - : OXFORD UNIV PRESS. - 0958-2029 .- 1471-5449. ; 26:4, s. 349-351 Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract A recent paper in this journal compares the Norwegian model of using publications counts for university funding with a similar intervention in Australia in the mid-1990 s. The authors argue that the Norwegian model (taking into account the quality of publications) performs better than the Australian (which did neglect paper quality other than being peer reviewed). We argue that these conclusions are in contrast to the evidence provided in the article, and therefore should be considered incorrect.
35.	Wang, Qi, et al. (författare) Defining the role of cognitive distance in the peer review process with an explorative study of a grant scheme in infection biology 2015 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 24:3, s. 271-281 Tidskriftsartikel (refereegranskat)abstract The aim of this article is twofold: (1) to provide a methodology for measurement of cognitive distance between researchers and (2) to explore the role of cognitive distance on the results of peer review processes. Cited references and the content of articles are used to represent their respective scientific knowledge bases. Based on the two different approaches-Author-Bibliographic Coupling analysis and Author-Topic analysis-we apply the methodology on a recent competition for grants from the Swedish Strategic Foundation. Results indicate that cognitive distances between applicants and reviewers might influence peer review results, but that the impact is to some extent at the unexpected end. The main contribution of this article is the elaboration on the relevance of the concept of cognitive distance to the issue of research evaluation in general, and especially in relation to peer review as a model used in grant decisions.
36.	Wise, Emily, et al. (författare) A participatory approach to tracking system transformation in clusters and innovation ecosystems-Evolving practice in Sweden's Vinnväxt programme 2022 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 31:2, s. 271-287 Tidskriftsartikel (refereegranskat)abstract For decades, cluster initiatives and funding programmes have been used as instruments of industrial and innovation policy-addressing system failures by strengthening linkages among actors, fostering innovation, and developing more effective innovation systems. More recently, a growing segment of these initiatives are also focused on driving system-level transformation and contributing to broader societal benefits. This segment is characterized by larger-scale and longer-Term strategic efforts involving a variety of stakeholders across different parts of society, aimed at contributing to addressing societal challenges. These characteristics are shared with the emerging frame of transformative innovation policy, which highlights the importance of embedded practices of learning and reflexivity to enable continuous monitoring of progress and inform and adapt the direction of systemic change processes-requiring new approaches to governance and evaluation. Despite deep experience with implementing cluster programmes and other systemic innovation policy instruments, practitioners still struggle with monitoring and evaluation. Current approaches focus on evidencing strengthened innovation (and economic effects) on the level of firms and research actors, and fail to capture contributions on the level of the broader system. This article presents an evolving approach for tracking system transformation in clusters and collaborative innovation initiatives. Through an interactive, co-development process with initiatives in the Swedish Vinnväxt programme, this research proposes a definition and set of system effect categories for cluster initiatives. It tests a participatory approach for tracking their contribution to system-level change over time, providing an initial case on which to build and apply in other transformative innovation programmes.
37.	Heshmati, Almas, et al. (författare) 2013 Ingår i: Research Evaluation. - : Oxford University Press (OUP). - 0958-2029 .- 1471-5449. ; 22:1, s. 15-29 Tidskriftsartikel (refereegranskat)abstract This article introduces an agent-based simulation model representing the dynamic processes of cooperative R&D in the manufacturing sector of South Korea. Firms’ behaviors were defined according to empirical findings on a data set from the internationally standardized Korean Innovation Survey in 2005. Simulation algorithms and parameters were defined based on the determinants of firms’ likelihood to participate in cooperation with other firms when conducting innovation activities. The calibration process was conducted to the point where artificially generated scenarios were equivalent to the one observed in the real world. The aim of this simulation game was to create a basic implementation that could be extended to test different policies strategies in order to observe sector responses (including cross-sector spillovers) when promoting cooperative innovation. Based on the evaluation of simulated research collaboration data, sector responses to strategies concerning government intervention in R&D of the firms can now be assessed.
38.	Hellström, Tomas (författare) Evaluation of artistic research 2010 Ingår i: Research Evaluation. - 0958-2029. ; 19:5, s. 306-316 Tidskriftsartikel (refereegranskat)abstract The gradual inclusion of art colleges and schools into the regular university system has prompted previously craft-based subjects, such as music, visual arts, design and performance, to develop and formalize a research component. While such 'artistic research' is debated, many key points of this debate are actualized when project proposals and results are evaluated by institutional funders. To provide firmer ground for such evaluations, this article explicates some dimensions of value of artistic research: its public and private, and its intrinsic and extrinsic values respectively, particularly in relation to mainstream science. The article describes possible tensions between researcher and evaluator standards, stemming from the special conditions of this field, using a Swedish case study. Key dimensions of value and associated epistemic tensions are identified, involving levels of acceptable serendipity in research processes and outcomes, acceptable forms of communication and the cross-sectoral nature of artistic research.
39.	Mattsson, P, et al. (författare) What do European research collaboration networks in life sciences look like? 2010 Ingår i: RESEARCH EVALUATION. - 0958-2029. ; 19:5, s. 373-384 Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)
40.	Carlsson, Tommy, et al. (författare) Experiences and preferences of care among Swedish immigrants following a prenatal diagnosis of congenital heart defect in the fetus : a qualitative interview study 2016 Ingår i: BMC Pregnancy and Childbirth. - : Springer Science and Business Media LLC. - 1471-2393 .- 1471-2393. ; 16:130 Tidskriftsartikel (refereegranskat)abstract BACKGROUND: Immigrants experience significant challenges when in contact with healthcare and report less satisfaction with maternity care compared to native Swedes. Research that gives voice to pregnant immigrant women and their partners following a prenatal diagnosis of a fetal anomaly is scarce. Thus, the aim of this study was to explore experiences and preferences of care following a prenatal diagnosis of congenital heart defect among Swedish immigrants.METHODS: Pregnant immigrants and their partners were consecutively recruited following a prenatal diagnosis of a congenital heart defect in the fetus. Nine respondents were interviewed in five interviews, four with the aid of a professional interpreter. The material was analyzed using manifest qualitative content analysis.RESULTS: The analysis resulted in five categories: 1) "Trustworthy information", 2) "Language barriers", 3) "Psychosocial situation", 4) "Peer support", and 5) "Religious positions".CONCLUSION: The potential need for interpreter services, visual information, psychosocial support, coordination with welfare officers, and respect for religious positions about termination of pregnancy are all important aspects for health professionals to consider when consulting immigrants faced with a prenatal diagnosis of fetal anomaly in the fetus. Peer support within this context needs to be further explored in future studies.

Skapa referenser, mejla, bekava och länka

Länka till träfflistan

Träfflista för sökning "L773:0958 2029 OR L773:1471 5449 "

Avgränsa träffmängd

År