Using topic modelling to analyse EU’s Rural Development policy

• Any social research at some point always touches upon issues dealing with the situatedness of the researcher. Policy analysis is no exception, and there have been many quantitative attempts to mitigate problems that arise from human biases. The general concern is that, for the most part, these methodological approaches remain fairly basic (e.g. word frequencies) in comparison to the semantic nuances a human reader would normally experience. In that light, the here presented approach explores the possibility of using topic modelling as a way to quantitatively assess policy without forgoing those finer nuances of human analysis. In this presentation, the material subject to topic modelling is EU’s Rural Development policy for 2007–2013 (RDP). It proclaims itself as the first European rural policy to in its conceptual framework cover aspects labelled as quality of life (QOL). In this paper, we treat this particular statement as a hypothesis, to which topic modelling is used to investigate if this really is the case. For any concept (not just QOL) to be incorporated into a policy and to retain its influence, it must be both mentioned and linked to other parts of that same policy, elsewise it could strike as merely a rhetorical strategy. Thereby, the hypothesis is that the more themes (topics) relate to a particular concept the more relative importance the policy allocates to that particular concept. In order to gauge this relative importance of QOL within RDP, we created a categorisation based upon: (1) the RDP’s own conceptual understanding of QOL, and (2) definitions provided by contemporary cutting-edge research dedicated to QOL. The analysis shows that only about 4 % of the topics found within the RDP relate to the issues of QOL. These particular topics only mention aspects of QOL without any explicit signs of implementation. This marginal position of QOL within RDP has been corroborated by other audits of the RDP using traditional qualitative techniques. Therefore, with further methodological development, this experimental application of topic modelling in policy analysis might represent one potential alternative to traditional qualitative methods.

Ämnesord

SAMHÄLLSVETENSKAP  -- Social och ekonomisk geografi -- Kulturgeografi (hsv//swe)

SOCIAL SCIENCES  -- Social and Economic Geography -- Human Geography (hsv//eng)

SAMHÄLLSVETENSKAP  -- Medie- och kommunikationsvetenskap -- Systemvetenskap, informationssystem och informatik med samhällsvetenskaplig inriktning (hsv//swe)

SOCIAL SCIENCES  -- Media and Communications -- Information Systems, Social aspects (hsv//eng)

SAMHÄLLSVETENSKAP  -- Annan samhällsvetenskap -- Tvärvetenskapliga studier inom samhällsvetenskap (hsv//swe)

SOCIAL SCIENCES  -- Other Social Sciences -- Social Sciences Interdisciplinary (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Language Technology (hsv//eng)

HUMANIORA  -- Filosofi, etik och religion -- Filosofi (hsv//swe)

HUMANITIES  -- Philosophy, Ethics and Religion -- Philosophy (hsv//eng)

SAMHÄLLSVETENSKAP  -- Statsvetenskap -- Studier av offentlig förvaltning (hsv//swe)

SOCIAL SCIENCES  -- Political Science -- Public Administration Studies (hsv//eng)

Nyckelord

topic modelling

policy analysis

rural development

quantitative social science

digital humanities

Human Geography

Kulturgeografi

Data- och informationsvetenskap

Computer and Information Sciences Computer Science

Social Sciences

Samhällsvetenskap

topic modelling

policy analysis

rural development

quantitative social science

digital humanities

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)