An Interdisciplinary Perspective on Evaluation and Experimental Design for Visual Text Analytics : Position Paper

• Appropriate evaluation and experimental design are fundamental for empirical sciences, particularly in data-driven fields. Due to the successes in computational modeling of languages, for instance, research outcomes are having an increasingly immediate impact on end users. As the gap in adoption by end users decreases, the need increases to ensure that tools and models developed by the research communities and practitioners are reliable, trustworthy, and supportive of the users in their goals. In this position paper, we focus on the issues of evaluating visual text analytics approaches. We take an interdisciplinary perspective from the visualization and natural language processing communities, as we argue that the design and validation of visual text analytics include concerns beyond computational or visual/interactive methods on their own. We identify four key groups of challenges for evaluating visual text analytics approaches (data ambiguity, experimental design, user trust, and "big picture" concerns) and provide suggestions for research opportunities from an interdisciplinary perspective.

Ämnesord

NATURVETENSKAP  -- Data- och informationsvetenskap -- Människa-datorinteraktion (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Human Computer Interaction (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Language Technology (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Sciences (hsv//eng)

SAMHÄLLSVETENSKAP  -- Annan samhällsvetenskap -- Tvärvetenskapliga studier inom samhällsvetenskap (hsv//swe)

SOCIAL SCIENCES  -- Other Social Sciences -- Social Sciences Interdisciplinary (hsv//eng)

Nyckelord

Evaluation

User Study

Visual Text Analytics

Text Visualization

Visual Analytics

Information Visualization

Natural Language Processing

Computational Linguistics

Text Mining

Informations- och programvisualisering

Information and software visualization

Data- och informationsvetenskap

Computer and Information Sciences Computer Science

Human-centered computing -

Visualization

Visualization design and evaluation methods

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)