Sökning: WFRF:(Oestreicher Lars) >
From Visual Forms t...
From Visual Forms to Metaphors : Targeting Cultural Competence in Image Analysis
-
- Oestreicher, Lars, 1962- (författare)
- Uppsala universitet,Bildanalys och människa-datorinteraktion,Avdelningen Vi3
-
- von Bonsdorff, Jan, 1959- (författare)
- Uppsala universitet,Konstvetenskapliga institutionen
-
(creator_code:org_t)
- 2022
- 2022
- Engelska.
-
Ingår i: Proceedings of the 6th Digital Humanities in the Nordic and Baltic Countries Conference (DHNB 2022). ; , s. 343-351
- Relaterad länk:
-
https://ceur-ws.org/...
-
visa fler...
-
https://uu.diva-port... (primary) (Raw object)
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- Image analysis has taken a large step forward with the development within machine learning. Today, recognizing images as well as constituent parts of images (faces, objects, etc.) is a relatively common task within machine learning. However, there is still a big difference between recognizing the content of a picture and understanding the meaning of the image. In the current project we have chosen an interdisciplinary approach to this problem, including art history, machine learning and computational linguistics. Current approaches pay large attention to details of the image when trying to describe what is in the picture, resulting, e.g., in that smiling faces will support the interpretation of the image as “positive” or “happy”, even if the picture itself is a scary scene. Other problematic issues are irony and other polyvalent messages with a large amount of ambiguity that enables for example humorous interpretations of a picture. As a starting point, we have chosen to identify visual agency, i.e., how and why pictures, when regarded as acting agents, effectively may catch the attention of the viewer. Our objective for this first phase of the project is to investigate multi-modal models’ capacity for recognizing such high-level image content as, for example, context, agency, visual narration, and metaphors. Ultimately, the goal is to improve cultural competence and visual literacy of neural networks through art-historical and humanities expertise. In the paper we will describe our current approach, the general ideas behind it, and the methods that will be used.
Ämnesord
- HUMANIORA -- Konst -- Konstvetenskap (hsv//swe)
- HUMANITIES -- Arts -- Art History (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Datorsystem (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Computer Systems (hsv//eng)
- HUMANIORA -- Språk och litteratur -- Jämförande språkvetenskap och allmän lingvistik (hsv//swe)
- HUMANITIES -- Languages and Literature -- General Language Studies and Linguistics (hsv//eng)
Nyckelord
- Multi-modal machine learning
- high-level image content
- visual metaphors
- cultural competence
- pictorial conventions
- Artificiell intelligens
- Artificial Intelligence
- Konstvetenskap
- History of Art
- Linguistics
- Lingvistik
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)