Classifying environmental sounds using image recognition networks

• Automatic classification of environmental sounds, such as dog barking and glass breaking, is becoming increasingly interesting, especially for mobile devices. Most mobile devices contain both cameras and microphones, and companies that develop mobile devices would like to provide functionality for classifying both videos/images and sounds. In order to reduce the development costs one would like to use the same technology for both of these classification tasks. One way of achieving this is to represent environmental sounds as images, and use an image classification neural network when classifying images as well as sounds. In this paper we consider the classification accuracy for different image representations (Spectrogram, MFCC, and CRP) of environmental sounds. We evaluate the accuracy for environmental sounds in three publicly available datasets, using two well-known convolutional deep neural networks for image recognition (AlexNet and GoogLeNet). Our experiments show that we obtain good classification accuracy for the three datasets. © 2017 The Author(s).

Subject headings

NATURVETENSKAP  -- Data- och informationsvetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences (hsv//eng)

Keyword

Convolutional Neural Networks

Deep Learning

Environmental Sound Classification

GPU Processing

Image Classification

Classification (of information)

Convolution

Deep neural networks

Image recognition

Knowledge based systems

Neural networks

Automatic classification

Classification accuracy

Classification tasks

Convolutional neural network

Environmental sound classifications

Environmental sounds

Image representations

Publication and Content Type

ref (subject category)

kon (subject category)