Bayesian Analysis of Phoneme Confusion Matrices

• This paper presents a parametric Bayesian approach to the statistical analysis of phoneme confusion matrices measured for groups of individual listeners in one or more test conditions. Two different bias problems in conventional estimation of mutual information are analyzed and explained theoretically. Evaluations with synthetic datasets indicate that the proposed Bayesian method can give satisfactory estimates of mutual information and response probabilities, even for phoneme confusion tests using a very small number of test items for each phoneme category. The proposed method can reveal overall differences in performance between two test conditions with better power than conventional Wilcoxon significance tests or conventional confidence intervals. The method can also identify sets of confusion-matrix cells that are credibly different between two test conditions, with better power than a similar approximate frequentist method.

Subject headings

TEKNIK OCH TEKNOLOGIER  -- Maskinteknik -- Strömningsmekanik och akustik (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Mechanical Engineering -- Fluid Mechanics and Acoustics (hsv//eng)

TEKNIK OCH TEKNOLOGIER  -- Elektroteknik och elektronik (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Electrical Engineering, Electronic Engineering, Information Engineering (hsv//eng)

Keyword

Bayes methods

mutual information

parameter estimation

speech recognition

Publication and Content Type

ref (subject category)

art (subject category)