| Title | ALBAYZIN Query-by-example Spoken Term Detection 2016 evaluation |
| Publication Type | Journal Article |
| Year of Publication | 2018 |
| Authors | Tejedor, J, Toledano, DT, López Otero, P, Docío Fernández, L, Proença, J, Perdigão, F, García-Granada, F, Sanchis, E, Pompili, A, Abad, A |
| Journal | Eurasip Journal on Audio, Speech, and Music Processing |
| Issue | 2 |
| Keywords | International evaluation, Query-by-example, Spanish Search on spontaneous speech, Spoken Term Detection |
| Abstract | Query-by-example Spoken Term Detection (QbE STD) aims to retrieve data from a speech repository given an acoustic (spoken) query containing the term of interest as the input. This paper presents the systems submitted to the ALBAYZIN QbE STD 2016 Evaluation held as a part of the ALBAYZIN 2016 Evaluation Campaign at the IberSPEECH 2016 conference. Special attention was given to the evaluation design so that a thorough post-analysis of the main results could be carried out. Two different Spanish speech databases, which cover different acoustic and language domains, were used in the evaluation: the MAVIR database, which consists of a set of talks from workshops, and the EPIC database, which consists of a set of European Parliament sessions in Spanish. We present the evaluation design, both databases, the evaluation metric, the systems submitted to the evaluation, the results, and a thorough analysis and discussion. Four different research groups participated in the evaluation, and a total of eight template matching-based systems were submitted. We compare the systems submitted to the evaluation and make an in-depth analysis based on some properties of the spoken queries, such as query length, single-word/multi-word queries, and in-language/out-of-language queries. |
| URL | https://link.springer.com/article/10.1186/s13636-018-0125-9 |
| DOI | 10.1186/s13636-018-0125-9 |
| Citation Key | 645 |
