http://repositorio.unb.br/handle/10482/46671
Título: | A probabilistically-oriented analysis of the performance of ASR Systems for brazilian radios and TVs |
Autor(es): | Azevedo, Diego Marques de Rodrigues, Guilherme Souza Ladeira, Marcelo |
Afiliação do autor: | University of Brasília, Instituto de Ciências Exatas, Departamento de Estatística University of Brasília, Instituto de Ciências Exatas, Departamento de Estatística University of Brasília, Instituto de Ciências Exatas, Departamento de Ciência da Computação |
Assunto: | Reconhecimento automático da voz Redes neurais (Computação) Inteligência artificial Áudio - propriedades |
Data de publicação: | 19-Nov-2022 |
Editora: | Springer |
Referência: | AZEVEDO, Diego Marques de; RODRIGUES, Guilherme Souza; LADEIRA, Marcelo. A probabilistically-oriented analysis of the performance of ASR Systems for brazilian radios and TVs. In: BRACIS, 11., 2022, Campinas. Anais [...]. Campinas: Springer, 2022. p. 169-180. DOI: https://doi.org/10.1007/978-3-031-21689-3_13. Disponível em: https://link.springer.com/chapter/10.1007/978-3-031-21689-3_13. Acesso em: 11 out. 2023. |
Abstract: | With the use of neural network-based technologies, Automatic Speech Recognition (ASR) systems for Brazilian Portuguese (BP) have shown great progress in the last few years. Several state-of-art results were achieved by open-source end-to-end models, such as the Kaldi toolkit and the Wav2vec 2.0. Alternative commercial tools are also available, including the Google and Microsoft speech to text APIs and the Audimus System of VoiceInteraction. We analyse the relative performance of such tools – in terms of the so-called Word Error Rate (WER) – when transcribing audio recordings from Brazilian radio and TV channels. A generalized linear model (GLM) is designed to stochastically describe the relationship between some of the audio’s properties (e.g. file format and audio duration) and the resulting WER, for each method under consideration. Among other uses, such strategy enables the analysis of local performances, indicating not only which tool performs better, but when exactly it is expected to do so. This, in turn, could be used to design an optimized system composed of several transcribers. The data generated for conducting this experiment and the scripts used to produce the stochastic model are public available. |
Unidade Acadêmica: | Instituto de Ciências Exatas (IE) Departamento de Ciência da Computação (IE CIC) Departamento de Estatística (IE EST) |
Programa de pós-graduação: | Programa de Pós-Graduação em Computação Aplicada, Mestrado Profissional |
Licença: | © 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG. |
DOI: | https://doi.org/10.1007/978-3-031-21689-3_13 |
Aparece nas coleções: | Trabalhos apresentados em evento |
Os itens no repositório estão protegidos por copyright, com todos os direitos reservados, salvo quando é indicado o contrário.