Search Results - "Plátek, Ondřej"

MooseNet: A Trainable Metric for Synthesized Speech with a PLDA Module by Plátek, Ondřej, Dušek, Ondřej

“…We present MooseNet, a trainable speech metric that predicts the listeners' Mean Opinion Score (MOS). We propose a novel approach where the Probabilistic…”
Get full text

With a Little Help from the Authors: Reproducing Human Evaluation of an MT Error Detector by Plátek, Ondřej, Lango, Mateusz, Dušek, Ondřej

“…This work presents our efforts to reproduce the results of the human evaluation experiment presented in the paper of Vamvas and Sennrich (2022), which…”
Get full text

factgenie: A Framework for Span-based Evaluation of Generated Texts by Kasner, Zdeněk, Plátek, Ondřej, Schmidtová, Patrícia, Balloccu, Simone, Dušek, Ondřej

“…We present factgenie: a framework for annotating and visualizing word spans in textual model outputs. Annotations can capture various span-based phenomena such…”
Get full text

Three Ways of Using Large Language Models to Evaluate Chat by Plátek, Ondřej, Hudeček, Vojtěch, Schmidtová, Patricia, Lango, Mateusz, Dušek, Ondřej

“…This paper describes the systems submitted by team6 for ChatEval, the DSTC 11 Track 4 competition. We present three different approaches to predicting…”
Get full text

TabGenie: A Toolkit for Table-to-Text Generation by Kasner, Zdeněk, Garanina, Ekaterina, Plátek, Ondřej, Dušek, Ondřej

“…Heterogenity of data-to-text generation datasets limits the research on data-to-text generation systems. We present TabGenie - a toolkit which enables…”
Get full text

Automatic Metrics in Natural Language Generation: A Survey of Current Evaluation Practices by Schmidtová, Patrícia, Mahamood, Saad, Balloccu, Simone, Dušek, Ondřej, Gatt, Albert, Gkatzia, Dimitra, Howcroft, David M, Plátek, Ondřej, Sivaprasad, Adarsa

“…Automatic metrics are extensively used to evaluate natural language processing systems. However, there has been increasing focus on how they are used and…”
Get full text

Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP by Belz, Anya, Thomson, Craig, Reiter, Ehud, Abercrombie, Gavin, Alonso-Moral, Jose M, Arvan, Mohammad, Braggaar, Anouck, Cieliebak, Mark, Clark, Elizabeth, van Deemter, Kees, Dinkar, Tanvi, Dušek, Ondřej, Eger, Steffen, Fang, Qixiang, Gao, Mingqi, Gatt, Albert, Gkatzia, Dimitra, González-Corbelle, Javier, Hovy, Dirk, Hürlimann, Manuela, Ito, Takumi, Kelleher, John D, Klubicka, Filip, Krahmer, Emiel, Lai, Huiyuan, van der Lee, Chris, Li, Yiru, Mahamood, Saad, Mieskes, Margot, van Miltenburg, Emiel, Mosteiro, Pablo, Nissim, Malvina, Parde, Natalie, Plátek, Ondřej, Rieser, Verena, Ruan, Jie, Tetreault, Joel, Toral, Antonio, Wan, Xiaojun, Wanner, Leo, Watson, Lewis, Yang, Diyi

“…We report our efforts in identifying a set of previous human evaluations in NLP that would be suitable for a coordinated study examining what makes human…”
Get full text

Recurrent Neural Networks for Dialogue State Tracking by Plátek, Ondřej, Bělohlávek, Petr, Hudeček, Vojtěch, Jurčíček, Filip

“…This paper discusses models for dialogue state tracking using recurrent neural networks (RNN). We present experiments on the standard dialogue state tracking…”
Get full text