情報処理学会 第75回全国大会講演要旨

Evaluation of interactivity will play a key role in transferring transparent accuracy paradigm of translation system to interactivity metaphor. Interactivity has been proposed as a new dimension of translation quality for designing translation system. However, unlike the accuracy dimension of translation quality, which has standard evaluation methods, such as adequacy and fluency human score or automatic BLEU score, there are no standard evaluation methods for the new interactivity dimension. Starting from translation environment view of translation systems, we examined parts of evaluations of interactivity in available translation systems, and proposed the three-phase model of interactivity, evaluation dimensions of interactivity and typical process of evaluation of the interactivity of translation systems.