Evaluation of Machine Translation Quality through the Metrics of Error Rate and Accuracy

Abstract

The aim of the paper is to find out whether it is necessary to use all automatic measures of error rate and accuracy when evaluating the quality of machine translation output from the synthetic Slovak language into the analytical English language. We used multiple comparisons for the analysis and visualized the results for each sentence through the icon graphs. Based on the results, we can state that all examined metrics, which are based on textual similarity, except the f-measure, are needed to be included in the MT quality evaluation when analyzing, sentence by sentence, the machine translation output.