Forgot your password?
BLEU+ / BLEU Tool
This software project aims to implement standart BLEU method for Machine Translation evaluation and to develop an extension of BLEU for agglutinative languages like Turkish, Finnish and Hungarian.
Current release
No stable release available yet.
Project Description
BLEU is widely used in Machine Translation community because it is an automatic method to evaluate the performance of the translation and it is reported to have correlation with human judges.
Recently, some negative aspects of BLEU method is published, but it is still the most appropriate and common way to report the efficiency of an MT system.
In this software project, we have implemented a modified version of BLEU for agglutinative languages,in order to built a bit more "intelligent" way to find "word matches". In agglutinative languages like Turkish, running words in text are combinations of a root word and a variable number suffixes affixed to that root. The straight-forward matching technique in BLEU fails when one suffix is misplaced or mistranslated, even if the roots and all other suffixes are matching. Our BLEU+ evaluation tool accepts words in decomposed form (root+suffix1+suffix2+...) and applies a more intelligent strategy for matching by using some fine-grained matching procedure.
