Tokenisation

Effect of Tokenisation Strategies for Low-Resourced Southern African Languages

Research into machine translation for African languages is very limited and low- resourced in terms of datasets and model evaluations. …