RCP: x.x, Manage enclitics in the tokenizer
The SimpleTokenizerXML does not use language specific rules to tokenize clitics.
Solution 1
Use TreeTagger clitic tokenizer rules for the fr, en and it languages as defined in the in “Gestion de la langue” section of https://groupes.renater.fr/wiki/txm-info/public/composant_de_tokenisation#solution_1_simpletokenizerxml
Solution 2
Use another tokenizer, to be choosen between existing solutions of https://groupes.renater.fr/wiki/txm-info/public/specs_import_annotation_lexicale_auto#solution, if TreeTagger lemmatization is not used.
(from redmine: issue id 217, created on 2013/07/08 by Matthieu Decorde)