Skip to content

RCP: X.X, word tag and skip tokenization import parameters

See specifications at https://groupes.renater.fr/wiki/txm-info/public/import_xtz#modify_the_import_form.

Add new import parameters:

  • word tag: specify the XML element that encode words
  • don’t tokenize : if selected, no tokenization is done (no W element created)

Solution

Available only in the XTZ+CSV import.

Change the “Lexical Segmentation”:

Unités lexicales

  • Balise de mots : w
  • Segmenter [o]/n
    • Caractères séparateurs
      • Espaces
      • Ponctuations
    • Caractères d’élision
    • Caractères de fin de phrase

Lexical Units

  • Words tag : w
  • Tokenize [o]/n
    • Separator characters
      • Spaces
      • Punctuations
    • Elision characters
    • End of sentence characters

(from redmine: issue id 1636, created on 2016/01/08 by Matthieu Decorde)

  • Relations: