Skip to content

Commit 1fd456c

Browse files
committed
Add a bunch more infinitives from the list of words reported as being incorrectly tokenized in stanfordnlp/stanza#1401 This does not lower the quality of the Stanza tokenizer, and hopefully helps with its tokenization of words with these lemmas
1 parent 6d83af4 commit 1fd456c

File tree

2 files changed

+353
-23
lines changed

2 files changed

+353
-23
lines changed

0 commit comments

Comments
 (0)