Sentence splitting algorithm

Definitions

• text separators
• sentence

Sentence splitting process

Process of sentence splitting can be decided into 4 independent steps:

1. extract text separators from tokens;
2. divide text separators into groups;
3. classify text separators groups;
4. split text with text separators groups;

Each step is described independently