Skip to content

Sentence splitting algorithm

b0noI edited this page Dec 20, 2014 · 12 revisions

WARNING this wiki is deprecated, new wiki is here and on our [new site](http://aif.io/

Definitions

Sentence splitting process

Process of sentence splitting can be done in 4 independent steps:

  1. Extract text separators from tokens;
  2. Divide text separators into groups;
  3. Classify text separators groups;
  4. Split text with text separators groups;

Each step is described independently.

Clone this wiki locally