| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 2014-11-19 | 1.) fixed the word tokenization mechanism in the CodeTokenizer which ↵ | Benjamin Paassen | |
| returned rubbish previously. 2.) Allowed multiline tokens if the mode is LINEBREAK (obsiously). 3.) returned LINEBREAK tokens in normal mode. 4.) added a CodeTokenizer test. | |||
| 2014-11-14 | implemented tokenizer test and started implementing CodeTokenizer under ↵ | Benjamin Paassen | |
| supervision of Maester Stoeckel. | |||
 |
index : ousia.git | |
| Ousía Main Repository |
| summaryrefslogtreecommitdiff |