Age | Commit message (Collapse) | Author | |
---|---|---|---|
2015-02-28 | Trimming forgotten protectedChars buffer | Andreas Stöckel | |
2015-02-28 | Fixed potential problem in SourceOffsetVector | Andreas Stöckel | |
2015-02-26 | Fixed non-initialized variable | Andreas Stöckel | |
2015-02-25 | start of branch, commit log will be rewritten | Andreas Stöckel | |
2015-02-22 | Adapted old Tokenizer infrastructure to new Tokens.hpp | Andreas Stöckel | |
2015-02-22 | Implemented TokenizedData, a facility to store data with tokens where tokens ↵ | Andreas Stöckel | |
can be dynamically enabled and the whitespace mode specified at the moment the tokens are read | |||
2015-02-22 | Added Token header containing a standalone definition of "Token" | Andreas Stöckel | |
2015-02-22 | Implemented SourceOffsetVector -- a class for storing the SourceOffset for ↵ | Andreas Stöckel | |
each character in a sequence in an fairly efficient manner | |||
2015-02-14 | Moved Tokenizer to core/parser/utils and adapted name | Andreas Stöckel | |
2015-02-14 | Moved DynamicTokenizer and TokenTrie to parser/utils | Andreas Stöckel | |