summaryrefslogtreecommitdiff
path: root/src/core/parser/utils
AgeCommit message (Collapse)Author
2016-04-25Implement endAtWhitespace flag which tells TokenizedDataReader to stop ↵Andreas Stöckel
reading data after the first whitespace character
2016-04-25Implement hasNonWhitespaceChar, lastCharIsWhitespace and ↵Andreas Stöckel
firstCharIsWhitespace methods for TokenizedData class
2016-04-25Fix commentAndreas Stöckel
2016-04-25Make Tokenizer functions constAndreas Stöckel
2016-04-25Typo in commentAndreas Stöckel
2016-04-25clang compatibility: disambiguate template parameterAndreas Stöckel
2016-04-25Change way indent and dedent special tokens are produced by TokenizedDataAndreas Stöckel
* Move dedent to the end of the previous line * Leave indent to the first character of the current line * Dedent is called as many times as indent
2015-03-03Started restructuring and adapting Stack class, reenabled unit tests (does ↵Andreas Stöckel
not compile right now)
2015-03-01Prefer longer non-primary tokensAndreas Stöckel
2015-03-01allowing to store gaps in SourceOffsetVector and fixed bug with trim not ↵Andreas Stöckel
resetting offsets correctly when the new length is zero
2015-02-28Always call trim if a bestMatch has been foundAndreas Stöckel
2015-02-28Trimming forgotten protectedChars bufferAndreas Stöckel
2015-02-28Fixed potential problem in SourceOffsetVectorAndreas Stöckel
2015-02-26Fixed non-initialized variableAndreas Stöckel
2015-02-25start of branch, commit log will be rewrittenAndreas Stöckel
2015-02-22Adapted old Tokenizer infrastructure to new Tokens.hppAndreas Stöckel
2015-02-22Implemented TokenizedData, a facility to store data with tokens where tokens ↵Andreas Stöckel
can be dynamically enabled and the whitespace mode specified at the moment the tokens are read
2015-02-22Added Token header containing a standalone definition of "Token"Andreas Stöckel
2015-02-22Implemented SourceOffsetVector -- a class for storing the SourceOffset for ↵Andreas Stöckel
each character in a sequence in an fairly efficient manner
2015-02-14Moved Tokenizer to core/parser/utils and adapted nameAndreas Stöckel
2015-02-14Moved DynamicTokenizer and TokenTrie to parser/utilsAndreas Stöckel