ousia.git/test/core/parser/utils, branch master Ousía Main Repository https://git.ousia-framework.org/ousia.git/atom?h=master 2016-04-25T20:24:16+00:00 Implement endAtWhitespace flag which tells TokenizedDataReader to stop reading data after the first whitespace character 2016-04-25T20:24:16+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-04-12T16:47:29+00:00 urn:sha1:667d9c4a082552fb64c5ffe7b0bd6212c8a8b1b3 Change way indent and dedent special tokens are produced by TokenizedData 2016-04-25T20:19:30+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-04-02T23:05:16+00:00 urn:sha1:c2fb096e02aca7dd3054dc2c8260c81847d8fa1f * Move dedent to the end of the previous line * Leave indent to the first character of the current line * Dedent is called as many times as indent Prefer longer non-primary tokens 2015-03-01T12:50:15+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-03-01T12:50:15+00:00 urn:sha1:31c83c05d257c9a7a336f12342c401f97d380674 allowing to store gaps in SourceOffsetVector and fixed bug with trim not resetting offsets correctly when the new length is zero 2015-03-01T12:49:26+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-03-01T12:49:26+00:00 urn:sha1:cb6cacdc7eade9d4290767bafb7ccf4e935d0fbf Test case for data being empty if a token is found 2015-02-28T14:48:07+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-02-28T14:48:07+00:00 urn:sha1:b54760fbd5470032dc716dc870dc08b32dfba5ac Reactivated TokenizerTest 2015-02-25T23:22:23+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-02-25T23:22:23+00:00 urn:sha1:19dd5946125e90dcbd61966896c9f6cfc4451d80 Moved "assert" functions to own header 2015-02-25T23:22:12+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-02-25T23:22:12+00:00 urn:sha1:041a2dd18050e9e26ca1ee00851461dff1e1f90c start of branch, commit log will be rewritten 2015-02-25T22:09:26+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-02-25T22:09:26+00:00 urn:sha1:84c9abc3e9762c4486ddc5ca0352a5d697a51987 Adapted old Tokenizer infrastructure to new Tokens.hpp 2015-02-22T22:07:43+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-02-22T22:07:43+00:00 urn:sha1:2d4508837b7885c962f815c062f98803917eca71 Implemented TokenizedData, a facility to store data with tokens where tokens can be dynamically enabled and the whitespace mode specified at the moment the tokens are read 2015-02-22T22:06:54+00:00 Andreas Stöckel astoecke@techfak.uni-bielefeld.de 2015-02-22T22:06:54+00:00 urn:sha1:cb697e7eb78ad0bdfc2a20a7bdd2c369b678ca09