summaryrefslogtreecommitdiff
path: root/token.h
Commit message (Collapse)AuthorAge
* Add TOK_BEGINDavid Phillips2018-08-06
| | | | | | | | | This lets us indicate that the lexer succeeded, even on an empty program. Previous behaviour was to return NULL on failure and on lex success of an empty progam. Enforcing the presence of a head for the linked token list ensures that we can reliably detect error as a caller of the lexer. Fixes test just added in previous commit too.
* Factor token definitions outDavid Phillips2018-08-06