Encapsulate input/position access in tokenizer. …
This would help taking input incrementally (rather than having a single `&str`) if we want to do that.