• Encapsulate input/position access in tokenizer.

    This would help taking input incrementally (rather than having a single `&str`) if we want to do that.
    SimonSapin committed Dec 29, 2014