tokenizer.go is presupposing older uax29

[opoudjis]

type tokenizer struct {
        sc *bufio.Scanner
}

Needs to be updated to

import (	"github.com/clipperhouse/uax29/iterators" )

type tokenizer struct {
        sc *iterators.Scanner
}

to work with more recent releases of uax29

[clipperhouse]

Will update! Or feel free to PR. Thanks.

[clipperhouse]

Should be fixed, try updating to latest.