x/text/transform: "short internal buffer" in transform.String() #24170
Description
What version of Go are you using (go version)?
go version go1.9.4 linux/amd64
Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (go env)?
GOARCH="amd64"
GOBIN=""
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="censored"
GORACE=""
GOROOT="/usr/lib/go-1.9"
GOTOOLDIR="/usr/lib/go-1.9/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build137536990=/tmp/go-build -gno-record-gcc-switches"
CXX="g++"
CGO_ENABLED="1"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
What did you do?
Run this code:
package main
import (
"io/ioutil"
"fmt"
"os"
"unicode"
"golang.org/x/text/runes"
"golang.org/x/text/transform"
"golang.org/x/text/unicode/norm"
)
func main() {
buffer, _ := ioutil.ReadAll(os.Stdin)
normalized, _, err := transform.String(
transform.Chain(norm.NFD, runes.Remove(runes.In(unicode.Mn)), norm.NFC),
string(buffer))
if err != nil {
panic(err)
}
fmt.Print(normalized)
}
as follows:
cat killer.txt | go run main.go
where killer.txt is attached: killer.txt
What did you expect to see?
The printed text, basically the same as the input.
What did you see instead?
panic: transform: short internal buffer
goroutine 1 [running]:
main.main()
/home/vadim/Projects/go-workspace/src/gopkg.in/src-d/go-license-detector.v1/bug.go:20 +0x28b
exit status 2