html tokenizer tries (and fails) tokenizing CDATA sections if they contain 'tags'.

[vdobler]

What steps will reproduce the problem?
Try to tokenize valid HTML where CDATA section contains 'tags'

What is the expected output?
No tokenization inside CDATA section is done.
See
http://www.whatwg.org/specs/web-apps/current-work/multipage/tokenization.html#cdata-section-state

What do you see instead?
html.Tokenizer will report <x> from "<![CDATA[ <x> ]]>"


Which compiler are you using (5g, 6g, 8g, gccgo)?
8g

Which operating system are you using?
Windows 7

Which revision are you using?  (hg identify)
gowin32_2011-03-07.1 (unsure which hg revision really)

Please provide any additional information below.

This bug is related to 1661 where javascript code gets missparsed.
issue #1661 would vanish for javascript which is properly enclosed
in a CDATA section if this bug would be solved.

Simple bug-triggering demo attached

Attachments:

1. bug.go (415 bytes)

[nigeltao]

Comment 1:

Yes, the html package is incomplete and full of known TODOs. I hope to get back to
working on it in May/June.

Owner changed to @nigeltao.

Status changed to Accepted.

[rsc]

Comment 2:

Status changed to Duplicate.

Merged into issue #2341.