Releases: commonmark/commonmark-spec
commonmark 0.30
- Add note clarifying that not every feature of HTML examples is normative
(#672). - Move "Backslash escapes" and "Character references" to "Preliminaries"
(#600). It was confusing having them in the "Inline" section, since
they also affect some block contexts (e.g. reference link definitions). - Clarify wording in spec for character groups (#618, Titus Wormer, with
Johel Ernesto Guerror Peña).- Remove line tabulation, form feed from whitespace
- Rename newline to line feed or line ending
- Reword spec to be more explicit about whitespace
- Rename
Punctuation
toUnicode punctuation
- Reword description of line breaks
- Link unicode punctuation
- Clarify link whitespace by describing "link information"
- Clarify link destination and title
- Add definition of ASCII control characters (#603, Titus Wormer).
- Fix wording in start condition of type 7 HTML (#665, Titus Wormer).
- Add
textarea
to list of literal HTML block tags (#657).
Likescript
,style
, andpre
,textarea
blocks can contain
blank lines without the contents being interpret as commonmark. - Add
textarea
to more cases (#667, Titus Wormer). - Remove superfluous restrictions on declarations (#620, Titus Wormer).
HTML declarations need not be limited to all capital ASCII letters. - Add inline link examples with empty link text (#636, jsteuer).
- Remove outdated restriction on list item (#627, Johel Ernesto Guerrero
Peña). This is a holdover from the days when two blank lines
broke out of a list. - Add example with unbalanced parens in link destination.
- Clarify that new blocks are added to container blocks. (#598, Jay
Weisskopf). - Clarify language for backtick code spans (#589, Johel Ernesto Guerrero
Peña). - Fix link text grouping sample (#584, Ashe Connor, Johel Ernesto
Guerrero Peña). - Fix misleading text for full reference link (#581). There is no
"first link label" here, just a link text. - Use better example to test unicode case fold for reference links (#582).
The earlier test could be passed by implementations that just uppercase. - Test new entity length constraints (#575, Miha Zupan).
- normalize.py: replace cgi.escape with html.escape (#656,
Christopher Fujino). - tools/make_spec.lua:
- Fix unqualified calls to node_append_child.
- Remove extraneous href attribute on headings (#625, Christoph Päper).
- Properly handle cross-refs (#578). Previously it broke in a few cases,
e.g. with soft breaks. - Use unsafe mode so HTML isn't filtered out.
- Changes for compatibility with lua 5.3's new number type.
- CSS and HTML improvements in HTML version of spec
(#639, #641, 642, Andrei Korzhyts). - Revise emphasis parsing algorithm description in light of
commonmark/cmark#383. - Add documentation of the npm package to README.md (thanks to
Shawn Erquhart). - Fix anchor definition for 'end condition'.
- Remove duplicate example (#660, Titus Wormer).
- Remove duplicate links in spec (#655, Levi Gruspe).
- Various typo fixes (#632, Scott Abbey; #623, Anthony Fok; #601, #617, #659,
Titus Wormer).
CommonMark 0.29
[0.29]
-
Clarify that entities can't be used to indicate structure (#474). For example, you can't use
*
instead of*
for a bullet list, or
to create a new paragraph. -
Limit numerical entities to 6 hex or 7 decimal digits (#487). This is all that is needed given the upper bound on unicode code points.
-
Specify dropping of initial/final whitespace in setext heading content (#461).
-
Add example with a reference link definition where the reference is never used (#454).
-
Add example with setext header after reference link defs (#395).
-
Clarify that script, pre, style close tags can begin an HTML block (#517).
-
Remove
meta
from list of block tags in start condition #6 of HTML blocks (#527). meta tags are used in some inline contexts (though this isn't valid HTML5), e.g. in schema.org. -
Disallow newlines inside of unquoted attributes (#507, Shyouhei Urabe) as per HTML spec: https://html.spec.whatwg.org/multipage/syntax.html#unquoted.
-
Remove vestigial restriction in list item spec (#543). The "not separated by more than one blank line" was a left-over from an earlier version of the spec in which two blank lines ended a list.
-
Fix tests where list items are indented 4+ spaces (#497). The tests did not accord with the spec here; these lines should be continuation lines (if no blank space) or indented code blocks (if blank space).
-
Clarify tildes and backticks in info strings (#119). We disallow backticks in info strings after backtick fences only. Both backticks and tildes are allowed in info strings after tilde fences. Add example.
-
Indicate that info string is trimmed of all whitespace (#505, Ashe Connor). As noted in github/cmark-gfm#60, the info string is not only trimmed of "spaces" (U+0020) but also of tabs.
-
Don't strip spaces in code span containing only spaces (#569). This allows one to include a code span with just spaces, using the most obvious syntax.
-
Add example w/ reference link w/ empty destination in
<>
(#172). -
Disallow link destination beginning with
<
unless it is inside<..>
(#538). This brings the description in line with the spec example:
[foo]: (baz)[foo] . <p>[foo]: <bar>(baz)</p> <p>[foo]</p>
-
Allow spaces inside link destinations in pointy brackets (#503). This reverts a change in 0.24 and should make things easier for people working with image paths containing spaces.
-
Remove redundant condition. We don't need to specify that the absolute URI in an autolink doesn't contain
<
, since this is specified in the description of an absolute URI. -
Add additional spec examples involving link destinations in
<>
(#473). -
Add test for
[test](<url\>)
(#562). -
Disallow unescaped
(
in parenthesized link titles (#526). -
Add example showing need for space before title in reference link (#469).
-
Add codepoints for punctuation characters (#564, Christoph Päper).
-
Clarify the left- and right-flanking definitions (#534, Jay Martin).
-
Match interior delimiter runs if lengths of both are multiples of 3 (#528). This gives better results on
a***b***c
without giving bad results on the cases that motivated the original multiple of 3 rule. -
Add another test case for emphasis (#509, Michael Howell).
-
Code spans: don't collapse interior space (#532).
-
Simplify revisions to code span normalization rules. Remove the complex rule about ignoring newlines adjacent to spaces. Now newlines are simply converted to spaces.
-
Replace image 'url' with 'destination' (#512, Phill).
-
Add some links for occurrences of "above" (#480).
-
Various typo fixes (#514, Kenta Sato; #533, nikolas; tnaia, #556; #551, Grahame Grieve).
-
Create .gitattributes so that changelog.txt is highlighted as markdown (#499, Christoph Päper).
-
Update GitHub links (Morten Piibeleht).
-
Update references to container and leaf block headers to use the correct pluralization (#531, Elijah Hamovitz).
-
Rephrase example #111 to indicate that the rendering is not mandated (#568).
-
Improve documentation of parsing strategy (#563). Note that
openers_bottom
needs to be indexed to delimiter run lengths as well as types. -
make_spec.lua: Fix migration of children nodes in create_anchors (#536, Zhiming Wang). This resulted in some bugs in the rendered spec (where words would be dropped from links).
-
Fix dingus link when double clicking Markdown code (#535, Zhiming Wang). Prior to this commit, the link opened is always
/dingus/?text=
(no text). -
Add spec.json generator to Makefile (M Pacer).
CommonMark 0.28
-
Allow unlimited balanced pairs of parentheses in link URLs
(@kivikakk, commonmark/cmark#166). The rationale is that there are many URLs
containing unescaped nested parentheses. Note that
implementations are allowed to impose limits on parentheses
nesting for performance reasons, but at least three levels
of nesting should be supported. -
Change Rule 14 for Emphasis. Previously the nesting
Strong (Emph (...)) was preferred over Emph (Strong (...)).
This change makes Emph (Strong (...)) preferred.
Note that the commonmark reference implementations
were not entirely consistent about this rule, giving
different results for***hi***
and
***hi****
This change simplifies parsing. It goes against the majority
of implementations, but only on something utterly trivial. -
Clarify definition of delimiter runs (Aidan Woods, #485).
-
Clarify precedence of thematic breaks over list items
in the list spec, not just the thematic break spec (Aidan Woods). -
Clarify definition of link labels and normalization
procedure (Matthias Geier, #479). -
Clarify that the end of an HTML block is determined by its
start, and is not changed by HTML tags encountered inside
the block. Give an example of a case where a block ends
before an interior element has been closed (Yuki Izumi, #459).
In the future we might consider changing the spec to handle
this case more intuitively; this change just documents more
explicitly what the spec requires. -
Acknowledge Aaron Swartz's role in developing Markdown.
-
Remove misleading backslash in example for disabling image markup
(Matthias Geier). -
Fix Unicode terminology (general category, not class)
(Philipp Matthias Schaefer). -
Add another illustrative case for code spans (#463).
-
Remove possibly misleading 'either's (#467).
-
Fix typo (Aidan Woods).
-
Clarify that some blocks can contain code spans (Matthias Geier).
-
Fix typo and clarified tab expansion rule (Scott Abbey).
-
Add a missing "iff" (Matthias Geier).
-
Add release checklist.
-
Added npm package for spec (Vitaly Puzrin).
-
Remove SPEC variable from Makefile.
CommonMark 0.26
-
Empty list items can no longer interrupt a paragraph.
This removes an ambiguity between setext headers and
lists in cases likefoo -
Removed the "two blank lines breaks out of lists" rule.
This is incompatible with the principle of uniformity
(and indeed with the spec for list items, which requires
that the meaning of a chunk of lines not change when it
is put into a list item.) -
Ordered list markers that interrupt a paragraph must start with 1.
-
Improved the section on tabs. Added some test cases for ATX
headers and thematic breaks. Clarified that it's not just cases
that affect indentation that matter, but all cases where whitespace
matters for block structure. -
Removed example of ATX header with tab after
#
. -
Allow HTML blocks to end on the last line of their container
(Colin O'Dell, #103). -
Spec changes in strong/emph parsing. See
https://talk.commonmark.org/t/emphasis-strong-emphasis-corner-cases/2123
for motivation. This restores intuitive parsings for a number of cases.
The main change is to disallow strong or emph when one of
the delimiters is "internal" and the sum of the lengths of
the enclosing delimiter runs is a multiple of 3. Thus,
**foo*bar***
gets parsed<strong>foo*bar</strong>
rather than
<em><em>foo</em>bar</em>**
as before. Thanks to Fletcher Penney
for discussion. -
Add tests to check that markdown parsing is working fine after an HTML
block end tag (Alexandre Mutel). -
Add test case for nested lists with an indent > 4 (Alexandre Mutel).
-
Cleaned up terminology around lazy continuation lines. Added some links.
-
Fixed broken links and typos (Artyom, Matthias Geier, Sam Estep).
-
Use
≤
instead of<
in list item spec for clarity. -
Add point about readibility to "What is Markdown" section.
-
Add example for list item starting with a blank line with spaces
(Robin Stocker). -
Make interact more button-like and clearer (Jeff Atwood).
-
spec_tests.py
: exit code is now sum of failures and errors. -
spec_tests.py
: specify newline when opening file.
CommonMark 0.25
- Added several more tab-handling cases (see commonmark/cmark#101).
- Fixed spec test for tabs. In the blockquote with a tab following
the>
, only one space should be consumed, yielding two spaces
at the beginning of the content. - Update license year range to 2016 (Prayag Verma).
- Fixed typo: setext heading line -> setext heading underline (#389).
- Fixed date 2015->2016 (#388)
CommonMark 0.24
[0.24]
-
New format for spec tests, new lua formatter for specs.
The format for the spec examples has changed from. markdown . html .
to
```````````````````````````````` example markdown . html ````````````````````````````````
One advantage of this is that
spec.txt
becomes a valid
CommonMark file. -
Change
tests/spec_test.py
to use the new format. -
Replace
tools/makespec.py
with a lua script,tools/make_spec.lua
,
which uses thelcmark
rock (and indirectly libcmark). It can
generate HTML, LaTeX, and CommonMark versions of the spec. Pandoc
is no longer needed for the latex/PDF version. And, since the new
program uses the cmark API and operates directly on the parse tree,
we get much more reliable translations than we got with the old
Python script (#387). -
Remove whitelist of valid schemes. Now a scheme is any sequence
of 2-32 characters, beginning with an ASCII letter, and containing
only ASCII letters, digits, and the symbols-
,+
,.
.
Discussion at http://talk.commonmark.org/t/555. -
Added an example: URI schemes must be more than one character.
-
Disallow spaces in link destinations, even inside pointy braces.
Discussion at http://talk.commonmark.org/t/779 and
http://talk.commonmark.org/t/1287/12. -
Modify setext heading spec to allow multiline headings.
Text likeFoo bar --- baz
is now interpreted as heading + paragraph, rather than
paragraph + thematic break + paragraph. -
Call U+FFFD the REPLACEMENT CHARACTER, not the "unknown code
point character." -
Change misleading undefined entity name example.
-
Remove misleading claim about entity references in raw HTML
(a regression in 0.23). Entity references are not treated
as literal text in raw HTML; they are just passed through. -
CommonMark.dtd: allow
item
incustom_block
.
CommonMark 0.23
[0.23]
-
Don't allow space between link text and link label in a
reference link. This fixes the problem of inadvertent capture:[foo] [bar] [foo]: /u1 [bar]: /u2
-
Rename "horizontal rule" -> "thematic break". This matches the HTML5
meaning for the hr element, and recognizes that the element may be
rendered in various ways (not always as a horizontal rule).
See http://talk.commonmark.org/t/horizontal-rule-or-thematic-break/912/3 -
Rename "header" -> "heading". This avoids a confusion that might arise
now that HTML5 has a "header" element, distinct from the "headings"
h1, h2, ... Our headings correspond to HTML5 headings, not HTML5 headers.
The terminology of 'headings' is more natural, too. -
ATX headers: clarify that a space (or EOL) is needed; other whitespace
won't do (#373). Added a test case. -
Rewrote "Entities" section with more correct terminology (#375).
Entity references and numeric character references. -
Clarified that spec does not dictate URL encoding/normalization policy.
-
New test case: list item code block with empty line (Craig M.
Brandenburg). -
Added example with escaped backslash at end of link label (#325).
-
Shortened an example so it doesn't wrap (#371).
-
Fixed duplicate id "attribute".
-
Fix four link targets (Lucas Werkmeister).
-
Fix typo for link to "attributes" (Robin Stocker).
-
Fix "delimiter" spellings and links (Sam Rawlins).
-
Consistent usage of "we" instead of "I" (renzo).
-
CommonMark.dtd - Rename
html
->html_block
,
inline_html
->html_inline
for consistency. (Otherwise it is too
hard to remember whetherhtml
is block or inline, a source of
some bugs.) -
CommonMark.dtd - added
xmlns
attribute to document. -
CommonMark.dtd - added
custom_block
,custom_inline
. -
CommonMark.dtd - renamed
hrule
tothematic_break
. -
Fixed some HTML inline tests, which were actually HTML blocks, given
the changes to block parsing rules since these examples were written
(#382). -
Normalize URLs when comparing test output. This way we don't fail
tests for legitimate variations in URL escaping/normalization policies
(#334). -
normalize.py
: don't useHTMLParseError
, which has been removed
as of python 3.5 (#380). -
Minor spacing adjustments in test output, to match cmark's output,
since we test cmark without normalization. -
makespec.py
: remove need for link anchors to be on one line. -
makespec.py
: Only do two levels in the TOC. -
Use
display:inline-block
rather than floats for side-by-side.
This works when printed too. -
Added better print CSS.
CommonMark 0.21
- Changed handling of tabs. Instead of having a preprocessing step
where tabs are converted to spaces, we now handle tabs directly in
the parser. This allows tabs to be retained in code blocks and code
spans. This change adds some general language to the effect that,
for purposes of determining block structure, tabs are to be treated
just like equivalent spaces. - Completely rewrote spec for HTML blocks. The new spec provides
better handling of tags like<del>
, which can be either block
or inline level content, better handling of custom tags, and
better handling of verbatim contexts like<pre>
, comments,
and<script>
. - Added 9-digit limit on ordered list start number.
Some browsers use signed 32-bit integers for indexing
the items of an ordered list, and this can lead to odd
or undefined behavior if 10-digit start numbers are allowed. - Allow (non-initial) hyphens in tag names (#239). Custom
tags in HTML5 must contain hyphens. - Clarified that HTML block is closed at end of containing
block, not just end of the document (as with fenced code blocks.) - Specify nested link definition behavior in prose (Benjamin
Dumke-von der Ehe). - Added test for edge case in link reference parsing
(Benjamin Dumke-von der Ehe, see commonmark/commonmark.js#49). - Added link tests with fragment identifiers and queries (David
Green, #342). - Added test cases with a literal backslash in a link destination
(see commonmark/commonmark.js#45). - Added test for entity
≧̸
which resolves to two code points.
Put entity tests on several lines for readability (see
commonmark/commonmark.js#47). - Fixed broken "pre" literal HTML example. Contents
weren't escaped properly. - Simplified defn of "unicode whitespace character,"
rectifying omission of line tabulation, U+000B (#343). - Removed ambiguity in definition of "line" (#346).
- Rewrapped two prose lines so
+
does not begin a line (#347). - Added another test with overlapping emphasis markers.
- Fixed link to 'attributes'.
- Revised appendix, "A parsing strategy," and
added a description of emphasis/link parsing algorithm. spec_tests.py
- set options for conversions, set library
paths in a more cross-platform way.spec_tests.py
: force utf-8 on test failure output and
--dump-tests
(#344, #345).spec_tests.py
: Properly handle visible tab→
in expected output.normalize.py
: Don't collapse whitespace inside pre tag.- Added
spec.html
to.gitignore
(#339). - Add
-dev
suffix to spec version after release (eksperimental). - Rename "non-space" to "non-whitespace" (Konstantin Zudov, #337).
CommonMark 0.20
- Require at least one nonspace character in a link label (#322).
- Require replacement (rather than omission) of U+0000 (#327).
- Clarified that entities resolving to U+0000 are to be
replaced by U+FFFD (#323). - Removed statement that what counts as a line ending is
platform-dependent (#326). We now count\r
,\n
,
or\r\n
as a line ending regardless of the platform.
(The line ending styles can even be mixed in a single document.) - Defined "space."
- Revised "non-space character". Previously a non-space character
was defined as anything but a space (U+0020). Now it is anything
that is not a whitespace character (as defined in the spec). - Clarified that tab expansion is a preprocessing step (#330).
- Clarified lazy block quote examples (#328).
- Clarified precedence of indentation that meets conditions for
both list item continuation blocks and indented code. - Added a test case with
#
directly followed by a letter
(not an ATX header). - Added two test cases illustrating that a list at the
outer level can have items that are indented by more
than four spaces (see commonmark.js#42 and
http://talk.commonmark.org/t/odd-list-behaviour/1189). - Fixed typo in emphasis examples.
CommonMark 0.19
- Fixed rules for
_
-based emphasis and strong emphasis (#317). Previously_(bar)_.
was not parsed as containing emphasis because the closing delimiter is both left- and right- flanking. This fix allows such delimiters, provided they're followed by punctuation (i.e., they have punctuation on both sides). Similarly, mutatis mutandis, for opening delimiters and for__
. - Clarified definitions of left-flanking and right-flanking (#310). The spec now says explicitly that the beginning and end of line count as whitespace for purposes of this definition.
- Clarified that a code fence followed by header line isn't a header (#306).
- Fixed alignment in flankingness examples (cosmetic).
- Fixed last "right flanking but not left flanking" example (#316).
- Fixed a broken link (Konstantin Zudov).
- Added link to list of implementations on wiki.
- Fixed mistake in examples of left/right flanking delimiters (Konstantin Zudov).
- Spell out
iff
(if and only if) the first time it is used (#309). - Fixed typos (isoroku, #309).
- Clarified wording for soft line break: newline can't be preceded by two spaces or a backslash.
- Replaced some references to UTF-8 that should be to unicode.
- Fixed dingus link in tools/template.html.
- Replaced obsolete reference to
spec2md.pl
in spec (#304).