Skip to content

Releases: commonmark/commonmark-spec

commonmark 0.30

20 Jun 15:59
@jgm jgm
Compare
Choose a tag to compare
  • Add note clarifying that not every feature of HTML examples is normative
    (#672).
  • Move "Backslash escapes" and "Character references" to "Preliminaries"
    (#600). It was confusing having them in the "Inline" section, since
    they also affect some block contexts (e.g. reference link definitions).
  • Clarify wording in spec for character groups (#618, Titus Wormer, with
    Johel Ernesto Guerror Peña).
    • Remove line tabulation, form feed from whitespace
    • Rename newline to line feed or line ending
    • Reword spec to be more explicit about whitespace
    • Rename Punctuation to Unicode punctuation
    • Reword description of line breaks
    • Link unicode punctuation
    • Clarify link whitespace by describing "link information"
    • Clarify link destination and title
  • Add definition of ASCII control characters (#603, Titus Wormer).
  • Fix wording in start condition of type 7 HTML (#665, Titus Wormer).
  • Add textarea to list of literal HTML block tags (#657).
    Like script, style, and pre, textarea blocks can contain
    blank lines without the contents being interpret as commonmark.
  • Add textarea to more cases (#667, Titus Wormer).
  • Remove superfluous restrictions on declarations (#620, Titus Wormer).
    HTML declarations need not be limited to all capital ASCII letters.
  • Add inline link examples with empty link text (#636, jsteuer).
  • Remove outdated restriction on list item (#627, Johel Ernesto Guerrero
    Peña). This is a holdover from the days when two blank lines
    broke out of a list.
  • Add example with unbalanced parens in link destination.
  • Clarify that new blocks are added to container blocks. (#598, Jay
    Weisskopf).
  • Clarify language for backtick code spans (#589, Johel Ernesto Guerrero
    Peña).
  • Fix link text grouping sample (#584, Ashe Connor, Johel Ernesto
    Guerrero Peña).
  • Fix misleading text for full reference link (#581). There is no
    "first link label" here, just a link text.
  • Use better example to test unicode case fold for reference links (#582).
    The earlier test could be passed by implementations that just uppercase.
  • Test new entity length constraints (#575, Miha Zupan).
  • normalize.py: replace cgi.escape with html.escape (#656,
    Christopher Fujino).
  • tools/make_spec.lua:
    • Fix unqualified calls to node_append_child.
    • Remove extraneous href attribute on headings (#625, Christoph Päper).
    • Properly handle cross-refs (#578). Previously it broke in a few cases,
      e.g. with soft breaks.
    • Use unsafe mode so HTML isn't filtered out.
    • Changes for compatibility with lua 5.3's new number type.
  • CSS and HTML improvements in HTML version of spec
    (#639, #641, 642, Andrei Korzhyts).
  • Revise emphasis parsing algorithm description in light of
    commonmark/cmark#383.
  • Add documentation of the npm package to README.md (thanks to
    Shawn Erquhart).
  • Fix anchor definition for 'end condition'.
  • Remove duplicate example (#660, Titus Wormer).
  • Remove duplicate links in spec (#655, Levi Gruspe).
  • Various typo fixes (#632, Scott Abbey; #623, Anthony Fok; #601, #617, #659,
    Titus Wormer).

CommonMark 0.29

08 Apr 17:09
@jgm jgm
Compare
Choose a tag to compare

[0.29]

  • Clarify that entities can't be used to indicate structure (#474). For example, you can't use * instead of * for a bullet list, or 
 to create a new paragraph.

  • Limit numerical entities to 6 hex or 7 decimal digits (#487). This is all that is needed given the upper bound on unicode code points.

  • Specify dropping of initial/final whitespace in setext heading content (#461).

  • Add example with a reference link definition where the reference is never used (#454).

  • Add example with setext header after reference link defs (#395).

  • Clarify that script, pre, style close tags can begin an HTML block (#517).

  • Remove meta from list of block tags in start condition #6 of HTML blocks (#527). meta tags are used in some inline contexts (though this isn't valid HTML5), e.g. in schema.org.

  • Disallow newlines inside of unquoted attributes (#507, Shyouhei Urabe) as per HTML spec: https://html.spec.whatwg.org/multipage/syntax.html#unquoted.

  • Remove vestigial restriction in list item spec (#543). The "not separated by more than one blank line" was a left-over from an earlier version of the spec in which two blank lines ended a list.

  • Fix tests where list items are indented 4+ spaces (#497). The tests did not accord with the spec here; these lines should be continuation lines (if no blank space) or indented code blocks (if blank space).

  • Clarify tildes and backticks in info strings (#119). We disallow backticks in info strings after backtick fences only. Both backticks and tildes are allowed in info strings after tilde fences. Add example.

  • Indicate that info string is trimmed of all whitespace (#505, Ashe Connor). As noted in github/cmark-gfm#60, the info string is not only trimmed of "spaces" (U+0020) but also of tabs.

  • Don't strip spaces in code span containing only spaces (#569). This allows one to include a code span with just spaces, using the most obvious syntax.

  • Add example w/ reference link w/ empty destination in <> (#172).

  • Disallow link destination beginning with < unless it is inside <..> (#538). This brings the description in line with the spec example:
    [foo]: (baz)

     [foo]
     .
     <p>[foo]: <bar>(baz)</p>
     <p>[foo]</p>
    
  • Allow spaces inside link destinations in pointy brackets (#503). This reverts a change in 0.24 and should make things easier for people working with image paths containing spaces.

  • Remove redundant condition. We don't need to specify that the absolute URI in an autolink doesn't contain <, since this is specified in the description of an absolute URI.

  • Add additional spec examples involving link destinations in <> (#473).

  • Add test for [test](<url\>) (#562).

  • Disallow unescaped ( in parenthesized link titles (#526).

  • Add example showing need for space before title in reference link (#469).

  • Add codepoints for punctuation characters (#564, Christoph Päper).

  • Clarify the left- and right-flanking definitions (#534, Jay Martin).

  • Match interior delimiter runs if lengths of both are multiples of 3 (#528). This gives better results on a***b***c without giving bad results on the cases that motivated the original multiple of 3 rule.

  • Add another test case for emphasis (#509, Michael Howell).

  • Code spans: don't collapse interior space (#532).

  • Simplify revisions to code span normalization rules. Remove the complex rule about ignoring newlines adjacent to spaces. Now newlines are simply converted to spaces.

  • Replace image 'url' with 'destination' (#512, Phill).

  • Add some links for occurrences of "above" (#480).

  • Various typo fixes (#514, Kenta Sato; #533, nikolas; tnaia, #556; #551, Grahame Grieve).

  • Create .gitattributes so that changelog.txt is highlighted as markdown (#499, Christoph Päper).

  • Update GitHub links (Morten Piibeleht).

  • Update references to container and leaf block headers to use the correct pluralization (#531, Elijah Hamovitz).

  • Rephrase example #111 to indicate that the rendering is not mandated (#568).

  • Improve documentation of parsing strategy (#563). Note that openers_bottom needs to be indexed to delimiter run lengths as well as types.

  • make_spec.lua: Fix migration of children nodes in create_anchors (#536, Zhiming Wang). This resulted in some bugs in the rendered spec (where words would be dropped from links).

  • Fix dingus link when double clicking Markdown code (#535, Zhiming Wang). Prior to this commit, the link opened is always /dingus/?text= (no text).

  • Add spec.json generator to Makefile (M Pacer).

CommonMark 0.28

02 Aug 15:31
@jgm jgm
Compare
Choose a tag to compare
  • Allow unlimited balanced pairs of parentheses in link URLs
    (@kivikakk, commonmark/cmark#166). The rationale is that there are many URLs
    containing unescaped nested parentheses. Note that
    implementations are allowed to impose limits on parentheses
    nesting for performance reasons, but at least three levels
    of nesting should be supported.

  • Change Rule 14 for Emphasis. Previously the nesting
    Strong (Emph (...)) was preferred over Emph (Strong (...)).
    This change makes Emph (Strong (...)) preferred.
    Note that the commonmark reference implementations
    were not entirely consistent about this rule, giving
    different results for

    ***hi***
    

    and

    ***hi****
    

    This change simplifies parsing. It goes against the majority
    of implementations, but only on something utterly trivial.

  • Clarify definition of delimiter runs (Aidan Woods, #485).

  • Clarify precedence of thematic breaks over list items
    in the list spec, not just the thematic break spec (Aidan Woods).

  • Clarify definition of link labels and normalization
    procedure (Matthias Geier, #479).

  • Clarify that the end of an HTML block is determined by its
    start, and is not changed by HTML tags encountered inside
    the block. Give an example of a case where a block ends
    before an interior element has been closed (Yuki Izumi, #459).
    In the future we might consider changing the spec to handle
    this case more intuitively; this change just documents more
    explicitly what the spec requires.

  • Acknowledge Aaron Swartz's role in developing Markdown.

  • Remove misleading backslash in example for disabling image markup
    (Matthias Geier).

  • Fix Unicode terminology (general category, not class)
    (Philipp Matthias Schaefer).

  • Add another illustrative case for code spans (#463).

  • Remove possibly misleading 'either's (#467).

  • Fix typo (Aidan Woods).

  • Clarify that some blocks can contain code spans (Matthias Geier).

  • Fix typo and clarified tab expansion rule (Scott Abbey).

  • Add a missing "iff" (Matthias Geier).

  • Add release checklist.

  • Added npm package for spec (Vitaly Puzrin).

  • Remove SPEC variable from Makefile.

CommonMark 0.26

15 Jul 19:13
@jgm jgm
Compare
Choose a tag to compare
  • Empty list items can no longer interrupt a paragraph.
    This removes an ambiguity between setext headers and
    lists in cases like

    foo
    -
    

    Removed the "two blank lines breaks out of lists" rule.
    This is incompatible with the principle of uniformity
    (and indeed with the spec for list items, which requires
    that the meaning of a chunk of lines not change when it
    is put into a list item.)

  • Ordered list markers that interrupt a paragraph must start with 1.

  • Improved the section on tabs. Added some test cases for ATX
    headers and thematic breaks. Clarified that it's not just cases
    that affect indentation that matter, but all cases where whitespace
    matters for block structure.

  • Removed example of ATX header with tab after #.

  • Allow HTML blocks to end on the last line of their container
    (Colin O'Dell, #103).

  • Spec changes in strong/emph parsing. See
    https://talk.commonmark.org/t/emphasis-strong-emphasis-corner-cases/2123
    for motivation. This restores intuitive parsings for a number of cases.
    The main change is to disallow strong or emph when one of
    the delimiters is "internal" and the sum of the lengths of
    the enclosing delimiter runs is a multiple of 3. Thus,
    **foo*bar*** gets parsed <strong>foo*bar</strong> rather than
    <em><em>foo</em>bar</em>** as before. Thanks to Fletcher Penney
    for discussion.

  • Add tests to check that markdown parsing is working fine after an HTML
    block end tag (Alexandre Mutel).

  • Add test case for nested lists with an indent > 4 (Alexandre Mutel).

  • Cleaned up terminology around lazy continuation lines. Added some links.

  • Fixed broken links and typos (Artyom, Matthias Geier, Sam Estep).

  • Use instead of < in list item spec for clarity.

  • Add point about readibility to "What is Markdown" section.

  • Add example for list item starting with a blank line with spaces
    (Robin Stocker).

  • Make interact more button-like and clearer (Jeff Atwood).

  • spec_tests.py: exit code is now sum of failures and errors.

  • spec_tests.py: specify newline when opening file.

CommonMark 0.25

15 Jul 19:12
@jgm jgm
Compare
Choose a tag to compare
  • Added several more tab-handling cases (see commonmark/cmark#101).
  • Fixed spec test for tabs. In the blockquote with a tab following
    the >, only one space should be consumed, yielding two spaces
    at the beginning of the content.
  • Update license year range to 2016 (Prayag Verma).
  • Fixed typo: setext heading line -> setext heading underline (#389).
  • Fixed date 2015->2016 (#388)

CommonMark 0.24

13 Jan 06:09
@jgm jgm
Compare
Choose a tag to compare

[0.24]

  • New format for spec tests, new lua formatter for specs.
    The format for the spec examples has changed from

    .
    markdown
    .
    html
    .
    

    to

    ```````````````````````````````` example
    markdown
    .
    html
    ````````````````````````````````
    

    One advantage of this is that spec.txt becomes a valid
    CommonMark file.

  • Change tests/spec_test.py to use the new format.

  • Replace tools/makespec.py with a lua script, tools/make_spec.lua,
    which uses the lcmark rock (and indirectly libcmark). It can
    generate HTML, LaTeX, and CommonMark versions of the spec. Pandoc
    is no longer needed for the latex/PDF version. And, since the new
    program uses the cmark API and operates directly on the parse tree,
    we get much more reliable translations than we got with the old
    Python script (#387).

  • Remove whitelist of valid schemes. Now a scheme is any sequence
    of 2-32 characters, beginning with an ASCII letter, and containing
    only ASCII letters, digits, and the symbols -, +, ..
    Discussion at http://talk.commonmark.org/t/555.

  • Added an example: URI schemes must be more than one character.

  • Disallow spaces in link destinations, even inside pointy braces.
    Discussion at http://talk.commonmark.org/t/779 and
    http://talk.commonmark.org/t/1287/12.

  • Modify setext heading spec to allow multiline headings.
    Text like

    Foo
    bar
    ---
    baz
    

    is now interpreted as heading + paragraph, rather than
    paragraph + thematic break + paragraph.

  • Call U+FFFD the REPLACEMENT CHARACTER, not the "unknown code
    point character."

  • Change misleading undefined entity name example.

  • Remove misleading claim about entity references in raw HTML
    (a regression in 0.23). Entity references are not treated
    as literal text in raw HTML; they are just passed through.

  • CommonMark.dtd: allow item in custom_block.

CommonMark 0.23

29 Dec 07:16
@jgm jgm
Compare
Choose a tag to compare

[0.23]

  • Don't allow space between link text and link label in a
    reference link. This fixes the problem of inadvertent capture:

    [foo] [bar]
    
    [foo]: /u1
    [bar]: /u2
    
  • Rename "horizontal rule" -> "thematic break". This matches the HTML5
    meaning for the hr element, and recognizes that the element may be
    rendered in various ways (not always as a horizontal rule).
    See http://talk.commonmark.org/t/horizontal-rule-or-thematic-break/912/3

  • Rename "header" -> "heading". This avoids a confusion that might arise
    now that HTML5 has a "header" element, distinct from the "headings"
    h1, h2, ... Our headings correspond to HTML5 headings, not HTML5 headers.
    The terminology of 'headings' is more natural, too.

  • ATX headers: clarify that a space (or EOL) is needed; other whitespace
    won't do (#373). Added a test case.

  • Rewrote "Entities" section with more correct terminology (#375).
    Entity references and numeric character references.

  • Clarified that spec does not dictate URL encoding/normalization policy.

  • New test case: list item code block with empty line (Craig M.
    Brandenburg).

  • Added example with escaped backslash at end of link label (#325).

  • Shortened an example so it doesn't wrap (#371).

  • Fixed duplicate id "attribute".

  • Fix four link targets (Lucas Werkmeister).

  • Fix typo for link to "attributes" (Robin Stocker).

  • Fix "delimiter" spellings and links (Sam Rawlins).

  • Consistent usage of "we" instead of "I" (renzo).

  • CommonMark.dtd - Rename html -> html_block,
    inline_html -> html_inline for consistency. (Otherwise it is too
    hard to remember whether html is block or inline, a source of
    some bugs.)

  • CommonMark.dtd - added xmlns attribute to document.

  • CommonMark.dtd - added custom_block, custom_inline.

  • CommonMark.dtd - renamed hrule to thematic_break.

  • Fixed some HTML inline tests, which were actually HTML blocks, given
    the changes to block parsing rules since these examples were written
    (#382).

  • Normalize URLs when comparing test output. This way we don't fail
    tests for legitimate variations in URL escaping/normalization policies
    (#334).

  • normalize.py: don't use HTMLParseError, which has been removed
    as of python 3.5 (#380).

  • Minor spacing adjustments in test output, to match cmark's output,
    since we test cmark without normalization.

  • makespec.py: remove need for link anchors to be on one line.

  • makespec.py: Only do two levels in the TOC.

  • Use display:inline-block rather than floats for side-by-side.
    This works when printed too.

  • Added better print CSS.

CommonMark 0.21

15 Jul 00:07
@jgm jgm
Compare
Choose a tag to compare
  • Changed handling of tabs. Instead of having a preprocessing step
    where tabs are converted to spaces, we now handle tabs directly in
    the parser. This allows tabs to be retained in code blocks and code
    spans. This change adds some general language to the effect that,
    for purposes of determining block structure, tabs are to be treated
    just like equivalent spaces.
  • Completely rewrote spec for HTML blocks. The new spec provides
    better handling of tags like <del>, which can be either block
    or inline level content, better handling of custom tags, and
    better handling of verbatim contexts like <pre>, comments,
    and <script>.
  • Added 9-digit limit on ordered list start number.
    Some browsers use signed 32-bit integers for indexing
    the items of an ordered list, and this can lead to odd
    or undefined behavior if 10-digit start numbers are allowed.
  • Allow (non-initial) hyphens in tag names (#239). Custom
    tags in HTML5 must contain hyphens.
  • Clarified that HTML block is closed at end of containing
    block, not just end of the document (as with fenced code blocks.)
  • Specify nested link definition behavior in prose (Benjamin
    Dumke-von der Ehe).
  • Added test for edge case in link reference parsing
    (Benjamin Dumke-von der Ehe, see commonmark/commonmark.js#49).
  • Added link tests with fragment identifiers and queries (David
    Green, #342).
  • Added test cases with a literal backslash in a link destination
    (see commonmark/commonmark.js#45).
  • Added test for entity &ngE; which resolves to two code points.
    Put entity tests on several lines for readability (see
    commonmark/commonmark.js#47).
  • Fixed broken "pre" literal HTML example. Contents
    weren't escaped properly.
  • Simplified defn of "unicode whitespace character,"
    rectifying omission of line tabulation, U+000B (#343).
  • Removed ambiguity in definition of "line" (#346).
  • Rewrapped two prose lines so + does not begin a line (#347).
  • Added another test with overlapping emphasis markers.
  • Fixed link to 'attributes'.
  • Revised appendix, "A parsing strategy," and
    added a description of emphasis/link parsing algorithm.
  • spec_tests.py - set options for conversions, set library
    paths in a more cross-platform way.
  • spec_tests.py: force utf-8 on test failure output and
    --dump-tests (#344, #345).
  • spec_tests.py: Properly handle visible tab in expected output.
  • normalize.py: Don't collapse whitespace inside pre tag.
  • Added spec.html to .gitignore (#339).
  • Add -dev suffix to spec version after release (eksperimental).
  • Rename "non-space" to "non-whitespace" (Konstantin Zudov, #337).

CommonMark 0.20

08 Jun 20:06
@jgm jgm
Compare
Choose a tag to compare
  • Require at least one nonspace character in a link label (#322).
  • Require replacement (rather than omission) of U+0000 (#327).
  • Clarified that entities resolving to U+0000 are to be
    replaced by U+FFFD (#323).
  • Removed statement that what counts as a line ending is
    platform-dependent (#326). We now count \r, \n,
    or \r\n as a line ending regardless of the platform.
    (The line ending styles can even be mixed in a single document.)
  • Defined "space."
  • Revised "non-space character". Previously a non-space character
    was defined as anything but a space (U+0020). Now it is anything
    that is not a whitespace character (as defined in the spec).
  • Clarified that tab expansion is a preprocessing step (#330).
  • Clarified lazy block quote examples (#328).
  • Clarified precedence of indentation that meets conditions for
    both list item continuation blocks and indented code.
  • Added a test case with # directly followed by a letter
    (not an ATX header).
  • Added two test cases illustrating that a list at the
    outer level can have items that are indented by more
    than four spaces (see commonmark.js#42 and
    http://talk.commonmark.org/t/odd-list-behaviour/1189).
  • Fixed typo in emphasis examples.

CommonMark 0.19

29 Apr 04:07
@jgm jgm
Compare
Choose a tag to compare
  • Fixed rules for _-based emphasis and strong emphasis (#317). Previously _(bar)_. was not parsed as containing emphasis because the closing delimiter is both left- and right- flanking. This fix allows such delimiters, provided they're followed by punctuation (i.e., they have punctuation on both sides). Similarly, mutatis mutandis, for opening delimiters and for __.
  • Clarified definitions of left-flanking and right-flanking (#310). The spec now says explicitly that the beginning and end of line count as whitespace for purposes of this definition.
  • Clarified that a code fence followed by header line isn't a header (#306).
  • Fixed alignment in flankingness examples (cosmetic).
  • Fixed last "right flanking but not left flanking" example (#316).
  • Fixed a broken link (Konstantin Zudov).
  • Added link to list of implementations on wiki.
  • Fixed mistake in examples of left/right flanking delimiters (Konstantin Zudov).
  • Spell out iff (if and only if) the first time it is used (#309).
  • Fixed typos (isoroku, #309).
  • Clarified wording for soft line break: newline can't be preceded by two spaces or a backslash.
  • Replaced some references to UTF-8 that should be to unicode.
  • Fixed dingus link in tools/template.html.
  • Replaced obsolete reference to spec2md.pl in spec (#304).