Org Mode reader: Pandoc ignores link text if the URL is image-ish, a.k.a. Cannot link to an image file without inlining the image

[edom]

How to reproduce

Pandoc version:

pandoc 2.4
Compiled with pandoc-types 1.17.5.1, texmath 0.11.1.2, skylighting 0.7.4

Command line:

pandoc a.org -o a.html

Input file a.org:

[[https://openclipart.org/image/300px/svg_to_png/216413/coniglio_rabbit_small.png]]

[[https://openclipart.org/image/300px/svg_to_png/216413/coniglio_rabbit_small.png][rabbit]]

Output file: a.html:

<p><img src="https://openclipart.org/image/300px/svg_to_png/216413/coniglio_rabbit_small.png" /></p>
<p><img src="https://openclipart.org/image/300px/svg_to_png/216413/coniglio_rabbit_small.png" /></p>

Expected output (Note the actual IMG vs the expected A in the second P):

<p><img src="https://openclipart.org/image/300px/svg_to_png/216413/coniglio_rabbit_small.png" /></p>
<p><a href="https://openclipart.org/image/300px/svg_to_png/216413/coniglio_rabbit_small.png">rabbit</a></p>

[jgm]

Confirmed with pandoc 2.5 also.
@tarleb