Add option for ShortLinks to be allowed in robots.txt

[the-hotmann]

I just noticed that in the robots.txt EVERYTHING is disallowed.

Now my situation is the following one:

I use a shortLink generated with Shlink on my Website as Menu-Link to track it and to have a short link in it. Google noticed this and crawled it. Now as the link is disallowed it warned me about that it is getting displayed on Google even it is basically blocked by the robots.txt.

Actually Google is doing right by crawling and displaying it as I want this. To not confuse Google I would like to have an option to select if the Shortlink should be crawlable or not.
If it should be crawlable (then it must not be a secret, but public link!) it should be excluded from the disallow of the robots.txt

Notice: this will reveal/expose all links that should be crawlable as they have to be mentioned in the robots.txt so if the link is not getting used publicly or is created as a secret link it should NOT be marked as crawlable.
Also: standardvalue of "crawlable" should ne false or 0

The robots.txt then should be created, or overwritten so if new crawlable links are getting added later it will be updated.

Could look like this:

[acelaya]

This is something nice to have.

The robots.txt file was added at some point as it is since it could be considered a sensitive default.

Of course it gives very little flexibility this way. Your suggestion would be useful.

[acelaya]

Feature merged. Will be part of Shlink v2.7.0, and supported on shlink-web-client 3.2.0