SavePageNow can't record websites whose CA certificate is slightly misconfigured

[VascoRatoFCCN]

When trying to record some websites like www.essv.ipv.pt or stayawaycovid.pt we get the following response:

However, web browsers have no problem accessing these websites:

It happens because the CA certificate is missing some information that most web browsers can easily fill in. SavePageNow before starting to record a webpage, it tries to do a http request to the requested website. If anything goes wrong it doesn't start recording, in this case we get an error due to a misconfigured CA certificate.

[VascoRatoFCCN]

arquivo/arquivo-webapp-eros@8e73a64 changes the checking behavior. Instead of blocking the request, it lets it go through and logs the error. e.g.:

This is good because we are no longer blocking users from using our service.

However, we now are susceptible to getting some cryptic messages while trying to use SavePageNow:

This SO answer has a solution to the CA certificate problem. We should analyze the logs to see if we should back to the previous implementation using this fix.

[VascoRatoFCCN]

A related problem, SavePageNow can be used to bypass security verification, it works on many of https://badssl.com/ examples of bad SSL.
How the browser reacts:

How SavePageNow reacts:

[arquivo-awp]

1. Remove pre-validation of URL on front-end.
2. Configure default error message on Pywb to avoid "ugly" error message on milestone Godhelpus https://github.com/arquivo/pwa-technologies/milestone/25

[dcgomes]

Fixed