Invalid HTTP_HOST header

[jpmckinney]

Invalid HTTP_HOST header: '46.43.2.235'. You may need to add '46.43.2.235' to ALLOWED_HOSTS.
Invalid HTTP_HOST header: '46.43.2.235:443'. You may need to add '46.43.2.235' to ALLOWED_HOSTS.
Invalid HTTP_HOST header: 'live.standard-search.opencontracting.uk0.bigv.io'. You may need to add 'live.standard-search.opencontracting.uk0.bigv.io' to ALLOWED_HOSTS.

Let's add these to the allowed hosts (the IP is for the standard-search server).

[odscjames]

Invalid HTTP_HOST header: '46.43.2.235'. You may need to add '46.43.2.235' to ALLOWED_HOSTS.
Invalid HTTP_HOST header: '46.43.2.235:443'. You may need to add '46.43.2.235' to ALLOWED_HOSTS.

Is there a use case for this one? Currently I think the only reason we would see this is bots trying to crawl us. (In fact, on a lot of our servers we set up an default apache placeholder site for bots to see).

Invalid HTTP_HOST header: 'live.standard-search.opencontracting.uk0.bigv.io'. You may need to add 'live.standard-search.opencontracting.uk0.bigv.io' to ALLOWED_HOSTS.

www.live.standard-search.opencontracting.uk0.bigv.io is however already set up as an ALLOWED_HOSTS and an SSL cert name - for the same avoiding-bots reason as above, can we leave it as this?

[jpmckinney]

Aha. Is there a way to quiet specific HTTP_HOST errors, so that we don't continually get new reports in Sentry?

[odscjames]

I see the problem - we do have an default host in place for HTTP crawlers, but not for HTTPS crawlers - ie h t t p://46.43.2.235/ gets placeholder, h t t p s://46.43.2.235/ gets site and generates a sentry error.

We can look into that.

[odscjames]

Look into stopping HTTPS crawlers hitting real sites and generating errors

[jpmckinney]

This has been solved in a few different ways:

• Re-configure the DisallowedHost logger to be muted
• Ignore the DisallowedHost logger via Sentry's configuration
• Ignore the Sentry issues

For now I ignored them until 2038-01-19 03:14 in Sentry.

[jpmckinney]

Also occurs on Data Review Tool (and presumably any Django app with Sentry installed).

[odscjames]

Commented in our deploy repository in https://github.com/OpenDataServices/deploy/issues/6

[jpmckinney]

I'm reconfiguring loggers.

• toucan
• cove-ocds
• cove-oc4ids
• standard-search Silence disallowed host errors OpenDataServices/standard-search#25

[jpmckinney]

Done and deployed. There's an open PR for standard-search. Once closed, we can resolve the open issues in Sentry.

[Bjwebb]

PR for standard-search is merged now.

Looks to me like all the open issues in Sentry are gone already.