Crates.io should not require the accept: header to contain the string html

[AaronFriel]

Microsoft Edge, curl, and likely other tools send Accept: */*. Crates.io is not accessible to these tools, and pages cannot be accessed via curl unless Accept: text/html or some variant containing html is sent.

crates.io/src/dist.rs

Lines 42 to 45 in d6eaeb8

	let wants_html = req.headers()
	.find("Accept")
	.map(|accept| accept.iter().any(|s| s.contains("html")))
	.unwrap_or(false);

[kureuil]

What version of Edge are you using ? I can browse the site just fine using Microsoft Edge 40.15063.0.0 on Windows 10 Pro 1703.

What do you mean by "not accessible" ? Do you get an empty response ? a 404 ?
Does it looks like #788 ?

[AaronFriel]

Yes, I get the 404 response because it did not send an Accept header that contains the string "html". I'm on the Insider Fast track on build 16257.

[AaronFriel]

Update: It appears my Edge is now sending Accept: text/html, application/xhtml+xml, image/jxr, */*, and all I've done since yesterday is restart. No clue why Edge was sending Accept: */*. I'll file a ticket on that side, but the Crates.io server should consider */* to include "html".

[carols10cents]

This indeed sounds like a duplicate of #788.