Handling incorrect content-length headers

[TomAugspurger]

From intake/intake#367

>>> x = len(dd.read_csv("https://raw.githubusercontent.com/hadley/nycflights13/master/data-raw/airports.csv").compute())
>>> y = pd.read_csv("https://raw.githubusercontent.com/hadley/nycflights13/master/data-raw/airports.csv")
>>> len(x), len(y)
(519, 1458)

@martindurant thinks this may be because Github's HTTP server isn't respecting the 'identity' request header, and is sending back the compressed content length instead.

How should we handle this situation?

[martindurant]

This is now fixed