"Please enable cookies" from ra.co (on Cloudflare) #41
Description
Subject of the issue
I'm getting a "title":"Please Wait... | Cloudflare" and "description":"Please enable cookies." from Resident Advisor's podcast episode pages, such as this one.
Steps to reproduce
curl -sL 'https://api.microlink.io/?url=https%3A%2F%2Fra.co%2Fpodcast%2F821'
Expected behaviour
Not sure what the description should be, but og:title is "RA.821 Sunju Hargun ⟋ RA Podcast", so I'd expect that for the title.
Actual behaviour
{
"status":"success",
"data":{
"title":"Please Wait... | Cloudflare",
"description":"Please enable cookies.",
"lang":"en",
"author":null,
"publisher":"Amazon",
"image":{
"url":"https://ra.co/cdn-cgi/images/trace/managed/js/transparent.gif?ray=6e6278b6dae58c30",
"type":"gif",
"duration":0.1,
"size":42,
"height":1,
"width":1,
"duration_pretty":"100ms",
"size_pretty":"42 B"
},
"date":"2022-03-03T12:45:50.000Z",
"url":"https://ra.co/podcast/821",
"logo":null
},
"statusCode":403,
"headers":{
"date":"Thu, 03 Mar 2022 12:45:50 GMT",
"content-type":"text/html; charset=UTF-8",
"cf-chl-bypass":"1",
"permissions-policy":"accelerometer=(),autoplay=(),camera=(),clipboard-read=(),clipboard-write=(),fullscreen=(),geolocation=(),gyroscope=(),hid=(),interest-cohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),screen-wake-lock=(),serial=(),sync-xhr=(),usb=()",
"cache-control":"private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0",
"expires":"Thu, 01 Jan 1970 00:00:01 GMT",
"x-frame-options":"SAMEORIGIN",
"expect-ct":"max-age=604800, report-uri=\"https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct\"",
"set-cookie":"__cf_bm=5KE3AuPAXjTbtqg1orpJUhrCEm74SBvBFamivvHlWzk-1646311550-0-ATV5QxpiBmqa/YdWk1PqMtqR3dvdRyhnoC1vmjBc6/Vx+nDJU9je3vRWZ4TawNbqXf994S1qOAZ9v5WWtlWPCbbjskKZYXuIEV8+aaohm1vE; path=/; expires=Thu, 03-Mar-22 13:15:50 GMT; domain=.ra.co; HttpOnly; Secure; SameSite=None",
"vary":"Accept-Encoding",
"server":"cloudflare",
"cf-ray":"6e6278b6dae58c30-EWR",
"content-encoding":"gzip"
}
}
Other info
Prior to discovering microlink.io I've used ad hoc hacks to fetch the titles, and had similar problems with the site then; they're probably doing stupid things at their end, so I don't know if this is fixable.
(Also, sorry if this wasn't the right issue tracker, as I couldn't figure out the canonical place for issues with just using the API from the command line.)