Skip to content
This repository has been archived by the owner on Jan 18, 2018. It is now read-only.

Tools for easily searching the list #37

Closed
thislooksfun opened this issue Feb 24, 2017 · 61 comments
Closed

Tools for easily searching the list #37

thislooksfun opened this issue Feb 24, 2017 · 61 comments

Comments

@thislooksfun
Copy link

thislooksfun commented Feb 24, 2017

It might be nice to have a searchable HTML site for the non-programmers that don't know how to use Github/grep. I am willing to throw one together early tomorrow afternoon (~13hrs from now), but if anyone wants to do it sooner, I wouldn't complain.

EDIT: Here's the list so far:
http://www.doesitusecloudflare.com/ (doesn't search the historical list, it's just current sites)
https://chrome.google.com/webstore/detail/cloudbleed-bookmark-check/egoobjhmbpflgogbgbihhdeibdfnedii - chrome plugin
http://cloudflarelistcheck.abal.moe/
https://talepicker.com/cloudbleed/
https://cloudbleed.ak5s.com/
https://thislooksfun.github.io/cloudbleed-search/ (mine - fully browser based)
http://pickarsch.xyz/
https://cloudbleedcheck.com/
https://github.com/Eonasdan/LeakyCloudChecker/ - windows app
https://bleed.cloud/index.html
https://chrome.google.com/webstore/detail/cloudbleed/gmbmbodfgolnnfhfanhjeodfambaoklj - chrome plugin
https://addons.mozilla.org/en-US/firefox/addon/cloudbleed/ - Firefox plugin
https://github.com/mikemrm/CloudFlare-HistoryChecker - Chrome / Firefox history checker

@pirate
Copy link
Owner

pirate commented Feb 24, 2017

I was planning on setting this up at some point, but if anyone else wants to toss one together before me, go for it.

@abalabahaha
Copy link
Contributor

I might be taking a stab at this in a few hours

@coderobe
Copy link
Contributor

You can open the txt in a browser tab and ctrl-f, there is no need for a website IMO

If there's gonna be one, i suggest keeping that in it's own repository though

@abalabahaha
Copy link
Contributor

abalabahaha commented Feb 24, 2017

@coderobe not everyone wants to (or can afford to) load a 68.4MB txt to search a single string

@tycoonlover1359
Copy link
Contributor

I would definitely agree with this. I'd make one myself, however I only know EXTREMELY basic HTML.

@coderobe A site for this would look a lot better, and be more user friendly.

@thislooksfun
Copy link
Author

thislooksfun commented Feb 24, 2017

@coderobe Yes, but people might not know that. Since this affects more than just us people familiar with GitHub (and even that web browsers have a search function), it would be nice.

I would do it now, but I unfortunately really need to get to bed so I can actually function in the morning. If nobody else has taken it up by the time I'm free I will take a stab at it.

@coderobe
Copy link
Contributor

I agree. Still, keeping it in a different repository would be beneficial for easy management / version control of the "database"

@abalabahaha
Copy link
Contributor

Agreed, since the site code should be mostly static after initial development. Having a link here directing to the other repo/site is enough.

@basisbit
Copy link
Contributor

maybe putting cloudflare as cache in between github.io and that website would be a fun idea - now that they fixed the actual issue.

@pirate pirate mentioned this issue Feb 24, 2017
@pirate
Copy link
Owner

pirate commented Feb 24, 2017

http://www.doesitusecloudflare.com/ (doesn't search the historical list, it's just current sites)

@franciscop
Copy link

Ouch, didn't see this issue and ended up doing one myself with the list from this repository. It's open source so you can actually switch it for any text dataset of your own. Will publish it when it gets deployed, which should be soon.

@franciscop
Copy link

franciscop commented Feb 24, 2017

Never mind, it uses 590MB of RAM and I'm not going to pay hundreds of dollars for a Heroku Professional Dyno, the code is in https://github.com/franciscop/cloudbleed if anyone is interested

@rickdmer
Copy link

Not exactly what was requested, but I created a Chrome extension that searches your bookmarks for sites that use Cloudflare: https://chrome.google.com/webstore/detail/cloudbleed-bookmark-check/egoobjhmbpflgogbgbihhdeibdfnedii

@abalabahaha
Copy link
Contributor

abalabahaha commented Feb 24, 2017

Made a very barebones list checker on my site for now, will improve on it when I get the time

@BhawaniGarg
Copy link

BhawaniGarg commented Feb 24, 2017

Here is a little tool from which you can search: https://talepicker.com/cloudbleed/

PS: i am updating my list every day so people can use it :)

@franciscop
Copy link

BTW if anyone wants http://cloudbleed.site/ I'll point the DNS to their project or transfer it

@thislooksfun
Copy link
Author

I'm starting work now on a simple search. Progress will be over at https://github.com/thislooksfun/cloudbleed-search , contributions are welcome.

@pathmissing
Copy link
Contributor

I too made a little tool: https://cloudbleed.ak5s.com/

@pathmissing
Copy link
Contributor

As already discussed in the IRC, I propose to use @abalabahaha's site and link it in the readme so it is easy to find for everyone.

@thislooksfun
Copy link
Author

Mine is coming along well. Will post initial version soon.

Related question: would it be possible to maintain some way to see which have been confirmed affected/unaffected? (like an [affected] / [unaffected] tag after the url in the list for example?

@EmmanuelMess
Copy link

@pathmissing https://cloudbleed.ak5s.com/ shows pages in duplicate ("localbitcoins.com", "animeflv.net").

@coderobe
Copy link
Contributor

it's also using an outdated list btw.

@pathmissing
Copy link
Contributor

Did not update the tool because there were plenty other tools. This version uses the outdated list.

@coderobe
Copy link
Contributor

@sahal2080 bleed.cloud uses an outdated list as well.

@coderobe
Copy link
Contributor

Please don't post services here if you don't intend to keep them up to date.
Thanks in advance.

@pathmissing
Copy link
Contributor

Most tools here have been posted before we decided which one to pick.

@coderobe
Copy link
Contributor

Well yes, but sites like bleed.cloud have only been added very recently, yet they are using lists from 2 days ago.

@MiningPickaxe
Copy link

MiningPickaxe commented Feb 25, 2017

I'm trying to keep my site up to date. Theoretically it should sync it every 30 min, does not work atm, doing it manually as soon as a new version arrives. Currently working on fixing it.

My site does not look so cool though

@coderobe
Copy link
Contributor

@MiningPickaxe whilst your website does use an up-to-date list, the wording is still a bit unclear IMO.

@MiningPickaxe
Copy link

If you could help me with that, I would appreciate it. I'm german and english is my secondary language...

@coderobe
Copy link
Contributor

@MiningPickaxe As you may understand, this is kinda out-of-scope here. You can check your site in to git though, allowing people to contribute.

@MiningPickaxe
Copy link

The code is now avaible here: https://github.com/MiningPickaxe/Cloudbleed-Domain-Checker
Feel free to give feedback, help me with my grammar and spelling or help to add new features/fix bugs

@mikemrm
Copy link

mikemrm commented Feb 26, 2017

I made a tool to search your Chrome and FireFox history and compare it to the current list of sites and tell you which sites you've been to are affected. Would appreciate you considering adding it to the list.
https://github.com/mikemrm/CloudFlare-HistoryChecker

@thislooksfun
Copy link
Author

@mikemrm added!

@mikemrm
Copy link

mikemrm commented Feb 26, 2017

Thanks!

@taltman
Copy link
Contributor

taltman commented Feb 26, 2017

I created a tool to check your browsing history across several browsers on MacOSX against the list, feedback welcome! https://github.com/taltman/cloudbleed-browser-scan

@peterrosell
Copy link

Another tool for bulk checking against the list of possible affected sites, https://github.com/peterrosell/cloudbleed-check. It always fetches the master version of the list. To use it you just pipe a file containing hostnames or urls. No external dependencies and can also be run as a docker container.

@coderobe
Copy link
Contributor

@peterrosell you mean like curl -Ls https://git.io/vyT0W | grep -x 'domain.com'? 😉

@pirate
Copy link
Owner

pirate commented Feb 26, 2017

I'm a little wary of all these Chrome extensions, at this point this list is intended for companies more than individuals. It will alert if they go on any of 4,000,000+ domains. There will be too many false positives to make it a useful tool, and by forcing users to reset so many passwords, we're more likely to make them choose poor ones.

@peterrosell
Copy link

peterrosell commented Feb 26, 2017

@coderobe more like this: echo "select url from urls;" | sqlite3 ~/.config/google-chrome/Default/History | docker run -i --rm peterrosell/cloudbleed-check:latest
It checks all urls from the input file

@taltman
Copy link
Contributor

taltman commented Feb 26, 2017

I've extended my tool for checking browser history on Mac (Safari, Chrome/Chromium, Firefox/TorBrowser) to now output the number of visits (summed across all browsers), and to report the most recent visit date (across all browsers) in addition to the URL, to make it easy to whittle down a large list (in my case, from 359 to 28 domains to manually check). Check it out here: https://github.com/taltman/cloudbleed-browser-scan @thislooksfun, can we add this to the list above? Thanks!

@taltman
Copy link
Contributor

taltman commented Feb 27, 2017

OK, cloudbleed-browser-scan now has been ported over to Linux. Would love for some help to get it ported to Windows...

@Eonasdan
Copy link

@taltman I have a wfp/windows app that does that

@taltman
Copy link
Contributor

taltman commented Feb 27, 2017

@Eonasdan Nice! Thanks for pointing it out to me. Does it support browsers on Windows beyond Chrome?

@mikemrm
Copy link

mikemrm commented Feb 27, 2017

Additionally. The app that I created above does chrome and Firefox in windows

@nuvious
Copy link

nuvious commented Feb 27, 2017

I wrote a java app for those that have password managers and can generate a list of all the domains they have accounts on. Youtube tutorial in ReadMe.md file.

https://github.com/nuvious/CloudFareDomainSearch

@smdvw5
Copy link

smdvw5 commented Feb 27, 2017

I hacked together a python script for going over exported Firefox bookmarks (save as 'bookmarks.json') as there is not a Firefox add-on for that at the moment.
Quick export guide: Bookmarks -> Show All Bookmarks -> Import and Backup -> Backup (name it 'bookmarks.json').
Have 'sorted_unique_cf.txt' downloaded in the same folder.
Run 'python3 site_search.py'.
( https://github.com/smdvw5/sites-using-cloudflare/blob/master/site_search.py )

@Eonasdan
Copy link

Eonasdan commented Mar 1, 2017

@taltman for whatever it's worth at this point.... my app now supports FF

@pirate
Copy link
Owner

pirate commented Mar 14, 2017

Closing this issue, I don't recommend that anyone create new tools to search list list due to having too many false positives. I'm going to work on archiving this repo, but thanks for everyone's help so far!

@pirate pirate closed this as completed Mar 14, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests