Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When two tribes go to war... uMatrix & uBo updates [hosts+lists] #210

Closed
Thorin-Oakenpants opened this issue Aug 15, 2017 · 19 comments

Comments

@Thorin-Oakenpants
Copy link
Member

commented Aug 15, 2017

♫ ♩ When two tribes go to war... ♬ ♪

This has taken me a couple of hours to troubleshoot (but in the process I cleaned out about 60 dead prefs in my prefs.js, so yay for me!)

  • Because automation is cool, and I'm a lazy bastard, I added BarbBlock's list to uBo. It added it, but completely blank.
  • Then I noticed I had lists (and hosts) not updated. When I tried manually (using the Update now button), an icon with a mouse-over tooltip displaying A network error prevented the resource from being updated would appear next to each subscribed list.
  • Fired up FF54 from 7 days ago, it all updated fine. My profile hasn't changed. So I thought maybe it's 55 and something like FPI or one of the new prefs.
  • So off to a nilla FF. Added uBo. Lists updated fine. Added my exact same user.js from my live 55, restarted, purged the lists, and they updated fine. Hmmm, not the user.js
  • Did a compare of the 55-NILLA prefs.js (with my user.js applied) to my 55-LIVE version's (which also has the user.js applied, doh!) - nothing do with any manual pref changes or something silly I did
    • ignored all the extensions.* and timestamps etc
    • cleaned about 60 dead prefs not cleaned up by mozilla (my profile is like 4 years old - stuff in there set by mozilla and never removed, I tell ya)
  • I exported all my uBo bits and bobs and reset uBo. Updates still failed.
  • Eventually I turned off uMatrix and voila - uBo was all good.

Had to add this uMatrix rule which scares the shit out me a little: behind-the-scene * xhr allow

Now I have done nothing to uBo's settings, and nothing to uMatrix. I am not sure if either of them updated recently. I have only been on 55 for 7 days. I did do some cleaning out of "My Rules" in uBo. Just the usual per domain tweaks in either extension. I do not know how or why this happened.

I have never had to have uMatrix allow XHR behind-the-scenes, and uBo always updated lists etc fine. I do not think I screwed anything up in uBo (because it updated when uM was disabled, and it failed when reset?), and I'm almost certain I didn't change anything in uMatrix, especially in a global context.

Not sure if I can test default uBo in NILLA (which I already have set up), and add uM to it, because I do not think uM default is hard-mode.

Ideas? PS: I took some piccies if you want me to post them

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

using

  • uMatrix 1.0 which has been out since April
  • uBlock Origin v1.13.8 which was released July 18, 2017

I must have done something? I'm baffled (I can rule out corruption I think)

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

On my config with uMatrix blocking everything except image & css by default and uBlock in hard mode i don't have the problem to update the 3rd-party filters:

ublock

My user.js you can find in my repo.

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

OK, I think it is corruption. Someone else had a similar issue (in ghacks article comments). I think it has been caused by an improperly configured rule. I manually added the rules a few days ago. Someone else has had Vivaldi and Chrome and FF all do this. He just restored his 2 day old ublock0.sqlite

I will remove the uM rule, reset uM, replace the sqlite, and re-import all my shizzle .. and retest

Can I ask how you added BarbBlock. Mine doesn't say BarbBlock, it says "https://ssl.bblck.me/blacklists/ublock-origin.txt"

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

By clicking this link on his website:

link

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

Yeah, I already worked it out. When you click on the link a confirmation dialog opens like this

uBlock₀: Add the following URL to your custom filter lists?

Title: "BarbBlock"
URL: https://ssl.bblck.me/blacklists/ublock-origin.txt

See the Title part? In uBo if you restore a backup, you lose the titles for custom lists - hence why mine said the file. Sucks to be me

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

Yeah i have then the link, but i couldn't past it here since it wasn't supported.
Just unsubscribe and re-add them, if there aren't to much?

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

OK, am getting annoyed. Its not corruption of any sort. I did all this

I will remove the uM rule, reset uM, replace the sqlite, and re-import all my shizzle .. and retest

No dice. It's poked without the uM rule. I will set up a nilla 55 (no user,js stuff) with nilla uM and uBo - damnit.

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

Just unsubscribe and re-add them, if there aren't to much?

Not sure what you mean. I purged em all in early tests. I have added and removed Barb a few times. I have removed and imported and backed up and restored a dozen things a dozen times.

The sqlite i used is one that works - its from 8 days ago in FF54 and tested as working

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

Just to regain the title, nothing more.

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

What uM rules do you have for behind the scenes and for xhr?

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

Take a look here.

@earthlng

This comment has been minimized.

Copy link
Member

commented Aug 15, 2017

You probably removed some of the default rules in uMatrix

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

The default rules on a uMatrix install would be:

https-strict: behind-the-scene false
matrix-off: about-scheme true
matrix-off: behind-the-scene true
matrix-off: chrome-extension-scheme true
matrix-off: chrome-scheme true
matrix-off: localhost true
matrix-off: opera-scheme true
referrer-spoof: behind-the-scene false
ua-spoof: behind-the-scene false

      • block
    • css allow
    • frame block
    • image allow
  • 1st-party * allow
  • 1st-party frame allow

Mine look like this:

matrix-off: about-scheme true
matrix-off: behind-the-scene true
matrix-off: chrome-extension-scheme true
matrix-off: chrome-scheme true
matrix-off: localhost true
matrix-off: opera-scheme true

      • block
    • cookie block
    • css allow
    • frame block
    • image allow
    • media block
    • other block
    • script block
    • xhr block
  • 1st-party * allow

Looks like i have behind-the-scene enabled.

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

matrix-off: behind-the-scene true <- this sucker - it was missing. I guess I removed it.

I loaded my old 54, exported matrix rules, did the same with current 55 - did a compare and that item there stood out like a donkey's testicles

PS uBO all looking pretty with names
Thanks for your help @Forsaked

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

Yep, take a look at the uMatrix Wiki here and the Issues here.

No Problem @Thorin-Oakenpants

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

I can't search anything in uMatrix issues - its all shutout due to the number of silly issues

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 15, 2017

PS: Mine is almost identical to yours @Forsaked - I am only missing * * xhr block - how many sites do you need to ok that on? If its only a few sites for posting, then I'll follow suit - and I don't block media

@Forsaked

This comment has been minimized.

Copy link
Collaborator

commented Aug 15, 2017

Nearly everything with a login page needs XHR, so i have many sites on my whitelist for XHR.

@Thorin-Oakenpants

This comment has been minimized.

Copy link
Member Author

commented Aug 26, 2017

I am now officially a "human bug" award winner :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants
You can’t perform that action at this time.