high load with firefox 52.9.0esr 32bit on 64bit linuxmint

[sh-dvl]

Prerequisites

• I verified that this is not a filter issue
  • Filter issues MUST be reported at filter issue tracker
• This is not a support issue or a question
  • Support issues and questions are handled at /r/uBlockOrigin
• I performed a cursory search of the issue tracker to avoid opening a duplicate issue
  • Your issue may already be reported.
• I tried to reproduce the issue when...
  • uBlock Origin is the only extension
  • uBlock Origin with default lists/settings
  • using a new, unmodified browser profile
• I am running the latest version of uBlock Origin
• I checked the documentation to understand that the issue I report is not a normal behavior

Description

fresh firefox 52.9.0esr 32bit from mozilla on a nearly fresh linuxmint 18.3 64bit with 4GB RAM

starting firefox leads immediatly to high load and unusable firefox.

same profile with 64bit-firefox: no problem (but firefox needs more memory due to 64bit)

so maybe a bitsize-issue?

A specific URL where the issue occurs

any

Steps to Reproduce

1. [First Step]
   install 32bit firefox 52.9.0esr
2. [Second Step]
   install ublock-origin
3. [and so on...]
   start firefox, try to select menus or try to load a website, do anything and wait forever...

Expected behavior:

just works

Actual behavior:

up to 100% load (top) without any progress visible

Your environment

• uBlock Origin version: 1.16.14, but also tried earlier ones
• Browser Name and version: firefox 52.9.0esr 32bit
• Operating System and version: linuxmint 18.3 64bit xfce-gui
• System: i5-6200U with 4GB, at least 2GB available during tests after starting firefox (no out-of-memory-issue)

You know uBO is not native application? Why you think it's not Firefox fault? Does this happen if you disable and enable uBO from about:addons page? If only on startup - try starting Firefox with -jsconsole command parameter and see if something is logged. Try recording performance profile https://perf-html.io/ will be hard to do this on startup, but if it's uBO then should also happen when you disable - enable from about:addons.

[uBlock-user]

same profile with 64bit-firefox: no problem

So a bad 32 bit firefox build possibly

ESR 32 bits, uBO legacy 1.16.4.4:

Error: Script terminated by timeout at:
HNTrieBuilder.prototype.vacuum@chrome://ublock0/content/js/hntrie.js:323:9
HNTrieBuilder.fromDomainOpt@chrome://ublock0/content/js/hntrie.js:85:12
FilterOriginHitSet.prototype<.matchOrigin.value@chrome://ublock0/content/js/static-net-filtering.js:890:30
FilterOrigin.prototype.match@chrome://ublock0/content/js/static-net-filtering.js:794:12
FilterBucket.prototype.match@chrome://ublock0/content/js/static-net-filtering.js:1309:14
FilterContainer.prototype.matchTokens@chrome://ublock0/content/js/static-net-filtering.js:2545:29
FilterContainer.prototype.matchStringGenericHide@chrome://ublock0/content/js/static-net-filtering.js:2573:21
FilterContainer.prototype.matchStringExactType@chrome://ublock0/content/js/static-net-filtering.js:2597:16
PageStore.prototype.init@chrome://ublock0/content/js/pagestore.js:322:22
PageStore@chrome://ublock0/content/js/pagestore.js:244:5
PageStore.factory@chrome://ublock0/content/js/pagestore.js:256:17
µb.bindTabToPageStats@chrome://ublock0/content/js/tab.js:857:21
vAPI.tabs.onNavigation@chrome://ublock0/content/js/tab.js:493:21
vAPI.net.registerListeners/locationChangedListener@chrome://ublock0/content/js/vapi-background.js:2402:9
  hntrie.js:323:9

Hmmm... Looks like you may be right.

1.16.14 is worse, ~12x:

NS_ERROR_NOT_AVAILABLE: Component returned failure code: 0x80040111 (NS_ERROR_NOT_AVAILABLE) [nsIDOMWindowUtils.isParentWindowMainWidgetVisible]  nsPrompter.js:350
Error: Script terminated by timeout at:
HNTrieBuilder.prototype.vacuum@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/hntrie.js:333:13
HNTrieBuilder.fromDomainOpt@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/hntrie.js:85:12
FilterOriginHitSet.prototype<.matchOrigin.value@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/static-net-filtering.js:890:30
FilterOrigin.prototype.match@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/static-net-filtering.js:794:12
FilterBucket.prototype.match@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/static-net-filtering.js:1319:14
FilterContainer.prototype.matchTokens@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/static-net-filtering.js:2536:29
FilterContainer.prototype.matchStringGenericHide@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/static-net-filtering.js:2564:21
FilterContainer.prototype.matchStringExactType@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/static-net-filtering.js:2588:16
PageStore.prototype.init@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/pagestore.js:322:22
PageStore@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/pagestore.js:244:5
PageStore.factory@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/pagestore.js:256:17
µb.bindTabToPageStats@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/tab.js:857:21
vAPI.tabs.onUpdated@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/tab.js:514:5
vAPI.tabs.registerListeners/onUpdated@moz-extension://ab6c7706-2274-4028-9b5b-c9dcc311be53/js/vapi-background.js:382:9

https://www.mozilla.org/en-US/firefox/organizations/all/?q=English%20(US)

Requires these libraries on my Mint 18.3 KDE:

libgtk-3-0:i386
libdbus-glib-1-2:i386
libxt6:i386

---

It's still pure JS, I thought this was compiled to WebAssembly https://github.com/gorhill/uBlock/blob/e83ffde5af29bd44ae529c5a60e2506970e7af34/src/js/hntrie.js

[uBlock-user]

Looks like you may be right.

You mean my bad 32 bit build claim ?

No, I thought uBO uses WebAssembly with some 64bit code and OP is right, but actually no WebAssembly is used.

So a bad 32 bit firefox build possibly

Yeah it's possible.

[gorhill]

The WebAssembly code was an experiment to find out if this helped performance-wise. It did not but I kept the code around to revisit eventually to find out whether the overhead incurred when crossing the js/wasm barrier has been lowered.

32bit build of 61.0.1 is OK.

[gorhill]

Possibly an issue with running Firefox 32-bit in a 64-bit linux? (an unlikely scenario, hence why this wasn't reported before?)

I am running mint 64-bit, how do I get to install the missing dependencies?

When I run ./firefox -P "esr-32bit-test" -no-remote -jsconsole from firefox directory I see error with name of missing library, then:

sudo apt install library:i386

[gorhill]

Alright it's asking me to pull in a whole lot of other stuff, and frankly I rather not pollute my current installation for a case which appears to me as an issue specific with Firefox 32-bit running in a 64-bit environment. uBO is OS agnostic, it's just javascript, it does not care whether integers/pointers are 32- or 64-bit.

As per call stack, it spins forever in the vaccuum method, which just make use of plain javascript arrays, if there was an actual issue with uBO, it would be with all uBOs, this is a core code path always hit as soon as filters are loaded.

[sh-dvl]

first, thanks for your tests on sunday...

tested again:

1. tried with all addons deactivated, all runs well, no error on stdout, following on jsconsole:

[Exception... "Component returned failure code: 0x80004004 (NS_ERROR_ABORT) [nsIPrefBranch.getComplexValue]"  nsresult: "0x80004004 (NS_ERROR_ABORT)"  location: "JS frame :: resource://app/components/nsBrowserContentHandler.js :: get startPage :: line 565"  data: no]  (unbekannt)
[Exception... "Component returned failure code: 0x8000ffff (NS_ERROR_UNEXPECTED) [nsIPrefBranch.getComplexValue]"  nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)"  location: "JS frame :: resource://app/components/nsBrowserContentHandler.js :: get startPage :: line 565"  data: no]  (unbekannt)

2. with only uBO active, again high load and bad response (10s or more) to open menu, addons-page or anything else. various outputs:

1532881733362	addons.webextension.uBlock0@raymondhill.net	WARN	Loading extension 'uBlock0@raymondhill.net': Reading manifest: Error processing permissions.1: Unknown permission "privacy"
Extension error: TypeError: command.suggested_key is null chrome://browser/content/ext-commands.js 79
[[Exception stack
loadCommandsFromManifest@chrome://browser/content/ext-commands.js:79:11
CommandList@chrome://browser/content/ext-commands.js:24:19
@chrome://browser/content/ext-commands.js:222:30
runSafeSyncWithoutClone@resource://gre/modules/ExtensionUtils.jsm:71:14
emit/promises<@resource://gre/modules/ExtensionUtils.jsm:384:55
emit@resource://gre/modules/ExtensionUtils.jsm:383:20
runManifest@resource://gre/modules/Extension.jsm:733:23
startup/<@resource://gre/modules/Extension.jsm:813:14
Current stack
runSafeSyncWithoutClone@resource://gre/modules/ExtensionUtils.jsm:73:129
emit/promises<@resource://gre/modules/ExtensionUtils.jsm:384:55
emit@resource://gre/modules/ExtensionUtils.jsm:383:20
runManifest@resource://gre/modules/Extension.jsm:733:23
startup/<@resource://gre/modules/Extension.jsm:813:14
]]
Extension error: out of memory undefined undefined
[[Exception stack
undefinedCurrent stack
runSafeSyncWithoutClone@resource://gre/modules/ExtensionUtils.jsm:73:129
runSafeSync@resource://gre/modules/ExtensionUtils.jsm:104:37
runSafe@resource://gre/modules/ExtensionCommon.jsm:123:32
receiveMessage@resource://gre/modules/ExtensionChild.jsm:586:49
_callHandlers/<@resource://gre/modules/MessageChannel.jsm:574:17
_callHandlers@resource://gre/modules/MessageChannel.jsm:573:14
_handleMessage/deferred.promise<@resource://gre/modules/MessageChannel.jsm:637:7
_handleMessage@resource://gre/modules/MessageChannel.jsm:634:24
receiveMessage@resource://gre/modules/MessageChannel.jsm:165:5
]]

[Exception... "Component returned failure code: 0x8000ffff (NS_ERROR_UNEXPECTED) [nsIPrefBranch.getComplexValue]"  nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)"  location: "JS frame :: resource://app/components/nsBrowserContentHandler.js :: get startPage :: line 565"  data: no]  (unbekannt)
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
Error: Invalid option requestBody  WebRequest.jsm:88:15
TypeError: commandsMap.get(...) is undefined[Weitere Informationen]  ext-commands.js:252:9
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
[Exception... "Component returned failure code: 0x80004004 (NS_ERROR_ABORT) [nsIPrefBranch.getComplexValue]"  nsresult: "0x80004004 (NS_ERROR_ABORT)"  location: "JS frame :: resource://app/components/nsBrowserContentHandler.js :: get startPage :: line 565"  data: no]  (unbekannt)
1532883189548	addons.webextension.uBlock0@raymondhill.net	WARN	Loading extension 'uBlock0@raymondhill.net': Reading manifest: Error processing permissions.1: Unknown permission "privacy"
command.suggested_key is null  ext-commands.js:79
[Exception... "Component returned failure code: 0x8000ffff (NS_ERROR_UNEXPECTED) [nsIPrefBranch.getComplexValue]"  nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)"  location: "JS frame :: resource://app/components/nsBrowserContentHandler.js :: get startPage :: line 565"  data: no]  (unbekannt)
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
Error: Invalid option requestBody  WebRequest.jsm:88:15
TypeError: commandsMap.get(...) is undefined[Weitere Informationen]  ext-commands.js:252:9
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52

Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
Error: Invalid option requestBody  WebRequest.jsm:88:15
TypeError: commandsMap.get(...) is undefined[Weitere Informationen]  ext-commands.js:252:9
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
[Exception... "Component returned failure code: 0x80004004 (NS_ERROR_ABORT) [nsIPrefBranch.getComplexValue]"  nsresult: "0x80004004 (NS_ERROR_ABORT)"  location: "JS frame :: resource://app/components/nsBrowserContentHandler.js :: get startPage :: line 565"  data: no]  (unbekannt)
1532883302460	addons.webextension.uBlock0@raymondhill.net	WARN	Loading extension 'uBlock0@raymondhill.net': Reading manifest: Error processing permissions.1: Unknown permission "privacy"
command.suggested_key is null  ext-commands.js:79
[Exception... "Component returned failure code: 0x8000ffff (NS_ERROR_UNEXPECTED) [nsIPrefBranch.getComplexValue]"  nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)"  location: "JS frame :: resource://app/components/nsBrowserContentHandler.js :: get startPage :: line 565"  data: no]  (unbekannt)
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
Error: Invalid option requestBody  WebRequest.jsm:88:15
TypeError: commandsMap.get(...) is undefined[Weitere Informationen]  ext-commands.js:252:9
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
NS_ERROR_NOT_AVAILABLE: Component returned failure code: 0x80040111 (NS_ERROR_NOT_AVAILABLE) [nsIDOMWindowUtils.isParentWindowMainWidgetVisible]  nsPrompter.js:350
Error: Script terminated by timeout at:
HNTrieBuilder.prototype.vacuum@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/hntrie.js:333:13
HNTrieBuilder.fromDomainOpt@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/hntrie.js:85:12
FilterOriginHitSet.prototype<.matchOrigin.value@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:890:30
FilterOrigin.prototype.match@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:794:12
FilterBucket.prototype.match@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:1319:14
FilterContainer.prototype.matchTokens@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:2536:29
FilterContainer.prototype.matchStringGenericHide@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:2564:21
FilterContainer.prototype.matchStringExactType@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:2588:16
PageStore.prototype.init@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/pagestore.js:322:22
PageStore.prototype.reuse@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/pagestore.js:378:5
µb.bindTabToPageStats@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/tab.js:878:5
vAPI.tabs.onNavigation@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/tab.js:491:25
vAPI.tabs.registerListeners/onCommitted@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/vapi-background.js:364:9
  hntrie.js:333:13
Invalid match pattern: 'moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/web_accessible_resources/*'  MatchPattern.jsm:52
Invalid match pattern: 'ws://*/*'  MatchPattern.jsm:52
Invalid match pattern: 'wss://*/*'  MatchPattern.jsm:52
NS_ERROR_NOT_AVAILABLE: Component returned failure code: 0x80040111 (NS_ERROR_NOT_AVAILABLE) [nsIDOMWindowUtils.isParentWindowMainWidgetVisible]  nsPrompter.js:350
Error: Script terminated by timeout at:
HNTrieBuilder.prototype.vacuum@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/hntrie.js:333:13
HNTrieBuilder.fromDomainOpt@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/hntrie.js:85:12
FilterOriginHitSet.prototype<.matchOrigin.value@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:890:30
FilterOrigin.prototype.match@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:794:12
FilterContainer.prototype.matchTokens@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:2527:33
FilterContainer.prototype.matchString@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/static-net-filtering.js:2765:22
PageStore.prototype.filterRequest@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/pagestore.js:640:18
onBeforeRequest@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/traffic.js:157:18
vAPI.net.registerListeners/onBeforeRequest@moz-extension://f5dc6456-d045-49f2-bfa8-f105cf573a48/js/vapi-webrequest.js:200:16
  hntrie.js:333:13

1532883302460	addons.webextension.uBlock0@raymondhill.net	WARN	Loading extension 'uBlock0@raymondhill.net': Reading manifest: Error processing permissions.1: Unknown permission "privacy"
Extension error: TypeError: command.suggested_key is null chrome://browser/content/ext-commands.js 79
[[Exception stack
loadCommandsFromManifest@chrome://browser/content/ext-commands.js:79:11
CommandList@chrome://browser/content/ext-commands.js:24:19
@chrome://browser/content/ext-commands.js:222:30
runSafeSyncWithoutClone@resource://gre/modules/ExtensionUtils.jsm:71:14
emit/promises<@resource://gre/modules/ExtensionUtils.jsm:384:55
emit@resource://gre/modules/ExtensionUtils.jsm:383:20
runManifest@resource://gre/modules/Extension.jsm:733:23
startup/<@resource://gre/modules/Extension.jsm:813:14
Current stack
runSafeSyncWithoutClone@resource://gre/modules/ExtensionUtils.jsm:73:129
emit/promises<@resource://gre/modules/ExtensionUtils.jsm:384:55
emit@resource://gre/modules/ExtensionUtils.jsm:383:20
runManifest@resource://gre/modules/Extension.jsm:733:23
startup/<@resource://gre/modules/Extension.jsm:813:14
]]
ExceptionHandler::GenerateDump cloned child 2601
ExceptionHandler::WaitForContinueSignal waiting for continue signal...
ExceptionHandler::SendContinueSignalToChild sent continue signal to child

###!!! [Parent][RunMessage] Error: Channel error: cannot send/recv


###!!! [Parent][RunMessage] Error: Channel error: cannot send/recv


###!!! [Parent][RunMessage] Error: Channel error: cannot send/recv


###!!! [Parent][RunMessage] Error: Channel error: cannot send/recv


###!!! [Parent][RunMessage] Error: Channel error: cannot send/recv

I'll try it today or tomorrow on a pure 32bit-machine to verify, if it's really a problem of 32bit on 64bit-machine