any way to *exclude* features?

[ljharb]

For example, I want to run all the Array.prototype tests, but I want to skip any TypedArray or Symbol.unscopables tests. How would I do this?

[ljharb]

I hacked something with a preprocessor, but it'd be great if i could provide it as a command-line option directly.

[ljharb]

awesome, thanks!

[rwaldron]

No problem! sorry for the delay

[rwaldron]

https://github.com/bterlson/test262-harness/releases/tag/v9.1.0

[ljharb]

hmm, i'm trying it in my project, but it doesn't seem to be working:

test262-harness -t "$(node -pe 'os.cpus().length - 1')" --prelude=./browser.js --host-args='--unhandled-rejections=none' --features-exclude='resizable-arraybuffer,regexp-unicode-property-escapes,regexp-named-groups,cross-realm,TypedArray,Temporal,Atomics,ShadowRealm,Proxy,FinalizationRegistry,WeakRef' --preprocessor=./test/preprocessor.js --test262-dir=node_modules/test262 'node_modules/test262/test/built-ins/**/*.js'

[rwaldron]

@ljharb I'll take a look first thing tomorrow.

[rwaldron]

A quick check right now:

~/clonez/test262-harness master
λ ./bin/run.js -t "$(node -pe 'os.cpus().length - 1')" --features-exclude='Atomics' --host-type=d8 --host-path=$(which v8) "$TEST262_DIR/test/built-ins/Atomics/**/*.js"
Ran 0 tests
0 passed
0 failed

~/clonez/test262-harness master
λ ./bin/run.js -t "$(node -pe 'os.cpus().length - 1')" --features-exclude='BigInt' --host-type=d8 --host-path=$(which v8) "$TEST262_DIR/test/built-ins/Atomics/**/*.js"
FAIL ../test262/test/built-ins/Atomics/wait/cannot-suspend-throws.js (default)
  `Atomics.wait(i32a, 0, 0, 0)` throws TypeError Expected a TypeError to be thrown but no exception was thrown at all

FAIL ../test262/test/built-ins/Atomics/wait/cannot-suspend-throws.js (strict mode)
  `Atomics.wait(i32a, 0, 0, 0)` throws TypeError Expected a TypeError to be thrown but no exception was thrown at all

Ran 536 tests
534 passed
2 failed
./bin/run.js -t "$(node -pe 'os.cpus().length - 1')"  --host-type=d8    18.94s user 12.45s system 269% cpu 11.661 total

~/clonez/test262-harness master 11s
λ ./bin/run.js -t "$(node -pe 'os.cpus().length - 1')" --host-type=d8 --host-path=$(which v8) "$TEST262_DIR/test/built-ins/Atomics/**/*.js"
FAIL ../test262/test/built-ins/Atomics/wait/cannot-suspend-throws.js (strict mode)
  `Atomics.wait(i32a, 0, 0, 0)` throws TypeError Expected a TypeError to be thrown but no exception was thrown at all

FAIL ../test262/test/built-ins/Atomics/wait/cannot-suspend-throws.js (default)
  `Atomics.wait(i32a, 0, 0, 0)` throws TypeError Expected a TypeError to be thrown but no exception was thrown at all

FAIL ../test262/test/built-ins/Atomics/wait/bigint/cannot-suspend-throws.js (default)
  `Atomics.wait(i64a, 0, 0n, 0)` throws TypeError Expected a TypeError to be thrown but no exception was thrown at all

FAIL ../test262/test/built-ins/Atomics/wait/bigint/cannot-suspend-throws.js (strict mode)
  `Atomics.wait(i64a, 0, 0n, 0)` throws TypeError Expected a TypeError to be thrown but no exception was thrown at all

Ran 740 tests
736 passed
4 failed
./bin/run.js -t "$(node -pe 'os.cpus().length - 1')" --host-type=d8    27.99s user 18.52s system 267% cpu 17.370 total

This all looks correct, but like I said: I will dig deeper tomorrow morning 👍

[ljharb]

Thanks. All of your examples have a single feature, so maybe the issue is with multiples?

[rwaldron]

Maybe? I wrote tests that used multiples, but maybe the tests are wrong. Will find out tomorrow 😄

[rwaldron]

@ljharb give 9.2.0 a try please

[ljharb]

that seems to be working :-D thanks!

[rwaldron]

No problem!