Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Complete StarlingMonkey SDK Tests #807

Merged
merged 6 commits into from
Jun 20, 2024
Merged

Complete StarlingMonkey SDK Tests #807

merged 6 commits into from
Jun 20, 2024

Conversation

guybedford
Copy link
Contributor

@guybedford guybedford commented Jun 19, 2024

This completes the StarlingMonkey SDK test suite, enabling all of the tests for the StarlingMonkey build and on CI.

We still need to enable the WPT though, which still has tests outstanding.

In the process a new test filtering command has been added making it possible to run local integration tests via npm run test:integration -- --starlingmonkey --local test-name for example.

@@ -548,7 +548,6 @@ bool CacheEntry::body(JSContext *cx, unsigned argc, JS::Value *vp) {
// options parameter is optional
// options is meant to be an object with an optional `start` and `end` fields, both which can be
// Numbers.
dump_value(cx, options_val, stdout);
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems like a log that was included previously as an oversight.

@guybedford guybedford changed the title Complete StarlingMonkey Port Complete StarlingMonkey Tests Jun 19, 2024
@guybedford guybedford changed the title Complete StarlingMonkey Tests Complete StarlingMonkey SDK Tests Jun 19, 2024
@guybedford guybedford requested a review from elliottt June 19, 2024 22:33
if: steps.cache-crate.outputs.cache-hit != 'true'

run_wpt:
if: github.ref != 'refs/heads/main' && false
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This adds the WPT test suite to CI, but disabled for now as there are still 100 tests failing. Will post fixes in a follow-up.

Copy link
Contributor

@elliottt elliottt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why did this switch to testing release builds instead of debug builds?

return Request::is_instance(obj) || Response::is_instance(obj) ||
SimpleCacheEntry::is_instance(obj) || KVStoreEntry::is_instance(obj) ||
CacheEntry::is_instance(obj);
return Request::is_instance(obj) || Response::is_instance(obj) || KVStoreEntry::is_instance(obj);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why remove SimpleCacheEntry and CacheEntry?

Copy link
Contributor Author

@guybedford guybedford Jun 20, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Right now, the js-compute-runtime build does not test its own debug build for the SDK tests, and I originally added these to the StarlingMonkey port fix assertions that were failing for the debug build, but it turns out it changes streaming behaviour which was the root cause of the remaining test. Thus switching from the debug build to the release build and reverting these changes was the required fix.

We should follow-up with a separate PR to reenable debug builds for the SDK tests, where we should then fix the assertions both for the existing runtime and the StarlingMonkey port.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah ok. Thanks!

@guybedford
Copy link
Contributor Author

To be clear - the current js-compute-runtime debug build does not pass the SDK tests, which was the root cause of this fix.

@guybedford guybedford merged commit 1c21c9a into main Jun 20, 2024
23 checks passed
@guybedford guybedford deleted the starlingmonkey-final branch June 20, 2024 16:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants