WIP smup #119

fitzgen · 2017-06-02T18:35:30Z

This change is


        Remove old mozjs


        Add new mozjs


        Remove bad Cargo.toml


        Remove testing Cargo.toml files


        WIP Fix finding of the include dir for bindgen

This needs to make its way upstream


        Re-export root through jsapi

This needs to be ported over to the m-c patch queue.


        Add more APIs to work with AutoIdVector.


        Return a ConversionResult::Failure when converting a non-iterable val…

…ue to Vec.


        Wrap uses of extern statics in unsafe blocks.

This fixes safe_extern_statics warnings; see <rust-lang/rust#36247>.


        Improve typed array support.


        Add missing hooks to SIMPLE_GLOBAL_CLASS_OPS.


        Add a test for typed array support.


        Handle panics.


        Fix travis build.


        Fix code involving empty type references

by changing it to use pointers instead. Fixes #311


        Add an implementation of Default for Heap<*mut T>.

We should be able to create a default value for any Heap<*mut T> where *mut T implements GCMethods<*mut T> and Copy, not just for Heap<*mut JSObject>.


        Add a method to create a Heap<T>.

Currently, to create a Heap<T>, one first has to create a Heap<T>::default, and then call Heap<T>::set. This is a common pattern and therefore should be abstracted behind a method.


        Add an implementation of Clone for Heap<T>.


        Add an implementation of PartialEq for Heap<T>.


        Implement a Trace trait for types that can be traced.

We expose several JSAPI functions that are used for tracing. By abstracting these functions behind a trait we can overload them on the type to be traced.


        Use a less strict bound for wrap_panic.

This is what's required for catch_unwind; there's no need to be stricter.


        Implement maybe_wrap_object_value without OOL calls

The only remaining OOL calls are ToWindowIfWindowProxy and JS_WrapValue, like in the equivalent Gecko function.


        Fix a typo in try_to_outerize


        Add methods to create a HandleValueArray.

Rust-mozjs currently does not define any methods to create instances of HandleValueArray. Consequently, consumers have to create these instances manually. This is unnecessary boilerplate, and therefore should be abstracted behind a function.


        Store the JSContext in TLS for easy access.


        Add type for ArrayBufferView.


        Remove the type parameter from GCMethods.

Fixes #256.


        Disallow constructing an unrooted Rooted with a value.

This should make it harder to use Rooted in an unsound way (when not using the rooted!() macro).


        Consistently apply the same bounds to RootedGuard's type parameter.


        Clear the value of a Rooted when the RootedGuard goes out of scope.

This ensures no unrooted values linger in the Rooted when it is no longer rooted. It should be impossible to access the value after that, but Handles currently lack the lifetime to prevent that (#153).


        TEMP don't source tooltool script on windows? sfink says it may work


        TEMP Add logging for whats in C:\Python2.7

jdm

I totally ignored the first two commits. The rest of the changes all look pretty sensible.

jdm · 2017-07-10T18:47:01Z

mozjs/python/mozbuild/mozbuild/test/frontend/data/rust-library-name-mismatch/Cargo.toml

@@ -1,12 +0,0 @@
-[package]


Is this being upstreamed? Does it cause problems for us somehow?

Cargo will complain about malformed toml files and refuse to look any further.

I upstreamed this into the js/src/make-source-package.sh bundling script that creates the source release tarballs. If we ever want to point directly at a revision of m-c, rather than snapshots in this repo, then we will need another fix.

jdm · 2017-07-10T18:47:01Z

mozjs/python/mozbuild/mozbuild/test/backend/data/host-rust-library-features/Cargo.toml

@@ -1,15 +0,0 @@
-[package]


Same question - do we need to automate the removal of these each time we update SpiderMonkey?

jdm · 2017-07-10T18:47:01Z

mozjs/js/rust/build.rs

@@ -25,7 +26,16 @@ fn build_jsglue_cpp() {

 /// Find the public include directory within our mozjs-sys crate dependency.
 fn get_mozjs_include_dir() -> path::PathBuf {
-    let entries = glob::glob("./target/*/build/mozjs_sys-*/out/dist/include")
+    let out_dir = env::var("OUT_DIR")


The commit message mentions the need for upstreaming. Has this happened? Is this still WIP?

The upstreaming is still theoretical because none of js/rust has actually landed in m-c yet. The m-c patches I had are fairly out of date now, and need to be recreated anyways, so this won't get lost.

jdm · 2017-07-10T18:47:01Z

mozjs/js/rust/build.rs

@@ -122,6 +122,8 @@ const WHITELIST_TYPES: &'static [&'static str] = &[
    "js::Class",
    "JS::CompartmentOptions",
    "JS::ContextOptions",
+    "js::DOMCallbacks",


Want to squash this with b778ac1 and 42e2f2b?

jdm · 2017-07-10T18:47:01Z

mozjs/js/rust/build.rs

@@ -160,6 +160,7 @@ const WHITELIST_TYPES: &'static [&'static str] = &[
    "JSType",
    "JSValueTag",
    "JSValueType",
+    "JSVersion",


Squash this with earlier whitelisting and subsequent similar commits?

jdm · 2017-07-10T18:47:01Z

mozjs/js/rust/src/sc.rs

+                callbacks: &jsapi::JSStructuredCloneCallbacks)
+                -> bool {
+        unsafe {
+            (*self.raw).read(Runtime::get(), vp, callbacks as *const _, ptr::null_mut())


The cast should not be necessary.

jdm · 2017-07-10T18:47:01Z

mozjs/js/rust/src/sc.rs

+                 callbacks: &jsapi::JSStructuredCloneCallbacks)
+                 -> bool {
+        unsafe {
+            (*self.raw).write(Runtime::get(), v, callbacks as *const _, ptr::null_mut())


Cast should not be necessary.

jdm · 2017-07-10T18:47:01Z

mozjs/js/rust/src/sc.rs

+    pub fn write(&mut self,
+                 v: jsapi::JS::HandleValue,
+                 callbacks: &jsapi::JSStructuredCloneCallbacks)
+                 -> bool {


Let's return Result<(), ()> instead.

jdm · 2017-07-10T18:47:01Z

mozjs/js/rust/src/sc.rs

+
+    /// Copy the given slice into this buffer. Returns false when an underlying
+    /// JSAPI call fails.
+    pub fn write_bytes(&mut self, bytes: &[u8]) -> bool {


Let's return Result<(), ()>.

jdm · 2017-07-10T18:47:01Z

mozjs/js/src/build.rs

@@ -5,7 +5,7 @@
 extern crate num_cpus;

 use std::env;
-use std::path;
+// use std::path;


Remove this?


        Remove unused import


        Remove unnecessary casts; return Result<(), ()> instead of bool


        TEMP stop using a custom branch of bindgen for logging

fitzgen · 2017-07-10T20:19:05Z

@jdm thanks for the initial pass on review! I pushed some new commits that should address your feedback.

fitzgen · 2017-07-10T20:20:38Z

Regarding squashing: I can squash everything that isn't a rebase from servo/rust-mozjs into a single commit before landing. That's probably easiest.

jdm · 2017-07-10T23:20:19Z

Approval conditional on getting CI working again, of course.


        Don't do more than 4 parallel jobs due to travis CI builders OOMing


        Just do 1 make build to avoid OOMs in travis CI


        Ok try 4 parallel jobs because 1 is timing out


        8 parallel jobs because 4 is still timing out


        6 parallel jobs because 8 is OOMing again


        Whitelist JS::Construct


        Whitelist JS_SameValue


        Run autoconf/configure/make inside the mozilla build environment


        Fix bad python 2.7 path on appveyor


        Use -j6 for appveyor builds as well


        WIP building on windows

fitzgen · 2017-09-20T20:07:21Z

@UK992, hello! I've been informed that you have helped out with Servo + windows build issues in the past before. If you have the cycles, I'd appreciate some help here (no worries if not!). I can build SpiderMonkey on Windows with MSVC just fine from mozjs/js/src/build.rs. However, when attempting to generate bindings with bindgen and libclang from mozjs/js/rust/build.rs, we trigger static_asserts inside SpiderMonkey. I suspect this has to do with differences between MSVC and libclang and interaction with some sort of build configuration. Note that bindgen and libclang work fine on both macOS and Linux, so there is something Windows specific going on here.

Thanks for your help!

c:\mozilla-central\js\rust\target\debug\build\js-ec9b7e18a60f19d9\out\..\..\mozjs_sys-d599741ab008ce05\out\dist\include\mozilla/Assertions.h:216:1: warning: function declared 'noreturn' should not return [-Winvalid-noreturn]
c:/mozbuild\clang\lib\clang\6.0.0\include\adxintrin.h:35:89: warning: ignoring unsupported 'adx' in the target attribute string [-Wignored-attributes]
c:/mozbuild\clang\lib\clang\6.0.0\include\adxintrin.h:43:89: warning: ignoring unsupported 'adx' in the target attribute string [-Wignored-attributes]
c:\mozilla-central\js\rust\target\debug\build\js-ec9b7e18a60f19d9\out\..\..\mozjs_sys-d599741ab008ce05\out\dist\include\js/Utility.h:270:12: warning: 'strdup' is deprecated: The POSIX name for this item is deprecated. Instead, use the ISO C and C++ conformant name: _strdup. See online help for details. [-Wdeprecated-declarations]
C:\Program Files (x86)\Windows Kits\10\Include\10.0.15063.0\ucrt\string.h:537:20: note: 'strdup' has been explicitly marked deprecated here
c:\mozilla-central\js\rust\target\debug\build\js-ec9b7e18a60f19d9\out\..\..\mozjs_sys-d599741ab008ce05\out\dist\include\js/RootingAPI.h:692:8: warning: 'dllimport' attribute ignored [-Wignored-attributes]
c:\mozilla-central\js\rust\target\debug\build\js-ec9b7e18a60f19d9\out\..\..\mozjs_sys-d599741ab008ce05\out\dist\include\js/Value.h:912:9: error: static_assert failed "JS_STATIC_ASSERT"
c:\mozilla-central\js\rust\target\debug\build\js-ec9b7e18a60f19d9\out\..\..\mozjs_sys-d599741ab008ce05\out\dist\include\js/Value.h:950:1: error: static_assert failed "Value size must leave three tag bits, be a binary power, and is ubiquitously depended upon everywhere"
thread 'main' panicked at 'Should generate JSAPI bindings OK: ()', src\libcore\result.rs:906:4
stack backtrace:
   0: std::sys_common::backtrace::_print
             at C:\projects\rust\src\libstd\sys_common\backtrace.rs:94
   1: std::panicking::default_hook::{{closure}}
             at C:\projects\rust\src\libstd\panicking.rs:380
   2: std::panicking::default_hook
             at C:\projects\rust\src\libstd\panicking.rs:397
   3: std::panicking::rust_panic_with_hook
             at C:\projects\rust\src\libstd\panicking.rs:611
   4: std::panicking::begin_panic<alloc::string::String>
             at C:\projects\rust\src\libstd\panicking.rs:572
   5: std::panicking::begin_panic_fmt
             at C:\projects\rust\src\libstd\panicking.rs:522
   6: std::panicking::rust_begin_panic
             at C:\projects\rust\src\libstd\panicking.rs:498
   7: core::panicking::panic_fmt
             at C:\projects\rust\src\libcore\panicking.rs:71
   8: core::result::unwrap_failed<()>
             at C:\projects\rust\src\libcore\macros.rs:41
   9: core::result::Result<bindgen::Bindings, ()>::expect<bindgen::Bindings,()>
             at C:\projects\rust\src\libcore\result.rs:799
  10: build_script_build::build_jsapi_bindings
             at .\build.rs:175
  11: build_script_build::main
             at .\build.rs:23
  12: panic_unwind::__rust_maybe_catch_panic
             at C:\projects\rust\src\libpanic_unwind\lib.rs:99
  13: std::rt::lang_start
             at C:\projects\rust\src\libstd\rt.rs:54
  14: main
  15: __scrt_common_main_seh
             at f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl:283
  16: BaseThreadInitThunk

bors-servo · 2017-09-21T18:21:06Z

☔ The latest upstream changes (presumably #121) made this pull request unmergeable. Please resolve the merge conflicts.

atouchet · 2018-08-21T16:37:00Z

Can this be closed now?

fitzgen and others added 30 commits May 10, 2017

Remove old mozjs

b8978c6

Add new mozjs

77fa359

Remove bad Cargo.toml

bef886d

Remove testing Cargo.toml files

d66fb78

WIP Fix finding of the include dir for bindgen

e2d2d20

This needs to make its way upstream

Re-export root through jsapi

3a8cd13

This needs to be ported over to the m-c patch queue.

Add more APIs to work with AutoIdVector.

5b30592

Return a ConversionResult::Failure when converting a non-iterable val…

478305b

…ue to Vec.

Wrap uses of extern statics in unsafe blocks.

add34bd

This fixes safe_extern_statics warnings; see <rust-lang/rust#36247>.

Improve typed array support.

9434341

Add missing hooks to SIMPLE_GLOBAL_CLASS_OPS.

573b538

Add a test for typed array support.

816a319

Handle panics.

c8a9a4b

Fix travis build.

c906e06

Fix code involving empty type references

e8a424d

by changing it to use pointers instead. Fixes #311

Add an implementation of Default for Heap<*mut T>.

c528e97

We should be able to create a default value for any Heap<*mut T> where *mut T implements GCMethods<*mut T> and Copy, not just for Heap<*mut JSObject>.

Add a method to create a Heap<T>.

e8b78cf

Currently, to create a Heap<T>, one first has to create a Heap<T>::default, and then call Heap<T>::set. This is a common pattern and therefore should be abstracted behind a method.

Add an implementation of Clone for Heap<T>.

1e6962a

Add an implementation of PartialEq for Heap<T>.

085c184

Implement a Trace trait for types that can be traced.

fe79953

We expose several JSAPI functions that are used for tracing. By abstracting these functions behind a trait we can overload them on the type to be traced.

Use a less strict bound for wrap_panic.

30007d1

This is what's required for catch_unwind; there's no need to be stricter.

Implement maybe_wrap_object_value without OOL calls

e6d2e1a

The only remaining OOL calls are ToWindowIfWindowProxy and JS_WrapValue, like in the equivalent Gecko function.

Fix a typo in try_to_outerize

2e870a4

Add methods to create a HandleValueArray.

35bb0eb

Rust-mozjs currently does not define any methods to create instances of HandleValueArray. Consequently, consumers have to create these instances manually. This is unnecessary boilerplate, and therefore should be abstracted behind a function.

Store the JSContext in TLS for easy access.

9c99759

Add type for ArrayBufferView.

b4e38fb

Remove the type parameter from GCMethods.

90ec8f8

Fixes #256.

Disallow constructing an unrooted Rooted with a value.

b7924a3

This should make it harder to use Rooted in an unsound way (when not using the rooted!() macro).

Consistently apply the same bounds to RootedGuard's type parameter.

1f190c1

Clear the value of a Rooted when the RootedGuard goes out of scope.

c7d04f4

This ensures no unrooted values linger in the Rooted when it is no longer rooted. It should be impossible to access the value after that, but Handles currently lack the lifetime to prevent that (#153).

fitzgen added 2 commits Jul 10, 2017

TEMP don't source tooltool script on windows? sfink says it may work

Loading status checks…

f5599e4

TEMP Add logging for whats in C:\Python2.7

Loading status checks…

8c2bd30

fitzgen force-pushed the fitzgen:smup branch from b9ab0ea to 8c2bd30 Jul 10, 2017

jdm requested changes Jul 10, 2017

View changes

fitzgen added 3 commits Jul 10, 2017

Remove unused import

09f2087

Remove unnecessary casts; return Result<(), ()> instead of bool

b2a1e3c

TEMP stop using a custom branch of bindgen for logging

Loading status checks…

752e334

jdm approved these changes Jul 10, 2017

View changes

Don't do more than 4 parallel jobs due to travis CI builders OOMing

Loading status checks…

a081cf2

fitzgen force-pushed the fitzgen:smup branch from c162f03 to a081cf2 Aug 22, 2017

fitzgen added 10 commits Aug 22, 2017

Just do 1 make build to avoid OOMs in travis CI

Loading status checks…

59e6e7b

Ok try 4 parallel jobs because 1 is timing out

Loading status checks…

3c2a450

8 parallel jobs because 4 is still timing out

Loading status checks…

f5fde16

6 parallel jobs because 8 is OOMing again

Loading status checks…

3663619

Whitelist JS::Construct

Loading status checks…

8af818e

Whitelist JS_SameValue

Loading status checks…

182973d

Run autoconf/configure/make inside the mozilla build environment

Loading status checks…

f301616

Fix bad python 2.7 path on appveyor

Loading status checks…

f75eeaa

Use -j6 for appveyor builds as well

Loading status checks…

5cbac15

WIP building on windows

Loading status checks…

08f655a

fitzgen mentioned this pull request Sep 20, 2017

WIP smup servo/servo#17143

Closed

jdm mentioned this pull request Oct 1, 2017

asm.js type error: Disabled by javascript.options.asmjs in about:config servo/servo#10401

Closed

jdm mentioned this pull request Dec 18, 2017

Update SpiderMonkey #130

Closed

jdm closed this Aug 21, 2018

servo / mozjs

WIP smup #119

WIP smup #119

fitzgen commented Jun 2, 2017 •

edited by larsbergstrom

jdm left a comment

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

fitzgen commented Jul 10, 2017

fitzgen commented Jul 10, 2017

jdm commented Jul 10, 2017

fitzgen commented Sep 20, 2017

bors-servo commented Sep 21, 2017

atouchet commented Aug 21, 2018

servo / mozjs

Join GitHub today

WIP smup #119

WIP smup #119

Conversation

fitzgen commented Jun 2, 2017 • edited by larsbergstrom

jdm left a comment

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

fitzgen commented Jul 10, 2017

fitzgen commented Jul 10, 2017

jdm commented Jul 10, 2017

fitzgen commented Sep 20, 2017

bors-servo commented Sep 21, 2017

atouchet commented Aug 21, 2018

fitzgen commented Jun 2, 2017 •

edited by larsbergstrom