feat(js): Extract *info functions into individual functions #4751

phated · 2022-06-24T00:33:23Z

This is a draft that builds upon #4750

Binaryen.ml provides separate functions for each of these utilities, but using the getMemorySegmentInfoByIndex helper function does a lot of extra work on each function call. By providing these under a namespace, the individual functions can be provided and then used in the "info" helper.

I'd like to do this to the other "info" helpers in the JS wrapper, but wanted to gather feedback first.

dcodeIO · 2022-06-24T12:11:10Z

Reminds me of the existing classes for Expression, Block, Function etc., which provide both namespaced static functions like Function.getName and convenient wrapper classes with getters for Function#name etc. through deriveWrapperInstanceMembers. Not all of the elements have a class yet, but perhaps here there could be a MemorySegment class (perhaps on top of a MemorySegmentRef) utilizing the existing concept?

MemorySegment
 .getOffset
 .setOffset
 .getData
 .setData
 .isPassive
 .setPassive
 #offset [get/set]
 #data [get/set]
 #passive [get/set]

Here's what's done for functions, for example:

binaryen/src/js/binaryen.js-post.js

Lines 4766 to 4818 in 9801693

    
           // Function wrapper 
        
           Module['Function'] = (() => { 
        
             // Closure compiler doesn't allow multiple `Function`s at top-level, so: 
        
             function Function(func) { 
        
               if (!(this instanceof Function)) { 
        
                 if (!func) return null; 
        
                 return new Function(func); 
        
               } 
        
               if (!func) throw Error("function reference must not be null"); 
        
               this[thisPtr] = func; 
        
             } 
        
             Function['getName'] = function(func) { 
        
               return UTF8ToString(Module['_BinaryenFunctionGetName'](func)); 
        
             }; 
        
             Function['getParams'] = function(func) { 
        
               return Module['_BinaryenFunctionGetParams'](func); 
        
             }; 
        
             Function['getResults'] = function(func) { 
        
               return Module['_BinaryenFunctionGetResults'](func); 
        
             }; 
        
             Function['getNumVars'] = function(func) { 
        
               return Module['_BinaryenFunctionGetNumVars'](func); 
        
             }; 
        
             Function['getVar'] = function(func, index) { 
        
               return Module['_BinaryenFunctionGetVar'](func, index); 
        
             }; 
        
             Function['getNumLocals'] = function(func) { 
        
               return Module['_BinaryenFunctionGetNumLocals'](func); 
        
             }; 
        
             Function['hasLocalName'] = function(func, index) { 
        
               return Boolean(Module['_BinaryenFunctionHasLocalName'](func, index)); 
        
             }; 
        
             Function['getLocalName'] = function(func, index) { 
        
               return UTF8ToString(Module['_BinaryenFunctionGetLocalName'](func, index)); 
        
             }; 
        
             Function['setLocalName'] = function(func, index, name) { 
        
               preserveStack(() => { 
        
                 Module['_BinaryenFunctionSetLocalName'](func, index, strToStack(name)); 
        
               }); 
        
             }; 
        
             Function['getBody'] = function(func) { 
        
               return Module['_BinaryenFunctionGetBody'](func); 
        
             }; 
        
             Function['setBody'] = function(func, bodyExpr) { 
        
               Module['_BinaryenFunctionSetBody'](func, bodyExpr); 
        
             }; 
        
             deriveWrapperInstanceMembers(Function.prototype, Function); 
        
             Function.prototype['valueOf'] = function() { 
        
               return this[thisPtr]; 
        
             }; 
        
             return Function; 
        
           })();

phated · 2022-06-24T20:43:00Z

Yeah, I was wondering if doing something similar to Expressions was desirable. I'm fine implementing like that, but it'll add more work, which I'll have to find some time to do.

Is there a way to move forward with the straightforward "instance logic" that I did or would the PR only be accepted if the static/class implementation were completed?

tlively · 2022-06-28T00:15:54Z

cc @ashleynh, who has worked on the internal representation of data segments in support of multiple memory. @dcodeIO's idea to reuse that class utility sounds like a good goal to me, but intermediate progress might be useful to land as well.

phated · 2022-07-08T21:10:28Z

src/js/binaryen.js-post.js

+    'module'() {
+      return UTF8ToString(Module['_BinaryenMemoryImportGetModule'](module));
+    },
+    'base'() {
+      return UTF8ToString(Module['_BinaryenMemoryImportGetBase'](module));
+    },


Should these be on something like self['memoryImport']?

I think it's ok as it is.

phated · 2022-07-08T21:10:53Z

src/js/binaryen.js-post.js

+    'max'() {
+      if (Module['_BinaryenMemoryHasMax'](module)) {
+        return Module['_BinaryenMemoryGetMax'](module);
+      }


Wasn't sure if this should have the if condition inside the function.

I think if there is no maximum then we should probably either error or return Infinity. Doing it here in JS makes the most sense to me (we couldn't return Infinity from C).

phated · 2022-07-08T21:16:05Z

Thanks for the guidance folks! I tried to replicate patterns I had seen elsewhere in binaryen.js-post.js. Please take a look and let me know if I should be doing anything differently.

I've updated the getSomethingInfo functions that we want to remove in Grain but there are still more. Ideally, this PR can guide others in updating the rest (and of course I'll be updating things as we use them in Grain).

kripken · 2022-07-12T16:36:52Z

src/js/binaryen.js-post.js

+    'max'() {
+      if (Module['_BinaryenMemoryHasMax'](module)) {
+        return Module['_BinaryenMemoryGetMax'](module);
+      }


I think if there is no maximum then we should probably either error or return Infinity. Doing it here in JS makes the most sense to me (we couldn't return Infinity from C).

kripken · 2022-07-12T16:36:55Z

src/js/binaryen.js-post.js

+    'module'() {
+      return UTF8ToString(Module['_BinaryenMemoryImportGetModule'](module));
+    },
+    'base'() {
+      return UTF8ToString(Module['_BinaryenMemoryImportGetBase'](module));
+    },


I think it's ok as it is.

kripken · 2022-07-12T16:39:56Z

src/js/binaryen.js-post.js

+// ElementSegment wrapper
+Module['ElementSegment'] = (() => {
+  // Closure compiler doesn't allow multiple `Function`s at top-level, so:
+  function Function(func) {


Should all these Function be ElementSegment?

Probably. I wasn't sure if these constructors should match the key or if Function was meant to be generic (due to the comment). I'll change them.

phated · 2022-07-12T17:43:05Z

@kripken thanks for the feedback! I've made the updates you suggested

kripken · 2022-07-19T16:22:36Z

src/js/binaryen.js-post.js

-    if (Module['_BinaryenMemoryHasMax'](module)) {
-      memoryInfo['max'] = Module['_BinaryenMemoryGetMax'](module);
+    var max = self['memory']['max']();
+    if (max) {


What is this checking? If the max is 0?

I'd expect this to check if the max is Infinity, but maybe I'm missing something...

@kripken I'm not sure, I copied this from the existing code. Who wrote that?

@kripken how about this?

Suggested change

if (max) {

if (max !== Infinity) {

FWIW, I guess the NFC value here would be undefined. Apart from this, if my other suggestions are agreed upon to be considered, there will be a HasMax function around that can be used instead, closely matching the previous code.

dcodeIO · 2022-07-19T17:56:25Z

src/js/binaryen.js-post.js

+    'module'() {
+      return UTF8ToString(Module['_BinaryenMemoryImportGetModule'](module));
+    },
+    'base'() {
+      return UTF8ToString(Module['_BinaryenMemoryImportGetBase'](module));
+    },
+    'initial'() {
+      return Module['_BinaryenMemoryGetInitial'](module);
+    },
+    'shared'() {
+      return Boolean(Module['_BinaryenMemoryIsShared'](module));
+    },
+    'max'() {
+      if (Module['_BinaryenMemoryHasMax'](module)) {
+        return Module['_BinaryenMemoryGetMax'](module);
+      } else {
+        return Infinity;
+      }


Is it intended that these are mixed with the instructions like memory.fill? Seems that it's quite easy to mistake them for instructions like memory.shared. Also, in light of multi memory, there'll likely need to be a memory wrapper anyhow to deal with any memory, so I wouldn't expect these to last for very long.

Yes, see where Alon said "I think it's ok as it is." above.

I'm just making these easier to use, if this hasn't been updated for multiple memory, than someone else will need to help make those changes.

Hmm, has the following variant been considered?

Module#getMemoryModule Module#getMemoryBase Module#getMemoryInitial Module#isMemoryShared Module#hasMemoryMax Module#getMemoryMax

Those would about match Module#setMemory for now, which is similarly subject to change, with all of them not conflicting with instructions.

I've not considered anything (maybe others have) because I'm just converting what is here from "expensive grab-bag" to "individual functions". Further improvements can be done later, as @tlively mentioned in the primary thread.

Perhaps this is a misunderstanding. I am not suggesting any significant changes in the above variant, just to move / rename these from memory (which so far covers exclusively instructions) to the Module instance (where methods of this kind without wrappers would typically go). Basically next to setMemory.

I'm going to leave that up to @kripken since he said it was fine to have these here when I asked.

Hmm, good point @dcodeIO , you're right that this would mix instructions like memory.fill() with helpers. We've put the helpers on the relevant JS objects using makeExpressionWrapper. So I agree that adding new getX/setX functions alongside those is more consistent. That seems best.

@phated Sorry for not reading this more in detail the first time! (I am not as up to date on the JS API as I used to be, since I've been busy with other things...)

Can someone else pick up these changes? We really need these changes in Grain and I don't have time to continue to make these large changes, as I'm actively needing to interview for jobs.

dcodeIO · 2022-07-20T05:14:00Z

src/js/binaryen.js-post.js

+Module['GlobalImport'] = (() => {
+  // Closure compiler doesn't allow multiple `GlobalImport`s at top-level, so:


The IIFE here is not necessary. Only affects JS built-ins like Function.

dcodeIO · 2022-07-20T05:14:24Z

src/js/binaryen.js-post.js

+Module['Global'] = (() => {
+  // Closure compiler doesn't allow multiple `Global`s at top-level, so:


Similarly, the IIFE here is not necessary. Only affects Function.

dcodeIO · 2022-07-20T05:14:54Z

src/js/binaryen.js-post.js

+Module['FunctionImport'] = (() => {
+  // Closure compiler doesn't allow multiple `FunctionImport`s at top-level, so:


As well: The IIFE here is not necessary. Only affects JS built-ins like Function.

dcodeIO · 2022-07-20T05:15:23Z

src/js/binaryen.js-post.js

+Module['Export'] = (() => {
+  // Closure compiler doesn't allow multiple `Export`s at top-level, so:


dcodeIO · 2022-07-20T05:15:30Z

src/js/binaryen.js-post.js

+Module['ElementSegment'] = (() => {
+  // Closure compiler doesn't allow multiple `ElementSegment`s at top-level, so:


dcodeIO · 2022-07-20T05:23:55Z

src/js/binaryen.js-post.js

+  self['memorySegment'] = {
+    'offset'(id) {
+      return Module['_BinaryenGetMemorySegmentByteOffset'](module, id);
+    },
+    'data'(id) {
+      const size = Module['_BinaryenGetMemorySegmentByteLength'](module, id);
+      const ptr = _malloc(size);
+      Module['_BinaryenCopyMemorySegmentData'](module, id, ptr);
+      const res = new Uint8Array(size);
+      res.set(new Uint8Array(buffer, ptr, size));
+      _free(ptr);
+      return res.buffer;
+    },
+    'passive'(id) {
+      return Boolean(Module['_BinaryenGetMemorySegmentPassive'](module, id));
+    }
+  }


Another suggestion to make this more uniform with other code. Move / rename these to

Module#getMemorySegmentByteOffset Module#getMemorySegmentData Module#isMemorySegmentPassive

Then becomes

myModule.getMemorySegmentByteOffset(segmentIndex)

instead of

myModule.memorySegment.offset(id)

Apart from adhering to surrounding code style, this also has the advantage that these won't conflict with eventual setters.

phated added 7 commits July 8, 2022 13:22

feat: Extract memorySegment functions into individual functions

6bb3f2c

feat: Extract getMemoryInfo into individual functions

08b157e

feat: Extract getGlobalInfo into individual functions

bf1f31b

feat: Extract getExportInfo into individual functions

34f5b3d

feat: FunctionImport and use the wrappers for getFunctionInfo

6a6bb67

Implement as wrappers

7d19a7d

feat: Extract getElementSegmentInfo into individual functions

b061058

phated force-pushed the phated/extract-infos branch from 0206660 to b061058 Compare July 8, 2022 21:09

phated commented Jul 8, 2022

View reviewed changes

phated added 2 commits July 8, 2022 14:12

fix export capitalization

65366bc

fix a missing return

e24858a

phated marked this pull request as ready for review July 8, 2022 21:14

phated changed the title ~~feat: Extract memorySegment functions into individual functions~~ feat: Extract *info functions into individual functions Jul 8, 2022

phated changed the title ~~feat: Extract *info functions into individual functions~~ feat(js): Extract *info functions into individual functions Jul 8, 2022

kripken reviewed Jul 12, 2022

View reviewed changes

phated added 2 commits July 12, 2022 13:39

Return Infinity if no max memory

8dc92ea

Rename function constructors

cfebb77

kripken reviewed Jul 19, 2022

View reviewed changes

dcodeIO reviewed Jul 19, 2022

View reviewed changes

dcodeIO reviewed Jul 20, 2022

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(js): Extract *info functions into individual functions #4751

feat(js): Extract *info functions into individual functions #4751

phated commented Jun 24, 2022

dcodeIO commented Jun 24, 2022

phated commented Jun 24, 2022

tlively commented Jun 28, 2022

phated Jul 8, 2022

kripken Jul 12, 2022

phated Jul 8, 2022

kripken Jul 12, 2022

phated commented Jul 8, 2022

kripken Jul 12, 2022

kripken Jul 12, 2022

kripken Jul 12, 2022

phated Jul 12, 2022

phated commented Jul 12, 2022

kripken Jul 19, 2022

phated Jul 19, 2022

phated Jul 19, 2022

dcodeIO Jul 20, 2022

dcodeIO Jul 19, 2022

phated Jul 19, 2022

dcodeIO Jul 19, 2022 •

edited

Loading

phated Jul 19, 2022

dcodeIO Jul 19, 2022

phated Jul 19, 2022

kripken Jul 26, 2022

phated Jul 26, 2022

dcodeIO Jul 20, 2022

dcodeIO Jul 20, 2022

dcodeIO Jul 20, 2022

dcodeIO Jul 20, 2022

dcodeIO Jul 20, 2022

dcodeIO Jul 20, 2022

		Module['GlobalImport'] = (() => {
		// Closure compiler doesn't allow multiple `GlobalImport`s at top-level, so:

		Module['Global'] = (() => {
		// Closure compiler doesn't allow multiple `Global`s at top-level, so:

		Module['FunctionImport'] = (() => {
		// Closure compiler doesn't allow multiple `FunctionImport`s at top-level, so:

		Module['Export'] = (() => {
		// Closure compiler doesn't allow multiple `Export`s at top-level, so:

		Module['ElementSegment'] = (() => {
		// Closure compiler doesn't allow multiple `ElementSegment`s at top-level, so:

feat(js): Extract *info functions into individual functions #4751

Are you sure you want to change the base?

feat(js): Extract *info functions into individual functions #4751

Conversation

phated commented Jun 24, 2022

dcodeIO commented Jun 24, 2022

phated commented Jun 24, 2022

tlively commented Jun 28, 2022

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

phated commented Jul 8, 2022

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

phated commented Jul 12, 2022

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

dcodeIO Jul 19, 2022 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

dcodeIO Jul 19, 2022 •

edited

Loading