Generate completion of Table.join join criteria using data from both joined tables

[Frizi]

Currently the completion forTable.join on parameter only takes the left-side table columns into account.

Ideally we want to compute the widget entries using column names from both tables. That requires new IDE and engine capabilities:

• Method metadata querying API needs to allow for providing more than one argument value.
• Visualization API needs to be extended to allow specifying multiple expressions for evaluation at once. Currently it is limited to one per visualization.
• Selection of requested method arguments to send for widget query needs to be specified, possibly as part of suggestion database, or as a widget metadata itself (that would require prior splitting of widget metadata and values query).

Acceptance criteria:

Table.join method on widget completion allows selecting join criteria using column names from both tables.

[jdunkerley]

As part of the JS Vue IDE work the ability to do this must be considered.

[Frizi]

So far, the limitation for this issue has been on the protocol level, not on UI. The discussion on it was started, but without any response yet https://github.com/orgs/enso-org/discussions/6832

GitHub

Widget Visualizations with multiple input expressions · enso-org · Discussion #6832

Currently, the data for dynamic node widgets is requested using language server's Visualization API. That allows us to resolve method annotations using the data from evaluated method call's target....

[JaroslavTulach]

Trying to recollect my previous thoughts and work on this topic reminds me of

• Instrumenter to observe behavior of nodes with UUID #7833

Take a look at * instead of + test to see that there already is a way for an Enso code (including visualization code - I hope) to observe not only self, but also other arguments when a call is made. E.g. once one:

• has the UUID of a node
• gets a pointer to main function via Meta.meta
• attaches on_call instrument
• and forces it to activate
• gets a callback with arguments

All that is needed (from my point of view) is to design an experiment to use this mechanism in the IDE. What one needs to do on the IDE side to invoke the instrumenter, @Frizi? How are the visualizations done in the GUI2?

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-03-11):

Progress: - prototypingTable.join

• debugging: https://discord.com/channels/401396655599124480/1216771381572800633/1216777084815544421
• analyzing FQN vs. imports
• _making .. an unary operator: https://github.com/enso-org/enso/pull/9285/files#r1519451329
• using autoscoped constructors in statics & dynamics discussions It should be finished by 2024-03-18.

Next Day: PoC for Table.join

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

GitHub

Use .. to identify autoscoped constructors by JaroslavTulach · Pull Request #9285 · enso-org/enso

Pull Request Description Fixes #9275. Checklist Please ensure that the following checklist has been satisfied before submitting the PR:

The documentation has been updated, if necessary.
All code...

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-03-12):

Progress: - Table.join prototyping - IDE sends more data

• review Tree.AutoscopedIdentifier: Autoscope syntax #9372 (review)
• IDE & autoscoped constructors brainstorming: Autoscoping for Table filter #9277 (comment)
• ongoing arrrow builder discussion: Arrow builder is not an Array #9358 (comment)
• reviewing Decimal: Decimal type: constuctors, comparisons, and arithmetic #9272 (comment)
• no UUIDs discussion: https://discord.com/channels/@me/1052230417073307678/1217031450323452005
• more on autoscoped constructors: Use autoscoping when constructing tag values of suggestion arguments #9293 (comment)
• dicussing Y.js: https://discord.com/channels/@me/1052230417073307678/1217212153161842698 It should be finished by 2024-03-18.

Next Day: Extract UUIDs for arguments in visualization

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-03-13):

Progress: - discussing WASM in y.js: https://discord.com/channels/@me/968956156758343744/1217509898414325900

• meeting about y.js server: Investigate hosting yjs server within GraalJS #7954 (comment)
• Y.js thoughts: https://discord.com/channels/@me/1052230417073307678/1217327240824492132
• debugging Table.join. Worked, at least once. Also: https://discord.com/channels/@me/948519891961544714/1217372688704606290
• meetings, AMA It should be finished by 2024-03-18.

Next Day: Use UUIDs from arguments in visualization

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-03-14):

Progress: - Poc of Table.join: #9410

• Bugfix foris_a Function check: Avoid Interop TypeOfNode specializations for EnsoObject #9431
• New version of IGV is out including two fixes that we provided: oracle/graal@8f54b76#diff-5c2805e0fef0535c28bff8559292cca73a8f81338c2ebe48f1e1039e9db3b68fR69
• FQN comment: Make FQN and imports consistent #9367 (comment)
• parser & indentation comment: Expressions not being run if indented by 1 more space than current indentation level #9419 (comment) It should be finished by 2024-03-18.

Next Day: Debugging & bugfixing

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-03-15):

Progress: - better foreign js debugging and coloring: #9440

• unit test for Enso grammar: 43ef037
• VSCode extension releaded thanks to @ola
• TypeOfNode PR merged: fb59778
• standups & tea
• RuntimeVisualizationsTest PR: Instrumentation, visualization and autoscoped constructors #9452 It should be finished by 2024-03-18.

Next Day: Instrumentation of autoscoped constructors

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-03-18):

Progress: - debuggging autoscoped constructors

• comments from Christian H: Allow control of throwDeniedThreadAccess via TruffleContext.threadAccessDeniedHandler oracle/graal#8266 (review)
• standups, demo meetings & discussion about RuntimeCache & co. It should be finished by 2024-03-18.

Next Day: Finish onstrumentation of autoscoped constructors

[enso-bot]

Jaroslav Tulach reports a new 🔴 DELAY for yesterday (2024-04-10):

Summary: There is 30 days delay in implementation of the Generate completion of Table.join join criteria using data from both joined tables (#5629) task.
It will cause 30 days delay for the delivery of this weekly plan.

Table.join is complicated

Delay Cause: After prototyping, I was working on something else

Possible solutions: Focus, focus, focus!

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-10):

Progress: - reviews

• meetings and dicussions It should be finished by 2024-04-17.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-11):

Progress: - fighting with typescript: #9410 (comment)

• review IndexState: Experiment in lock-free module invalidation #9639 (review)
• debugging Table.join It should be finished by 2024-04-17.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-12):

Progress: - working on Table.join: 81aa216

• review of JDK path: On MacOS, do not assume existence of Contents/Home in the JDK binary path #9684 (review) It should be finished by 2024-04-17.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for the last Saturday (2024-04-13):

Progress: - describing status of Table.join: https://github.com/orgs/enso-org/discussions/9695#discussioncomment-9101924

• discovering argument names: Access non-self arguments when widget annotations are computed #9410 (comment)
• argument names on the engine side
• debugging IDE and JVM, finding GetAnnotationNode It should be finished by 2024-04-17.

GitHub

[2024-04-15] Library & Engine Team Update · enso-org · Discussion #9695

Radosław: Refactoring Enso_File to be path based #9581 Radosław: Improve handling of File.parent and File.name #9642 Radosław: Make HTTP tests more robust by adding retries to the tests #9652 Rados...

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-15):

Progress: - reviewing Table.join PoC with Dmitry

• investigating CNFE: Compiler Internal Error on new project in 2024.4.12 package #9687 (comment)
• consolidate get_annotation: 6786250
• AI design note: Language Server API for AI #9656 (comment)
• no need for zero_arg: 654c11c
• experimenting with get_widget_json_with_uuids method
• standup & demo meetings It should be finished by 2024-04-17.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-16):

Progress: - get_widget_json method with uuids arg: #9410 (comment)

• Discussing reactivity with Pawel: https://github.com/enso-org/enso/blob/dff1c0c88ba09fdf18cfcf85e5c1f1d286c72512/app/gui2/src/util/database/reactiveDb.ts
• reading vue.js concepts: https://vuejs.org/guide/essentials/reactivity-fundamentals.html to be able to use them in RuntimeCache
• got rid oflastExecCached: 4c62581
• planning and meeting It should be finished by 2024-04-17.

GitHub

enso/app/gui2/src/util/database/reactiveDb.ts at dff1c0c88ba09fdf18cfcf85e5c1f1d286c72512 · enso-org/enso

Hybrid visual and textual functional programming. Contribute to enso-org/enso development by creating an account on GitHub.

Vue.js

Vue.js - The Progressive JavaScript Framework

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-17):

Progress: - thinking about caching: https://github.com/enso-org/enso/blob/fda41cbfd1d1966d8772d1a889905b78651e734e/docs/runtime/caching.md

• caching without leaks: Access non-self arguments when widget annotations are computed #9410 (comment)
• fixing npm lint
• VSCode 1.33.440 can be released by @ola: Support also COMMAND_RUN and COMMAND_DEBUG actions #9041
• standups, meetings, retro, AMA It should be finished by 2024-04-17.

GitHub

enso/docs/runtime/caching.md at fda41cbfd1d1966d8772d1a889905b78651e734e · enso-org/enso

Hybrid visual and textual functional programming. Contribute to enso-org/enso development by creating an account on GitHub.

[enso-bot]

Jaroslav Tulach reports a new 🔴 DELAY for yesterday (2024-04-18):

Summary: There is 6 days delay in implementation of the Generate completion of Table.join join criteria using data from both joined tables (#5629) task.
It will cause 6 days delay for the delivery of this weekly plan.

Delay Cause: functionality is working and is being reviewed, but it needs to be polished and tests written

Possible solutions: Let's plan to integrate by next Tuesday

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-18):

Progress: - 2 == 2.0 - #9607 (comment)

• dealing with Float==Integer: Make conversion of double to BigDecimal exact #9740
• unit testing TypeScript: 59ada87
• unit testing with cache: 6942ef5
• reviewing unicode: Text literals: Accept unpaired-surrogate escape codes. #9731 (review)
• ydoc notes: 9d7c750#r1570045334 It should be finished by 2024-04-23.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-19):

Progress: - fixing 2^63: #9740 (comment)

• alternative fix for ..Nothing: Allow ..Nothing to resolve to Nothing #9746
• review Type Inference PoC: Type Inference PoC - iteration 1 - most basic type inference #8652 (review)
• bookclubbing: https://discord.com/channels/401396655599124480/1228037798078976013/1230851032423206993
• reported download issue: enso-bundle tries to download missing engine #9753
• FIS snb points QA: https://discord.com/channels/@me/948519891961544714/1230915676198146048
• standups It should be finished by 2024-04-23.

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for the last Saturday (2024-04-20):

Progress: - evaluating benchmarks: #9746 (comment)

• review ydoc server: Run ydoc-server with GraalVM #9528 (comment)
• review private constructors: Atom constructors can be private #9692 (review)
• review of SQLite removal: In-memory suggestions #9751 (review)
• == & hash for Decimal: Make conversion of double to BigDecimal exact #9740 (comment) It should be finished by 2024-04-23.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-22):

Progress: - Table.join needs final review: #9410

• review of Atom constructors can be private #9692 It should be finished by 2024-04-23.

[enso-bot]

Jaroslav Tulach reports a new STANDUP for yesterday (2024-04-23):

Progress: - Got review for Table.join: #9410

• ..True PR merged: Special treatment for ..True and ..False #9767
• warning to Decimal.from: Make conversion of double to BigDecimal exact #9740 (comment)
• Double.hashCode: Make conversion of double to BigDecimal exact #9740 (comment)
• polishing GeeCon presentation: https://docs.google.com/presentation/d/1Lo-Ns9Cm4sRV9QxON8hUzcBnNOw33SVbeHBS2rbnpVQ
• planning, meeting, standup It should be finished by 2024-04-23.