Add notes

development/meetings/2022-02-21.md

@@ -0,0 +1,80 @@
+2021-02-21 Development Meeting
+==============================
+Kacper, Craig, Sara, Tim
+
+Agenda
+------
+* Updates
+* Allocations - [name=Craig]
+    * Kacper 40% starting 03/01
+    * Craig 20% starting 03/01
+    * Sara 25% starting 03/01
+    * Tim x% starting 03/01
+        * My WT allocation is going down, but in the short run will not much affect how I spend my time.
+* Pop-out - [name=Craig]
+    * Can we have "Open X in new tab/window"?
+* VW evaluation feedback
+    * https://github.com/whole-tale/whole-tale/issues/112 (WT in general)
+        * Long image build
+        * Add tooltips
+        * Upload folder support
+        * Combine envs (R/Stata, Matlab/Stata)
+        * Moving folder usability
+            * KK: we could be pushing FUSE route
+    * https://github.com/whole-tale/whole-tale/issues/110 (stata)
+        * Add task bar to support maximize 
+        * Fix window sizing if possible
+        * Fix Stata 14 PNG issue
+    * https://github.com/whole-tale/whole-tale/issues/111 (matlab)
+        * Desktop version (XPRA)
+        * Address handling older versions
+
+Updates
+-------
+* Kacper
+    * Bugfixes
+        * [DataONE] add missing headers prop to DataONEVerificator -- [girder_wholetale#522](https://github.com/whole-tale/girder_wholetale/pull/522)
+        * Properly handle data streams with Content-Encoding -- [girder_wt_data_manager#52](https://github.com/whole-tale/girder_wt_data_manager/pull/52)
+        * [dms] Use thread locking during reads. Fixes #32 -- [girderfs#33](https://github.com/whole-tale/girderfs/pull/33)
+        * Raise exception during rename if target exists. Fixes #18 -- [virtual_resources#19](https://github.com/whole-tale/virtual_resources/pull/19)
+        * 
+    * Verify checksum of transferred files -- [girder_wt_data_manager#53](https://github.com/whole-tale/girder_wt_data_manager/pull/53)
+    * Globus debugging with Mike, Craig and Kyle
+    * Reviews
+
+* Craig
+    * Test plan execution/revision for v1.1
+    * Add checksumAlgorithm parameter to determine D1 alg used -- [girder_wholetale#524](https://github.com/whole-tale/girder_wholetale/pull/524)
+    * Add sha1 support to bag export -- [girder_wholetale#525](https://github.com/whole-tale/girder_wholetale/pull/525)
+    * Remove broken data symlink and results dir from run  -- [wt_versioning#39](https://github.com/whole-tale/wt_versioning/pull/39)
+    * Pin gcp version to 3.0.4 for now -- [girder#15](https://github.com/whole-tale/girder/pull/15)
+    * Translate evaluator feedback
+
+* Tim
+    * Made REPROs a bit more DRY..
+        ```
+        FROM ubuntu:22.04
+
+        ENV REPRO_NAME blazegraph-service
+
+        COPY .repro /repro
+        RUN bash /repro/builders/repro.bootstrap
+
+        USER repro
+
+        # install module dependencies
+        ENV PACKAGE_URL_TEMPLATE 'https://github.com/cirss/${module_name}/releases/download/v${package_version}/'
+        RUN repro.install blaze 0.2.6
+        RUN repro.install geist 0.2.6
+        RUN repro.install blazegraph-service local
+
+        CMD  /bin/bash -il
+        ```
+    * Still need to get working local overrides of REPRO dependencies to support development in tandem.
+    * Will be back to working on provenance capabilities this week.
+    * 
+
+* Sara
+    * PR for 249/250
+        * Handle failed rename
+        * decode URL parameters for AiWT

development/meetings/2022-03-07.md

@@ -0,0 +1,75 @@
+2021-03-07 Development Meeting
+==============================
+Kacper, Mike, Craig, Sara, Tim
+
+Agenda
+------
+* Updates
+* Release v1.1 -- [name=Craig]
+    * Planned
+        - [x] Handle importing Tales from DataONE - [girder_wholetale#531](https://github.com/whole-tale/girder_wholetale/pull/531)
+        - [x] Prevent "double" publish of the same version of a Tale - [gwvolman#170](https://github.com/whole-tale/gwvolman/pull/170)
+        - [x] Disable export for users without write permission - [dashboard#260](https://github.com/whole-tale/ngx-dashboard/issues/260)
+            * https://github.com/whole-tale/ngx-dashboard/pull/262
+    * Other open issues
+        - [x] Tooltips [ngx-dashboard#253](https://github.com/whole-tale/ngx-dashboard/pull/253)
+        - [ ] Importing D1 dataset fails with I/O error - [girder_wholetale#530](https://github.com/whole-tale/girder_wholetale/issues/530)
+        - [x] Context menu no longer works after upload/rename - [ngx-dashboard#259](https://github.com/whole-tale/ngx-dashboard/issues/259)
+        - [x] AiWT URL encoding issue remains - [ngx-dashboard#258](https://github.com/whole-tale/ngx-dashboard/issues/258)
+        - [ ] File manager sometimes shows content for wrong tab - [ngx-dashboard#261](https://github.com/whole-tale/ngx-dashboard/issues/261)
+
+Updates
+-------
+
+* Kacper
+    * Handle importing Tales from DataONE - [girder_wholetale#531](https://github.com/whole-tale/girder_wholetale/pull/531)
+    * Prevent "double" publish of the same version of a Tale - [gwvolman#170](https://github.com/whole-tale/gwvolman/pull/170)
+    * Reviews
+
+* Craig
+    * Release testing + documentation 
+
+* Sara
+    * PR for env.json -> env.js
+        * Loaded in index.html, before Angular stuff
+    * I still owe Craig a PR review (or two or three, sorry!)
+
+* Tim
+    * Continuing Geist, blazegraph, cpr development.
+
+* Mike
+    * No updates this week.
+
+2021-02-28 Development Meeting
+==============================
+Kacper, Craig, Tim, Mike, Sara
+
+Agenda
+------
+* Updates
+
+Updates
+-------
+
+* Kacper
+    * Tagged and released 1.1rc1
+    * Bugfixes as we go
+
+* Craig
+    * Ran through test plan + test plan revisions
+    * PR review/testing
+    * Deployed test.wholetale.org Jetstream cluster
+
+* Tim
+    * The new module system is helping.
+    * Cleaning up the SDTL-ProvONE work.
+
+* Sara
+    * Looking into GIRDER_API_URL bug
+        * Will look into `sed` alternative
+    * Suggested Github actions to automate builds
+        * See https://github.com/nds-org/ndslabs
+        * Verifies Docker build for PRs
+        * Build/push a new Docker image on release
+
+* Mike

development/meetings/2022-03-14.md

@@ -0,0 +1,32 @@
+2021-03-14 Development Meeting
+==============================
+Kacper, Mike, Craig, Sara, Tim
+
+
+Agenda
+------
+* Updates
+* WebDAV discussion
+
+Updates
+-------
+
+* Kacper
+    * Released v1.1 \o/
+    * Working on "faster" home/workspace mounts
+
+* Craig
+    * v1.1rc2 testing
+    * Documentation 
+    * Troubleshooting Lars' issue
+
+* Mike
+
+* Sara
+    * PR for AiWT url decode problem
+    * PR for fixing context menu after rename/upload
+    * PR for wonky file-browser behavior
+
+* Tim
+    * Still obsessed with REPROs.
+    * Cleaning up dependencies between projects in different repos.

development/meetings/2022-03-21.md

@@ -0,0 +1,36 @@
+2021-03-21 Development Meeting
+==============================
+Kacper, Mike, Craig, Tim
+
+
+Agenda
+------
+* Updates
+* MRAN discussion
+    * https://docs.microsoft.com/en-us/answers/questions/779145/mran-time-machine-for-r-open-333-is-down.html
+    * https://github.com/microsoft/microsoft-r-open/issues/133
+    * https://cran.r-project.org/mirmon_report.html
+* 
+
+
+Updates
+-------
+* Kacper
+    * "Fixed" 500 in Globus+ORCID auth flow -- [girder_wholetale#535](https://github.com/whole-tale/girder_wholetale/pull/535)
+    * Switch to bind mounts for home/workspace -- [gwvolman#172](https://github.com/whole-tale/gwvolman/pull/172)
+    * Looking into converting Matlab/Stata into "drop-ins"
+
+
+* Craig
+    * v1.1 deployment
+    * PR review/testing
+    * Troubleshooting Lars' tale/WebDav
+    * MRAN woes
+    * Documentation
+    * Mostly out this week
+
+* Tim
+    * Finding that REPROs are a good way to introduce transparency (and provenance) into Docker image building.
+    * 
+
+* Mike

development/meetings/2022-03-28.md

@@ -0,0 +1,30 @@
+2021-03-28 Development Meeting
+==============================
+Kacper, Mike, Craig, Sara, Tim
+
+Agenda
+------
+* Updates
+* Upload folders:
+    * Needs review, [see slack exchange]( https://wholetale.slack.com/archives/G3QBV6QDC/p1644272438321289)
+
+Updates
+-------
+* Kacper
+    * Nothing to report really.
+
+* Sara
+    * Updated PR for file contents fix
+        * forkJoin is annoying, and apparently needs manual unsub (even tho rxjs docs say otherwise)
+    * Upcoming talks about uploading folders
+        * See https://github.com/bodom0015/multi-upload-poc
+
+* Craig
+    * Out last week
+    * Accessibility sub-project
+
+* Tim
+    * Continuing work on provenance using REPROs as a vehicle for now.
+    * Will be targeting eScience for a publication--all are invited.
+
+* Mike

development/meetings/2022-04-04.md

@@ -0,0 +1,37 @@
+2021-04-04 Development Meeting
+==============================
+Kacper, Mike, Craig, Tim, Sara
+
+Agenda
+------
+* Updates
+* Bugfix release:
+    * getting nfs mounts to .prod?
+        * LET'S DO THIS! -- Leeroy Jenkins
+
+
+Updates
+-------
+* Kacper
+    * Autocreate directories for file uploads to virtual resources -- [virtual_resources#20](https://github.com/whole-tale/virtual_resources/pull/20)
+    * Separate internal API from REST API in wt_versioning -- [wt_versioning#42](https://github.com/whole-tale/wt_versioning/pull/42)
+    * Allow to restore to a specific version during copying -- [wt_versioning#43](https://github.com/whole-tale/wt_versioning/pull/43) (just four lines of code! after refactor...)
+        * Minor update to the copy job (pass versionId) -- [girder_wholetale#536](https://github.com/whole-tale/girder_wholetale/pull/536)
+    * Switch rruns to NFS mounts -- [gwvolman#175](https://github.com/whole-tale/gwvolman/pull/175)
+        * deployed to .stage
+
+* Craig
+    * PR review/testing
+    * Accessibility/universal design proposal
+
+* Mike
+    * no updates
+
+* Sara
+    * Working on folder upload PR
+
+* Tim
+    * Not much new to report. Nearing a first REPROS release.
+    * Wondering if accessibility proposal is an opportunity to introduce a conversational interface into Whole Tale.
+        * Actual requirements for provenance graphs can be satisfied by answering questions posed by the user.
+        * A simple query (naturalish) language for reproducibility and provenance?

development/meetings/2022-04-11.md

@@ -0,0 +1,36 @@
+2021-04-11 Development Meeting
+==============================
+Kacper, Mike, Sara, Tim, Craig
+
+Agenda
+------
+* Updates
+* No call next week (04/18/22)
+
+
+Updates
+-------
+* Kacper
+    * Updated .prod to use nfs mounts
+        * That included fixing .prod that was in bad state due to a) nodes running out of space for /var/lib/docker b) one of the nodes autoupdating docker to a different version
+    * Embarked on journey to find a decent monitoring solution
+        * Current contender is: Grafana + Loki + Promtail
+    * Started working on some basic accessibility improvements:
+        * poked Globus (via Kyle) to fix their "institution dropdown"
+        * "fixed" login page -- [whole-tale/ngx-dashboard#270](https://github.com/whole-tale/ngx-dashboard/pull/270) 
+        * Adding VS code as an optional IDE to existing Jupyter-based r2d images -- wip...
+
+* Tim
+    * Working on getting the SKOPE data processing containers working as REPROs, modularized, etc, and working with the provenance recording tools.
+    * Had forgotten about all the implicit dependencies between various geospatial computing packages.
+
+* Sara
+    * PR for folder uploads
+
+* Mike
+    * Trying to set up meeting with USC
+
+* Craig
+    * Accessibility proposal/LOI
+    * Need to work on CSDMS tutorial
+    * Family in town + kids' spring break 4/13 - 4/22

development/meetings/2022-04-25.md

@@ -0,0 +1,41 @@
+2021-04-25 Development Meeting
+==============================
+Kacper, Sara, Tim, Craig, Mike
+
+Agenda
+------
+* Updates
+* CSDMS
+    * Discussion of `extra_build_files` required for example tales.
+    * Possibly add ability to edit tale
+
+Updates
+-------
+* Kacper
+    * nothing to report. OO"O" entire week.
+    * Week prior:
+        * Updated [whole-tale/girder_wholetale#536](https://github.com/whole-tale/girder_wholetale/pull/536) to include "shallow" copy. (see [comment](https://github.com/whole-tale/wt_versioning/pull/43#issuecomment-1099309535))
+        * Fixed non-globus login -- [whole-tale/girder_wholetale#537](https://github.com/whole-tale/girder_wholetale/pull/537)
+    * will review outstanding PRs (mainly dashboard)
+
+* Craig
+    * Mostly out last week
+    * PR review
+    * Sloan LOI
+    * CSDMS tutorial + doc updates
+
+* Sara
+    * Approved accessibility PR from @xarthisius
+    * 2 PRs for Files view are ready to merge
+        * Fixed bug reported by Craig - thank you, I had accidentally removed the handling for this edge case!
+        * Fixed scoping bug
+        * Files now upload one at a time, to prevent UI/API from being overwhelmed
+        * Next up: I'll try and make an upload queue display while files are uploading (possibly with a warning to avoid refreshing the page)
+
+* Tim
+    * Racing to take advantage of the DOE FOA Kacper found last week.
+    * We have permission from campus to be one of the two pre-application submitters.
+    * Talking to Kyle Chard about collaborating on this.
+
+* Mike
+    * no updates