{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":518462089,"defaultBranch":"main","name":"witan.sen2","ownerLogin":"MastodonC","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-07-27T13:06:25.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/2911834?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1708099223.0","currentOid":""},"activityList":{"items":[{"before":"1031babe32d116e03cc0eeb597157ddecdc1b274","after":null,"ref":"refs/heads/add-ancestor-table-ids-to-csv-read","pushedAt":"2024-02-16T16:00:23.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"}},{"before":"a97600ddb51b0d75dc5787b51283beff08340464","after":"3cb40c1beb87ac2934eb4d6944b85400b5d8eb29","ref":"refs/heads/main","pushedAt":"2024-02-16T16:00:19.000Z","pushType":"pr_merge","commitsCount":4,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Merge pull request #18 from MastodonC/add-ancestor-table-ids-to-csv-read\n\nAdd ancestor `:*-table-id`s to COLLECT Blade CSV read, so that:\r\n- Easier to use the sen2-blade modules as all chidren of the requests table have `:person-id` & `:requests-id`.\r\n- Matches the SEN2 Blades extracted from LA precursor Excel files, which have datasets keyed by `:person-id` & `:requests-id`.\r\n- Removes requirement to merge in ancestor `:*-table-id`s from a table-id-ds in witan.sen2.return.person-level.blade.plans-placements.\r\n- Removes requirement for witan.sen2.return.person-level.blade.csv in witan.sen2.return.person-level.blade.eda & witan.sen2.return.person-level.blade.plans-placements.\r\n- Results in witan.sen2.return.person-level.blade.eda & witan.sen2.return.person-level.blade.plans-placements code that can be be used without modification for SEN2 Blades extracted from sources other than a COLLECT CSV export (such as LA pre-submission workbooks).","shortMessageHtmlLink":"Merge pull request #18 from MastodonC/add-ancestor-table-ids-to-csv-read"}},{"before":null,"after":"1031babe32d116e03cc0eeb597157ddecdc1b274","ref":"refs/heads/add-ancestor-table-ids-to-csv-read","pushedAt":"2024-02-16T15:11:26.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Remove dependency on witan.sen2.return.person-level.blade.csv\n\nNow have `:person-id` & `:requests-id` in all SEN2 Blade module datasets","shortMessageHtmlLink":"Remove dependency on witan.sen2.return.person-level.blade.csv"}},{"before":"23a107647021ece666df8f4223ef5246ee600ad5","after":null,"ref":"refs/heads/update-checks-of-plans-placements","pushedAt":"2024-02-12T09:10:44.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"}},{"before":"12b393fd28e3094f11f416cfad2871c2bbc97915","after":"a97600ddb51b0d75dc5787b51283beff08340464","ref":"refs/heads/main","pushedAt":"2024-02-12T09:10:41.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Merge pull request #17 from MastodonC/update-checks-of-plans-placements\n\nUpdate checks of plans & placements:\r\n- change check `:col-fn`s from function applied to entire dataset but expected to only add a single appropriately named `:issue-*` column to function to be used within `tc/add-column`, so: clear are just adding an issues column; simpler to specify; and more robust as with this formulation cannot mess up the rest of the plans & placements dataset or mis-sepcify the name of the `:issue-*` column.\r\n- add `:cols-required` to check definition and update `flag-issues` to only run a check if those columns are present. This allows checks to be run on plans & placements after applying updates, when only key columns are retained.\r\n- extend checks: note that some checks on full plans & placements overlap (eg. a `:issue-unknown-age-at-start-of-school-year` will result in a `:issue-missing-ncy-nominal`): this is intentional and is to ensure appropriate checking of plans & placements after applying updates.\r\n- simplify reporting of issues, including separating out the specification of the totals.\r\n- make `checks` a function and allow specification of allowable `sen-types` and `sen-settings`, the latter so that updates can (ab)use :sen-setting to specify :estab-cat at placement level without being flagged as an issue by checks.\r\n- drop 1-arity versions of functions that had `checks` as optional 2nd argument and require `checks` are always passed as a parameter.","shortMessageHtmlLink":"Merge pull request #17 from MastodonC/update-checks-of-plans-placements"}},{"before":null,"after":"23a107647021ece666df8f4223ef5246ee600ad5","ref":"refs/heads/update-checks-of-plans-placements","pushedAt":"2024-02-09T12:44:13.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Update checks of plans & placements\n\n- change check `:col-fn`s from function applied to entire dataset but expected to only add a single appropriately named `:issue-*` column to function to be used within `tc/add-column`, so: clear are just adding an issues column; simpler to specify; and more robust as with this formulation cannot mess up the rest of the plans & placements dataset or mis-sepcify the name of the `:issue-*` column.\n- add `:cols-required` to check definition and update `flag-issues` to only run a check if those columns are present. This allows checks to be run on plans & placements after applying updates, when only key columns are retained.\n- extend checks: note that some checks on full plans & placements overlap (eg. a `:issue-unknown-age-at-start-of-school-year` will result in a `:issue-missing-ncy-nominal`): this is intentional and is to ensure appropriate checking of plans & placements after applying updates.\n- simplify reporting of issues, including separating out the specification of the totals.\n- make `checks` a function and allow specification of allowable `sen-types` and `sen-settings`, the latter so that updates can (ab)use :sen-setting to specify :estab-cat at placement level without being flagged as an issue by checks.\n- drop 1-arity versions of functions that had `checks` as optional 2nd argument and require `checks` are always passed as a parameter.","shortMessageHtmlLink":"Update checks of plans & placements"}},{"before":"23938b4150349cbc6de78528de3a53514f89533c","after":null,"ref":"refs/heads/genericalise-blade","pushedAt":"2024-02-07T17:21:23.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"}},{"before":"d75967a2be99430a8f72b9ae13dd774b7ac53b80","after":"12b393fd28e3094f11f416cfad2871c2bbc97915","ref":"refs/heads/main","pushedAt":"2024-02-07T17:21:19.000Z","pushType":"pr_merge","commitsCount":7,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Merge pull request #16 from MastodonC/genericalise-blade\n\nRemove CSV specific aspects where unnecessary yielding more generic code that can be used for SEN2 Blade data read from other file formats.\r\n- Add template `sen2-blade` ns to read SEN2 Blade in one place.\r\n- Remove unnecessary CSV file references\r\n- Remove (most) COLLECT Blade CSV export specific aspects from plans-placements lib ns, so ns can be used on SEN2 Blades extracted from other sources such as LA pre-submission spreadsheets.\r\n- Parameterise columns from SEN2 Blade carried forwards into plans-placements, for flexibility & consistency.","shortMessageHtmlLink":"Merge pull request #16 from MastodonC/genericalise-blade"}},{"before":"b76450a1faba6aec4fce32059e553380953f78de","after":"23938b4150349cbc6de78528de3a53514f89533c","ref":"refs/heads/genericalise-blade","pushedAt":"2024-02-01T00:18:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Parameterise column selection from sen2 blade in plans-placements\n\n…and further reduce differences between versions for sen2-blade extractions.\n\nThis results in some changes to columns selected and column order in\nthe CSV output files included in this commit, but the data contained\nin the columns common with those produced by the previous version are identical.","shortMessageHtmlLink":"Parameterise column selection from sen2 blade in plans-placements"}},{"before":"b8e336488e1995c939ebf87dd284b495aacf40d8","after":"b76450a1faba6aec4fce32059e553380953f78de","ref":"refs/heads/genericalise-blade","pushedAt":"2024-01-31T15:40:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Reduce plans-placement lib requirement for sen2-blade extraction lib\n\nTowards using single plans-placement lib with different sen2-blade extraction libs:\n- define sen2-blade-table-id-col-names locally\n- get col-name->label maps via parameters rather than from sen2-blade extraction lib","shortMessageHtmlLink":"Reduce plans-placement lib requirement for sen2-blade extraction lib"}},{"before":"fe0c9a464aede13a345170b6f2e64106b2f8818b","after":"b8e336488e1995c939ebf87dd284b495aacf40d8","ref":"refs/heads/genericalise-blade","pushedAt":"2024-01-29T21:29:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Improve reporting of files","shortMessageHtmlLink":"Improve reporting of files"}},{"before":"a22fa7591870652664280c107f981d9a29d2e8f0","after":"fe0c9a464aede13a345170b6f2e64106b2f8818b","ref":"refs/heads/genericalise-blade","pushedAt":"2024-01-29T14:30:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Remove ignored code","shortMessageHtmlLink":"Remove ignored code"}},{"before":"1051f0f48f0ba04eb3b64dca5d4602d55599514a","after":"a22fa7591870652664280c107f981d9a29d2e8f0","ref":"refs/heads/genericalise-blade","pushedAt":"2024-01-29T13:57:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Remove unnecessary CSV file references","shortMessageHtmlLink":"Remove unnecessary CSV file references"}},{"before":null,"after":"1051f0f48f0ba04eb3b64dca5d4602d55599514a","ref":"refs/heads/genericalise-blade","pushedAt":"2024-01-26T13:49:01.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Add template sen2-blade ns to read SEN2 Blade in one place\n\n- Update other ns to get sen2-blade data from this new ns, reducing duplicated and CSV specific code","shortMessageHtmlLink":"Add template sen2-blade ns to read SEN2 Blade in one place"}},{"before":"a8303aa5f298a4faa1c96ccdd2a41e3922f3ef68","after":null,"ref":"refs/heads/plan-placement-updates","pushedAt":"2024-01-24T12:58:05.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"}},{"before":"db2538995139609e6758d930e3422badad72131d","after":"d75967a2be99430a8f72b9ae13dd774b7ac53b80","ref":"refs/heads/main","pushedAt":"2024-01-24T12:58:00.000Z","pushType":"pr_merge","commitsCount":3,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Merge pull request #15 from MastodonC/plan-placement-updates\n\nUpdates to plan-placement CSV file handling:\r\n- Define parser-fn for reading plan-placement CSVs locally\r\n - Rather than collating from `sen2-blade-csv`, to reduce dependencies and so consistent across SEN2 Blade Exports and other SEN2 submission/pre-submission data.\r\n - Allow specification of read options to …csv-file->ds functions.\r\n- Replace checks and delta chars in issues summary with \"X\" and \"*\" for consistent fixed-width display spacing.\r\n- Put `def`s calling `…col-name->label` fns on a delay (in templates) so consistent.","shortMessageHtmlLink":"Merge pull request #15 from MastodonC/plan-placement-updates"}},{"before":"c6c6ec619c3c66c48669764037553a5eea5bd26b","after":"a8303aa5f298a4faa1c96ccdd2a41e3922f3ef68","ref":"refs/heads/plan-placement-updates","pushedAt":"2024-01-19T15:55:27.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Put col-name->label fns on a delay so consistent","shortMessageHtmlLink":"Put col-name->label fns on a delay so consistent"}},{"before":null,"after":"c6c6ec619c3c66c48669764037553a5eea5bd26b","ref":"refs/heads/plan-placement-updates","pushedAt":"2024-01-19T15:46:51.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Define parser-fn for reading plan-placement CSVs locally\n\n- Rather than collating from `sen2-blade-csv`, to reduce dependencies and so consistent across SEN2 Blade Exports and other SEN2 submission/pre-submission data.\n- Allow specification of read options to …csv-file->ds functions.\n\nReplace checks and delta chars in issues summary with \"X\" and \"*\" for consistent fixed-width display spacing.","shortMessageHtmlLink":"Define parser-fn for reading plan-placement CSVs locally"}},{"before":"342287b0ab0d4ab2db2cc7fc767d2bc388bf1f8f","after":null,"ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-15T16:21:12.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"}},{"before":"60d7066abdd71f47b2beef8fcd9da080013127c9","after":"db2538995139609e6758d930e3422badad72131d","ref":"refs/heads/main","pushedAt":"2024-01-15T16:21:07.000Z","pushType":"pr_merge","commitsCount":11,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Merge pull request #14 from MastodonC/csv-read-updates\n\nImprove Blade CSV Export reading ns and associated EDA so more consistent with approach have to take with pre-submission Excel files provided by some clients.\r\n\r\nCSV read:\r\n- Add module order and title definitions.\r\n- Update `:key-fn`s to pass through any unexpected columns named as-is.\r\n- Rename `-csv-col-label->name`→`-src-col-label->name` so generic.\r\n- Replace module specific read functions with `csv->ds` including ::post-fn for post-processing.\r\n- Use `:local-date` rather than `:packed-local-date`\r\n- Add maps of `src-col-name->label` & `col-name->label` for each module so can pass to EDA functions.\r\n- Add function `file-paths->ds-map` to read CSV files specified as map of file-paths. (Previous `->ds-map` function was parameterised by file-names within a single separately specified directory.)\r\n\r\nEDA:\r\n- Add `module order`.\r\n- Rename `…csv-col…`→`…src-col…` so generic.\r\n- Define `default-module-cols-to-report-distinct-vals` outside reporting function and parameterise.\r\n- Replace `report-csv-ds-info` with `report-module-info` and `report-csv-ds-map-info` & `report-csv-ds-map-info-all` with `report-all-module-info`:\r\n - Modularise\r\n - Allow `title`, `src-col-name->col-name`, `col-name->label` & `cols-to-report-distinct-vals` to be specified as parameters rather than hardcoded (removing dependency on CSV read ns functions).\r\n - Only report on modules that are present.\r\n\r\nTemplate EDA notebook:\r\n- Changes for updates to EDA ns.\r\n\r\nplans-placements library ns\r\n- Changes for updates to CSV read ns.\r\n\r\nTemplate plans-placements derivation `ns` & EDA notebook:\r\n- Changes for updates to CSV read ns.\r\n- Bring `col-name->label` maps and `checks` definitions into derivation `ns` (rather than use from plans-placements lib) to ensure consistent with plans-placements data and allow updating.\r\n\r\nShorten paths (**ns name changes**) for namespaces that are now not COLLECT export or CSV specific:\r\n- `witan.sen2.return.person-level.blade-export.csv` -> `witan.sen2.return.person-level.blade.csv`\r\n- `witan.sen2.return.person-level.blade-export.csv.eda` -> `witan.sen2.return.person-level.blade.eda`\r\n- `witan.sen2.return.person-level.blade-export.csv.plans-placements` -> `witan.sen2.return.person-level.blade.plans-placements`","shortMessageHtmlLink":"Merge pull request #14 from MastodonC/csv-read-updates"}},{"before":"4d2d8797dfa7b2c00bd4ed1ae32f14446c62f568","after":"342287b0ab0d4ab2db2cc7fc767d2bc388bf1f8f","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-12T16:16:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Remove -export from blade-export as code not specific to exports","shortMessageHtmlLink":"Remove -export from blade-export as code not specific to exports"}},{"before":"25ebb4b1ed7b509804e5481616ec0b0e0c69cbc5","after":"4d2d8797dfa7b2c00bd4ed1ae32f14446c62f568","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-12T12:57:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Move ..blade-export.csv.plans-placements up as now not CSV specific","shortMessageHtmlLink":"Move ..blade-export.csv.plans-placements up as now not CSV specific"}},{"before":"b015e84731cc34dcc2a4c95285b0971ca22524ce","after":"25ebb4b1ed7b509804e5481616ec0b0e0c69cbc5","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-12T12:49:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Use checks and col-names from plans-placements","shortMessageHtmlLink":"Use checks and col-names from plans-placements"}},{"before":"2b2021eaee30afa587291511cab034ea668b94b3","after":"b015e84731cc34dcc2a4c95285b0971ca22524ce","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-12T12:48:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Shorten docstrings","shortMessageHtmlLink":"Shorten docstrings"}},{"before":"74e63cdae2876663e1b5a452cb9c1844e3d28063","after":"2b2021eaee30afa587291511cab034ea668b94b3","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-12T12:38:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Canonicalise docstring case","shortMessageHtmlLink":"Canonicalise docstring case"}},{"before":"59c5a8abfd63a3d364d2849673aa05319bf5b21e","after":"74e63cdae2876663e1b5a452cb9c1844e3d28063","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-12T12:12:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Make docstring \"SEN2 Blade CSV export\" terminology consistent","shortMessageHtmlLink":"Make docstring \"SEN2 Blade CSV export\" terminology consistent"}},{"before":"8bc78b49e61c06e26f757b84a963eb8b03a1e0c0","after":"59c5a8abfd63a3d364d2849673aa05319bf5b21e","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-11T11:38:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Correct minor docstring issues and remove redundant requires","shortMessageHtmlLink":"Correct minor docstring issues and remove redundant requires"}},{"before":"ede01735c871347b3d9efea540598d9097a89193","after":"8bc78b49e61c06e26f757b84a963eb8b03a1e0c0","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-10T17:10:10.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Move EDA ns up out of CSV folder as now generic for all SEN2 Blades","shortMessageHtmlLink":"Move EDA ns up out of CSV folder as now generic for all SEN2 Blades"}},{"before":"e9b999b90c552e304cfd1f7f56ed40589422382b","after":"ede01735c871347b3d9efea540598d9097a89193","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-10T14:46:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Correct some headings & comments","shortMessageHtmlLink":"Correct some headings & comments"}},{"before":null,"after":"e9b999b90c552e304cfd1f7f56ed40589422382b","ref":"refs/heads/csv-read-updates","pushedAt":"2024-01-10T12:21:10.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eraderna","name":"Andrew Holmes","path":"/eraderna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/107362057?s=80&v=4"},"commit":{"message":"Improve Blade CSV Export reading ns and associated EDA\n\nSo more consistent with approach have to take with pre-submission Excel files provided by some clients.\n\nCSV read:\n- Add module order and title definitions.\n- Update `:key-fn`s to pass through any unexpected columns named as-is.\n- Rename `-csv-col-label->name`→`-src-col-label->name` so generic.\n- Replace module specific read functions with `csv->ds` including ::post-fn for post-processing.\n- Use `:local-date` rather than `:packed-local-date`\n- Add maps of src-col-name->label & col-name->label for each module so can pass to EDA functions.\n- Add function `file-paths->ds-map` to read CSV files specified as map of file-paths. (Previous `->ds-map` function was parameterised by file-names within a single separately specified directory.)\n\nEDA:\n- Add module order.\n- Rename `…csv-col…`→`…src-col…` so generic.\n- Define `default-module-cols-to-report-distinct-vals` outside reporting function and parameterise.\n- Replace `report-csv-ds-info` with `report-module-info` and `report-csv-ds-map-info` & `report-csv-ds-map-info-all` with `report-all-module-info`:\n - Modularise\n - Allow `title`, `src-col-name->col-name`, `col-name->label` & `cols-to-report-distinct-vals` to be specified as parameters rather than hardcoded (removing dependency on CSV read ns functions).\n - Only report on modules that are present.\n\nTemplate EDA notebook:\n- Changes for updates to EDA ns.\n\nTemplate plans-placements & EDA notebook:\n- Changes for updates to CSV read ns.","shortMessageHtmlLink":"Improve Blade CSV Export reading ns and associated EDA"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAD_LyeOwA","startCursor":null,"endCursor":null}},"title":"Activity · MastodonC/witan.sen2"}