Skip to content

Release 0.1.32

Choose a tag to compare

@github-actions github-actions released this 01 Apr 01:04
· 370 commits to main since this release

Features

  • ability to dry-run for preflight analysis (fe61f51)
  • add dataset-datatype constraints to disallow nested schemas on data storage types that do not support nesting/non-primitive types (a0609be)
  • add new MTG atlas example project (8bc315c)
  • additional comparison pipeline (2bae1f4)
  • additional dual efcore-python testing pipeline (20286c8)
  • allow for gradient pre-flight checks for better unit testing (ad8947d)
  • allow for nodata (unit) node input and ouput (3c7874e)
  • allow for sync node outputs (fe1778c)
  • allow plaintext description on pipeline nodes (83fd041)
  • allow schemas to have required members (31dc519)
  • begin testing framework (074f37e)
  • better analyzer for missing pipeline requirements (569816e)
  • catalog-level definition of inspection levels (c6ef393)
  • completed efcore plugin refactor (769952d)
  • configuration options for metadata providers (4eb2596)
  • consolidate setup into FlowthruApplication builder, migrate critical code from test-flights to library code (1fbc156)
  • create centralized SerializedLabel anno for universal label serialization (a6ca4e1)
  • create oracle text full/partial embedding dataset (8ea8e29)
  • custom ratchet testing architecture (b9ce539)
  • distributed catalog entries (a3de8af)
  • dummy pipeline template (2afd606)
  • efcore extension (085f8d0)
  • embedding pipeline example (e0d5276)
  • enum serialization annotations (a3eb127)
  • flexible & extensible catalogentries (e676bc1)
  • force increment change (06d3522)
  • functional ml.net wrapper start (958b29a)
  • further mast coverage (b276d6c)
  • generic file catalog entry (e9794aa)
  • improved DAG metadata output for full/active on run (c3b98e9)
  • initial library setup (e1312a3)
  • internal umap timing reports (7f79ba4)
  • json data catalog implementation (0918226)
  • kedro iris starter (8859c17)
  • magic AST (94b4d99)
  • magic atlas accurate umap (488b81c)
  • magic atlas embedding distribution analysis (3871d2d)
  • magicatlas k-means clustering analytics (e1f756d)
  • magicatlas k-means clustering analytics (cebd25c)
  • mast error code system, superpower install (4578f93)
  • mast revamp, unit tests (7fb7611)
  • mast testing, ast (55c632c)
  • metadata analysis in JSON and Mermaid form (ce56eae)
  • move x-validate to data science portion to spice dag (c9523aa)
  • nuget publish action flow (71c9e49)
  • pca clustering, pipeline (b806414)
  • pipeline builder addnode overloads (a619aeb)
  • pipeline slicing (a16fecc)
  • pure kedro spaceflights example (cc5b8ac)
  • pythonic nodes (#6) (b0289a4)
  • required parameter support for schemas (ac9aec1)
  • retail data example (ecfdcda)
  • run all pipelines as unified dag (68da6ab)
  • scryfall card processing (79aa48b)
  • service-based API surface changes (925f38d)
  • simplify node pipeline registration type param requirements to remove redundant information (69efa58)
  • sparse matrix optimizations (ebd6988)
  • specify empty EFCore tables as errors (802326c)
  • specify empty EFCore tables as errors (b622aeb)
  • starter umap comparison tests (8dbc537)
  • strategized umap (c69eb27)
  • stronger onboarding processes (#8) (8939c37)
  • templating process (acba958)
  • testing process for template pipeline creation (501ddae)
  • tiebreaking jiggle on atlas umap, to break up single-value columns (5bb4522)
  • umap first stab (50f0552)
  • umap graph init and gradiant speedups (71dfb07)
  • umap optimizations (d51477d)
  • umap optimizations, parallelization (eaa2418)
  • umap opts, applied to magic atlas (d910e11)
  • upload ML and ML.NET flowthru extensions as separate packages (9898bc5)
  • use verify for ratchet-style testing (0ccea9f)
  • vscode snippets (1aca658)

Bug Fixes

  • add datasets docs structure and initial kedro data (f787cc6)
  • add dependsOn to publish target and remove explicit build command (7b06b73)
  • add missing assertion in test method (ed5f3f1)
  • add missing curly in tests (f161ce5)
  • add retail data example to solution (7aa36f2)
  • add self-reference graph construction tests (3a53d79)
  • Added more functionality to IFlowthruService (#7) (690232b)
  • allow CI workflow to run when called by release workflow (5d5cf69)
  • analyzer check for missing config (b43a99d)
  • better mast reporting (9791efd)
  • break up flowthru libraries into less monolithic pieces, with an all-in barrel export package (f681074)
  • cancellation token interface tweaks (97252e7)
  • cancellation token respect (0d74aaf)
  • chromium pre-download (0a2b74c)
  • cleanup for unignored files & metadata configuration (f5b480f)
  • clear all previous data files (fb3aaf4)
  • configure Chromium for CI environment (43907d5)
  • conform examples to thin CLI wrap (96ec378)
  • consistent naming for catalog entry extensions in additional nuget packages (ae2d97b)
  • consolidate CI and release into single workflow (42ea370)
  • correct baseline UMAP implementation (061d31b)
  • correction to template versioning script (e16a6e0)
  • do not attempt to pack source generators (0f58cb7)
  • example projects now use source generator for schema typing (963d11e)
  • factory return types on catalog entries (e064ecb)
  • fix compilation in atlas umap (82d85d4)
  • fix data io directory paths, catalog (cc4f246)
  • fix gitignore in example projects (ffee26b)
  • fix json (de)serial for nested dict (403a9d1)
  • fix NX target in Actions (e6ba1f1)
  • fix parquet deserialization of enum types (6df3267)
  • ignore files (a849f9c)
  • improved handling of nested/flat schema detection for BCL types (8ae8da1)
  • include Kedro reference data for KedroSpaceflights.Custom (67474fa)
  • include kedro source data, include notice for license (9a65834)
  • include uv locks (84e69e7)
  • internal restructure for inspectability (c2d59e5)
  • mast cost processing (0324b23)
  • match ml.next namespaces with ml.net (75d782c)
  • minor updates (32445d5)
  • ml.next test singlethreading to avoid RNG race condition (8a85030)
  • more flexible template example tests (f50de8c)
  • move-away from phantom types within UMAP metrics (c5441a1)
  • multi-package static factory pattern for catalogentries (b79370e)
  • nuget deploy (365f13e)
  • nuget package restore issue (again) (92cdd8b)
  • nuget publish (940762d)
  • nuget updates (1de6fe1)
  • nx-dotnet/dotnet setup order fix on action (a3bc222)
  • optimizations for Chromium usage during testing (a843068)
  • parquet load issues (7119849)
  • parquet loading tactics updated to correct nulls (4130509)
  • phantom readmes as temp for build (9f93336)
  • prep pythonic templates, tests for CI (56254b5)
  • project.json change (aa03cb4)
  • purge retaildata from test, sln records (db63b23)
  • purge retaildata test (9ba0376)
  • refactor kedro custom example to use proper data layout (c84de20)
  • release (ea23e9d)
  • remove columnname (a490de0)
  • remove deprecated alpha libraries (df73c62)
  • remove ghost data loading python file (11e09a4)
  • remove kept metadata files (fb0748f)
  • remove languageext v5 upstream dep (21b7554)
  • remove large data files that cause clone death (9c8018f)
  • remove side effects from image render nodes (5fce6f5)
  • remove timestamp from kedro custom to avoid false stats updates (e8c4bbf)
  • remove unit test for discovery count (b451f6d)
  • resolve API surface areas between MagicAtlas->MagicAST (2faf982)
  • resolve CI/CD double-tap test issue (1ad8fde)
  • resolve empty template creation issue (#11) (78f3bf8)
  • resolve issues with NX command. (3f98a9e)
  • resolve nuget pack error during template testing. (96caf69)
  • resolve python venv resolution hiccup and add appropriate python worker logs (#9) (32b1685)
  • restructure pack pipeline (ad783d1)
  • rollback umap opts (6f5e329)
  • separate reviews preprocessing to separate node, strengthen null value check with PDV (2976e6e)
  • service changes on test fixtures (98f6fab)
  • service disposal on CLI (bf30640)
  • simplification for scalar name (cbd0881)
  • skip EnsureSourceGeneratorBuilt target when NoBuild is true (0974bbd)
  • small testing service disposal fixes (9fbb8b3)
  • solution fixes (46a14c5)
  • SpaceflightsPythonEFCore: track schema/catalog files excluded by .gitignore (c72e4bc)
  • split up CI/CD task into test and release (380e594)
  • stale docs removed (1d553d4)
  • sync flowthru package versions across all packages (f739025)
  • tutorial docs (d60866f)
  • unsealed pipelineexecutionrequest (279d6de)

Documentation