[Docs] Update change log for V1.6.3 (#5354)

mlrun · Jun 2, 2024 · 4691956 · 4691956
1 parent f869a55
commit 4691956
Show file tree

Hide file tree

Showing 6 changed files with 54 additions and 31 deletions.
diff --git a/docs/change-log/index.md b/docs/change-log/index.md
@@ -1,7 +1,7 @@
 (change-log)=
 # Change log
 
-- [v1.6.2](#v1-6-2-29-march-2024) | [v1.6.1](#v1-6-1-29-february-2024) | [v1.6.0](#v1-6-0-22-february-2024)
+- [v1.6.3](#v1-6-3-29-may-2024)  | [v1.6.2](#v1-6-2-29-march-2024) | [v1.6.1](#v1-6-1-29-february-2024) | [v1.6.0](#v1-6-0-22-february-2024)
 - [v1.5.2](#v1-5-2-30-november-2023) | [v1.5.1](#v1-5-1-2-november-2023) | [v1.5.0](#v1-5-0-23-october-2023)
 - [v1.4.1](#v1-4-1-8-august-2023) | [v1.4.0](#v1-4-0-23-july-2023)
 - [v1.3.4](#v1-3-4-23-august-2023) | [v1.3.3](#v1-3-3-7-jun-2023) | [v1.3.2](#v1-3-2-4-jun-2023) | [v1.3.1](#v1-3-1-18-may-2023) | [v1.3.0](#v1-3-0-22-march-2023) 
@@ -13,6 +13,52 @@
 - [Deprecations and removed code](#deprecations-and-removed-code)
 
 
+## v1.6.3 (29 May 2024)
+
+### Workflows
+| ID       |Description                                                               |
+|----------|---------------------------------------------------------------------------|
+|ML-3521,5482|Remote/scheduled workflows can now be performed by a project with a source that is contained on the image. See [Scheduling a workflow](../concepts/scheduled-jobs.html#scheduling-a-workflow). Tech Preview. |
+
+### Infrastructure
+
+| ID    |Description                                                                 |
+|-------|----------------------------------------------------------------------------|
+|ML-5739|MLRun now supports email-like username.|
+
+### Documentation
+| ID    |Description                                                               |
+|-------|---------------------------------------------------------------------------|
+|ML-4620| Updated [Realtime monitoring and drift detection tutorial](../tutorials/05-model-monitoring.html) and {ref}`monitoring-overview` for the [model monitoring](#model-monitoring) feature introduced in v1.6.0.|
+|NA     | New page describing {ref}`log-artifacts`.                                 |
+|NA     | New page describing {ref}`parallel-workflows`.                                 |
+|NA     | New page describing {ref}`conditional-workflow`.                                 |
+|NA     | New page describing {ref}`exithandler-workflow`.                                 |
+
+### Breaking change
+| ID          |Description                                                               |
+|-------|---------------------------------------------------------------------------|
+|ML-6098|The `prediction` and `named_predictions` columns (list of all predictions) were removed from the model monitoring parquet files. Each prediction is still available in a column of its own.|
+
+###  Closed issues
+
+| ID       |Description                                                               |
+|----------|---------------------------------------------------------------------------|
+|ML-4149|Workflows are now listed from newest to oldest.|
+|ML-5763|The log formatter options can now be changed by an env var.|
+|ML-5772|Resolved: "Projects" screen/counters may show "N/A" or "MySQL server has gone away" transient error.|
+|ML-5776|Concurrent request to project deletion now do not fail.|
+|ML-6000|Improved MLRun startup time on system with large number of runs.|
+|ML-6026|Remote workflows using a large image no longer time-out.|
+|ML-6045|UI: User-filters return all of the matching users.|
+|ML-6048|UI: An admin user can now change its role in the project. |  
+|ML-6051|UI: After an admin user deletes itself from a project, the user is redirected.|
+|ML-6188|If a workflow runner pod fails due to an application error, an immediate response returns the error (and not that the workflow does not exist).|
+|ML-6194|When running workflows with a remote engine, functions files are not synced instead they are loaded dynamically during runtime.|
+|ML-6317|Reduced MLRun memory consumption.|
+|ML-6384|Improved resource consumption of list runs with partitioning query |
+|ML-6397|Artifacts are no longer stored in the run body in the DB, instead a map of artifact keys to URIs is maintained.|
+|ML-6489|Resolved jobs transient failures with error 'ClientOSError(104, 'Connection reset by peer')'.|
 
 ## v1.6.2 (29 March 2024)
 
@@ -24,8 +70,6 @@
 |ML-5749, 6037|After the user removes ownership of the currently displayed project, the UI redirects to the Projects page.|
 |ML-5977|The 'Members' tab in Project settings is now shown for groups with admin privileges.|
 
-
-
 ## v1.6.1 (29 February 2024)
 
 ###  Closed issue
@@ -50,7 +94,7 @@
 ### Model monitoring 
 | ID     |Description                                                                                         |
 |---------|-----------------------------------------------------------------------------------------------------|
-|ML-4620|New Grafana Model Monitoring Applications dashboard that includes charts and KPIs that are relevant to a specific monitoring application (under a specific model endpoint). The graphs are: Draft status by category, Average drift value result, Latest result, Aopplication summary, Result value by time, Drift detection history. See [Model Monitoring Applications dashboard](../monitoring/model-monitoring-deployment.html#model-monitoring-applications-dashboard).|
+|ML-4620|Model monitoring is now based on monitoring apps that are run on a set of model end-points, see {ref}`monitoring-overview`. The Grafana Model Monitoring Applications dashboard now includes charts and KPIs that are relevant to a specific monitoring application (under a specific model endpoint). The graphs are: Draft status by category, Average drift value result, Latest result, Aopplication summary, Result value by time, Drift detection history. See [Model Monitoring Applications dashboard](../monitoring/model-monitoring-deployment.html#model-monitoring-applications-dashboard).|
 
 ### Runtimes
 
@@ -866,7 +910,6 @@ with a drill-down to view the steps and their details. [Tech Preview]
 |ML-3143/ML-3432|Cannot delete a remote function from the DB (neither with SDK nor UI).  |NA |v1.2.1    |
 |ML-3445|`project.deploy_function` operation might get stuck when running v1.3.0 demos on an Iguazio platform running v3.2.x.| Replace code: `serving_fn = mlrun.new_function("serving", image="python:3.9", kind="serving", requirements=["mlrun[complete]", "scikit-learn~=1.2.0"])` with: <br>`function = mlrun.new_function("serving", image="python:3.9", kind="serving") function.with_commands([ "python -m pip install --upgrade pip", "pip install 'mlrun[complete]' scikit-learn==1.1.2", ])`|v1.3.0    |
 |NA|The feature store does not support schema evolution and does not have schema enforcement.| NA| v1.2.1    |
-|ML-3521|Cannot schedule a workflow without a remote source. | NA| v1.2.1    |
 |ML-3526|Aggregation column order is not always respected (storey engine).| NA | v1.3.0|
 |ML-3626|The "Save and ingest" option is disabled for a scheduled feature set. |NA | v1.3.0|
 |ML-3627|The feature store allows ingestion of string type for the timestamp key resulting in errors when trying to query the offline store with time filtration.|Use only timestamp type.| v1.2.1    |
@@ -903,10 +946,6 @@ with a drill-down to view the steps and their details. [Tech Preview]
 |ML-5573|The default value of feature-set ingest() infer_options is "all" (which includes Preview) and as a result, during ingest, preview is done as well. As a result, if a validator was configured for a feature, each violation causes two messages to be printed.|NA|v1.6.0|
 |ML-5732|When using an MLRun client previous to v1.6.0, the workflow step status might show completed when it is actually aborted.|Abort the job from the SDK instead of from the UI, or upgrade the client. |1.6.0|
 |ML-5876|The maximum length of project name + the longest function name for `project.enable_model_monitoring` is 63 chars. |Keep the name combination at a maximum of 63 chars. |v1.6.0|
-|ML-6048|UI: An admin user cannot change its role in the project. | NA |v1.6.2|
-|ML-6045|UI: If a user-filter has a large number of matches, it may not display all the matching users. |Narrow your search to be sure you get all the matches.|v1.6.2|
-|ML-6051|UI: After an admin user deletes itself from a project, the user stays in the Projects Members page even though it has no permissions and cannot view any aspects of the project.|  NA |v1.6.2|
-
 
 ## Limitations
 | ID     |Description                                                                                                                                 |Workaround |Opened in|
@@ -942,6 +981,7 @@ with a drill-down to view the steps and their details. [Tech Preview]
 
 | Will be removed|Deprecated|API                                                                                |Use instead                                                                                                                                                 |
 |---------------|------------|----------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| v1.9.0       |v1.6.3    |`FunctionSpec.clone_target_dir`                                                      |`ImageBuilder.source_code_target_dir`
 | v1.8.0       |v1.6.0    |HTTPDB: `last` parameter of `list_runs`                                              | NA. Was not used.|
 | v1.8.0       |v1.6.0    |Feature store: `get_offline_features`                                                |`FeatureVector.get_offline_features()`|
 | v1.8.0       |v1.6.0    |Feature store: `get_online_feature_service`                                          |`FeatureVector.get_online_feature_service()`|

diff --git a/docs/data-prep/ingest-data-fs.md b/docs/data-prep/ingest-data-fs.md
@@ -55,7 +55,7 @@ df = quotes_set.preview(quotes)
 print(quotes_set.get_stats_table())
 ```
 
-### Inferring data
+## Inferring data
 
 There are two ways to infer data:
 - Metadata/schema: This is responsible for describing the dataset and generating its meta-data, such as deducing the 

diff --git a/docs/feature-store/transformations.md b/docs/feature-store/transformations.md
@@ -217,8 +217,7 @@ steps. When implementing custom transformations, the code has to support all eng
 
 ```{admonition} Note
 The vast majority of MLRun's built-in transformations support all engines. The support matrix is available 
-[here](../serving/available-steps.html#data-transformation-steps).
-```
+[here](../feature-store/transformations.html#data-transformation-steps).
 
 The following are the main differences between transformation steps executing on different engines:
 

diff --git a/docs/store/models.md b/docs/store/models.md
@@ -48,7 +48,7 @@ def train_iris(context: MLClientCtx):
                       labels={"class": "sklearn.linear_model.LogisticRegression"})
 ```
 
-Save the code above to `train_iris.py`. The following code loads the function and runs it as a job. See the [quick-start page](quick-start.html#mlrun-setup) to learn how to create the project and set the artifact path. 
+Save the code above to `train_iris.py`. The following code loads the function and runs it as a job. See the [Quick start tutorial](../tutorials/01-mlrun-basics.html) to learn how to create the project and set the artifact path. 
 
 ``` python
 from mlrun import code_to_function

diff --git a/docs/tutorials/01-mlrun-basics.ipynb b/docs/tutorials/01-mlrun-basics.ipynb
@@ -12,21 +12,6 @@
     "# Quick start tutorial\n"
    ]
   },
-  {
-   "cell_type": "markdown",
-   "id": "d4cbf4a8-7e92-49f8-be36-c48a99fb4527",
-   "metadata": {
-    "pycharm": {
-     "name": "#%% md\n"
-    },
-    "tags": [
-     "docs-only"
-    ]
-   },
-   "source": [
-    "[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/mlrun/mlrun/blob/development/docs/tutorial/colab/01-mlrun-basics-colab.ipynb)"
-   ]
-  },
   {
    "cell_type": "markdown",
    "id": "f3d4f37f-741c-4341-af7c-4cf2747e38f9",
@@ -1801,7 +1786,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.7.7"
+   "version": "3.9.13"
   }
  },
  "nbformat": 4,

diff --git a/docs/tutorials/04-pipeline.ipynb b/docs/tutorials/04-pipeline.ipynb
@@ -643,7 +643,6 @@
     "You might also want to explore the following demos:\n",
     "\n",
     "- For an example of distributed training pipeline using TensorFlow, Keras, and PyTorch, see the [**mask detection demo**](https://github.com/mlrun/demos/tree/1.2.x/mask-detection).\n",
-    "- To learn more about deploying live endpoints and concept drift, see the [**network-operations (NetOps) demo**](https://github.com/mlrun/demos/tree/1.2.x/network-operations).\n",
     "- To learn about using the feature store to process raw transactions and events in real-time and respond and block transactions before they occur, see the [**Fraud prevention demo**](https://github.com/mlrun/demos/tree/1.2.x/fraud-prevention-feature-store).  \n",
     "- For an example of a pipeline that summarizes and extracts keywords from a news article URL, see the [**News article summarization and keyword extraction via NLP**](https://github.com/mlrun/demos/tree/1.2.x/news-article-nlp)."
    ]
@@ -665,7 +664,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.7.7"
+   "version": "3.9.13"
   },
   "vscode": {
    "interpreter": {