Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RELEASE] MRC v24.03.00 #457

Merged
merged 26 commits into from
Apr 8, 2024
Merged

[RELEASE] MRC v24.03.00 #457

merged 26 commits into from
Apr 8, 2024

Conversation

dagardner-nv
Copy link
Contributor

❄️ Code freeze for branch-24.03 and v24.03 release

What does this mean?

Only critical/hotfix level issues should be merged into branch-24.03 until release (merging of this PR).

All other development PRs should be retargeted towards the next release branch: branch-24.06.

What is the purpose of this PR?

  • Update documentation
  • Allow testing for the new release
  • Enable a means to merge branch-24.03 into main for the release

mdemoret-nv and others added 20 commits November 30, 2023 17:43
Merge pull request #419 from mdemoret-nv/branch-24.03-merge-23.11
Updates MRC to use `dependencies.yaml` for the source of truth for environment files, and adds a pre-commit hook to ensure the environment files get generated before commit. Also adds the pre-commit hook as a check in CI to ensure we catch missed changes.

Authors:
  - Christopher Harris (https://github.com/cwharris)

Approvers:
  - David Gardner (https://github.com/dagardner-nv)
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #416
Adds falke8, yapf, and isort pre-commit hooks.

Authors:
  - Christopher Harris (https://github.com/cwharris)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #420
…426)

* Adds a new `has_skip_ci_label` output to the `prepare` job.
* Skips the rest of the pipeline when true

Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #426
* Prevent `libmrc_pymrc.so` from being installed into python's site-packages dir, as this lib is already present in the lib dir.
* Fixes permissions issue where the conda env was owned by `root:root`, simply ensuring the env retains the `conda` group permission wasn't sufficient as `cmake` attempts to modify exiting dirs (https://gitlab.kitware.com/cmake/cmake/-/issues/10978), and running `chmod -R` after the fact is too slow.

Closes #428

Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #429
This PR fixes an issue where some libraries were using `${PROJECT_NAME}-core-exports` and others were using `${PROJECT_NAME}-exports`. Since there is no need for multiple export sets anymore, this updates all exports to be `${PROJECT_NAME}-exports`

Requires nv-morpheus/utilities#61 to be merged first

Authors:
  - Michael Demoret (https://github.com/mdemoret-nv)
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - David Gardner (https://github.com/dagardner-nv)

URL: #427
Authors:
  - Christopher Harris (https://github.com/cwharris)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #433
Closes #435
Closes #424
Closes #423
Closes #422

Authors:
  - Christopher Harris (https://github.com/cwharris)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #436
per request from ops

Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Christopher Harris (https://github.com/cwharris)

URL: #442
This PR enables the ForwardMerger [ops-bot](https://github.com/rapidsai/ops-bot) plugin.

Authors:
  - Jake Awe (https://github.com/AyodeAwe)

Approvers:
  - Christopher Harris (https://github.com/cwharris)

URL: #446
Add the io_scheduler from libcoro, rename to IoScheduler, use standard code styles, and adjust implementation to support MRC's other libcoro port details.

Authors:
  - Christopher Harris (https://github.com/cwharris)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #448
…am nodes (#449)

1. Adds a new C++ type `RoundRobinRouterTypeless` which is very similar to `BroadcastTypeless` except it only pushes values to one of the downstream connections instead of copying
2. Adds a new Python type `RoundRobinRouter` which allows using the `RoundRobinRouterTypeless` from python
3. Adds a C++ test to confirm connectivity
4. Adds Python tests to verify output

Authors:
  - Michael Demoret (https://github.com/mdemoret-nv)

Approvers:
  - Devin Robison (https://github.com/drobison00)

URL: #449
…eturning null (#451)

* Currently when `cast_from_pyobject` encounters an unsupported type it returns a json null.
* Updates the method to throw a `pybind11::type_error`, matching the `TypeError` exception raised by the Python std `json.dumps` method.
* Add `get_py_type_name` helper method
* Breaking behavior change

Closes #450

Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #451
When running an instance of the `AsyncioRunnable` class, it populates the output with:
```
I20240313 16:41:26.300143 3296734 asyncio_runnable.hpp:246] AsyncioRunnable::run() > Creating new event loop
I20240313 16:41:26.300436 3296734 asyncio_runnable.hpp:259] AsyncioRunnable::run() > Calling run_until_complete() on main_task()
```

This PR changes that to a `DVLOG(10)` since this information is more tracing than actually informative.

Authors:
  - Michael Demoret (https://github.com/mdemoret-nv)

Approvers:
  - Christopher Harris (https://github.com/cwharris)
  - David Gardner (https://github.com/dagardner-nv)

URL: #456
…waiting for timeouts (#453)

Adds a manually driven TestScheduler that can fast-forward through delayed coroutines.

Required for nv-morpheus/Morpheus#1548

Authors:
  - Christopher Harris (https://github.com/cwharris)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #453
@dagardner-nv dagardner-nv added the ! - Release Related to a Major Release label Apr 1, 2024
@dagardner-nv dagardner-nv requested review from a team as code owners April 1, 2024 16:19
Copy link

copy-pr-bot bot commented Apr 1, 2024

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@dagardner-nv
Copy link
Contributor Author

/ok to test

dagardner-nv and others added 4 commits April 4, 2024 18:43
Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Christopher Harris (https://github.com/cwharris)

URL: #460
Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #467
Adds maximum simultaneous tasks support to `TaskContainer` by only starting new tasks if the number of currently executing tasks is less than the maximum number of simultaneous tasks and starting new tasks as older tasks shut down. this eliminates the need for external semaphores or ticketing systems.

Authors:
  - Christopher Harris (https://github.com/cwharris)
  - David Gardner (https://github.com/dagardner-nv)
  - Michael Demoret (https://github.com/mdemoret-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #464
@mdemoret-nv
Copy link
Contributor

/ok to test

@mdemoret-nv
Copy link
Contributor

/ok to test

Copy link

codecov bot commented Apr 8, 2024

Codecov Report

Merging #457 (e1d0e9d) into main (de48cb1) will decrease coverage by 0.05%.
Report is 18 commits behind head on main.
The diff coverage is 73.10%.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #457      +/-   ##
==========================================
- Coverage   74.03%   73.99%   -0.05%     
==========================================
  Files         394      402       +8     
  Lines       13955    14411     +456     
  Branches     1053     1133      +80     
==========================================
+ Hits        10332    10663     +331     
- Misses       3623     3748     +125     
Flag Coverage Δ
cpp 70.61% <73.89%> (+0.10%) ⬆️
py 41.25% <9.26%> (-1.38%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Coverage Δ
...pp/mrc/include/mrc/coroutines/detail/poll_info.hpp 100.00% <100.00%> (ø)
cpp/mrc/include/mrc/coroutines/scheduler.hpp 100.00% <ø> (ø)
cpp/mrc/include/mrc/coroutines/test_scheduler.hpp 100.00% <100.00%> (ø)
.../mrc/include/mrc/memory/resources/detail/arena.hpp 72.48% <100.00%> (ø)
...thon/mrc/_pymrc/include/pymrc/asyncio_runnable.hpp 95.23% <100.00%> (ø)
...mrc/_pymrc/include/pymrc/utilities/json_values.hpp 100.00% <100.00%> (ø)
...rc/_pymrc/include/pymrc/utilities/object_cache.hpp 0.00% <ø> (ø)
python/mrc/core/node.cpp 100.00% <100.00%> (ø)
python/mrc/core/subscriber.cpp 88.00% <ø> (ø)
python/mrc/_pymrc/src/utils.cpp 87.50% <96.15%> (+5.68%) ⬆️
... and 7 more

... and 2 files with indirect coverage changes


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update de48cb1...e1d0e9d. Read the comment docs.

@mdemoret-nv mdemoret-nv merged commit a5bcd12 into main Apr 8, 2024
30 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
! - Release Related to a Major Release
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

4 participants