Skip to content

Expose realtime raw-frame inflight caps - #548

Merged
Onat-Inak merged 6 commits into
developfrom
perf/realtime-inflight-link-option
Jul 9, 2026
Merged

Expose realtime raw-frame inflight caps#548
Onat-Inak merged 6 commits into
developfrom
perf/realtime-inflight-link-option

Conversation

@Onat-Inak

@Onat-Inak Onat-Inak commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add GraphLinkOptions::max_inflight_per_stream and max_inflight_total for RealtimeLatestByStream links.
  • Apply the caps only when realtime links carry raw decoder-backed holder samples.
  • Keep env/default fallback behavior, with Core defaults of 4 per stream and min(per_stream * stream_count, 8) total.
  • Expose the fields through Python bindings, graph IO/export, API surface tests, docs, and focused C++ unit coverage.

Testing

  • git diff --check
  • Neat SDK build:
    • unit_realtime_link_options_test
    • unit_graph_io_contract_test
    • _pyneat_core

Closes #550
Refs #540

RealtimeLatestByStream links need app-level control over how many decoder-backed raw frames can be admitted downstream. Add explicit per-stream and total caps to GraphLinkOptions while keeping env/default fallback behavior.
@Onat-Inak
Onat-Inak requested a review from a team as a code owner July 8, 2026 23:04

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 530e736135

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/pipeline/graph/GraphComposition.cpp Outdated
@Onat-Inak Onat-Inak self-assigned this Jul 8, 2026
@Onat-Inak Onat-Inak added the bug Something isn't working label Jul 8, 2026
@Onat-Inak Onat-Inak linked an issue Jul 8, 2026 that may be closed by this pull request
7 tasks
manuel-roldan
manuel-roldan previously approved these changes Jul 8, 2026

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 9852e029cb

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/pipeline/runtime/EdgeRouter.cpp Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 1ee4b19b51

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/pipeline/runtime/ExecutionGraphCompiler.cpp Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 9533f229ef

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/pipeline/runtime/ExecutionGraphCompiler.cpp Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d756102e89

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/pipeline/graph/GraphComposition.cpp

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 64300ab6b6

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/pipeline/runtime/EdgeRouter.cpp
@Onat-Inak
Onat-Inak merged commit bb92fe7 into develop Jul 9, 2026
9 checks passed
@Onat-Inak
Onat-Inak deleted the perf/realtime-inflight-link-option branch July 9, 2026 07:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Expose per-link realtime raw-frame inflight controls

2 participants