Skip to content

Update multimodal in-framework FastAPI from NeMo to Megatron Bridge#511

Merged
athitten merged 6 commits intomainfrom
bobchen/mm_inframework
Jan 30, 2026
Merged

Update multimodal in-framework FastAPI from NeMo to Megatron Bridge#511
athitten merged 6 commits intomainfrom
bobchen/mm_inframework

Conversation

@meatybobby
Copy link
Contributor

@meatybobby meatybobby commented Nov 14, 2025

Update multimodal in-framework FastAPI:

  • Move loading http/https images in server
  • Support image_url in content
  • Change default top_k=0 in FastAPI for vLLM compatibility
  • Move nemo to megatron bridge

@copy-pr-bot
Copy link

copy-pr-bot bot commented Nov 14, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions bot added documentation Improvements or additions to documentation deploy scripts tests multimodal labels Nov 14, 2025
@meatybobby meatybobby requested a review from marta-sd November 14, 2025 18:30
@meatybobby
Copy link
Contributor Author

/ok to test 11d78ec

@meatybobby meatybobby changed the title Update multimodal in-framework FastAPI Update multimodal in-framework FastAPI from NeMo to Megatron Bridge Jan 29, 2026
@meatybobby
Copy link
Contributor Author

/ok to test bd2172e

@meatybobby
Copy link
Contributor Author

/ok to test 4bd3da2

Copy link
Contributor

@athitten athitten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you @meatybobby ! I will let @marta-sd confirm on her end.

@athitten athitten merged commit ec63263 into main Jan 30, 2026
38 checks passed
@athitten athitten deleted the bobchen/mm_inframework branch January 30, 2026 20:48
ko3n1g pushed a commit that referenced this pull request Jan 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants