[Feature][MiniMax-H3] Support full official input matrix: FL2VA last-frame & first+last-frame, Ref2VA multi-image / image-only / mixed image+video+audio references

[brandneway]

Implementation PR: #5752

?? The feature, motivation and pitch

vLLM-Omni MiniMax-H3 ????????

???????HF ??? / MiniMax API ?? / SGLang ???? minimax_h3_spec_research.md?? vllm-omni ?????feature/minimax-h3 ????????
?????pipeline_minimax_h3.py?reference_video.py?serving_video.py?api_server.py

?????????????

??	??
t2va ?????	?
fl2va ??????????? 0 ??	?
ref2va ?? + ?????	?
ref2va ????????????????????????	?????? + multipart input_references ???
?????duration / num_frames?17n+5 ?????????flow_shift / audio_flow_shift	?

????? / ????????????????

FL2VA ??

#	????	vllm-omni ??	????
F1	??????frame_index: -1?	? ????diffuse() ??? keyframe_frame_indices=[0]????	pipeline_minimax_h3.py:900
F2	????????frame_index: [0, -1]?	? ????_load_image ??????? "MiniMax H3 currently supports exactly one image"	pipeline_minimax_h3.py:126-129

Ref2VA ????????? ?9??? ?3??? ?3??? ?12???????/???

#	???????	vllm-omni ??	????
R1	?? + ?????2?9 ??	? ??? 1 ???? F2 ? _load_image ???	pipeline_minimax_h3.py:128
R2	?? + ??????????	? ?????? ref2va ???????"image Ref2VA requires multi_modal_data.audio"	pipeline_minimax_h3.py:1147-1150
R3	?? + ?? + ??	? ?????"ref2va currently accepts image+audio or one or more videos, not both"	pipeline_minimax_h3.py:1043-1044
R4	?? + ?? + ??????	? ?????"does not accept a separate audio condition"??????????	pipeline_minimax_h3.py:1047-1050
R5	?? + ?? + ?? + ??	? ????R3/R4 ????	??
R6	??????2?3 ??	? ??? 1 ????"MiniMax H3 currently supports exactly one audio"	pipeline_minimax_h3.py:150-153
R7	?????? 2?15s?????????	?? ?????????? ffmpeg ????????target_frame_count=num_frames?????????? N ?????? 2?15s/?????	reference_video.py:105-139
R8	?????????SGLang ? start_time_seconds?	? ???????? 0 ?????	reference_video.py
R9	?????? URL ?????	? ??????video_reference.video_url ?????? PIL ????????? prepare_reference_videos ??????? ? TypeError?multipart input_references ????????	api_server.py:3120-3132?reference_video.py:154-157
R10	??????+???????	?? serving ??? image+video ???? H3 ??? R3 ?????????????????	serving_video.py:132-136

??

#	??/SGLang ??	vllm-omni ??	????
G1	num_outputs_per_prompt?1?10?seed ? seed + output_index ???	? H3 pipeline ??? fan-out?forward ????????? num_outputs_per_prompt?AudioX pipeline ?????H3 ???	pipeline_minimax_h3.py:1020-1021
G2	???? 4?15s ????	?? ???extra_args["duration"] ???????????????????	pipeline_minimax_h3.py:402-410
G3	aspect_ratio / short_edge ?????t2va ?????fl2va ??????ref2va ?? 16:9?	?? ????????? width/height?t2va/ref2va ???? 768?1344	pipeline_minimax_h3.py:412-424
G4	?????????? [256,5760]px???? [0.4,2.5]??? 23.976?60 FPS?????/???	?? ?????? [1:4, 4:1]??????	pipeline_minimax_h3.py:209-210

????????????????

??	??	vllm-omni ??	vllm-omni ?? API
???t2va?	?	?	?
?? + ???fl2va?	?	?	?
?? + ???fl2va?	?	?	?
?? + ?? + ???fl2va?	?	?	?
?? + ???9?ref2va?	?	?? ? 1 ???????	?? ??
?? + ????3?ref2va/V2V?	?	??????????	?? ? multipart ?????URL ?????????
?? + ? + ??	?	?	?
?? + ? + ????3?	?	?? ??? 1 ?	?? ??
?? + ?? + ??	?	?	?
?? + ? + ?? + ??	?	?	?

---

[brandneway]

minimax_h3_spec_research.md