Parent Issue
Subtask of #203
Problem
7 architectures in tests/export/test_all_architectures_io.py cannot be fully validated:
- 6 skipped:
AutoConfig.for_model() returns no config class (composite/meta architectures)
- 1 xfailed: Optimum bug in
speecht5 OnnxConfig
Skipped Architectures (6)
These architectures require manual HF config construction because AutoConfig.for_model() doesn't support them directly.
1. internlm2 (text_decoder)
- Reason: Not registered in transformers
AutoConfig mapping
- Fix: Create
InternLM2Config manually or use LlamaConfig as base (InternLM2 shares Llama architecture)
2. siglip-text-with-projection (multimodal)
- Reason: Sub-component of SigLIP, not a standalone model
- Fix: Extract text config from
SiglipConfig via siglip_config.text_config
3. siglip-text (multimodal)
- Reason: Sub-component of SigLIP
- Fix: Same as above - extract from parent config
4. musicgen (audio)
- Reason: Composite model with text encoder + audio decoder
- Fix: Create
MusicgenConfig with sub-configs: MusicgenDecoderConfig + T5Config
5. vision-encoder-decoder (seq2seq)
- Reason: Meta architecture requiring encoder + decoder configs
- Fix: Create
VisionEncoderDecoderConfig from ViTConfig (encoder) + GPT2Config (decoder)
6. encoder-decoder (seq2seq)
- Reason: Meta architecture requiring encoder + decoder configs
- Fix: Create
EncoderDecoderConfig from BertConfig (encoder) + BertConfig (decoder)
XFailed Architecture (1)
7. speecht5 (audio)
- Reason:
SpeechT5OnnxConfig._behavior is not set when task="text-to-audio" with default SpeechT5Config
- Root cause: Optimum's
SpeechT5OnnxConfig.__init__ expects a specific _behavior attribute that the default config doesn't provide
- Fix options:
- A) File upstream Optimum bug report
- B) Construct config with correct
_behavior attribute manually
- C) Override with ModelKit's own
register_onnx_overwrite
Acceptance Criteria
Files to Modify
tests/export/test_all_architectures_io.py - Add manual config construction for skipped architectures
tests/export/conftest.py - Add new config fixtures if needed
Parent Issue
Subtask of #203
Problem
7 architectures in
tests/export/test_all_architectures_io.pycannot be fully validated:AutoConfig.for_model()returns no config class (composite/meta architectures)speecht5OnnxConfigSkipped Architectures (6)
These architectures require manual HF config construction because
AutoConfig.for_model()doesn't support them directly.1.
internlm2(text_decoder)AutoConfigmappingInternLM2Configmanually or useLlamaConfigas base (InternLM2 shares Llama architecture)2.
siglip-text-with-projection(multimodal)SiglipConfigviasiglip_config.text_config3.
siglip-text(multimodal)4.
musicgen(audio)MusicgenConfigwith sub-configs:MusicgenDecoderConfig+T5Config5.
vision-encoder-decoder(seq2seq)VisionEncoderDecoderConfigfromViTConfig(encoder) +GPT2Config(decoder)6.
encoder-decoder(seq2seq)EncoderDecoderConfigfromBertConfig(encoder) +BertConfig(decoder)XFailed Architecture (1)
7.
speecht5(audio)SpeechT5OnnxConfig._behavioris not set when task="text-to-audio" with defaultSpeechT5ConfigSpeechT5OnnxConfig.__init__expects a specific_behaviorattribute that the default config doesn't provide_behaviorattribute manuallyregister_onnx_overwriteAcceptance Criteria
speecht5xfail resolved (either fixed or documented as upstream bug)Files to Modify
tests/export/test_all_architectures_io.py- Add manual config construction for skipped architecturestests/export/conftest.py- Add new config fixtures if needed