Skip to content

Use lazy tensor #1427

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
41229e2
Use ONNX IR for model builder
justinchuby Apr 23, 2025
02aac04
wip
justinchuby Apr 23, 2025
5fb9e44
initializer
justinchuby Apr 23, 2025
48dd0ba
Undo detach
justinchuby Apr 23, 2025
6275bca
use force=True
justinchuby Apr 23, 2025
9b5fcf7
Find numpy type
justinchuby Apr 23, 2025
693e79e
Save some numpy conversions
justinchuby Apr 23, 2025
82bf7ce
make_rotary_embedding_multi_cache
justinchuby Apr 23, 2025
361127a
remove numpy helper
justinchuby Apr 23, 2025
c67675e
Make constants
justinchuby Apr 23, 2025
976f211
Format import
justinchuby Apr 23, 2025
6c4b159
Fix syntax
justinchuby Apr 23, 2025
e1171c1
sort
justinchuby Apr 23, 2025
07d8fff
Handle int4
justinchuby Apr 23, 2025
24f86e6
import
justinchuby Apr 23, 2025
56ae3b2
set
justinchuby Apr 23, 2025
3418771
Support precision
justinchuby Apr 23, 2025
f00cb6c
Fix onnx_dtype
justinchuby Apr 23, 2025
0fac4f6
Use register_initializer
justinchuby Apr 23, 2025
892c82d
Use external tensor
justinchuby Apr 23, 2025
eb9a0e9
ignore_cleanup_errors
justinchuby Apr 23, 2025
3069c09
clean up
justinchuby Apr 23, 2025
68193ef
remove cache data
justinchuby Apr 23, 2025
d179b24
make_value_info
justinchuby Apr 23, 2025
19567ee
make_value_info
justinchuby Apr 23, 2025
d256e22
Handle None output
justinchuby Apr 23, 2025
9d5b0d1
uint4
justinchuby Apr 23, 2025
76af7ed
int4
justinchuby Apr 23, 2025
6cdce16
makedirs
justinchuby Apr 23, 2025
f428288
Fix make_inputs_and_outputs
justinchuby Apr 23, 2025
4d8dff4
simplify
justinchuby Apr 23, 2025
198134a
Import opset
justinchuby Apr 24, 2025
e4c9b4e
Fix softcap_exists naming
justinchuby Apr 24, 2025
fc06e75
Fix value shape
justinchuby Apr 24, 2025
272ba00
https://github.com/microsoft/onnxruntime-genai/pull/1420
justinchuby Apr 24, 2025
fec08aa
rename
justinchuby Apr 24, 2025
89f12b5
Refactor to utils file
justinchuby Apr 24, 2025
55fc16f
Fix config
justinchuby Apr 24, 2025
0965f60
Fix import
justinchuby Apr 24, 2025
ec1b950
import
justinchuby Apr 24, 2025
b169bbf
Remove eval
justinchuby Apr 24, 2025
be36882
Is none
justinchuby Apr 24, 2025
b835ab2
Update test
justinchuby Apr 24, 2025
494a5f2
WIP
justinchuby Apr 26, 2025
2797f91
Try this
justinchuby Apr 26, 2025
8bc3236
syntax
justinchuby Apr 26, 2025
525b418
Use torch tensors
justinchuby Apr 27, 2025
0f31e56
Use torch tensors
justinchuby Apr 27, 2025
35203df
cache
justinchuby Apr 27, 2025
b8867a5
auto
justinchuby Apr 27, 2025
8742ed7
contiguous
justinchuby May 9, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading