Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AIR] LightningTrainer Dolly V2 FSDP Fine-tuning Example #34990

Merged
Merged
Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
5918983
init
woshiyyya Apr 26, 2023
f427704
can forward, not backward
woshiyyya Apr 27, 2023
29cde26
run success
woshiyyya Apr 28, 2023
5c53a1e
runnable e2e
woshiyyya Apr 29, 2023
22e6bb3
using pipeline for inference
woshiyyya Apr 29, 2023
22edc1a
get reasonable output
woshiyyya May 1, 2023
b904d0f
better sections
woshiyyya May 1, 2023
be52d45
wip
woshiyyya May 2, 2023
98d5048
wip
woshiyyya May 2, 2023
d88eb02
rm useless files
woshiyyya May 2, 2023
47b4ecf
polish wording
woshiyyya May 3, 2023
d4a38db
lint
woshiyyya May 3, 2023
7ecc382
finish 1st version
woshiyyya May 3, 2023
eae132a
acclerate training from 20min to 10min with activation checkpointing
woshiyyya May 3, 2023
1edb56b
finish dolly 7B training
woshiyyya May 3, 2023
097e177
remove 3b example
woshiyyya May 5, 2023
b06de89
add release tests
woshiyyya May 5, 2023
b8b1e62
add error message
woshiyyya May 5, 2023
c63babb
Merge remote-tracking branch 'upstream/master' into air/lightning_dol…
woshiyyya May 5, 2023
fe70347
add variation
woshiyyya May 5, 2023
1be677f
add availability zone
woshiyyya May 5, 2023
d0fd15e
modify available zone
woshiyyya May 5, 2023
c8bb719
wip..
woshiyyya May 5, 2023
76b12ab
add pip packages
woshiyyya May 6, 2023
4b738a4
fix runtime env
woshiyyya May 6, 2023
670421c
update ptl requirement
woshiyyya May 6, 2023
1b5dfb0
limit train step & local dir
woshiyyya May 6, 2023
56c473a
clear output and add gce compute comfig
woshiyyya May 6, 2023
65fd090
Merge remote-tracking branch 'upstream/master' into air/lightning_dol…
woshiyyya May 8, 2023
d7ca9af
add intro section
woshiyyya May 8, 2023
d917c83
fix lint
woshiyyya May 8, 2023
f572e40
rm env config
woshiyyya May 8, 2023
39abd72
add links in doc tree and other examples
woshiyyya May 8, 2023
ce0e5d1
Merge remote-tracking branch 'upstream/master' into air/lightning_dol…
woshiyyya May 9, 2023
e8d06a1
add symlink for release test files
woshiyyya May 9, 2023
49a8370
address comments
woshiyyya May 9, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading