Add flash-attention patch for falcon-7b (#3580) #1631
Job | Run time |
---|---|
1m 58s | |
41s | |
1m 32s | |
1m 41s | |
13m 19s | |
2m 54s | |
4m 31s | |
1m 45s | |
1m 47s | |
22s | |
2m 56s | |
33m 26s |
Job | Run time |
---|---|
1m 58s | |
41s | |
1m 32s | |
1m 41s | |
13m 19s | |
2m 54s | |
4m 31s | |
1m 45s | |
1m 47s | |
22s | |
2m 56s | |
33m 26s |