New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

I cannot reproduce the finetuning procedure by following README #15

Open

daehuikim opened this issue Mar 22, 2024 · 0 comments

daehuikim commented Mar 22, 2024 •

edited

Loading

Hello, I am trying to test my data in Control Prefix manner.
While I am testing, I always encounter error like below.

Validation sanity check: 0it [00:00, ?it/s]
Validation sanity check:   0%|          | 0/4 [00:00<?, ?it/s]Traceback (most recent call last):
  File "cptest/src/datatotext/finetune.py", line 932, in <module>
    model = main(args)
   ...
RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling `cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc)`

What Can I do for solving this problem? there is nothing I modified in files in src/ directory.
Thanks for watching this!

The text was updated successfully, but these errors were encountered:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment