We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I'm trying to finetune openai-clip model using my own dataset but when I tried finetuner.fit, it raised an error like this
--------------------------------------------------------------------------- ValueError Traceback (most recent call last) Cell In[4], line 5 1 import finetuner 2 from finetuner.callback import EvaluationCallback ----> 5 run = finetuner.fit( 6 model='openai/clip-vit-base-patch32', 7 train_data='blend-train', 8 eval_data='blend-val', 9 epochs=5, 10 learning_rate= 1e-7, 11 loss='CLIPLoss', 12 device='cuda', 13 callbacks=[ 14 EvaluationCallback( 15 model='clip-text', 16 index_model='clip-vision', 17 query_data='finetuner/fashion-eval-data-queries', 18 index_data='finetuner/fashion-eval-data-index', 19 gather_examples=True, 20 ) 21 ], 22 ) File /usr/local/lib/python3.10/dist-packages/finetuner/__init__.py:103, in fit(model, train_data, *args, **kwargs) 94 def describe_models(task: Optional[str] = None) -> None: 95 """Print model information, such as name, task, output dimension, architecture 96 and description as a table. 97 (...) 101 102 """ --> 103 print_model_table(model, task=task) File /usr/local/lib/python3.10/dist-packages/finetuner/tuner/__init__.py:94, in fit(embed_model, train_data, eval_data, preprocess_fn, collate_fn, epochs, batch_size, num_items_per_class, loss, configure_optimizer, learning_rate, scheduler_step, device, callbacks, num_workers, **kwargs) File /usr/local/lib/python3.10/dist-packages/finetuner/tuner/__init__.py:20, in _get_tuner_class(dnn_model) File /usr/local/lib/python3.10/dist-packages/finetuner/helper.py:68, in get_framework(dnn_model) ValueError: can not determine the backend of 'openai/clip-vit-base-patch32'
Can someone tell me or guide me in fixing this issue
The text was updated successfully, but these errors were encountered:
hi @TEnsorTHiru sorry for the late reply, can you tell me which version of finetuner are you using?
Sorry, something went wrong.
No branches or pull requests
I'm trying to finetune openai-clip model using my own dataset but when I tried finetuner.fit, it raised an error like this
Can someone tell me or guide me in fixing this issue
The text was updated successfully, but these errors were encountered: