You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have fine-tune Table Structure Recognition model for with 20 epoch, inference result are also getting but to get evaluation metrics script not giving any result and freeze for forever
Folder "test_data" have 2 subdirectory "images" and "test". In "test" xml files are sore with respect to images
Command result:
(transformers) user@RUSUBBIZ:/table-transformer/src$ python main.py --mode eval \
--data_type structure \
--config_file structure_config.json \
--data_root_dir /table_transformers_str/test_data \
--model_load_path /str_model/model_20.pth \
--table_words_dir /table_transformers_str/test_data/table_words_dir \
--device gpu \
--batch_size 16 \
--debug \
--debug_save_dir /table_transformers_str/eval_result \
--test_max_size 8 \
--metrics_save_filepath /table_transformers_str/eval_result
{'lr': 5e-05, 'lr_backbone': 1e-05, 'batch_size': 8, 'weight_decay': 0.0001, 'epochs': 1, 'lr_drop': 1, 'lr_gamma': 0.9, 'clip_max_norm': 0.1, 'backbone': 'resnet18', 'num_classes': 6, 'dilation': False, 'position_embedding': 'sine', 'emphasized_weights': {}, 'enc_layers': 6, 'dec_layers': 6, 'dim_feedforward': 2048, 'hidden_dim': 256, 'dropout': 0.1, 'nheads': 8, 'num_queries': 125, 'pre_norm': True, 'masks': False, 'aux_loss': False, 'mask_loss_coef': 1, 'dice_loss_coef': 1, 'ce_loss_coef': 1, 'bbox_loss_coef': 5, 'giou_loss_coef': 2, 'eos_coef': 0.4, 'set_cost_class': 1, 'set_cost_bbox': 5, 'set_cost_giou': 2, 'device': 'cuda', 'seed': 42, 'start_epoch': 0, 'num_workers': 1, 'data_root_dir': '/table_transformers_str/test_data', 'config_file': 'structure_config.json', 'data_type': 'structure', 'model_load_path': '/str_model/model_20.pth', 'load_weights_only': False, 'model_save_dir': None, 'metrics_save_filepath': '/table_transformers_str/eval_result', 'debug_save_dir': '/table_transformers_str/eval_result', 'table_words_dir': '/table_transformers_str/test_data/table_words_dir', 'mode': 'eval', 'debug': True, 'checkpoint_freq': 1, 'train_max_size': None, 'val_max_size': None, 'test_max_size': 8, 'eval_pool_size': 1, 'eval_step': 1, '__module__': '__main__', '__dict__': <attribute '__dict__' of 'Args' objects>, '__weakref__': <attribute '__weakref__' of 'Args' objects>, '__doc__': None}
----------------------------------------------------------------------------------------------------
Running evaluation/inference in DEBUG mode, processing will take longer. Saving output to: /table_transformers_str/eval_result.
loading model
/data/opt/miniconda/envs/transformers/lib/python3.9/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
warnings.warn(
/data/opt/miniconda/envs/transformers/lib/python3.9/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=ResNet18_Weights.IMAGENET1K_V1`. You can also use `weights=ResNet18_Weights.DEFAULT` to get the most up-to-date weights.
warnings.warn(msg)
loading model from checkpoint
loading data
creating index...
index created!
/data/opt/miniconda/envs/transformers/lib/python3.9/site-packages/torch/nn/modules/conv.py:456: UserWarning: Applied workaround for CuDNN issue, install nvrtc.so (Triggered internally at ../aten/src/ATen/native/cudnn/Conv_v8.cpp:80.)
return F.conv2d(input, weight, bias, self.stride,
***** After this, script freeze here for infinite time
I am expecting once eval script run will get below metrics but not getting.
In this folder "/table_transformers_str/eval_result" visualisation is storing only:
If any one has faced similar issue while evaluation then please share how to get evaluation metrics for fine-tune model Table Structure Recognition, thanks for advance
The text was updated successfully, but these errors were encountered:
Hi @rusubbiz-muzkaq
I also want to fine tune the table structure recognition model on my own dataset.
Can you please tell me how should I do it ? And can you please share me the code for it.
I'm fine tuning the model but not getting proper results after fine tuning.
I have fine-tune Table Structure Recognition model for with 20 epoch, inference result are also getting but to get evaluation metrics script not giving any result and freeze for forever
Command used to run eval script:
Folder "test_data" have 2 subdirectory "images" and "test". In "test" xml files are sore with respect to images
Command result:
***** After this, script freeze here for infinite time
I am expecting once eval script run will get below metrics but not getting.
In this folder "/table_transformers_str/eval_result" visualisation is storing only:
![000101000909008U1UB2023__0_bboxes](https://private-user-images.githubusercontent.com/87762550/312919338-104ddd39-e1a1-49e6-bd2d-3a6ee877472d.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4Njc2NDksIm5iZiI6MTcyMzg2NzM0OSwicGF0aCI6Ii84Nzc2MjU1MC8zMTI5MTkzMzgtMTA0ZGRkMzktZTFhMS00OWU2LWJkMmQtM2E2ZWU4Nzc0NzJkLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDA0MDIyOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWFiN2FmYWM1ZDk1ZDBhYTZhNmEwYWY0ZmVkOGE2NjY4MTRhNDUzMzQ5NjQyNDAxOWQ4YTJjZmQzNTNmNWJhODAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.3FchlQ_LGVslo-KPbPA76qa1uYv0bzTBBszqA5NUblM)
![000101000909008U1UB2023__0_cells](https://private-user-images.githubusercontent.com/87762550/312919348-f99a18fb-b4b5-4f8b-80f2-966ab91ee250.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4Njc2NDksIm5iZiI6MTcyMzg2NzM0OSwicGF0aCI6Ii84Nzc2MjU1MC8zMTI5MTkzNDgtZjk5YTE4ZmItYjRiNS00ZjhiLTgwZjItOTY2YWI5MWVlMjUwLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDA0MDIyOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWE1MmYyODdlYjQ4MThiOWFlNmU2MjQwMTE0MGIxZmJiZTRiODBlNjMwZWY0NDllY2Y4ODYzMjliNWYyZTkyMzYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.HukfI504LpVxqWqLEX1V4Gf4r_sBEaBPdmlIfxL7Nok)
If any one has faced similar issue while evaluation then please share how to get evaluation metrics for fine-tune model Table Structure Recognition, thanks for advance
The text was updated successfully, but these errors were encountered: