Skip to content

Can't train my custom model #7912

@testnco

Description

@testnco

Hi,

I need to train an image recognition with a custom dataset. I found this tutorial online : https://tensorflow-object-detection-api-tutorial.readthedocs.io/en/latest/training.html

I followed carefully all the step and when I launched my training a weird thing happened. It look like the training began but on every image it did not do things even if it takes like 1 minute before adding a new line on the prompt.

"INFO:tensorflow:Starting Session.
I1205 11:38:48.920712 139894946572096 learning.py:754] Starting Session.
INFO:tensorflow:Saving checkpoint to path training/model.ckpt
I1205 11:38:49.326428 139893023946496 supervisor.py:1117] Saving checkpoint to path training/model.ckpt
INFO:tensorflow:Starting Queues.
I1205 11:38:49.371733 139894946572096 learning.py:768] Starting Queues.
INFO:tensorflow:global_step/sec: 0
I1205 11:38:56.664494 139893015553792 supervisor.py:1099] global_step/sec: 0
INFO:tensorflow:global_step/sec: 0
I1205 11:40:51.604840 139893015553792 supervisor.py:1099] global_step/sec: 0
INFO:tensorflow:global_step/sec: 0
I1205 11:42:51.600481 139893015553792 supervisor.py:1099] global_step/sec: 0
INFO:tensorflow:global_step/sec: 0
I1205 11:44:51.600608 139893015553792 supervisor.py:1099] global_step/sec: 0
INFO:tensorflow:global_step/sec: 0
I1205 11:46:51.600104 139893015553792 supervisor.py:1099] global_step/sec: 0
INFO:tensorflow:Saving checkpoint to path training/model.ckpt
I1205 11:48:49.324800 139893023946496 supervisor.py:1117] Saving checkpoint to path training/model.ckpt
INFO:tensorflow:global_step/sec: 0
I1205 11:48:51.599744 139893015553792 supervisor.py:1099] global_step/sec: 0"

Also, when I launch the training I got a lot of warning at the beginning I don't know if it's a part of the problem.

Thank you for your help.

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions