Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Restarting data prefetching from start" repeated many times one by one. why? is it wrong... #1833

Closed
iTony opened this issue Feb 4, 2015 · 5 comments

Comments

@iTony
Copy link

iTony commented Feb 4, 2015

The backend is LMDB, and source image type is '.tif', batchsize is 32 using alexnet. The train set is 1680, and test is 420.

@iTony iTony changed the title "Restarting data prefetching from start" repeated many times. "Restarting data prefetching from start" repeated many times, is it wrong??? Feb 5, 2015
@iTony iTony changed the title "Restarting data prefetching from start" repeated many times, is it wrong??? "Restarting data prefetching from start" repeated many times, why? is it wrong... Feb 5, 2015
@iTony iTony changed the title "Restarting data prefetching from start" repeated many times, why? is it wrong... "Restarting data prefetching from start" repeated many times one by one. why? is it wrong... Feb 5, 2015
@pannous
Copy link

pannous commented Feb 5, 2015

In general it means that you don't have enough training data and it has to use the data over and over again. For your specific case there's not enough information to determine the reason.

@iTony
Copy link
Author

iTony commented Feb 13, 2015

I0213 15:45:11.502871 2555 net.cpp:652] Copying source layer loss
I0213 15:47:06.173857 2598 data_layer.cpp:195] Restarting data prefetching from start.
I0213 15:49:11.281966 2620 data_layer.cpp:195] Restarting data prefetching from start.
I0213 15:51:17.663100 2641 data_layer.cpp:195] Restarting data prefetching from start.
I0213 15:53:24.120622 2771 data_layer.cpp:195] Restarting data prefetching from start.
I0213 15:55:29.678560 2866 data_layer.cpp:195] Restarting data prefetching from start.
I0213 15:57:35.737491 2989 data_layer.cpp:195] Restarting data prefetching from start.
I0213 15:59:47.717577 3410 data_layer.cpp:195] Restarting data prefetching from start.
I0213 16:02:17.745021 4441 data_layer.cpp:195] Restarting data prefetching from start.
I0213 16:04:42.962713 5467 data_layer.cpp:195] Restarting data prefetching from start.
I0213 16:06:48.253739 5489 data_layer.cpp:195] Restarting data prefetching from start.
I0213 16:08:54.760535 5642 data_layer.cpp:195] Restarting data prefetching from start.
I0213 16:11:03.428972 5695 data_layer.cpp:195] Restarting data prefetching from start.

@erictzeng
Copy link
Contributor

Please ask usage questions on caffe-users -- the issues tracker is primarily for Caffe development discussion.

@ExplorerLu
Copy link

hello,have you solved this problem?I have met the same problem.my net is also Alexnet ,my train set is 50000 and my test set is 15000.I have tried to ruduce the batch_size to 32,but it seems useless.

@manuiiitv
Copy link

manuiiitv commented Apr 4, 2019

"Restarting data prefetching from start" , well this says that at this point all of your training/validation data has seen by the network. Now it will start looking from the beginning. It means your one epoch is complete.
Let's say you have 50000 images in training and batch size is 50. So after 5000 iterations you will get this message. It is not an error but just a message.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants