Skip to content

Comments

Improve the ImageNet example and update the MNIST tutorial#2919

Open
cNikolaou wants to merge 5 commits intoBVLC:masterfrom
cNikolaou:improve_imagenet_files
Open

Improve the ImageNet example and update the MNIST tutorial#2919
cNikolaou wants to merge 5 commits intoBVLC:masterfrom
cNikolaou:improve_imagenet_files

Conversation

@cNikolaou
Copy link
Contributor

I decided to improve the ImageNet and the MNIST tutorials and provide a script to make the things easier and more thorough for the new users. I spent some time on the caffe-users group and I believe that the new version of the tutorials will help new users to understand how to use Caffe better.

  • Provide a script that automates and simplifies the process of extracting the .tar files which contain the ILSVRC2012 images (train and val). This script might be useful for other purposes as well (extracting other .tar files of images) with minor changes.
  • Update the ImageNet tutorial with information for the usage of the new script.
  • Update the MNIST tutorial, because the code that is used as an example is from an old version of lenet_train_test.prototxt.
  • Update the ImageNet tutorial with information on the size that the data will be on the disk, so that the users can check if there was any issue during the data preparation stage.
  • Update the ImageNet tutorial on how to use the /examples/imagenet/create_imagenet.sh
  • Improve the /examples/imagenet/create_imagenet.sh by using the --encode_type option when running convert_imageset. Default value will be "", but users should have the option to change it if they have space constrains.

Provide a script that automates and simplifies the process of extracting
the .tar files which contain the ILSVRC2012 images (train and val). The
script provides comments on the stage of the process. This script might be
useful for other purposes as well (extracting other .tar files of images)
with minor changes.

Also updated the readme.md file with information for the usage of the new
script.
@cNikolaou cNikolaou changed the title Add a new script to extract data for the ImageNet Add a new script to extract data for the ImageNet example Aug 14, 2015
@cNikolaou cNikolaou changed the title Add a new script to extract data for the ImageNet example Add a new script to extract data for the ImageNet example and improve the MNIST tutorial Aug 14, 2015
Provide more information for the ImageNet tutorial that will make
new users able to understand how to use the Caffe better and easier.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe someone can find a better name for that sub-header. The Data Preprocessing is good but it might not be the best. Any change is welcome.

Add more options to the create_imagenet.sh file and also update the tutorial
to document the new changes.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Check whether this addition would be valuable to the Caffe users. Also check the corresponding additions to the readme.md file which improves the tutorial.

@cNikolaou
Copy link
Contributor Author

@ronghanghu, this PR is finished. I think that it improves the ImageNet tutorial and that will help new users to understand Caffe and make them able to change the examples based on their needs.

Please review my comments on the changes that I made to ensure that I do not say anything wrong. Especially the part where the --encoding option is used when running convert_imageset. If you don't like the addition of the --encoding (which I think it will be good, based on some questions I saw in the caffe google group) you can merge the previous commit.

@cNikolaou cNikolaou changed the title Add a new script to extract data for the ImageNet example and improve the MNIST tutorial Improve the ImageNet example and update the MNIST tutorial Aug 16, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants