Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Are images from different TF-records contained in different folders shuffled to form the training batches? #10353

Open
rcruzgar opened this issue Nov 8, 2021 · 0 comments

Comments

@rcruzgar
Copy link

rcruzgar commented Nov 8, 2021

Hi,

I am trying to understand how the object_detection API deals with the training TF-records.
As you know, TF-records can be provided specifying as many input_path items as wanted in the train_input_reader section of the pipeline.config file.

For example:

  tf_record_input_reader {
    input_path: "asia/train_*.record"
    input_path: "america/train_*.record"
    input_path: "europe/train_*.record"
  }

My question is: in which order are the TF-records used in the training, are they shuffled? I understand the images inside each TF-record are shuffled, aren't they? But are the images of different TF-records from different folders included on a same batch?

I am afraid that on each batch there are only images of one continent (as it is how the folders containing my TF-records are organized, i.e. Asia, America, Europe...).

Best regards,
Rubén.

@kumariko kumariko self-assigned this Nov 8, 2021
@kumariko kumariko assigned tombstone, jch1 and pkulzc and unassigned kumariko Nov 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants