Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make not schedule any pipeline run when the iterator has prepare_first_batch=False #2859

Merged
merged 2 commits into from
Apr 13, 2021

Conversation

JanuszL
Copy link
Contributor

@JanuszL JanuszL commented Apr 13, 2021

  • fixes the FW iterator behavior when prepare_first_batch=False. It used to
    run prefetch on the pipeline even when set to False.
  • adds an appropriate test case

Signed-off-by: Janusz Lisiecki jlisiecki@nvidia.com

Why we need this PR?

Pick one, remove the rest

  • It makes not schedule any pipeline run when the iterator has prepare_first_batch=False

What happened in this PR?

Fill relevant points, put NA otherwise. Replace anything inside []

  • What solution was applied:
    fixes the FW iterator behavior when prepare_first_batch=False. It used to run prefetch on the pipeline even when set to False.
  • Affected modules and functionalities:
    base_iterator.py
    test_fw_iterators.py
  • Key points relevant for the review:
    NA
  • Validation and testing:
    adds an appropriate test case
  • Documentation (including examples):
    No

JIRA TASK: [ NA]

…st_batch=False`

- fixes the FW iterator behavior when `prepare_first_batch=False`. It used to
  run prefetch on the pipeline even when set to `False`.
- adds an appropriate test case

Signed-off-by: Janusz Lisiecki <jlisiecki@nvidia.com>
@JanuszL
Copy link
Contributor Author

JanuszL commented Apr 13, 2021

!build

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [2263079]: BUILD STARTED

def test_paddle_prepare_first_batch():
from nvidia.dali.plugin.paddle import DALIGenericIterator as PaddleIterator
check_prepare_first_batch(PaddleIterator, output_map=["data"],
to_np=lambda x: np.array(x["data"]))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add line break at the end

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Signed-off-by: Janusz Lisiecki <jlisiecki@nvidia.com>
@dali-automaton
Copy link
Collaborator

CI MESSAGE: [2263079]: BUILD PASSED

@JanuszL JanuszL merged commit be6560f into NVIDIA:master Apr 13, 2021
@JanuszL JanuszL deleted the fix_prepare_first_batch branch April 13, 2021 11:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants