Skip to content

feat(selfchkout): add UIs and scripts for visual interaction & easy demo#209

Merged
adrianboguszewski merged 19 commits intoopenvinotoolkit:masterfrom
mjdivankoller:master
May 20, 2025
Merged

feat(selfchkout): add UIs and scripts for visual interaction & easy demo#209
adrianboguszewski merged 19 commits intoopenvinotoolkit:masterfrom
mjdivankoller:master

Conversation

@mjdivankoller
Copy link
Contributor

The update focuses on the Automated Self-checkout reference implementation.

  • It incorporates a new Gradio-based UI that provides interactivity and additional options to view, process, and review the video (See the Jupyter Notebook), detections/tracking, and log messages.
    • It can choose a different video for previewing (full or small screen) and processing it.
    • The processed video is shown when the batch of frames is released (progressive).
    • It can save the final processed video for future reference.
    • A Log table allows the user to filter outputs dynamically while the video is under processing or once processed.
    • A bar plot shows the detected object classes and their frequency.
    • The purchased items are shown as an independent table to contrast them with log messages and detected objects.
  • It adds a set of scripts to make it easier to test the demo. For example, you can install, run, or clean the environment and run the demo visually directly (See the 'Scripts' section).

@adrianboguszewski adrianboguszewski self-requested a review February 27, 2025 13:04
@adrianboguszewski adrianboguszewski requested a review from Copilot May 6, 2025 14:35
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces a new Gradio-based UI and a suite of scripts to install, run, and clean the environment for the Automated Self-Checkout demo. It enhances interactivity with video processing features and updates documentation to include direct links to the new scripts and usage instructions.

  • Added a new file (envscripts.md) documenting installation and demo execution scripts.
  • Updated the README.md to reference the new scripts and describe the Gradio UI enhancements.

Reviewed Changes

Copilot reviewed 10 out of 17 changed files in this pull request and generated 1 comment.

File Description
ai_ref_kits/automated_self_checkout/envscripts.md New markdown file outlining installation, running, and cleaning scripts for the demo.
ai_ref_kits/automated_self_checkout/README.md Updated documentation to include details and links to the new scripts and UI enhancements.
Files not reviewed (7)
  • ai_ref_kits/automated_self_checkout/requirements.txt: Language not supported
  • ai_ref_kits/automated_self_checkout/scripts/cleanEnv.sh: Language not supported
  • ai_ref_kits/automated_self_checkout/scripts/installEnv.sh: Language not supported
  • ai_ref_kits/automated_self_checkout/scripts/runDemo.sh: Language not supported
  • ai_ref_kits/automated_self_checkout/scripts/runEnv.sh: Language not supported
  • ai_ref_kits/automated_self_checkout/scripts/setup.sh: Language not supported
  • ai_ref_kits/automated_self_checkout/scripts/utilities.sh: Language not supported
Comments suppressed due to low confidence (1)

ai_ref_kits/automated_self_checkout/envscripts.md:80

  • Duplicate figure numbering ('Figure 4') is used for multiple images. Updating the figure labels to distinct numbers can help avoid confusion.
![Starting the Demo UI](./img/schkout_figure_04.png)

Minor fix in writting style.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link
Contributor

@adrianboguszewski adrianboguszewski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mjdivankoller please do the following:

  1. Remove all images from the repo and use the links to the github assets instead (the approach we use in all our kits)
  2. Rename the "scripts" dir to "setup" and rework it to be consisted with setup files in demos dir
  3. Solve the conflict in the notebook (that prevents merging)
  4. Remove unnecessary thing from envscript.md and merge it into README.md

When you have it ready, we will go to the next phase :)

@mjdivankoller
Copy link
Contributor Author

Adding the envscripts images to the asset:
schkout_figure_01
schkout_figure_02
schkout_figure_03
schkout_figure_04
schkout_figure_05
schkout_figure_06

@mjdivankoller
Copy link
Contributor Author

@mjdivankoller please do the following:

  1. Remove all images from the repo and use the links to the github assets instead (the approach we use in all our kits)
  2. Rename the "scripts" dir to "setup" and rework it to be consisted with setup files in demos dir
  3. Solve the conflict in the notebook (that prevents merging)
  4. Remove unnecessary thing from envscript.md and merge it into README.md

When you have it ready, we will go to the next phase :)

@adrianboguszewski thank you for your feedback. The changes have been incorporated as requested.
Regards, Mario

@mjdivankoller
Copy link
Contributor Author

Updated requirements to openvino 2025.1 and subsample.
Tested ok on MeteorLake (64 GB and Core Ultra) with OpenVINO version: 2025.1.0-18503-6fec06580ab-releases/2025/1.

@adrianboguszewski adrianboguszewski merged commit 7e871e5 into openvinotoolkit:master May 20, 2025
11 of 17 checks passed
AnishaUdayakumar pushed a commit to AnishaUdayakumar/openvino_build_deploy that referenced this pull request May 21, 2025
…emo (openvinotoolkit#209)

* feat(selfchkout): add management scripts to install, run, and clean UC

* feat(selfchkout): add a gradio-based UI for interactivity and demo

* feat(selfchkout): add libraries in requirements.txt

* Update ai_ref_kits/automated_self_checkout/envscripts.md

Minor fix in writting style.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* update assets, scripts (setup), docs, and notebook.

* Update ai_ref_kits/automated_self_checkout/README.md

* upd directrun.py and notebook

* upd openvino to 2025.1 and subsample

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Adrian Boguszewski <adekboguszewski@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants