Skip to content

v0.17

Compare
Choose a tag to compare
@Sxela Sxela released this 01 Dec 14:48
90b1da4

Changelog:

  • add SAMTrack from https://github.com/z-x-yang/Segment-and-Track-Anything
  • fix bug with 2+ masks
  • print error when reloading gui fails
  • renamed default_settings_path to settings_path and load_default_settings to load_settings_from_file
  • fix default_settings_path error by #sozeditit
  • add lycoris
  • add lycoris/lora selector
  • fix SAMTrack ckpt folder error ty to laplaceswzz
  • fix SAMTrack video export error
  • fix pillow error

Segment and track anything

Made a CLI wrapper around https://github.com/z-x-yang/Segment-and-Track-Anything to export separate alpha masks for each object.

Only tested to run in colab/docker, may require extra steps to build and install Segment-and-Track-Anything on windows.

Scroll down to Extras - Masking and tracking. Run the install cell. Wait for it to finish, then restart the notebook and run the next cell - Detection setup.
This cell is used to tweak detection on a single frame.
After you're satisfied with detection results run the next cell to track the whole video. Outputs will be saved to root dir / videoFrames / _masks /

You can restart runtime after that and use masks as usual.

LyCORIS

Can be used the same way as LORAs, using the lora:loraname:lowareight syntax.

You can put them in the same folder. Can't be mixed together with loras, so you'll need to switch to either lora os lycoris and only use one type of them in your prompts.