Integrate textual inversion to allow for personalized t2i results

[Oceanswave]

The textual-inversion paper and the accompanying textual-inversion repository describes the approach of being able to train a new model and introduce a new vocabulary to the fixed model to provide the ability to generate images of a new, provided subject.

The provided source works with the release version of SD, as confirmed by myself and others, and it would be great if the capabilities found in this repository could be combined with this one.

[lstein]

That sounds wonderful! Do you have a patch against the upstream that I can have a look at?

[Oceanswave]

I do - https://github.com/BaristaLabs/textual_inversion

hope to work on a PR to this repo that brings in the necessary deps and code, but you might beat me to it

[morganavr]

Today @MATRIXMANE moderator on Stable Diffusion Discord shared his repo and Colab with SD Textual Inversion:
https://github.com/nicolai256/Stable-textual-inversion_win
https://colab.research.google.com/drive/1bnPJzT-dN0DUR50Z3GwtMtTKLm03o2c1?usp=sharing

Maybe these two resources could help you, guys.

[lstein]

PR #55 added support for textual inversion. The code is unstable right now. I'd recommend holding off on pulling. Lincoln

…

On Wed, Aug 24, 2022 at 7:59 AM morganavr ***@***.***> wrote: Today @MATRIXMANE moderator on Stable Diffusion Discord shared his repo and Colab with SD Textual Inversion: https://github.com/nicolai256/Stable-textual-inversion_win https://colab.research.google.com/drive/1bnPJzT-dN0DUR50Z3GwtMtTKLm03o2c1?usp=sharing Maybe these two resources could help you, guys. — Reply to this email directly, view it on GitHub <#38 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAA3EVIWF2DXNW76NXGSXN3V2YFCBANCNFSM57MAMRUA> . You are receiving this because you commented.Message ID: ***@***.***>

-- *Lincoln Stein* Head, Adaptive Oncology, OICR Senior Principal Investigator, OICR Professor, Department of Molecular Genetics, University of Toronto Tel: 416-673-8514 Cell: 416-817-8240 ***@***.*** *E**xecutive Assistant* Michelle Xin Tel: 647-260-7927 ***@***.*** ***@***.***>* *Ontario Institute for Cancer Research* MaRS Centre, 661 University Avenue, Suite 510, Toronto, Ontario, Canada M5G 0A3 @OICR_news <https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Foicr_news&data=04%7C01%7CMichelle.Xin%40oicr.on.ca%7C9fa8636ff38b4a60ff5a08d926dd2113%7C9df949f8a6eb419d9caa1f8c83db674f%7C0%7C0%7C637583553462287559%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=PS9KzggzFoecbbt%2BZQyhkWkQo9D0hHiiujsbP7Idv4s%3D&reserved=0> | www.oicr.on.ca *Collaborate. Translate. Change lives.* This message and any attachments may contain confidential and/or privileged information for the sole use of the intended recipient. Any review or distribution by anyone other than the person for whom it was originally intended is strictly prohibited. If you have received this message in error, please contact the sender and delete all copies. Opinions, conclusions or other information contained in this message may not be that of the organization.