mps support

[Funofabot]

I think the boiler plate send to cuda will probably need to change give the fact that people will use metal with this. A phd was having problems with this. Its something that we need to work on. Cant ignore it.
This should still be inclusive to all.
Part of why I am here is that I don't play around. Dreamers need a place to dream.
@kabachuha we need to make provisions for metal support ie: mps

[fbarretto]

Hi, hope you don't mind I join this conversation but I would like to add a few comments. First of all, I really do appreciate all the work done by the deforum team. Deforum isn't the only tool I've been playing with but is certainly one of the most interesting. It's really amazing what you've done.
I really understand how hard and stressful it is to maintain a project like this and I'm very sorry I don't have enough resources to donate a mac by myself. I would do that, if I could, but there is no way we can assume that every PhD is rich or is able to solve any problem. Actually, a PhD means nothing outside its small knowledge bubble. We can't assume either that anyone is soaking anything or we might say that everyone who is not coding (all users) is just soaking benefits. I suppose you could say that from apps or people who are making real money with these tools and giving nothing back, but it is really rude and unnecessary to assume anything like that about anyone.
To solve the resources limitation, from the top of by head, I would say that there are 2 main ways mac users could help: (a) crowdfunding for the equipment you need and (b) trying to contribute with code. For the crowdfunding, I have no idea about how many mac users there are, but it must worth a shot. For code contributions, we can't assume that everyone is able to understand the deforum code and work on it, even if they have a PhD (which are very restrict to a specific domain). Most people would love to contribute by coding, but they use these UIs because they don't have coding expertise or they are not familiar with ML/python (or diffusion). One way to overcome this limitation would be to offer people some kind of introduction or crash courses on how the code works so they would learn faster or you could establish some kind of mentorship where you would assign tasks for people less familiar with the code and supervise their work until they become self-sufficient.
Personally, I would love to contribute by coding but this is not my field of expertise development-wise. I will take a shot, nonetheless, and try to understand how things work under the hood, but it may take some time. Anyway, I would love to help. Let me know if you are willing to chat on discord and point me so we could speed things up.

[Funofabot]

I understand how difficult all of this is. It also is really hard to use something when it doesn't work. Aside from the commercial products, which are really good, the concepts change so fast that trying to keep up with it is a daunting challenge. It would not surprise me if all of this is obsoleted in a month.
And things like the 3D mode using Deforum are still very much a WIP. This version of Deforum is not equal to the notebook version of Deforum. While trying to unify the versions, there is a daily struggle with making compromises that exclude or change existing work.

My white board has never seen this much use. There are probably multiples of 1000's of people working on this. Its incredible.

[Funofabot]

You are all good. I need to make sure that I stay on my meds. Its such a cool project that I dont want to lose out on the chance to help make it better.
I'd love to send you something in the next couple of days to have you look over so that you can test it, I dont have a way to test it. Again I apologize for being insane. Thank you for offering to help.

[Funofabot]

Just for curiousness have you tried --no-half in the commandline args?
Its my understanding also that when using mps as a device, it will default to 'cpu'
I briefly looked over the related code for the 3d transformations, it should do be setting the device to 'cpu' however I haven't looked far enough back to see if there is something forced. Also .half() shouldn't be called in the code if mps is the device as it sets it to 'cpu' if that is the case.

Its very interesting that you are getting the rotation around the bottom right corner also.
Ill see if I can do something later this afternoon.

I am also very others have been able to get this working.
I am assuming that you are using the current webui from automatic1111 and installed the extension through the extension tab.

[Funofabot]

I have stuff to try with you to see if about getting it to work. Let me know when you have time to test some things out.

[Funofabot]

Another question is what MacOS version do you have installed?

[fbarretto]

I'm sorry for the delay in getting back to you. I was offline for the last couple of days but I'm back now. I'm glad to know that you're feeling better and I want you to know that my help offer stands.

I'll try to run with the --no-half arg to see if it helps and I'll let you know how it goes. Let me know what else do you want me to test. If you think it might be easier I can shoot you a message on discord so we could try to work it out.

I'm running MacOS 13.0.1 the current webui from auto1111 and have 2 instances: (a) the extensions installed through the extension tab and a (b) instance installed manually by cloning the deforum4auto1111 repo. I believe that the issue persisted on both but the final reported tests were run on the instance "a". I might try to update everything (auto and deforum) and run the tests again this weekend.