Turns your conversations into images
When you have a Google Colab pro plus subscription, use this:
With Google Colab pro plus you can now also use this tool with img2img: (molding your image with your words and emotions)
When you don't have Colab plus pro but you have OpenAI & StabilityAI API keys, use this:
With audio-recording and transcription through the browser, auto-translation, and emotion analysis features, Mic2img is perfect for co-creation sessions, brainstorming, or reflecting on ideas. By turning it on parallel to a human converstion, and allowing the AI to influence your conversations, it becomes an ideal tool for human/AI co-creation and looking at topics from different perspectives.
Mic2img uses multiple AI models and can automatically transcribe and translate speech from any language, analyze keywords and emotions, and generate prompts for image creation every 30 seconds. With customizable options such as a custom stable diffusion model and the ability to add prompts and negative prompts, you can adjust the results to your specific needs.
Mic2img also allows you to start a server and display images in another browser window, making collaboration and idea sharing more efficient.
If you get a 403 Forbidden message when trying to open the server window, please try copying the notebook to your own drive.
In Google Colab plus pro, This notebook requires high ram. Ideally we a A100 or V100. Other GPUs may lead to issues. In this case you should use the lite version that uses API keys.
The concept of the img2emo2txt tool originated at the Academy of Performing Arts in Prague as part of the project "Generative neural networks and human imagination: participatory approaches to synthetic media production" with the support of the Institutional Endowment for the Longterm Conceptual Development of the Research Institutes, as provided by the Ministry of Education, Youth and Sports of the Czech Republic in the year 2023.
Development: Scy Heidekamp - https://scyheidekamp.nl/ Concept & research: Lenka Hamosova - https://hamosova.com/