Punko Discord Bot

This is a personal project meant for learning AI. I have integrated a few custom AI models to develop an AI Chatbot and an AI image generation feature for this bot

The AI Chatbot portion of this bot uses the Microsoft DialoGPT conversational model trained with message from people in family groupchat. I followed Lynn Zheng's tutorial to create this portion of the bot.

Here is a demo of the Discord bot AI chat function.

You can also directly chat with the model hosted on Hugging Face's Model Hub.

Image Generation

Image generation! Just like midjourney Punko can generate images powered by a custom trained Stable Diffusion Image Model

You can also directly prompt the model hosted on Hugging Face's Model Hub

Structure of this Project

• model_train_upload_workflow.ipyb: Notebook to be run in Google Colab to train and upload the model to Hugging Face's Model Hub
• DreamBooth_Stable_Diffusion.ipynb: Notebook to train the image generation stable diffusion model
• main.py: Script to be imported into a Repl.it Python Discord.py project

Roadmap

• Train AI chatbot
• Integrate AI chatbot with discord boy
• Train image generation model
• Integrate image generation model with discord bot
• Add negative prompts to image generation API calls
• Add an AI model to do automatic prompting? based on key words?

Resource Links

• My AI conversational chatbot model
• My AI image generation model
• Lynn Zheng's blog on freeCodeCamp
• Lynn Zheng's video
• Stable Diffusion Tutorial by SECourses
• API call example