A next.js web application that integrates AI capabilities with draw.io diagrams. This app allows you to create, modify, and enhance diagrams through natural language commands and AI-assisted visualization.
20251110_draw_io_demo.mp4
Demo site: https://next-ai-draw-io.vercel.app/
- LLM-Powered Diagram Creation: Leverage Large Language Models to create and manipulate draw.io diagrams directly through natural language commands
- Image-Based Diagram Replication: Upload existing diagrams or images and have the AI replicate and enhance them automatically
- Diagram History: Comprehensive version control that tracks all changes, allowing you to view and restore previous versions of your diagrams before the AI editing.
- Interactive Chat Interface: Communicate with AI to refine your diagrams in real-time
- Smart Editing: Modify existing diagrams using simple text prompts
- Targeted XML Editing: AI can now make precise edits to specific parts of diagrams without regenerating the entire XML, making updates faster and more efficient
The application uses the following technologies:
- Next.js: For the frontend framework and routing
- @ai-sdk/react: For the chat interface and AI interactions
- react-drawio: For diagram representation and manipulation
Diagrams are represented as XML that can be rendered in draw.io. The AI processes your commands and generates or modifies this XML accordingly.
This application supports multiple AI providers, making it easy to deploy with your preferred service. Choose from:
| Provider | Status | Best For |
|---|---|---|
| AWS Bedrock | ✅ Default | Claude models via AWS infrastructure |
| OpenAI | ✅ Supported | GPT-4, GPT-5, and reasoning models |
| Anthropic | ✅ Supported | Direct access to Claude models |
| Google AI | ✅ Supported | Gemini models with multi-modal capabilities |
| Azure OpenAI | ✅ Supported | Enterprise OpenAI deployments |
| Ollama | ✅ Supported | Local/self-hosted open source models |
Note that claude-sonnet-4-5 has trained on draw.io diagrams with AWS logos, so if you want to create AWS architecture diagrams, this is the best choice.
- Clone the repository:
git clone https://github.com/DayuanJiang/next-ai-draw-io
cd next-ai-draw-io- Install dependencies:
npm install
# or
yarn install- Configure your AI provider:
Create a .env.local file in the root directory:
cp env.example .env.localEdit .env.local and configure your chosen provider:
- Set
AI_PROVIDERto your chosen provider (bedrock, openai, anthropic, google, azure, ollama) - Set
AI_MODELto the specific model you want to use - Add the required API keys for your provider
See the Multi-Provider Support section above for provider-specific configuration examples.
- Run the development server:
npm run dev- Open http://localhost:3000 in your browser to see the application.
The easiest way to deploy your Next.js app is to use the Vercel Platform from the creators of Next.js.
Check out the Next.js deployment documentation for more details.
Or you can deploy by this button.
Be sure to set the environment variables in the Vercel dashboard as you did in your local .env.local file.
app/ # Next.js application routes and pages
extract_xml.ts # Utilities for XML processing
components/ # React components
chat-input.tsx # User input component for AI interaction
chatPanel.tsx # Chat interface with diagram control
ui/ # UI components (buttons, cards, etc.)
lib/ # Utility functions and helpers
utils.ts # General utilities including XML conversion
public/ # Static assets including example images
- Allow the LLM to modify the XML instead of generating it from scratch everytime.
- Improve the smoothness of shape streaming updates.
- Add multiple AI provider support (OpenAI, Anthropic, Google, Azure, Ollama)
- Solve the bug that generation will fail for session that longer than 60s.
This project is licensed under the MIT License.
For support or inquiries, please open an issue on the GitHub repository or contact the maintainer at:
- Email: me[at]jiang.jp