Realtime AI guided by your hand.
Own the composition and elevate your creativity. MusePro is the next generation of drawing tools - a professional-grade app for iOS and visionOS where your Apple Pencil strokes guide real-time AI image generation.
demo.mp4
Unleash your creativity with familiar tools and groundbreaking AI.
Watch your vision unfold as your strokes guide the AI.
feature-enhance.mp4
Your drawings transform as you create them - not after. The AI follows your composition, respecting your artistic intent while adding stunning detail in real-time.
- Full Apple Pencil support with pressure sensitivity
- Sub-second inference via WebSocket streaming
- Powered by Latent Consistency Models for instant results
- SDXL-quality outputs with minimal latency
Guide the AI with prompts to bring your ideas to life.
feature-prompting.mp4
- Text-to-Image - Quickly change directions with words
- Randomize - Never face a blank canvas again
- Enhance - Beautiful detail with a tap
- Vision - Your drawing described by GPT-4 Vision
Fine-tune the AI with intuitive sliders. You're always in control.
feature-shapes.mp4
- Shuffle the seed to explore endless possibilities
- Pause to put AI collaboration on hold
- Adjust influence strength to balance your drawing vs AI interpretation
Enhance details and polish your masterpiece.
feature-realtime.mp4
- 2x Upscaling - Print-ready outputs from your sketches
- Creative Enhancement - Sliders help bring rough concepts to life
- Background Removal - Clean cutouts instantly
Infuse your art with shapes, images, and text.
feature-aicontrol.mp4
Import photos, add geometric shapes, and incorporate typography directly into your canvas as composition guides.
Experiment and refine effortlessly with layers.
- Unlimited layers with 16 blend modes
- Per-layer opacity and locking
- Drag & drop reordering
A brush library for every artistic dream.
hero.mp4
17+ brush categories from dry media to vintage effects, all with full pressure and tilt sensitivity. Compatible with Procreate brushes.
This isn't a wrapper around an API. MusePro is built from the ground up with custom technology.
- 120 FPS rendering - Buttery smooth on ProMotion displays
- GPU-accelerated compositing - Zero lag layer blending
- Hand-written Metal shaders - Custom brush rendering and blend modes
- Texture-based brush system - Grain textures, shape dynamics, pressure curves
- Smart memory management - Efficient texture caching and buffer handling
- Stroke Capture - Apple Pencil events at 240Hz with position, pressure, tilt, azimuth
- Bezier Generation - Raw input to smooth curves preserving natural dynamics
- Brush Stamping - Textured quads along curves with configurable blending
- Layer Compositing - Per-layer textures with GPU blend modes
- Display - Final composite at up to 120fps
- Canvas Snapshot - Current state captured and compressed
- WebSocket Stream - Persistent connection to Fal.ai inference
- Incremental Updates - Results stream without blocking UI
- Graceful Handling - Connection drops, retries, rate limiting
MusePro/
├── Canvas/ # Metal rendering engine & canvas management
├── Brush/ # Brush system with texture support
├── BrushSets/ # Pre-built brush libraries
├── MetalBase/ # Core Metal infrastructure & shaders
├── Elements/ # Drawing primitives (lines, shapes, chartlets)
├── Enhancer/ # AI upscaling & enhancement views
├── Tools/ # UI components (color picker, layers, controls)
├── Data & Documents/ # Document system, storage, undo/redo
├── Math & Utils/ # Bezier curves, gesture recognition, utilities
└── Colors.xcassets/ # Color palette definitions
- Xcode 15.0+
- iOS 16.4+ / visionOS 1.0+
- Apple Developer account (for device deployment)
-
Clone the repository:
git clone https://github.com/StyleOf/MusePro.git cd MusePro -
Set up your API keys:
GoogleService-Info.plist- Firebase configuration<key>API_KEY</key> <string>YOUR_FIREBASE_API_KEY</string>
RemoteConfigDefaults.plist- Fal.ai API key<key>falKey</key> <string>YOUR_FAL_AI_API_KEY</string>
UserManager.swift- RevenueCat (for subscriptions, optional)Purchases.configure(withAPIKey: "YOUR_REVENUECAT_API_KEY")
App.swift- Intercom (for support, optional)Intercom.setApiKey("YOUR_INTERCOM_API_KEY", forAppId: "YOUR_APP_ID")
LiveImageModel.swift- OpenAI (for prompt enhancement)let openAI = OpenAI(apiToken: "YOUR_OPENAI_API_KEY")
-
Update the bundle identifier to your own
-
Build and run!
Managed via Swift Package Manager:
| Dependency | Purpose |
|---|---|
| Firebase | Analytics, Remote Config |
| RevenueCat | Subscription management |
| FalClient | Real-time AI inference |
| OpenAI | GPT-4 prompt enhancement |
| Intercom | Customer support |
| Kingfisher | Image caching |
| ZIPFoundation | Document compression |
| Platform | Version | Status |
|---|---|---|
| iPhone | iOS 16.4+ | Full Support |
| iPad | iPadOS 16.4+ | Full Support (Optimized) |
| Vision Pro | visionOS 1.0+ | Full Support |
We'd love to hear about it! While not required, please consider:
- Starring this repo
- Sharing your project with us on Twitter/X
- Crediting MusePro in your app's about section
Contributions are welcome! Feel free to:
- Report bugs and request features via Issues
- Submit Pull Requests for improvements
- Share your creations made with MusePro
This project is licensed under the MIT License - see the LICENSE file for details.
- Custom Metal rendering engine built with love
- AI powered by Fal.ai
- Originally developed by Omer Karisman at StyleOf
Made for artists and creators who want to own their composition while embracing AI collaboration.