SONIC: Spectral Optimization of Noise for Inpainting with Consistency

Seungyeon Baek, Erqun Dong, Shadan Namazifard, Mark J. Matthews, Kwang Moo Yi

---

Inpainting Example

Given a nearest-pixel inpainted image (left) and its corresponding prompt, we can inpaint the image via noise optimization.

Input	Inpainted Output

"A young man with short black hair styled upward, dark brown eyes, and fair skin with light stubble. He has well-defined eyebrows and is wearing a black collar or shirt. The background is a clean white."

---

Code Release

• ✅ Inpainting code with sample images and prompts
• ⬜ Environment setup guide
• ⬜ Metrics code from FLAIR and BrushNet