Proposal: Improved UI for ink to text

[winston-de]

Proposal: Improved UI for ink to text

Summary

Currently, the ink to text flyout looks a out of date, and is unintuitive to use. For example, it is hard to select suggestions, and there isn't a convenient way to undo. It is also annoying to have the text jump when it is immediately converted after writing. Recently, the Microsoft Journal app was released, which includes new (and in my opinion better styles) for ink-to-handwriting. I think it would be nice if this style, or a similar one, was included in WinUI 2.x.

Current:

Journal style ink-to-text:

Improvements over current version:

• undo, redo, and clear
• eraser tool
• output preview instead of immediate conversion from ink to text
• inline suggestions

Rationale

• This will help improve the inking experience on windows to make it more intuitive

Scope

Capability	Priority
This proposal will update the ink to text ui to match new winui styles	Must
This proposal will place the word suggestions inline, instead of showing them in a separate flyout to make it easier to use	Must
This proposal will add undo, redo, and clear buttons	Should
This proposal will show a preview of the output, instead of converting it immediately	Should
This proposal will add an eraser tool for handwriting	Could
This proposal will improve the ink to text recognition	Won't

Important Notes

Journal app: https://www.microsoft.com/store/productId/9N318R854RHH

Open Questions

Should ink to text be in it's own flyout, or should it be inline?

[StephenLPeters]

@chigy fyi

[danielkornev]

Was wondering whether there are any updates on this?