Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Advanced Paste] Add advanced text formatting #33109

Open
CrazeXD opened this issue May 27, 2024 · 20 comments
Open

[Advanced Paste] Add advanced text formatting #33109

CrazeXD opened this issue May 27, 2024 · 20 comments
Assignees
Labels
Idea-Enhancement New feature or request on an existing product Product-Advanced Paste Refers to the Advanced Paste module Status-In progress This issue or work-item is under development

Comments

@CrazeXD
Copy link

CrazeXD commented May 27, 2024

Description of the new feature / enhancement

Make AdvancedPaste more versatile by giving more text editing shortcuts, such as convert to single line (to get rid of linebreaks when copy pasting from a pdf), capitalize (correctly capitalize a sentence / convert to upper/lowercase), etc.

Scenario when this would be used?

This feature could be used during essay writing. When copying information from a pdf over to for example a google doc, it would be helpful to be able to select the text and paste it as a single line.

Supporting information

No response

@CrazeXD CrazeXD added the Needs-Triage For issues raised to be triaged and prioritized by internal Microsoft teams label May 27, 2024
@e-t-l
Copy link
Contributor

e-t-l commented May 28, 2024

This seems more like a feature request for the Advanced Paste component, doesn't it?

@CrazeXD
Copy link
Author

CrazeXD commented May 28, 2024

Smart, I didnt have that feature installed from later updates.

@htcfreek htcfreek added Idea-Enhancement New feature or request on an existing product Product-Advanced Paste Refers to the Advanced Paste module labels May 28, 2024
@htcfreek
Copy link
Collaborator

@CrazeXD
Could you please rename the issue to something lik "[Advanced Paste] Add advanced text formatting"?

@CrazeXD CrazeXD changed the title Change QuickAccent to Quick Format [Advanced Paste] Add advanced text formatting May 28, 2024
@htcfreek
Copy link
Collaborator

My thoughts on this: Great idea but the new fornats should be available through the ui too. (Maybe configurable which one.) There are so many shortcuts in PowerToys already 🤯 and I can't imagine everyone if I need it.

@CrazeXD
Copy link
Author

CrazeXD commented May 30, 2024

What I was thinking about was something similiar to what word does. On paste, a small tooltip pops up with different options where you can press a keybind to change the way something pastes in. This could be toggled on or off, with the additional options of what you mentioned.

@htcfreek
Copy link
Collaborator

What I was thinking about was something similiar to what word does. On paste, a small tooltip pops up with different options where you can press a keybind to change the way something pastes in. This could be toggled on or off, with the additional options of what you mentioned.

Sounds interesting. Can you share a demo or mock up?

@CrazeXD
Copy link
Author

CrazeXD commented May 31, 2024

I don't really have any experience in creating mockups, but here is a little google drawing I made as an example.
image

@joadoumie
Copy link
Contributor

I like this idea! I was actually noodling on and started prototyping a feature that would allow users to add their own custom shortcut that they could reuse. Ideally, we could make it so that the user can select which SLM they want to use for the custom shortcut and/or decide to use the Open AI API flow we already have today.

It sounds like your enhancement is slightly different because some of the functionality doesn't really need an AI model, but rather just additional logic baked into advanced paste (which sounds nice).

I'd love to coordinate our ideas and efforts here, so we don't do overlapping work with the additional shortcuts flow. I'm working to get my prototype design to a point where I can share the designs out in this thread and we can bounce ideas off one another!

@CrazeXD
Copy link
Author

CrazeXD commented May 31, 2024

Sounds great, let me know!

@htcfreek htcfreek added Status-In progress This issue or work-item is under development and removed Needs-Triage For issues raised to be triaged and prioritized by internal Microsoft teams labels Jun 1, 2024
@jaimecbernardo
Copy link
Collaborator

Thinking if instead of having this be a whole new shortcut, perhaps being options for Text as Plain text, changing that text in some ways we select? Just an idea, though.

@CrazeXD
Copy link
Author

CrazeXD commented Jun 3, 2024

That's what we were discussing above, integration with advanced paste.

@joadoumie
Copy link
Contributor

joadoumie commented Jun 3, 2024

Apologies for the delay - I didn't have a chance to clean up the UI more than what I had already mocked up for just the settings, so here is roughly the idea that I was playing around with:

4b9bedfa-157a-4de4-8cba-e8e034631389

The overall goal of this feature is to allow the user to have autonomy over various copy/paste flows they want to include. It would be great to be able to choose from a set of local models and/or choose from whatever cloud based models we have available.

Please be aware this is purely a mockup of the settings functionality with essentially random strings in places that I've just used to communicate the idea. @CrazeXD @jaimecbernardo @craigloewen-msft - would be interested to get your thoughts.

@CrazeXD, I know your suggestion is a bit different, but I think we can integrate both of our ideas in a cohesive way.

@CrazeXD
Copy link
Author

CrazeXD commented Jun 3, 2024

I really like that mockup, I think it definetly expands upon the ideas I originally was thinking about. Both of these features definetly have a place in Advanced Paste and I think I have a way of integrating them as well.

Instead of having a global option "Enable Paste with AI" as you have at the top, what we could do is just use the presets and inside the preset customizer have the option to enable AI, at which point we would be able to see all of the different options and modals that you designed in your demo. We could also have optionality for regex, capitalization, single line, etc. to give as much control over the paste function as we can think of (baked in with regular code rather than an AI model as in my original issue).

Let me know what you think about this combination @joadoumie

@joadoumie
Copy link
Contributor

Seems like a good approach to me. Not sure if this is what you had in mind exactly, but having a regex type input that would literally just apply some regex formula to text and paste it would be epic.

@CrazeXD
Copy link
Author

CrazeXD commented Jun 3, 2024

That's what I was thinking, sounds like a useful feature.

@jaimecbernardo
Copy link
Collaborator

Please be aware this is purely a mockup of the settings functionality with essentially random strings in places that I've just used to communicate the idea. @CrazeXD @jaimecbernardo @craigloewen-msft - would be interested to get your thoughts.

It sounds like an interesting feature. A sort of quick prompts. I wonder if it makes sense having them on the same section as the others or having a distinct section like "custom prompts", to distinguish local run logic from AI based prompts. 🤔

@CrazeXD
Copy link
Author

CrazeXD commented Jun 4, 2024

My thought process was that inside of a separate modal for preset editing, we have a toggle similar to the original mockup that enables Paste with AI and then opens up many more options relevant to an AI based feature. This could reduce some of the confusion/clutter within the page (at least in my opinion). Let me know what you think about this approach.

@joadoumie
Copy link
Contributor

@CrazeXD - maybe some artwork to help illustrate your last suggestion could be helpful. Just pen on paper works, nothing too fancy!

I'm really excited about merging these ideas and continuing to build them out!

@CrazeXD
Copy link
Author

CrazeXD commented Jun 7, 2024

@joadoumie Here is my pencil and paper crude drawing. Apologize for the delay, I've been busy with finals.

image

The idea is that when a user clicks on the "Add custom shortcut " in the above prototype, they see this as a pop-up modal. A cool feature idea I had while drawing this was "Custom string code", in which a user gets to make a custom C# script or other language (not getting too gritty on those details) which will be run on paste.

This would be in addition to the Google drawing I have at the top, which would show up on a different paste key one, or perhaps it could be one of the different icons.

@joadoumie
Copy link
Contributor

joadoumie commented Jun 10, 2024

Love these ideas thank you - sorry for the slow turnaround! I'm juggling a few ideas coming in from various areas - great idea for the scripting logic (C#, python etc.). There are a lot of moving parts coming from different directions that I'd like to bring into the mix and need to figure out the best way to prioritize with the team.

I'm working on some proposals this week and will share out here as soon as I can.

edit: I hope your finals went great!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Idea-Enhancement New feature or request on an existing product Product-Advanced Paste Refers to the Advanced Paste module Status-In progress This issue or work-item is under development
Projects
Status: No status
Development

No branches or pull requests

6 participants
@jaimecbernardo @e-t-l @htcfreek @CrazeXD @joadoumie and others