Support mouse input

[mtlynch]

Mouse input capturing is doable. We can use a really similar mechanism to what we're already doing to emulate a keyboard:

https://www.raspberrypi.org/forums/viewtopic.php?t=234495

• Possibly useful: https://github.com/Blub/netevent
  • Not sure if it supports the scenario we want where we're translating JavaScript events to HID mouse events.

[somik123]

Mouse input capturing is doable. We can use a really similar mechanism to what we're already doing to emulate a keyboard:

https://www.raspberrypi.org/forums/viewtopic.php?t=234495

+1 on this.

Really need mouse support to finish installing a certain OS developed by Microsoft...

[Lotusshaney]

This would be fantastic !

[thetanil]

moved comment to issue 96

[mtlynch]

@thetanil a separate issue would be great! Can you include the Windows version where you're seeing this?

[somik123]

Any plans or timeline on this? Most installers support mouse so it'll make navigation easier.

[mtlynch]

@somik123 - It's the top feature on my list. I'm aiming to have it working this month. I just need to find some bandwidth for it because a lot of my focus the past week has been helping new users get up and running and shipping out kits.

[Bramzor]

+1

I need the same functionality in the coming weeks. (Do not need keyboard, only the mouse input). Maybe we can create a new branch and work on this together to get the basic functionality working?

[peterberbec]

I, for one, welcome our new TinyPilot overlords.

[ImCoKeMaN]

Would it be using this? https://developer.mozilla.org/en-US/docs/Web/API/Element/mousemove_event and then if you were to save the previous mouse position, capture new offset and do a diff, that's what the mouse gadget needs as input right?
If you're already past this stage, awesome, but this idea was in my head and wanted to share it if is on the right track.

[mtlynch]

@ImCoKeMaN - Yep, that's my plan. Thanks for the pointer!

[sstur]

Hey, let me know if you need any support to help write the JS or any web frontend dev for this, I'll be happy to pitch in!

[mtlynch]

@sstur - Thanks for reaching out! Is there a feature or piece you're interested in taking on? I think contributions work best when you can work on something you see as improving your experience using TinyPilot.

[sstur]

Right, I was specifically thinking about the mouse support, just if you need anything on the JavaScript UI side to move that feature forward (although I'm happy to tackle any frontend feature). I'm still waiting on my parts that I ordered as soon as I discovered this project, so I'll have a better idea soon of what I'm interested in improving.

I don't mean to hijack this thread for this discussion, this one is already resolved it looks like.\ I'll pick one of the other issues or create one and see where this can be improved. Thanks!

[mtlynch]

The only big missing feature from mouse behavior I can think of at the moment is scrollwheel movement. That's probably going to be more backend-heavy, but it does involve a bit of frontend.