Pen pressure function and Thank you very much

[TangXiaoLin-CN]

Moonlight-Sunshine 10-point multi-touch feature is really great. I never thought I'd be using a high-performance Windows desktop with a touch gesture on a handheld device. I'm using a Surface pro 7 10-point touch tablet computer and it works very well. As of today, I have uninstalled all the GFE that I have used before because of this overwhelming function

Additionally... Is it possible to support the pressure sensing pen function? If this is supported, I believe it will be an innovative program in the field of graphics works. (especially 3D graphics)

Anyway, this 5.0 version update is another life-changing opportunity for me. Thank you so much.

[Andres-3DArtist]

Yeah please, I'm 3D artist and I'm looking forward to be able to use my main workspace remotely with Zbrush or Substance painter. Being able to use a Wacom from the client pc or Apple/Samsung/Xiaomi pencil would be awesome.

That would be a life changing

[TangXiaoLin-CN]

Yeah please, I'm 3D artist and I'm looking forward to be able to use my main workspace remotely with Zbrush or Substance painter. Being able to use a Wacom from the client pc or Apple/Samsung/Xiaomi pencil would be awesome.

That would be a life changing

I downloaded and view code of moonlight, I find it support pen pressure function. but it is not compiled to latest release. And I find moonlight cant do more, because SDL2 just surpport pen pressure.SDL2 cant surpport pen float on screen surface as a mouse. It mean pen cant normal works on windows,except moonlight to improve it or upgrade to SDL3.

[Andres-3DArtist]

And do you think it'd be possible to update to SLD3? I mean, if we can have hope hahaha

[TangXiaoLin-CN]

And do you think it'd be possible to update to SLD3? I mean, if we can have hope hahaha

hahah,I personally hope it is possible very much.But it is diffcult after I know status of SDL3. SDL3 is review now, and it has a lot of changed,therefore upgrade project may is complex and need much time.

reletively,to individually changed SDL2's code for adapt windows' pen pressure is easy, but this is not conducive to upgrade SDL3.

however, official version of SDL3 will be publish in furture, project upgrade also is inevitable. We just need wait and hope.

[cgutman]

Yes, the problem is that SDL doesn't expose pen pressure until SDL 3 (which isn't yet released). Someone posted a WIP PR that converts Moonlight to SDL 3 (#1182) but it's probably outdated now since SDL3 is still making breaking changes.

Once SDL 3 is officially released and Moonlight has been updated to support it, the actual changes to support pen pressure are trivial.

[TangXiaoLin-CN]

Yes, the problem is that SDL doesn't expose pen pressure until SDL 3 (which isn't yet released). Someone posted a WIP PR that converts Moonlight to SDL 3 (#1182) but it's probably outdated now since SDL3 is still making breaking changes.

Once SDL 3 is officially released and Moonlight has been updated to support it, the actual changes to support pen pressure are trivial.

Thank you for your reply and hard work.

[gschintgen]

This issue has me wondering: Is a digital pen / stylus currently supposed to work correctly with absolute coordinates? (Pressure sensitivity would be a luxury at this point...)

Currently my Wacom stylus (integrated into a Thinkpad Yoga S1) is working perfectly fine locally, but if I use that Thinkpad as Moonlight client to my Sunshine host, the host only receives relative mouse movement packets from the pen. I.e. if I lift the pen so that it's no longer detected as hovering and then bring it near the screen again that new absolute position is not transmitted to Sunshine.

Is that expected?

(That is with moonlight 5.0.1, but since the release notes for 6.0 don't mention anything pen related I wouldn't expect changes. Host and client are Ubuntu 22.04.)

[Lucalme]

@gschintgen

This issue has me wondering: Is a digital pen / stylus currently supposed to work correctly with absolute coordinates? (Pressure sensitivity would be a luxury at this point...)

Currently my Wacom stylus (integrated into a Thinkpad Yoga S1) is working perfectly fine locally, but if I use that Thinkpad as Moonlight client to my Sunshine host, the host only receives relative mouse movement packets from the pen. I.e. if I lift the pen so that it's no longer detected as hovering and then bring it near the screen again that new absolute position is not transmitted to Sunshine.

Is that expected?

(That is with moonlight 5.0.1, but since the release notes for 6.0 don't mention anything pen related I wouldn't expect changes. Host and client are Ubuntu 22.04.)

I'm on windows 11 on both client and host and have the exact same issue. Did you find a way to make it work?

[gschintgen]

I'm on windows 11 on both client and host and have the exact same issue. Did you find a way to make it work?

No, it's not currently supported on PC as it seems: LizardByte/Sunshine#2606 (comment)

I can confirm though that Samsung's S-Pen on a tablet (moonlight-android) is working indeed (host: Sunshine Linux), but I couldn't test it in-depth to check whether or not pressure sensitivity is working. (Caveat: the pen stutters heavily every 20-40 seconds if used via moonlight/sunshine; there is an issue about it that may have been closed prematurely. I'll have to properly test all of this sometime.)

[Andres-3DArtist]

I'm on windows 11 on both client and host and have the exact same issue. Did you find a way to make it work?

No, it's not currently supported on PC as it seems: LizardByte/Sunshine#2606 (comment)

I can confirm though that Samsung's S-Pen on a tablet (moonlight-android) is working indeed (host: Sunshine Linux), but I couldn't test it in-depth to check whether or not pressure sensitivity is working. (Caveat: the pen stutters heavily every 20-40 seconds if used via moonlight/sunshine; there is an issue about it that may have been closed prematurely. I'll have to properly test all of this sometime.)

I've tested it in my Samsung S9 Ultra and it's weird. I do have pen pressure in Photoshop but not in Zbrush

[Lucalme]

I'm on windows 11 on both client and host and have the exact same issue. Did you find a way to make it work?

No, it's not currently supported on PC as it seems: LizardByte/Sunshine#2606 (comment)

I can confirm though that Samsung's S-Pen on a tablet (moonlight-android) is working indeed (host: Sunshine Linux), but I couldn't test it in-depth to check whether or not pressure sensitivity is working. (Caveat: the pen stutters heavily every 20-40 seconds if used via moonlight/sunshine; there is an issue about it that may have been closed prematurely. I'll have to properly test all of this sometime.)

I'm wondering if it would be possible to write a transparent overlay with third party library (preferably linux and windows compatible) that would capture pen data and then transmit it to the app to send over network. Would have to look into code but seems it could be good temporary fix since SDL 3 is not yet stable.

[Kuuh4]

Update! SDL 3 Is out!
https://github.com/libsdl-org/SDL/milestone/10

Edit: Actually moonlight already supports pen pressure?
It works properly on my Samsung S9+, testing the pressure on a OpenProcessing webpage via Firefox Nightly

(I'm struggling making it work with krita tho)

[Fuchsiae]

It might interest some as a temporary solution, you can use Weylus (and in particular the community fork) : https://github.com/electronstudio/WeylusCommunityEdition

Then you can play around like I did,

1. In Sunshine deactivate all the options about touch input or pen support, restart Sunshine
2. launch the Weylus server on the host
3. Open Moonlight on the client device
4. open your web browser above it > open the Weylus client page (:port) > on the side menu, uncheck the mouse and touch transmission but keep Stylus transmission checked
5. Still on the side menu, cut the video stream, and put it in black screen, power save mode for the least delay.
   (You could use only Weylus, but I find that the video stream delay is way too big compared to Moonlight, which is why I use both at the same time instead, but Weylus limited to registering pen information).
6. Then open a software that allows you to render your current window completely transparent (I used a software called "Spooky View" on Windows : https://github.com/littletijn/spooky-view)
7. Be sure to have Moonlight open on focus, and the web browser on the Weylus client page, transparent, above it.
8. Make the browser full screen

Et voilà ! You can use your pen directly on the screen of the host computer through your tablet device, with pen pressure registered and few delay.