Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trigger click action with mouth gesture (smiling or opening mouth) #25

Open
1j01 opened this issue Aug 11, 2022 · 0 comments
Open

Trigger click action with mouth gesture (smiling or opening mouth) #25

1j01 opened this issue Aug 11, 2022 · 0 comments
Labels
affects:desktop-app Affects the Electron app affects:web-library Affects usage of the tracky-mouse.js library enhancement New feature or request

Comments

@1j01
Copy link
Owner

1j01 commented Aug 11, 2022

Currently the app supports dwell clicking (hovering in one spot long enough to trigger a click), but a gesture would be faster.

There is already the facemesh library included for detecting the pose of the user's face, and whilst it doesn't look like it handles eye or eyebrow movements well enough, I think detecting a smile or open mouth should work fine.
It might cause accidental clicks sometimes though when it loses proper tracking of the face, we'll have to see if that's a problem.

You should still have the option of using dwell clicking.
See #1 for support for clicking by blinking.

@1j01 1j01 added enhancement New feature or request affects:web-library Affects usage of the tracky-mouse.js library affects:desktop-app Affects the Electron app labels Aug 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects:desktop-app Affects the Electron app affects:web-library Affects usage of the tracky-mouse.js library enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant