What specific use case do you envision for your project?

[ruloqs]

Its very interesting the project but i can't see it in my workflow. Can you elaborates examples? Also i was thinking maybe as MCP server could be useful for frontend develop idk

There is one use case, but i don't like it, for example to control workers from not working.

[Roy3838]

The project was born because i thought of the privacy implications of using AI to watch and monitor your screen!

There are existing "administration" tools that do exactly that, like Hubstaff, CleverControl and other tools that monitor workers. Which is NOT the intended use of Observer at all. In fact, I would even go out of my way to prevent it from being used as a computer administration tool.

The real goal of this project is making it super simple to use local small LLMs to do very simple qualitative processing which is not possible using non ML tools. So anything that requires a bit of thinking or of common sense.
Some uses I wrote in the reddit post could be:

• Logging what you're doing.
• Watching when a progress bar finishes (great for long training runs or queries)
• Distraction detection, if you're not being productive, sends a notification
• Recording your zoom meeting and organizing it into topics discussed (or starts recording when a specific topic starts being discussed)
• I personally used it a lot as a german flashcard generator, which was weirdly useful, it logged relevant words it saw on my screen and their german translation.
• Leaving your computer AFK when playing minecraft for example and getting a notification if you die so you can recover the items before they despawn.

The uses are admittedly niche, and i think each person would require it for a very specific use case, but the goal is no make it dead simple to use and make it accessible to anyone!

[helloyoann]

I found this looking for a way to run LLMs locally....that can just monitor what im doing on computer and phone...and start to build data I can chat about with an agent and start to test automation ideas and rules.