Skip to content

Releases: mr1charles/linux-ai-assistant-

Little Toby 1.1.0

Choose a tag to compare

@github-actions github-actions released this 26 Sep 18:58

Little Toby now has an Android app, a Telegram bot, your notes as its
memory, and an overnight queue. It also has a website:
https://mr1charles.github.io/linux-ai-assistant-/

What's new

  • An Android app. Download LittleToby.apk below and open it. The
    first time, paste the link that toby phone on shows, or type the
    address and code. After that it opens straight to your computer over
    Tailscale.
  • Talk to Toby on Telegram. Make your own private bot with @Botfather
    and run toby telegram setup. Only accounts you confirm at the computer
    can use it. You get each task's steps as they happen, Allow / Don't allow
    buttons for anything that needs your OK, voice notes, and instant
    notifications. See docs/TELEGRAM.md.
  • Your notes folder as Toby's memory. Run toby notes set ~/Obsidian
    (or any folder of Markdown notes). Toby searches it when you ask about
    something, and keeps a daily log of what it did.
    See docs/NOTES.md.
  • An overnight queue. Add tasks with toby queue add "…", /queue in
    Telegram, or by editing Queue.md. Toby works through them between 01:00
    and 07:00 while the computer is awake, and leaves what it found in
    Outbox/. Anything that needs your OK is left for you.
    See docs/QUEUE.md.
  • A real off switch for the Dynamic Island (toby island off).

Update your computer

toby update

Or, for a first install:

curl -fsSL https://raw.githubusercontent.com/mr1charles/linux-ai-assistant-/main/install.sh | bash

Install the phone app

  • Android: download LittleToby.apk below. Allow installing from your
    browser if Android asks.
  • iPhone: download LittleToby-unsigned.ipa below and sideload it
    with your own Apple ID (Plume Impactor on Linux, AltStore or Sideloadly).
    See docs/COMPANION.md.

Either way, install Tailscale on the phone and sign in with the same account
as the computer, then run toby phone on.

Good to know

  • The first time you run toby phone on, Tailscale may ask you to turn on
    Serve for your network. Open the link it gives you and click Enable.
  • On a small local model, Toby sometimes answers a question about the
    computer without checking first. A bigger model, or cloud mode, does
    better.
  • The Android app hasn't been tried on many phones yet. If something's off,
    please open an issue.

Little Toby 1.0.0

Choose a tag to compare

@github-actions github-actions released this 23 Sep 20:32
0459617

Little Toby's first release: everything since the first version, plus the
iPhone app.

What's new

  • Control your computer from your iPhone, from anywhere. Ask Toby to
    check on things, run commands and builds, open apps, and move or tidy
    files. Each task shows up live on the phone with its steps, and you can
    pause or stop it. Anything that changes something waits for your OK on
    the phone or the computer. Pairing each phone takes a one-time code, a
    six-digit number that matches on both screens, and your OK on the
    computer. It all runs over your own Tailscale network, so nothing is
    open to the internet.
  • A native iPhone app (SwiftUI, iOS 17 or later): Home, Chat with
    voice, Tasks, Computer (windows, live screen if you allow it, terminal
    output, files) and Settings, in light and dark. There's also a web app
    for Android or any browser.
  • Work Mode: Toby reads what's on the screen and works on it the way you
    would. It can click, drag and scroll, circle, underline and highlight,
    and write by hand using real pen input. Afterwards it checks that the
    page actually changed.
  • Permission levels: looking is done at once. Changing things asks
    first. Risky things (sudo, deleting whole folders, changing anything
    outside your home folder) are refused unless you turn them on.
  • One-command install and a toby command (toby update, toby doctor,
    toby phone pair…).
  • Fingerprint approval for Toby's questions.
  • Faster answers: obvious requests are answered at once, and Toby picks
    the best local model for your computer.
  • Animations all run on one motion system: the chibi that walks out,
    carries the pointer and types on a little keyboard, the lid fold on
    sleep, a smarter Dynamic Island, and Toby-style window animations.

Update your computer

If you already have the toby command:

toby update

Otherwise (a first install, or a copy from before this release):

curl -fsSL https://raw.githubusercontent.com/mr1charles/linux-ai-assistant-/main/install.sh | bash

Add -s -- --phone to the end (… | bash -s -- --phone) to also install
Tailscale for the phone. Your data stays in ~/linux-agent. If that folder
holds an older, unrelated copy, it's left alone and the code goes in
~/.local/share/little-toby instead. If your Hyprland config still starts
the old Toby, the installer tells you where.

Install the iPhone app

  1. Download LittleToby-1.0.0-unsigned.ipa below.
  2. Sign and install it with your own Apple ID using a sideloading tool:
    Plume Impactor (works on
    Linux), AltStore with AltServer, or Sideloadly
    on Windows or macOS.
  3. On the iPhone, turn on Settings → Privacy & Security → Developer
    Mode
    (it restarts), then trust your Apple ID under Settings →
    General → VPN & Device Management
    .
  4. On the computer run toby phone on. In the app, tap Pair a
    computer
    , scan the code, check that the numbers match, and approve
    on the computer.

With a free Apple ID the app has to be re-signed every 7 days (the tools
can do it for you). A paid Apple Developer account makes that a year.
The full guide is in docs/COMPANION.md.

Good to know

  • Tested automatically: the whole computer side in a headless desktop,
    and the iPhone app on GitHub's Mac machines. There, a UI test pairs with
    a real Toby, asks for a task, approves it and watches it finish, on a
    small and a large iPhone in light and dark.
  • Not yet tried on a real iPhone or on real Hyprland hardware. Pen input,
    finding buttons through accessibility on Wayland, and reading text on a
    dark theme are the parts most likely to need adjusting.
  • Notifications while the app is in the background can be late (iOS
    decides when the app may check). For instant ones, set up
    ntfy as described in the guide.
  • Work Mode writes what you ask it to write. It won't answer homework or
    graded work for you.

first one

Choose a tag to compare

@mr1charles mr1charles released this 23 Sep 20:31
0459617

What's Changed

New Contributors

Full Changelog: https://github.com/mr1charles/linux-ai-assistant-/commits/1.0