Skip to content

v1.4.0

Choose a tag to compare

@github-actions github-actions released this 31 Oct 09:38
· 187 commits to main since this release
c7343a3

m365crawl v1.4.0

Read Microsoft Scout history, reach older mail through optional WorkIQ, and say plainly when a read did not sync.

A compatible addition on the stable 1.x line. Existing commands, flags, defaults and field meanings are preserved; --max-age 0 keeps its 1.x meaning.

New

  • scout sync, scout list, scout search, scout show and scout sources read Microsoft Scout session history from your local OneDrive folder on macOS and Windows (Linux with --root). Only files already on the computer are read; cloud-only files are counted, never downloaded. Secrets in sessions are stored as [redacted].
  • Optional WorkIQ source, off by default: workiq enable, workiq sync --source mail, workiq coverage, workiq status and workiq disable read server mail and chat counts through your separately installed, signed-in WorkIQ CLI. Ordinary reads, plain sync and watch never launch it. A mail or chat read that asks for a range older than the local cache carries workiq_routes with the exact commands to run next.
  • --no-sync (or M365CRAWL_NO_SYNC=1) reads the archive as it is. Every sync-backed read now reports implicit_sync (ran, skipped_fresh, disabled, waited_for_other_sync or other_sync_in_progress), and a read that skipped its sync says so instead of looking fresh. Help, the agent guide and emitted follow-up commands now use --no-sync.
  • Windows new Outlook profiles with several content mailboxes read each mailbox into its own account (outlook/<profile>/mailbox-2, -3, …). The first mailbox keeps outlook/<profile> and its IDs; a mailbox that cannot be attributed is refused and nothing is applied.
  • Mail outputs add dated_at, received_at_disagrees, older_copy, copy_of and current, and mail list --since/--until adds folder_copies.

Fixed

  • --until means the same on every date-bounded read: up to, but not including, the given time, and a date alone includes that whole day.
  • Sent Items are dated by when they were sent, in mail list, search, mail thread and a calendar event's related_mail.
  • A message Outlook keeps in an old and a new folder set is listed and counted once.
  • A closed Outlook no longer reads as healthy: reads past the cache's last write carry outlook_cache_stale in source_health, and doctor warns.
  • The --no-sync caution on notes, documents, Loop and people reads names when the oldest source was last read (UTC), so the same archive gives the same answer every time.
  • Reads run in parallel wait for another run's sync instead of failing with locked. Explicit sync still exits 4 locked.

Security

  • The Teams credential purge overwrites cleared values on disk, clears the write-ahead log, and drops credential-bearing record and Loop keys.
  • The archive always runs with SQLite's secure_delete on, so replaced or deleted content is overwritten with zeros.
  • Whole Graph download URLs and temporary sign-in URL parameters are redacted. The new rules cause one full reread of unchanged desktop-cache records after upgrading.

Upgrade notes

  • Schema 20 → 22. The first writable open migrates a 1.3.0 archive from schema 20 to schema 22 (21 adds the Scout tables, 22 the WorkIQ state). Read-only opens of older archives do not migrate. Older binaries are not promised to read the new schema.
  • One-time rewrite. The first explicit sync or watch rewrites an archive written by an older version once (VACUUM), so nothing that version left in free space remains. It needs free disk space of about twice the archive's size. Without it, the sync report and doctor say vacuum_pending with the space needed, and a later sync tries again. A read's implicit sync never runs it.
  • --no-sync. Use --no-sync where you meant "do not sync". For fresh data, run m365crawl sync first or keep a positive --max-age. --max-age 0 still turns the implicit sync off, and its results now say implicit_sync: "disabled" with a notice.
  • WorkIQ is opt-in. It needs the WorkIQ CLI installed and signed in separately; installing it, signing in and accepting its EULA are one-time human steps that m365crawl never performs. Whole-account mail sync needs room for the whole mailbox (about 35 GB per 100,000 items) and is refused with workiq_disk_space when the archive's disk cannot hold it. Fetching only a date range is tracked in #262. Chats report counts only.

Not claimed

Native WorkIQ service qualification, WorkIQ on Windows, several Windows Outlook content mailboxes on real data (the single-mailbox path is qualified), complete server history and calendar support for several mailboxes per profile are not claimed.

Install

On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.

On Windows, download m365crawl_1.4.0_windows_amd64.zip or m365crawl_1.4.0_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.

The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.