Repository navigation
v1.4.0
m365crawl v1.4.0
Read Microsoft Scout history, reach older mail through optional WorkIQ, and say plainly when a read did not sync.
A compatible addition on the stable 1.x line. Existing commands, flags, defaults and field meanings are preserved; --max-age 0 keeps its 1.x meaning.
New
scout sync,scout list,scout search,scout showandscout sourcesread Microsoft Scout session history from your local OneDrive folder on macOS and Windows (Linux with--root). Only files already on the computer are read; cloud-only files are counted, never downloaded. Secrets in sessions are stored as[redacted].- Optional WorkIQ source, off by default:
workiq enable,workiq sync --source mail,workiq coverage,workiq statusandworkiq disableread server mail and chat counts through your separately installed, signed-in WorkIQ CLI. Ordinary reads, plainsyncandwatchnever launch it. A mail or chat read that asks for a range older than the local cache carriesworkiq_routeswith the exact commands to run next. --no-sync(orM365CRAWL_NO_SYNC=1) reads the archive as it is. Every sync-backed read now reportsimplicit_sync(ran,skipped_fresh,disabled,waited_for_other_syncorother_sync_in_progress), and a read that skipped its sync says so instead of looking fresh. Help, the agent guide and emitted follow-up commands now use--no-sync.- Windows new Outlook profiles with several content mailboxes read each mailbox into its own account (
outlook/<profile>/mailbox-2,-3, …). The first mailbox keepsoutlook/<profile>and its IDs; a mailbox that cannot be attributed is refused and nothing is applied. - Mail outputs add
dated_at,received_at_disagrees,older_copy,copy_ofandcurrent, andmail list --since/--untiladdsfolder_copies.
Fixed
--untilmeans the same on every date-bounded read: up to, but not including, the given time, and a date alone includes that whole day.- Sent Items are dated by when they were sent, in
mail list,search,mail threadand a calendar event'srelated_mail. - A message Outlook keeps in an old and a new folder set is listed and counted once.
- A closed Outlook no longer reads as healthy: reads past the cache's last write carry
outlook_cache_staleinsource_health, anddoctorwarns. - The
--no-synccaution on notes, documents, Loop and people reads names when the oldest source was last read (UTC), so the same archive gives the same answer every time. - Reads run in parallel wait for another run's sync instead of failing with
locked. Explicitsyncstill exits 4locked.
Security
- The Teams credential purge overwrites cleared values on disk, clears the write-ahead log, and drops credential-bearing record and Loop keys.
- The archive always runs with SQLite's
secure_deleteon, so replaced or deleted content is overwritten with zeros. - Whole Graph download URLs and temporary sign-in URL parameters are redacted. The new rules cause one full reread of unchanged desktop-cache records after upgrading.
Upgrade notes
- Schema 20 → 22. The first writable open migrates a 1.3.0 archive from schema 20 to schema 22 (21 adds the Scout tables, 22 the WorkIQ state). Read-only opens of older archives do not migrate. Older binaries are not promised to read the new schema.
- One-time rewrite. The first explicit
syncorwatchrewrites an archive written by an older version once (VACUUM), so nothing that version left in free space remains. It needs free disk space of about twice the archive's size. Without it, the sync report anddoctorsayvacuum_pendingwith the space needed, and a later sync tries again. A read's implicit sync never runs it. --no-sync. Use--no-syncwhere you meant "do not sync". For fresh data, runm365crawl syncfirst or keep a positive--max-age.--max-age 0still turns the implicit sync off, and its results now sayimplicit_sync: "disabled"with a notice.- WorkIQ is opt-in. It needs the WorkIQ CLI installed and signed in separately; installing it, signing in and accepting its EULA are one-time human steps that m365crawl never performs. Whole-account mail sync needs room for the whole mailbox (about 35 GB per 100,000 items) and is refused with
workiq_disk_spacewhen the archive's disk cannot hold it. Fetching only a date range is tracked in #262. Chats report counts only.
Not claimed
Native WorkIQ service qualification, WorkIQ on Windows, several Windows Outlook content mailboxes on real data (the single-mailbox path is qualified), complete server history and calendar support for several mailboxes per profile are not claimed.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.
On Windows, download m365crawl_1.4.0_windows_amd64.zip or m365crawl_1.4.0_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.