Repository navigation
Releases
v1.7.0
m365crawl v1.7.0
Mail reads again.
A compatible minor release on the stable 1.x line. Outlook for Mac mail reads recover on stores written since 2026-11-12, and the CLI gains a machine-readable command catalogue and safer write previews.
Added
m365crawl help --jsonprints every command with who sees its effect (privateorothers), whether it only reads, and its exit codes.- Every write takes
--why(the same as--reason), and--dry-runpreviews a write without sending or changing anything. m365crawl watch <chat> --timeout DURATIONwaits for a new message in one chat and answers await/1document, with a--cursorto wait again.
Fixed
- Outlook for Mac mail reads no longer fail with
outlook_mail_layout_unsupportedon stores that use the0x431message header and0x762body layouts. Every other unknown layout is still refused. For0x431messages the flag byte is not established, soflagreadsunknown. content fetch imageaccepts inline PNGs in Teams standard/private channel root posts (select the team with--team-idor a link'sgroupId; native channel export is not qualified here),content fetch streamlists native transcript candidates, browser commands with an already-cancelled context are safe, a closed pipe ends cleanly, andedit,deleteandremovename the command that does the real change.
Coverage and upgrade
No archive schema change. The mail mapper version rises to 6, so the next sync re-reads the Outlook store. Archived rows and tombstones are kept. Server completeness is not claimed.
Real-cache acceptance and native Windows checks for the new mail layouts were not part of this release's qualification; the installed-consumer recovery is reported separately on the issue.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.
On Windows, download m365crawl_1.7.0_windows_amd64.zip or m365crawl_1.7.0_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.6.0
m365crawl v1.6.0
One picture is worth its own bytes.
A compatible minor release on the stable 1.x line. Inspect a cached Teams message's image references offline, then explicitly export one selected PNG. Message text remains text; its media coverage now says so.
Added
content imagesinventories image references from one exact cached Teams message without calling the server or fetching bytes.content fetch image --image-id ID --output FILEexports one uniquely bound PNG through the optional WorkIQ source. It verifies the current account, chat, message and selected reference, validates the PNG bytes, rechecks the binding and closes the native reader before publication.- Output is private and never overwrites an existing file. Ownership and ACL checks use the open macOS/Windows file handles; an uncertain privacy result refuses the export instead of changing permissions. Error receipts say what was published or retained.
- Typed Teams message output discloses its returned-message media scope even with field projection. Search, calendar context and watch events retain their own bounded scope. Text export does not include image bytes or inspect the references.
Coverage and upgrade
No archive schema change or full resync is required. Image inventory is offline; explicit acquisition requires the optional WorkIQ source and a current binding to the selected message. Export does not change the archive.
One successful PNG export is not complete media capture. Other image formats, channels, OCR and automatic fetching remain outside this release. It does not establish historical immutability, complete server history or a complete transcript.
Successful native WorkIQ acquisition on Windows, several populated Windows Outlook content mailboxes and a live protected-document view-only refusal remain unverified. Windows artifact and filesystem checks are not native Microsoft 365 acquisition proof. No new source or access permission is granted.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.
On Windows, download m365crawl_1.6.0_windows_amd64.zip or m365crawl_1.6.0_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.5.2
m365crawl v1.5.2
Transcript coverage gets a clearer map, not a crystal ball.
A compatible patch on the stable 1.x line. Populated transcript output gains explicit coverage metadata; existing transcript text, fetching, grouping, projections and archive schema are preserved.
Added
transcripts showreportscoverage_scope: "discovered_parts"so a complete fetch is not mistaken for complete server discovery or recording speech coverage.- Each segment includes
notice_duration_secondsfrom its archived recording notice. A positive duration is a number; an unavailable or nonpositive duration isnull, not an invented estimate. - Plain transcript output names the same limited coverage scope.
completestill means every discovered part has fetched text.
Fixed
- Synthetic WorkIQ fetch-failure and recheck tests reuse existing real archive fixtures where appropriate, reducing repeated SQLite acquisition while retaining every fault sample, real handles, native-lock checks and existing deadlines. Crawler acquisition and required release gates are unchanged.
Coverage and upgrade
No special sync or archive migration is required for these diagnostics. Read an already archived call with m365crawl --no-sync transcripts show CALL_ID to inspect its discovered parts without an implicit sync.
A recording notice duration is metadata, not a measurement of how much speech the transcript contains. This release does not recover an undiscovered transcript tail, establish complete server history or acquire inline-image bytes. Unknown coverage remains unknown.
Successful native WorkIQ acquisition on Windows, several populated Windows Outlook content mailboxes and a live protected-document view-only refusal remain unverified. Windows artifact checks are not native Microsoft 365 acquisition proof. No new source or access permission is granted.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.
On Windows, download m365crawl_1.5.2_windows_amd64.zip or m365crawl_1.5.2_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.5.1
m365crawl v1.5.1
Mac mail finds its footing again after an Outlook cache-layout change.
A compatible patch on the stable 1.x line. Existing commands, flags, output fields and archive schema are unchanged.
Fixed
- Outlook for Mac mail sync reads the measured message-detail layout
0xc9/0x610alongside the existing0x60flayout. It uses the correct string base, rather than merely admitting the new tag, and continues refusing unknown or short layouts. - The mail mapper version advances so the next ordinary sync rereads an unchanged Outlook store and can recover from the earlier unsupported-layout failure.
- Writable archive opens share a read-only connection for their integrity checks, avoiding repeated SQLite schema setup within the unchanged short-writer deadline.
Added
- An agent field guide with a quick start, a worked coverage example, common read/write pitfalls and a privacy-aware handoff checklist.
Upgrade and coverage
Run an ordinary m365crawl sync after upgrading, then inspect its source results and m365crawl doctor. The layout fix does not prove complete mailbox or server history. Other unsupported layouts, including attachment 0x16a/0x31e, remain explicitly reported omissions; this release does not claim their acquisition.
WorkIQ service qualification on Windows, several populated Windows Outlook content mailboxes and a live protected-document view-only refusal remain unverified. No new source or access permission is granted by this patch.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.
On Windows, download m365crawl_1.5.1_windows_amd64.zip or m365crawl_1.5.1_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.5.0
m365crawl v1.5.0
Say which days the archive covers, fetch only the missing mail range through WorkIQ, and let a person turn on directed writes.
A compatible addition on the stable 1.x line. Existing commands, flags and field meanings are preserved. One default narrows on purpose: a read no longer syncs this machine's data into an archive this machine does not feed (see upgrade notes).
New
m365crawl coveragesays, per day and source (Sent Items, Inbox, chats, meeting chats, channels, calendar), whether the archive holds everything the app cached:covered,partialornot_covered, with an exact item count, reasons and a fix. Use--day, or--since/--untilfor up to 31 days.mail list,messages, boundedsearchand thecalendaragenda add the same verdict asrange_coverage, so a real zero can be told from a day the archive does not cover.workiq sync --source mail --since T [--until U]fetches only the server mail in that range, and can prove the range complete (--coverage proof). A mail read whose range the archive does not cover now routes to a window of exactly the missing range instead of a whole-account sync.- Directed writes through WorkIQ, off by default: send a Teams chat message, send new mail, reply, reply all, save, update or discard a mail draft, and add or remove a chat reaction (
m365crawl writes ...). Every write names the agent and a reason; a message counts as sent only once it is read back from the server, and an outcome m365crawl cannot establish isunknown(exit 5) and never resent. content fetch doc LINKreads one OneDrive or SharePoint Office file through WorkIQ, keeping text only when WorkIQ reports that the file's rights allow extraction. Sharedsearchincludes those documents.- Mail outputs add
folders, every folder a Mac mail message is in with its read state.
Fixed
- Mail on Mac no longer drops a message from
--folder sent(or any folder) because another copy of it changed more recently;mail foldersandmail unreadcount each copy where it is. - A message with a copy in Sent Items is dated by its send time in every list.
- Opening the archive for a sync, including each
watchtick, waits up to five seconds for another writer instead of failing with "database is locked". - An archive whose schema number reached a feature without that feature's tables reads as not having the feature instead of failing.
Upgrade notes
- Schema 30. The first writable open (a
sync, or a read that syncs first) migrates the archive to schema 30: a 1.4.0 archive from 22, a 1.3.0 archive from 20. The new tables hold WorkIQ documents, mail folder membership, the directed write log and WorkIQ mail windows. Read-only opens of older archives do not migrate. Older binaries refuse the newer archive (archive_newer). - Writes are off. Directed writes stay off until the person turns them on by typing
m365crawl writes onon the controlling terminal; agents never run it.m365crawl writes statusshows the switch, which is a file beside the archive, not part of the schema. The gates stop accidental writes; they are not a security boundary against an agent with shell access. - WorkIQ is still opt-in. It needs the separately installed, signed-in WorkIQ CLI; installing it, signing in and accepting its EULA are one-time human steps that m365crawl never performs. Ordinary reads, plain
syncandwatchnever launch it. - Reads on another archive no longer sync into it. A read syncs first only into the default archive or an archive this machine's sources feed. A read with
--dbon a scratch file, a copy, another machine's archive or a test archive answers from the archive as it is, withimplicit_sync: "foreign_archive"and a notice naming the explicitm365crawl --db PATH syncto run if you want this machine's data in it. A--dbpath with no archive is no longer created (implicit_sync: "no_archive"). An archive you already sync into keeps syncing; after moving one, runsyncon it once. - Fill a missing mail range with a window. When
range_coverageorcoveragereports mailnot_covered, its route gives the exactworkiq sync --source mail --since ... --until ...for that range, which fits on disk where a whole-account sync of a large mailbox does not.
Not claimed
A live view-only refusal for protected documents has not been observed yet. Native WorkIQ service qualification, WorkIQ on Windows, several Windows Outlook content mailboxes on real data and complete server history are not claimed.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.
On Windows, download m365crawl_1.5.0_windows_amd64.zip or m365crawl_1.5.0_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.4.0
m365crawl v1.4.0
Read Microsoft Scout history, reach older mail through optional WorkIQ, and say plainly when a read did not sync.
A compatible addition on the stable 1.x line. Existing commands, flags, defaults and field meanings are preserved; --max-age 0 keeps its 1.x meaning.
New
scout sync,scout list,scout search,scout showandscout sourcesread Microsoft Scout session history from your local OneDrive folder on macOS and Windows (Linux with--root). Only files already on the computer are read; cloud-only files are counted, never downloaded. Secrets in sessions are stored as[redacted].- Optional WorkIQ source, off by default:
workiq enable,workiq sync --source mail,workiq coverage,workiq statusandworkiq disableread server mail and chat counts through your separately installed, signed-in WorkIQ CLI. Ordinary reads, plainsyncandwatchnever launch it. A mail or chat read that asks for a range older than the local cache carriesworkiq_routeswith the exact commands to run next. --no-sync(orM365CRAWL_NO_SYNC=1) reads the archive as it is. Every sync-backed read now reportsimplicit_sync(ran,skipped_fresh,disabled,waited_for_other_syncorother_sync_in_progress), and a read that skipped its sync says so instead of looking fresh. Help, the agent guide and emitted follow-up commands now use--no-sync.- Windows new Outlook profiles with several content mailboxes read each mailbox into its own account (
outlook/<profile>/mailbox-2,-3, …). The first mailbox keepsoutlook/<profile>and its IDs; a mailbox that cannot be attributed is refused and nothing is applied. - Mail outputs add
dated_at,received_at_disagrees,older_copy,copy_ofandcurrent, andmail list --since/--untiladdsfolder_copies.
Fixed
--untilmeans the same on every date-bounded read: up to, but not including, the given time, and a date alone includes that whole day.- Sent Items are dated by when they were sent, in
mail list,search,mail threadand a calendar event'srelated_mail. - A message Outlook keeps in an old and a new folder set is listed and counted once.
- A closed Outlook no longer reads as healthy: reads past the cache's last write carry
outlook_cache_staleinsource_health, anddoctorwarns. - The
--no-synccaution on notes, documents, Loop and people reads names when the oldest source was last read (UTC), so the same archive gives the same answer every time. - Reads run in parallel wait for another run's sync instead of failing with
locked. Explicitsyncstill exits 4locked.
Security
- The Teams credential purge overwrites cleared values on disk, clears the write-ahead log, and drops credential-bearing record and Loop keys.
- The archive always runs with SQLite's
secure_deleteon, so replaced or deleted content is overwritten with zeros. - Whole Graph download URLs and temporary sign-in URL parameters are redacted. The new rules cause one full reread of unchanged desktop-cache records after upgrading.
Upgrade notes
- Schema 20 → 22. The first writable open migrates a 1.3.0 archive from schema 20 to schema 22 (21 adds the Scout tables, 22 the WorkIQ state). Read-only opens of older archives do not migrate. Older binaries are not promised to read the new schema.
- One-time rewrite. The first explicit
syncorwatchrewrites an archive written by an older version once (VACUUM), so nothing that version left in free space remains. It needs free disk space of about twice the archive's size. Without it, the sync report anddoctorsayvacuum_pendingwith the space needed, and a later sync tries again. A read's implicit sync never runs it. --no-sync. Use--no-syncwhere you meant "do not sync". For fresh data, runm365crawl syncfirst or keep a positive--max-age.--max-age 0still turns the implicit sync off, and its results now sayimplicit_sync: "disabled"with a notice.- WorkIQ is opt-in. It needs the WorkIQ CLI installed and signed in separately; installing it, signing in and accepting its EULA are one-time human steps that m365crawl never performs. Whole-account mail sync needs room for the whole mailbox (about 35 GB per 100,000 items) and is refused with
workiq_disk_spacewhen the archive's disk cannot hold it. Fetching only a date range is tracked in #262. Chats report counts only.
Not claimed
Native WorkIQ service qualification, WorkIQ on Windows, several Windows Outlook content mailboxes on real data (the single-mailbox path is qualified), complete server history and calendar support for several mailboxes per profile are not claimed.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or brew upgrade --cask m365crawl, or verify the matching Darwin tarball against checksums.txt. Darwin binaries are Developer ID signed and notarized by the normal release pipeline.
On Windows, download m365crawl_1.4.0_windows_amd64.zip or m365crawl_1.4.0_windows_arm64.zip, verify it against checksums.txt, unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.3.0
m365crawl v1.3.0
Read one Engage thread from the link someone shared.
- Add
content fetch engage-thread URLfor an Engage thread URL or a supported
Teams Engage deep link. Capture the observed starter and replies, native
authors and clocks, safe links and generic attachment metadata. - Keep immutable archived observations readable through
content show,
content search, sharedsearch --source contentand text output without
reacquisition. - Report partial coverage and losses explicitly. Unsafe signed or
credential-bearing values are omitted or redacted. Attachments are not
downloaded or classified into file/image types, and links grant no
extraction rights. - Wait for the requested browser document instead of accepting an already
completed previous document. Selected-thread capture can separately qualify
a fresh exact-target landing after a committed same-frame replacement, while
retaining final native account, target and generation checks.
The archive remains schema 20. Existing Home observations and source-health
behavior remain intact; this is not a promise that older binaries can read
the new selected-thread representations.
Native selected-thread acquisition is qualified on macOS with the tool-owned
browser. Native Windows service acquisition, interactive sign-in challenges,
every future native variant and all-server reply completeness are not claimed.
This adds no WorkIQ source or protected Office-document extraction.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or
brew upgrade --cask m365crawl, or verify the matching Darwin tarball against
checksums.txt. Darwin binaries are Developer ID signed and notarized by the
normal release pipeline.
On Windows, download m365crawl_1.3.0_windows_amd64.zip or
m365crawl_1.3.0_windows_arm64.zip, verify it against checksums.txt,
unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.2.0
m365crawl v1.2.0
Say when an archive answer is missing a source that stopped being read.
- Add
source_healthand matching notices to participating Teams, mail,
calendar, search and SQL reads, including offline reads and zero matches.
Health stays outside item projection with--fields. - Keep failures scoped to the sources and accounts each command actually reads.
Show the last successful read and newest known archive modification when
recorded; never invent an account or a historical timestamp. - Add
failed_source_healthto sync reports without changing existing sync
statuses. Keep interval-skipped failures visible and clear a failure only
with a qualified successful read. - Preserve legacy archive outcomes on read-only opens. Keep outcome-persistence
errors visible, including through implicit refresh and cancellation, rather
than claiming checked-empty health. - Track future mail, folder and attachment modifications independently of
published mail-state timestamps. - Fix Homebrew verification ordering without weakening trust or signature
checks.
Writable opens migrate the archive from schema 19 to schema 20. Older binaries
refuse newer archives; this is not a downgrade promise. Read-only legacy opens
do not migrate. Historical body or attachment write times that older versions
never recorded cannot be reconstructed.
This remains a local-cache reader, not complete server history. It adds no
WorkIQ source, protected Office-document extraction or support for several
Windows content mailboxes per profile. Existing source-admission and unknown
layout refusals remain intact.
Install
On macOS, use brew install --cask ourostack/tap/m365crawl or
brew upgrade --cask m365crawl, or verify the matching Darwin tarball against
checksums.txt. Darwin binaries are Developer ID signed and notarized by the
normal release pipeline.
On Windows, download m365crawl_1.2.0_windows_amd64.zip or
m365crawl_1.2.0_windows_arm64.zip, verify it against checksums.txt,
unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.1.1
m365crawl v1.1.1
Restore macOS Outlook mail and calendar reads after the October update.
- Read event layout
0x6b/0x459and mail-body layout0xca/0x752
alongside the older supported layouts. - Preserve established calendar identity and automatic links when an account
layout is unknown, rather than treating it as confirmed empty identity. - Keep a failed mail read visible as a stale-data notice in mail commands and
mail-participating search, including offline reads, zero hits and selected
fields. A successful mail read clears the failure. - Preserve offline search compatibility with older readable archives that do
not yet have retained failure storage.
Unknown layouts remain explicit. The observed account layout 0x49/0x1a12
and attachment layout 0x16a/0x31e are not newly supported. Attachment losses
remain partial coverage; neither the local cache nor this release promises
complete server history. Existing archive schema 19, public IDs, read-only
source handling and Windows mailbox-attribution guards remain unchanged.
Install
On macOS, use brew install ourostack/tap/m365crawl or
brew upgrade m365crawl, or verify the matching Darwin tarball against
checksums.txt. Darwin binaries are Developer ID signed and notarized by the
normal release pipeline.
On Windows, download m365crawl_1.1.1_windows_amd64.zip or
m365crawl_1.1.1_windows_arm64.zip, verify it against checksums.txt,
unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.
v1.1.0
m365crawl v1.1.0
Windows Outlook calendar support.
A compatible addition on the stable 1.x line. Existing commands, acquisition
defaults, public field meanings and archive schema 19 are preserved.
Windows Outlook calendar
- Read cached calendar events from the new Outlook WebView2 OWA store alongside
existing Windows mail support. Calendar queries, source counts and doctor use
the supported public paths. - Report calendar and mail read health independently. Retain an unlinked
calendar profile when sign-in identity cannot be verified; never guess its
account. - Preserve explicit unknown attendee responses, available decoded Preview text,
unresolved timezone labels and known UTC intervals. Retained uncertainty alone
is not an omitted event. Malformed fields, unsupported values, partial
attendees and unproved all-day dates still report loss. - Keep last-good calendar evidence after later failures. OWA calendar deletion
is not inferred, and HxStore-only block-health ratios are not applied to it.
The cache is not complete service history. Several populated content mailboxes
per Windows profile remain a separate, unsupported case with explicit attribution
guards; this release does not relax them. Sources remain read-only.
Install
On macOS, use brew install ourostack/tap/m365crawl or
brew upgrade m365crawl, or verify the matching Darwin tarball against
checksums.txt. Darwin binaries are Developer ID signed and notarized by the
normal release pipeline.
On Windows, download m365crawl_1.1.0_windows_amd64.zip or
m365crawl_1.1.0_windows_arm64.zip, verify it against checksums.txt,
unzip into a user-owned directory and run m365crawl.exe.
Windows binaries are intentionally unsigned.
The darwin binaries are Developer ID signed and notarized by Apple.
The Windows binaries are unsigned.