Repository navigation
Basic IMAP Without The Extension
Issues: #257 (Basic IMAP unavailable in the Docker image), #259 (is there a plan for IMAP?), and before them #50 Β· Module: Tickets β Mailboxes Β· From: the release after 4.10.0
This page is the decision record: what the problem was, what was considered, what was chosen and why. If the question "why doesn't FreeITSM just use the imap extension?" comes up again, this is the answer.
- How it works under the hood: Basic IMAP client - Developer Guide
- How it is tested, and how to verify it yourself: Basic IMAP client - Testing and verifying
- Setting up a mailbox: Basic IMAP / SMTP Mailboxes
Basic IMAP mailboxes used to read mail through PHP's imap extension. PHP 8.4 removed that extension from PHP itself, and the C library it is built on is no longer packaged by Debian 13 - which is what the Docker image runs. So Basic IMAP did not work in Docker, did not work on Debian 13, and on Windows meant hunting the internet for a DLL. FreeITSM now talks IMAP itself, in plain PHP. Nothing to install, on any platform, and one code path for Docker and everything else.
PHP's imap_* functions were never really PHP's own code. They were a thin wrapper around c-client, a C library from the University of Washington whose last release was in 2007. It had known security problems and nobody to fix them. In PHP 8.4.0 the PHP project removed the extension from PHP and moved it to PECL, the add-on repository, where it is kept alive but not developed.
That is a change to PHP, not to an operating system, so every platform felt it:
| Platform | What happened to Basic IMAP |
|---|---|
The Docker image (php:8.4-apache, Debian 13) |
Could not work. Debian 13 no longer packages c-client, so the extension cannot even be compiled into the image. docker/php-extensions.txt left it out on purpose (#207) |
| Debian 13 | No php-imap package at all. apt install php-imap - the command our own wiki gave - simply failed |
| Windows (WAMP / XAMPP) on PHP 8.4 | No php_imap.dll in the box. You had to find the right one on PECL - matching the PHP version, thread-safe or not, 64-bit - copy it in and edit php.ini. php.net itself warns that the thread-safe build Apache needs is not supported |
| Ubuntu 25.10, Debian 12, Ubuntu 24.04 | Still worked - Ubuntu packaged the PECL build, older releases are on PHP 8.2/8.3 |
So the feature worked best on old systems and worst on new ones, and the official Docker image - the easiest way to run FreeITSM - could not use it at all.
#50 was closed with better documentation: a per-platform table and Windows DLL instructions. That made the problem clear; it did not make it go away. #257 and #259 came back to the same wall from the Docker side - one with a workaround of rebuilding the image on Debian 12, which the reporter themselves called "not a clean solution".
| Docker | Windows | Debian 13 | For whoever runs it | |
|---|---|---|---|---|
| A. Build the Docker image on Debian 12 and compile the extension | β | β unchanged | β unchanged | Fixes one platform; ties the image to an older Debian (security support ends 2028) and to a 2007 C library |
| B. Ship the extension's binaries with FreeITSM | messy | one DLL per PHP version Γ thread-safety Γ architecture | one .so per distribution |
Still needs a php.ini edit - a web app cannot load an extension itself. A pile of binaries to build, ship and keep secure |
| C. Use an existing PHP IMAP library (e.g. Webklex PHP-IMAP) | β | β | β | Pulls in large dependencies (as far as we know: Carbon, parts of Symfony and Laravel). FreeITSM has no Composer - every library is copied in by hand and tracked in VENDOR.md for security updates |
| D. FreeITSM speaks IMAP itself, in plain PHP | β | β | β | Nothing to install. One code path everywhere |
"Bundle the extension" was the first instinct, and it is worth saying why it is not possible. An extension is compiled C code that has to match the exact PHP build it loads into, and it is loaded by PHP at start-up from
php.ini- not by the application. FreeITSM cannot carry it and switch it on. Option D is what "bundled" turns out to mean for a PHP application: the capability ships as PHP.
FreeITSM has its own small IMAP client, includes/imap_client.php. It is the same decision FreeITSM made long ago for sending: replies already go out through a small built-in SMTP client (imapSmtpSend()), not a mail library or extension. Reading now works the same way.
Why it is the right call for FreeITSM:
- Nothing to install, anywhere. It uses only what every PHP build has: network sockets, OpenSSL for encryption, base64 and quoted-printable decoding, and mbstring/iconv for character sets. The Docker image, WAMP, Debian, Ubuntu and shared hosting all have those.
- Docker and non-Docker cannot drift apart. There is one code path, and no part of it depends on the platform. A fix for one is a fix for all.
- The image stays on current Debian. No downgrade, no 2007 C library.
- It is the protocol FreeITSM needs, not all of IMAP. Sign in, list folders, open one, find unread mail, read it without marking it read, then mark it read, move it or delete it. About ten commands.
- Self-hosting is easier. For an open-source product other organisations run themselves, every native extension removed is one less thing that can go wrong on somebody else's server.
The hardest part of reading email is not the network conversation - it is MIME: an email can be nested parts inside parts, HTML with a plain-text alternative, base64 and quoted-printable encodings, a dozen character sets, inline images, attachments with names in any language. Writing a MIME parser is genuinely hard, and the advice when this was researched was "don't reinvent MIME parsing".
FreeITSM doesn't. IMAP servers already parse MIME, and will describe a message's structure and hand over one part at a time:
-
BODYSTRUCTURE- the server returns the message's tree of parts: types, encodings, character sets, filenames, which part is an attachment. -
BODY.PEEK[1.2]- the server returns just that part (here, the second part inside the first), without marking the message read. -
ENVELOPE- the server returns the sender, recipients, subject and Message-ID, with addresses already split into name, mailbox and domain.
This is exactly what the old extension relied on - imap_fetchstructure() and imap_fetchbody() were these same two IMAP requests. So the new client is like-for-like: the mail server (Dovecot, Exchange, Gmail, whatever the host runs) does the hard parsing, as it always did. What is left for FreeITSM is small and well-defined: undo base64 or quoted-printable on each part (built into PHP), convert character sets (built into PHP), and decode encoded headers and filenames.
The other way - fetch the whole raw email and parse the MIME locally - would have meant either writing a MIME parser or adding a library. The pure-PHP ones carry several dependencies, and the convenient one (php-mime-mail-parser) needs the mailparse extension - the same problem we were escaping.
When this approach was researched, four concerns came up. All four were right to raise.
| Concern | How it is handled |
|---|---|
| IMAP is more complicated than it looks - multi-line responses, unsolicited responses, length-prefixed literals, tags that must be matched, continuation requests, servers that differ | The client is built around exactly those: every command has a tag and the client reads until that tag comes back; unrequested lines along the way are kept or ignored; literals are read by byte count in both directions; capabilities decide between MOVE and the older COPY + EXPUNGE. All of it is tested against two different real servers - see Testing
|
| Email parsing is the biggest headache | The mail server does it (above). Nothing in FreeITSM parses raw MIME |
| Authentication can get complicated (OAuth2, SASL) | Not for this feature. Microsoft 365 and Google mailboxes already connect through their own APIs (Graph, Gmail) - not IMAP - and are unchanged. Basic IMAP exists only for username-and-password hosts, so the client needs plain LOGIN
|
| You become responsible for security | Certificates are verified with the same policy as every other outbound connection in FreeITSM. A server that refuses passwords on an unencrypted line (LOGINDISABLED) is never sent one. Every value sent is quoted or length-prefixed, so a password containing a line break cannot become a second command. Reads have timeouts and a size cap. Details in the Developer Guide
|
The research also suggested testing against Exchange Online, Gmail and Dovecot. Dovecot - what most cPanel hosts run - is in the automated tests, along with GreenMail. Exchange Online is not a target: Microsoft has switched off password sign-in for IMAP, and Microsoft 365 customers use the Graph connector anyway. Gmail works with an app password and is the recommended real-world check before a release.
-
Nothing to install. Basic IMAP works after upgrading, on Docker, Windows, Debian 13 and everywhere else. If you installed the
imapextension for FreeITSM, it is no longer used; you can leave it or remove it. - No settings change. Server, port, encryption, username, password, folder and post-import actions mean exactly what they did.
- Microsoft 365 and Gmail mailboxes are untouched.
- A few things now work that did not always before - folder names with accents, attachment names in other languages, clearer errors. The full list is in the Developer Guide.
- Basic IMAP client - Developer Guide Β· Testing and verifying
- Basic IMAP / SMTP Mailboxes - setting one up
- The Docker image was missing PHP extensions (#207) - how the image's extension list and its guard test work
FreeITSM β an open-source IT Service Management platform Β· github.com/edmozley/freeitsm Β· MIT licence
- Installation
- β° Scheduled tasks (cron jobs)
-
Architecture
- β³ π§Ή Root folder tidy (URL routing)
- β³ π Database Integrity (FKs & constraints)
- β³ π οΈ Database Verification β Developer Guide
- β³ π§© Service Layer (UI + API share code)
- β³ πͺ€ Code traps (the TRAP: comments)
- β³ π Commenting for the Engineering wiki
- β³ π οΈ Engineering wiki scanner - Developer Guide
- β³ π Service-Layer progress
- π€ Contributing (read before a pull request)
- π§ͺ Developer tests
- π PDF exports moved to PDFKit (#254)
- AI Providers
- Internationalisation (i18n)
- Timezones & Time Handling
- π Date & Time Formats
- π± Currencies
- π§ The sidebar (optional module rail)
- π§© Preference templates
- π Display order (modules, Watchtower cards) β Developer Guide
- Theming & Dark Mode
- ποΈ Recent β getting back to what you were doing
- β¨οΈ Command palette (βK)
- π Searching inside tickets
- π Attached documents
-
MobileβFriendly
- β³ π« Mobile: Tickets
- β³ π» Mobile: Assets
- β³ π Mobile: Calendar
- β³ π Mobile: Knowledge
- β³ π¦ Mobile: Service Status
- β³ πΌ Mobile: Watchtower
- β³ π§© Mobile: Problem Management
- β³ π Mobile: Change Management
- β³ πΏ Mobile: Software
- β³ β Mobile: Tasks
- β³ π Mobile: Forms
- β³ π Mobile: Contracts
- β³ π Mobile: Domains
- β³ π Mobile: People
- β³ π Mobile: Projects
- β³ ποΈ Mobile: Files
- β³ π Mobile: LMS
- β³ πΊοΈ Mobile: CMDB
- β³ πΊοΈ Mobile: Network Mapper
- β³ π§ Mobile: Process Mapper
- β³ βοΈ Mobile: Workflow
- β³ π₯οΈ Mobile: System
- β³ π Mobile: Reporting
- β³ π Mobile: System Wiki
- β³ π Mobile: Self-Service Portal
- β³ π§° Mobile: Techniques & Tricks
-
Security
- Layer 1 β which modules you can enter
- β³ π§© Module Access Control
- β³ π οΈ Module Access β Developer Guide
- β³ π Switching modules off
- β³ π οΈ Module availability β Developer Guide
- β³ π Module availability β design (#217)
- Layer 2 β what you can administer
- β³ π Roles & Permissions
- β³ π οΈ Roles β Developer Guide
- β³ π€ Why capabilities are constants
- Layer 3 β the System module
- β³ π Admin Access Control
- Hardening
- β³ π Security review response 2026-08
- β³ π‘οΈ Security hardening 2026-08
- β³ π οΈ Security hardening 2026-08 β Developer Guide
- β³ π‘οΈ Round three β plain English
- β³ π οΈ Round three β Developer Guide
- β³ π‘οΈ CSRF protection (S4) β Developer Guide
- Single Sign-On (SSO)
- ποΈ LDAP & Active Directory
-
π¦ Microsoft Entra ID
- β³ π₯ Importing people and groups
- β³ π» Intune: assets to their primary user
- β³ π’ Organisation chart
- β³ π οΈ Entra directory sync β Developer Guide
- β³ π οΈ Entra import - review (#235)
- β³ π οΈ Entra follow-ups - review (#237-#240)
- β³ π οΈ Intune primary user - review (#236)
- β³ π οΈ Organisation chart - review (#242)
- π CardDAV contact sync
- Browser Extension
- API Reference
-
π REST API β how it works
- β³ π Proposal: custom fields, inventory import and change evidence (#194)
- β³ π οΈ Custom fields, evidence + inventory - review (#195-#197)
- β³ π οΈ Long forms in a task's Work view - review (#198)
- β³ π οΈ Empty Procedures fold - review (#247)
- β³ π« REST API: Tickets
- β³ π» REST API: Assets
- β³ π΄ REST API: Problems
- β³ π REST API: Changes
- β³ π REST API: Knowledge
- β³ β REST API: Tasks
- β³ ποΈ REST API: CMDB
- β³ π REST API: Contracts
- β³ ποΈ REST API: Calendar
- β³ πΏ REST API: Software
- β³ π REST API: Domains
- β³ π¦ REST API: Service Status
- β³ βοΈ REST API: Morning Checks
- β³ π REST API: Forms
- β³ βοΈ REST API: Workflow
- β³ π·οΈ REST API: Cost centres
- β³ π§βπΌ REST API: Analysts
- β³ πΊοΈ REST API: Network Mapper
- β³ π§ Using the API docs page
- β³ π OpenAPI specification
- β³ β OpenAPI: kept correct
- β³ π οΈ Maintaining the catalogue
- Watchtower
-
Tickets
- β³ π οΈ Inbox.js map β Developer Guide
- β³ π οΈ Floating windows & the file viewer β Developer Guide
- β³ π οΈ Tickets settings β Developer Guide
- β³ π Simpler ticket and task forms - design (#218)
- β³ ποΈ The ticket workspace
- β³ π The ticket table
- β³ π Rota copy and paste β Developer Deep Dive
- β³ β Checklists & SOPs
- β³ βοΈ Mandatory fields
- β³ π§Ύ Custom ticket fields
- β³ π·οΈ Ticket categories
- β³ π§Ύ A type for every new ticket
- β³ π₯ Assigning tickets to a team, and escalation
- β³ π’ One board across every company
- β³ π Ticket dashboard β Developer Guide
- β³ Mailbox Authentication
- β³ π€ Email send log
- β³ π Attachment size limits and large emails
-
β³ Basic IMAP mailboxes
- β³ π Basic IMAP without the PHP extension (#257)
- β³ π οΈ Basic IMAP client β Developer Guide
- β³ π§ͺ Basic IMAP client β Testing and verifying
- β³ π οΈ Verifying a mail folder β Developer Guide
- β³ π οΈ Mailbox providers β Developer Guide
- β³ π οΈ How Gmail mail collection works β Developer Guide
- β³ Email rendering & images
- β³ SLA Management
- β³ WhatsApp channel
-
β³
βοΈ Telegram channel - β³ β CSAT company scope and filters β Developer Guide
- β³ π₯ Microsoft Teams channel
- β³ π¨οΈ Mattermost channel
- β³ π¬ Web chat channel
- β³ π£ Slack channel
- β³ π Linking tickets
- β³ β Record previews
- β³ π Ticket notes: internal or shared
- β³ ποΈ Canned responses
- β³ βοΈ Limiting replies to particular senders
- β³ π¨ Telling the analyst a ticket is theirs
- β³ βοΈ Email signatures
- β³ π The public web address
- β³ π’ Ticket numbering
- β³ π Raising a ticket for someone else
- β³ π Merging tickets
- β³ π Confidential tickets
- β³ π₯ Portal managers
- β³ π Who has seen a ticket
- β³ π Reading long tickets
- β³ β Splitting tickets
- β³ β Selecting several tickets
- β³ ποΈ The folder pane
- β³ π½ Just my tickets, or no closed ones
- β³ π οΈ Snoozing tickets β Developer Guide
- β³ π₯ Collision detection
- β³ β±οΈ Time tracking
- β³ π Case reports - a ticket and its work as one PDF
- β³ π Scheduled work in your own calendar
- Problem Management
-
Tasks
- β³ π οΈ Task board and subtasks β Developer Guide
- β³ π§βπ€βπ§ People on a task ("Involved")
- β³ π Repeating tasks
- β³ π’ Moving a task between companies
- π Projects
-
Assets
- β³ π’ Moving an asset between companies
- β³ π Shared asset locations
- β³ π§βπΌ Assigning assets to analysts
- β³ π Warranty and lease alerts
- β³ π Leases
- β³ π Saved table views
- β³ π¨οΈ Recording anything, and importing it
- β³ π§© Asset type layouts
- β³ π Inventory freshness
- β³ π Linked configuration item
- β³ π Connected assets
- β³ π Asset review
-
β³ π·οΈ QR asset labels
- β³ π οΈ QR asset labels β Developer Guide
- β³ π Asset label designer - design (#229)
- β³ π· Asset scanning β Developer Guide
- β³ π οΈ Asset tag numbering β Developer Guide
- β³ π οΈ Asset reconciliation β Developer Guide
- β³ π οΈ Reconciliation, tags + labels - review (#164)
- β³ π Who holds what, and handover documents
- β³ π₯οΈ The inventory agent (PowerShell)
- β³ ποΈ Proxmox VE servers
- β³ βοΈ VMware Cloud Director servers
- β³ πͺ Hyper-V and Failover Clusters
- β³ π Linking equipment to tickets
- β³ βοΈ Follow-up tasks on a ticket
- Knowledge
- Change Management
- Calendar
- Morning Checks
- Reporting
- Software
-
Forms
- β³ π¨ The form designer β Developer Guide
- β³ π Layout & the grid β Developer Guide
- β³ ποΈ Collections β grouping submissions
- β³ π Submissions as PDFs
- β³ β‘ What happens next β a form's own actions
- β³ π οΈ Sections & conditional logic β Developer Guide
- β³ π οΈ Lookup fields β Developer Guide
- β³ π‘οΈ Catalogue request approvals
- People
- Starters & leavers
- Domains
- ποΈ Files
- Contracts
- Service Status
- π Notifications
- π¨ War Room
- Self-Service Portal
- LMS
- Process Mapper
- CMDB
- Network Mapper
- Workflows
- Issue trackers (Jira, Azure DevOps)
- π‘ Zabbix (monitoring)
- π¬ Microsoft Teams alerts
- π 3CX (phone system)
-
System
- β³ π οΈ Preferences β Developer Guide
- β³ π Finding people in the Analysts list
- β³ πͺ When an analyst leaves
- β³ π οΈ System β Branding β Developer Guide
- β³ π©Ί Page health (D019) β Developer Guide
- β³ β Feature Bingo
- β³ π·οΈ Cost centres
- β³ π· Photo Album
- β³ Demo Data
- β³ π οΈ Demo Data β Developer Guide
-
Overview
- β³ π Progress tracker
- β³ Concepts & vocabulary
- β³ Email routing & mailboxes
- β³ Settings: global vs per-company
- β³ Users & self-service
- β³ Staff cross-company access
- β³ One company supporting another
- β³ π’ One board across every company
- β³ Worked examples
- β³ Pitfalls & gotchas
- β³ Scope: what it's for
- β³ π οΈ Developer Guide (make a module multi-company)
- β³ ποΈ Case study: CMDB (a linked graph)
- β³ π§ͺ Test harness (prove it's isolated)
- What this is
-
π Bugs resolved
- β³ π #255 Article previews showed HTML codes
- β³ π #252 A link to a Knowledge article did not open
- β³ π #254 PDFs could not print Polish
- β³ π #250 Clicking a folder left the open article on screen
- β³ π« #260 The dashboard cog did nothing
- β³ π« #248 A department rule never matched on four routes
- β³ π A directory account could be matched to someone else
- β³ π« #244 Reply went to the assigned analyst
- β³ π A lookup answer could name any record
- β³ π« #227 A mailbox could not be deleted
- β³ π« #226 A picture on a note could not be closed
- β³ π» #222 The Assets page never loaded in 4.3.0
- β³ βοΈ #214 A "contains" condition did not match capitals
- β³ βοΈ #216 A workflow email from a chosen mailbox always failed
- β³ π³ The Docker image was missing PHP extensions
- β³ π A failed DNS lookup read as a missing record
- β³ π A link could change data
- β³ π Access outlived its removal
- β³ π Knowledge articles could run scripts
- β³ π Knowledge writes ignored permissions
- β³ π Company boundaries (Oct 2026)
- β³ π Smaller gaps (Oct 2026)
- β³ π Escaped text could leave its attribute
- β³ π Task descriptions were not cleaned
- β³ π Task documents ignored company scope
- β³ π Repeating tasks ignored company scope
- β³ π¬ #183 Mailbox checks overlapped
- β³ π #188 Transfer lock shown off when unknown
- β³ β #184 Subtask names and Overdue
- β³ π§© #186 Teams: the buttons did nothing
- β³ π Text in a change could run script
- β³ π AI settings changed without the AI permission
- β³ πͺ #178 Deleting an analyst failed
- β³ π« A team with no departments showed 0 tickets
- β³ π Projects: adding a phase did nothing on Save
- β³ π Leavers could still sign in
- β³ πΌοΈ Logo and courses broke on Apache with PHP-FPM
- β³ π’ Chat tickets ignored your ticket numbering
- β³ π Dates shown as a dash, or in server time
- β³ π Assets β Users showed people from other companies
- β³ π Restricted analysts could read other modules' data
- β³ πΌοΈ Replies with a picture in the thread failed to send
- β³ π Reply attachments never reached the customer
- β³ π οΈ Outbound email attachments β Developer Guide
- β³ π A global SSO provider was missing from the portal
- β³ π Behind a proxy, the SSO redirect said http
- β³ βοΈ The portal tagline moved when you saved it
- β³ π¨ The portal settings screen forgot what you saved
- β³ π‘οΈ The approvals inbox said "Error" and nothing else
- β³ π A table's answers were missing from the PDF
- β³ β A single-select column let you tick every option
- β³ π The portal ignored a form's field widths
- β³ π The tasks board stopped taking clicks
- β³ ποΈ #121 The index list is out of date after upgrading
- β³ π #133 The calendar subscription was empty
- β³ π #131 Tasks always reopened on the board
- β³ π₯ #129 Every page returned HTTP 500 after upgrading
- β³ π³ #127 A PHP warning above the System page
- β³ π #126 Notes stamped with the server's clock
- β³ π Storing every date in UTC
- β³ πͺ The portal was down for everyone signed in
- β³ βοΈ #120 Workflow notes could never be written
- β³ βοΈ #123 Three errors when running Database Verification
- β³ π #122 The description box was a stub in the corner
- β³ π£ Demo data deleted real accounts
- β³ π #117 Sign-in redirected to the wrong address
- β³ π¨ #108 The priority dot was invisible
- β³ β±οΈ #116 Time logged from the right-click menu
- β³ π #114 API keys refused by our own guard
- β³ ποΈ #110 Assigning a task told nobody
- β³ πͺ #107 Signed out while still working
- β³ π #103 "Share with Requester" reached nobody
- β³ π #102 Search found nothing for hyphens
- β³ πͺ #101 Source code editor opened behind
- β³ βοΈ #88 Subtasks could not be ticked off
- β³ π» #84 Asset deep link selected nothing
- β³ π« #79 A new ticket arrived with no status
- β³ π§ #79 A ticket from email did not say so
- β³ π #78 Bell opened to nothing
- β³ π¬ #77 Mail only collected from Inbox
- β³ π #74 The default password could not be changed
- β³ π¦ #70 Renaming an impact level
- β³ π€ #67 App-only mailboxes could not send
- β³ π #45 Verify only ever worked for Microsoft
- β³ π #45 IMAP reported as not authenticated
- β³ βοΈ An email template stopped escaping itself
- β³ π The portal dashboard showed the wrong time
- β³ π’ The folder said 99 and the list showed 96