Test environment for contributing #3175

Closed

SirLouen started this conversation in General

SirLouen
Jun 30, 2025

Which is your preferred environment to test phpmailer for contributing?

Replies: 1 comment 2 replies

SirLouen
Jun 30, 2025
Author

I just set up a local mailhog server, andit appearss that a lot of local configs is going on here.
True is that most are skipped. Still, I would like to know what setup devs like to use around for this.

Example

``` There was 1 error:

PHPMailer\Test\PHPMailer\DKIMTest::testDKIMSigningMail
PHPMailer\PHPMailer\Exception: Could not instantiate mail function.

/home/user/src/php/PHPMailer/src/PHPMailer.php:2037
/home/user/src/php/PHPMailer/src/PHPMailer.php:1753
/home/user/src/php/PHPMailer/src/PHPMailer.php:1568
/home/user/src/php/PHPMailer/test/PHPMailer/DKIMTest.php:240

--

There were 3 failures:

PHPMailer\Test\PHPMailer\MailTransportTest::testSendmailSend
Could not execute: /usr/sbin/sendmail -t -i
Failed asserting that false is true.

/home/user/src/php/PHPMailer/test/PHPMailer/MailTransportTest.php:37

PHPMailer\Test\PHPMailer\MailTransportTest::testMailSend
Could not instantiate mail function.
Failed asserting that false is true.

/home/user/src/php/PHPMailer/test/PHPMailer/MailTransportTest.php:103

PHPMailer\Test\PHPMailer\PHPMailerTest::testEmptyBody
Could not instantiate mail function.
Failed asserting that false is true.

/home/user/src/php/PHPMailer/test/PHPMailer/PHPMailerTest.php:718

--

There was 1 incomplete test:

PHPMailer\Test\PHPMailer\AuthCRAMMD5Test::testAuthCRAMMD5
Test needs a connection to a server supporting the CRAMMD5 auth mechanism.

/home/user/src/php/PHPMailer/test/PHPMailer/AuthCRAMMD5Test.php:29

--

There were 38 skipped tests:

PHPMailer\Test\PHPMailer\DKIMTest::testDKIMSignOpenSSLNotAvailableException
Test requires OpenSSL not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/DKIMTest.php:251

PHPMailer\Test\PHPMailer\DKIMWithoutExceptionsTest::testDKIMSignOpenSSLNotAvailable
Test requires OpenSSL not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/DKIMWithoutExceptionsTest.php:41

PHPMailer\Test\PHPMailer\MailTransportTest::testQmailSend
Qmail is not installed

/home/user/src/php/PHPMailer/test/PHPMailer/MailTransportTest.php:49

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: single address without name" ('joe@example.com', array(array(array('', 'joe@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: single address with name" ('Joe User joe@example.com', array(array(array('Joe User', 'joe@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: single RFC2047 address folded onto multiple lines" ('=?iso-8859-1?B?QWJjZGVmZ2ggSW...e.com>', array(array(array('Abcdefgh Ijklmñ 會議室預約系統', 'xyz@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: single RFC2047 address with space encoded as _" ('=?iso-8859-1?Q?Abcdefgh_ijklm...e.com>', array(array(array('Abcdefgh ijklmñ', 'xyz@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: single address, quotes within name" ('Tim "The Book" O'Reilly <foo@...e.com>', array(array(array('Tim "The Book" O'Reilly', 'foo@example.com')), array(array('Tim The Book O'Reilly', 'foo@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: two addresses with names" ('Joe User joe@example.com, J...e.net>', array(array(array('Joe User', 'joe@example.com'), array('Jill User', 'jill@example.net'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: two addresses with names, one without" ('Joe User joe@example.com,Ji...e.com,', array(array(array('Joe User', 'joe@example.com'), array('Jill User', 'jill@example.net'), array('', 'frank@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Valid address: multiple address, various formats, including one utf8-encoded name" ('joe@example.com, <me@example....e.org>', array(array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('Название теста', 'encoded@example.org')), array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('=?utf-8?B?0J3QsNC30LLQsNC90Lj...gtCw?=', 'encoded@example.org')), array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('=?utf-8?B?0J3QsNC30LLQsNC90Lj...gtCw?=', 'encoded@example.org'))), 'utf-8')
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Invalid address: single address, incomplete email" ('Jill User <doug@>', array(array()))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Invalid address: single address, invalid characters in email" ('Joe User <{^c@**Dog^}@cartoon.com>', array(array()))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImap with data set "Invalid address: multiple addresses, invalid periods" ('Joe User <joe@example.com.>, ...e.net>', array(array()))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:65

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: single address without name" ('joe@example.com', array(array(array('', 'joe@example.com'))))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: single address with name" ('Joe User joe@example.com', array(array(array('Joe User', 'joe@example.com'))))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: single RFC2047 address folded onto multiple lines" ('=?iso-8859-1?B?QWJjZGVmZ2ggSW...e.com>', array(array(array('Abcdefgh Ijklmñ 會議室預約系統', 'xyz@example.com'))))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: single RFC2047 address with space encoded as _" ('=?iso-8859-1?Q?Abcdefgh_ijklm...e.com>', array(array(array('Abcdefgh ijklmñ', 'xyz@example.com'))))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: single address, quotes within name" ('Tim "The Book" O'Reilly <foo@...e.com>', array(array(array('Tim "The Book" O'Reilly', 'foo@example.com')), array(array('Tim The Book O'Reilly', 'foo@example.com'))))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: two addresses with names" ('Joe User joe@example.com, J...e.net>', array(array(array('Joe User', 'joe@example.com'), array('Jill User', 'jill@example.net'))))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: two addresses with names, one without" ('Joe User joe@example.com,Ji...e.com,', array(array(array('Joe User', 'joe@example.com'), array('Jill User', 'jill@example.net'), array('', 'frank@example.com'))))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Valid address: multiple address, various formats, including one utf8-encoded name" ('joe@example.com, <me@example....e.org>', array(array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('Название теста', 'encoded@example.org')), array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('=?utf-8?B?0J3QsNC30LLQsNC90Lj...gtCw?=', 'encoded@example.org')), array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('=?utf-8?B?0J3QsNC30LLQsNC90Lj...gtCw?=', 'encoded@example.org'))), 'utf-8')
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Invalid address: single address, incomplete email" ('Jill User <doug@>', array(array()))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Invalid address: single address, invalid characters in email" ('Joe User <{^c@**Dog^}@cartoon.com>', array(array()))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingNativeNoMbstring with data set "Invalid address: multiple addresses, invalid periods" ('Joe User <joe@example.com.>, ...e.net>', array(array()))
Test requires MbString not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:105

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: single address without name" ('joe@example.com', array(array(array('', 'joe@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: single address with name" ('Joe User joe@example.com', array(array(array('Joe User', 'joe@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: single RFC2047 address folded onto multiple lines" ('=?iso-8859-1?B?QWJjZGVmZ2ggSW...e.com>', array(array(array('Abcdefgh Ijklmñ 會議室預約系統', 'xyz@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: single RFC2047 address with space encoded as _" ('=?iso-8859-1?Q?Abcdefgh_ijklm...e.com>', array(array(array('Abcdefgh ijklmñ', 'xyz@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: single address, quotes within name" ('Tim "The Book" O'Reilly <foo@...e.com>', array(array(array('Tim "The Book" O'Reilly', 'foo@example.com')), array(array('Tim The Book O'Reilly', 'foo@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: two addresses with names" ('Joe User joe@example.com, J...e.net>', array(array(array('Joe User', 'joe@example.com'), array('Jill User', 'jill@example.net'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: two addresses with names, one without" ('Joe User joe@example.com,Ji...e.com,', array(array(array('Joe User', 'joe@example.com'), array('Jill User', 'jill@example.net'), array('', 'frank@example.com'))))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Valid address: multiple address, various formats, including one utf8-encoded name" ('joe@example.com, <me@example....e.org>', array(array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('Название теста', 'encoded@example.org')), array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('=?utf-8?B?0J3QsNC30LLQsNC90Lj...gtCw?=', 'encoded@example.org')), array(array('', 'joe@example.com'), array('', 'me@example.com'), array('Joe Doe', 'doe@example.com'), array('John O'Groats', 'johnog@example.net'), array('=?utf-8?B?0J3QsNC30LLQsNC90Lj...gtCw?=', 'encoded@example.org'))), 'utf-8')
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Invalid address: single address, incomplete email" ('Jill User <doug@>', array(array()))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Invalid address: single address, invalid characters in email" ('Joe User <{^c@**Dog^}@cartoon.com>', array(array()))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ParseAddressesTest::testAddressSplittingImapNoMbstring with data set "Invalid address: multiple addresses, invalid periods" ('Joe User <joe@example.com.>, ...e.net>', array(array()))
Extension imap is required.

/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128
/home/user/src/php/PHPMailer/test/PHPMailer/ParseAddressesTest.php:128

PHPMailer\Test\PHPMailer\ReplyToGetSetClearTest::testAddReplyToFailsOn8BitCharInDomainWithoutOptionalExtensions
Test requires MbString and/or Intl not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/ReplyToGetSetClearTest.php:412

PHPMailer\Test\PHPMailer\SetFromTest::testSetFromFailsOn8BitCharInDomainWithoutOptionalExtensions
Test requires MbString and/or Intl not to be available

/home/user/src/php/PHPMailer/test/PHPMailer/SetFromTest.php:197

</details>

2 replies

Synchro Jun 30, 2025
Maintainer

Local setup is indeed a little tricky. There are some notes in the examples readme about testing tools. I use HELO, and msmtp. The test suite uses postfix and smtp-sink. There are test combinations for all the different PHP versions and permitted extension configs (e.g. with/without imap). I have often thought about writing a testing SMTP server that works like badssl.com, allowing you to provoke specific server errors through client config.

SirLouen Jun 30, 2025
Author

I will look into all these tools. A dummy SMTP server like mailhog with status control would be a great idea definitely, ngl.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment