Notifications: Mails classified as spam by gmx

[1u]

related: #874, #802

Html mails from Openki go into spam with reason: 6 (nemesis text pattern profiler); Detail=V3; (most other mails recognized as Junk have same text there)
I think all html mails go into spam in all gmx accounts. Can someone confirm in order to define priority of this problem?

Content-Type: text/html; charset=utf-8
Subject: [Openki] Private message from greg
DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mail.openki.net; q=dns/txt; s=smtp; t=1517857287; h=MIME-Version: Date: Content-Transfer-Encoding: Message-ID: Subject: To: Sender: From: Content-Type; bh=rmWxmmQe7gHbsUbtiXjvXLNmqJnU8gQFKyTl0NBLYCY=; b=itu4bRnST8koq9etAgycBkphHij7mfQJSBVOXnocs0tIhdpvUcoZKTLn8Ng/sSQvLmlePCyb wZb8C7tM0A6dcj6PUj7CykYL2UModPwrktMjF9zZ1LgBIaMWha8s6OBAOs3PKFvB4WGf/Xyq xSL6T2IIJuN63NazVxV4zq5ptVA=
X-GMX-Antispam: 6 (nemesis text pattern profiler); Detail=V3;
X-UI-Filterresults: junk:10;V01:K0:2hp2TGwjjHg=:G+F7Ms/vrRNhTTZ+BtF13Q8nrw7b oojOC2iGwPE14uAjctORiCdUOEY5zXa/enanXqfC5SgJjvN0+ty9kYk0Sa+HQyHeVWOcuQd6r jz6Ac38HpwaKOQgqQ7ZitNK5cZ6v623ncE1q7p820w6W+hC7/T3mfcXQO5kUUUVpgF6zzo5jK dnxiD+ayRKlBOJdNC/BNFdKP72zgQZlWA7QwGec/0b4EWtYa6BQY3FAhzmpTQAFn3Rs7BSxha +QCeqvzwm1fqE85wVBJpSxPns4LEGOGn9FaEc2V35uG4MTHVU84+NAd2FIHc896qjRQGSXFBK hwc/+D+gnUU+utSx31NzdjgltDnM7Gy8w4j/PDhTDS5NSci0OC7/oYNTZ5/IsgHcvjwIM9pDQ hJyHxQImiiBmQp0JHsf5vXvIMcSGpj1igxIFzYTqu0aDHVjEuWu1qLX7Wu1YpZQCjkQWWKoUs wgY02wKvfZhIJ2aby/NOnfLZqBAgvyBeV23EVPMHccr3hxYC+AX2bZlCZrj6NhXxW1VMRUiOK 0KmU6TOveDEZgQS/d2qTMGEV0jYid8y8TJgRmVhT6mz+3QjojbCIOSTFKwa5yWBRJ+GI3mLvz 0ugOWmRPX622tU7BVLGN/KdjsWj13k5WnBigcYldcYWFgMiT+E75rdzCqFeP/nJYLSSWbUvrC LJGENknwftnpJNnCP2WFNY65PqlgEKo4zetIXPHsp2JpjoH70T37MSbv25w7KaBCvWUdOrQHs J33jQzN6eRF3Wvvl7xCFlWdB37Sohq0rLhzTwupglKUc+fU8js785aIv3jc7ZK7uniehaxDAL /JVS05lBqAfaxs9fphGGJKTqN4iODRJq+VjhFv0V2TIdeTXdew/ho+6/BJBfyiOv4XkumPrhA AqiBkDZRIG3VlZ2IpL6HAWRJ9RZZPSY5eDsvpOeIfNYgLFfJB92yYpOZ5kFEoZno9I1K12aHq IxK9F2krKnWbijsGVy1YVJPidLESqiM8kWBJAGk5xdW12CGhVPweFgDiwcXYh0KK9SDlVp5xn bxYQw7TJjiaVsXL47DHbdvlWWM55CUzsgT1v8g5SqI4FWW2UmdVoYdAXr9e67SHPdY5D9NAEV 5yL49utwf2wi6NsCKx/oZhqxcIDFzxCaPkJaRi09GCZ/uRMI8f1FbWs556isoULiCf5r7xQfr nFUVqJb5VlhVeVJChHk8S6IxNjx37Cf5Wcr6ImU6RqgzMA6DFM6OhzGyohldiKSEeYamS7YP4 C95rnKNkhgLmRd01ELAUuA/1puz82R56y516ZFCucDmoQZrRD4TDY8TRJo4J3il3Mf5Jn+az2 OnEn7d5SHSyE4fKCO6B7vX7pIScKj0ZBOVhrgbztC17Rti7reiQtZyblSbS9AqX+vkqXVhP0B o+O0Bn5GXWmFNMjtMyRztOHAEyRA8Jo24yBIc7QprCU5k5YORpCOdLPS6+SNtJY8P6mrdnzu2 HULf5gTl4uOxPJmeVbL/FplmvrLyrz4dQExtIt6b0w83+abkRlIxJeGzpR29OIiiEz5i3q+mS YV33HCrzpRjxLYQM18GafaMX6VWaKlz3JbhCFgwaXQ6Pb5z7ZU6O3y/ngbKVsE2fgYwv/rbnw hUkg80hKGGMyPH9qp8DnxjJmi9BwsIUHQ9bulS9KdzeVUTp0+1tr1SMkcjagO0iQamVWl6gsW /UB4TaSUVVaF3ixiYDLlWqcAlbMnGmnihgV37BAJfb/nQVfu7DhIT1ocVdFx8LXq43JdE3wUB pScnPZwTXnXGbyLXnyqbU/k3J+KSiu96NA==

this one didn't:

Content-Type: text/plain
Subject: Reset your password on Openki
DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mail.openki.net; q=dns/txt; s=smtp; t=1517857782; h=MIME-Version: Date: Content-Transfer-Encoding: Message-ID: Subject: To: From: Content-Type: Sender; bh=oKUJN/Zp/axIt1TxpObfXxRaDXYHFFxDfStAEWtaZjs=; b=FX1PFwSPC0pzPgAuqHJeRMhFcjpj4gvTYc+HRaJgHiDBocQI+TfwFy+9tDjfQ4uLEIMQD8Vp gDs02VzFwyXVE5gV8G8/aSoASesN3KgQMgRpyt3LTxL717ogfj4Bry+pPxOHKJMu3s6lFAdF xkhfs5XMhVVNdzd/8gqJKybgroE=
X-GMX-Antispam: 0 (Mail was not recognized as spam); Detail=V3;
X-UI-Filterresults: notjunk:1;V01:K0:E+67RFQNlC8=:wfCyEvRQIf1Qg1xCghnW2ks5V8 U0pkQ9zA7JmK7Trq4Qjg3oTOOqKb70H3q/5DmPDcXuaU8yfoWaZWb0V659TVDbGp437jNcVGm p9k6O/owYlLtmcQbGjvRsNlvDJGZMCGjJILDLIyiKVMIE2rxzAaYUPuhtnKaSx19RbnrAnZsQ aQHgnJQrT243vL1QPkbulfuBoS1kQ8/r8q7cUDD6rxvg74hxM+EyVaqPh1WyguUwrNOWF3tZN K+O5yvp0YTq8cciAY7tNYzu7xVvqo/BLVGph2CSMe+azRrNd1tP627GvOoDrJUoP1Afg/JwFY 69xhBLUJ+VmBmRe37IYkTshdRUM+nJcno/XHeTIUKb/27S9A2zfFht/lCe9gfPLXCWpnPaoKe 77OVcqYHrRObb7nE2T1PTLYTkZh9SFBtyqfWBkzBYMUgVOwcERj51WsjNdt0IZT2168tvuFu6 2kRF4KAg+I4vSOFOd14eSpFy+6zpgkCNvWDkq83p8KmCc3Nx1cKBm1hRK5OKaE5f3MqG8uSCd Ew+4XfJClVK7xGe8/b9yZ04EaTFzJ3435nc4IXaHaAB9XcSUSJuUHsLzblxWHAG7GwyL6HfHK peJnMk8utaKljvxHrz3MFfaXEJlyLGsVe3phNeLX/2R5FDoEBZt+3TYJx5AwNsHNktjGRhLud 8/8iNd9/0SOrsY/xFu55YjCe9iAdi9FSiZSDeo6WfqWHKb75px7NMUN2iKO+YF4aRjBfTB3EK Al8hVJF1+eFDd0dz65bzbcV9UCvosNp4PZ/SLT19cugz2eiV0RDnyCPBaMpAPwYjzYpAkmhjm DBCN4HloHTwJEo7MbkygUyR299O+wTDhiNR9Z8fDht3hwSfwS2j9SY+4qsmswRf4Id94O10NJ cwZDEm4SCziaGFV70a9C9ADuFzAW1jrfcQkvpRRe/Zm966CwZ0DW7eDCWmefovc6LXdHITBhv kASG36BSW+zzw4cNneBnKaIgACWXFH37Cp7shkVg/kuOYbV2Tu+wxO7Xc5yG2Z5G8HbLfvyJ1 OxjTFJGZjNAsgmr0pVq0gQY6Sbt0TYfQS3x3RBvMnp+MYumwfIshOJehDyj1zbvnBx4/5aTTg xuuJhOviQ2FSDNkWMc8sA3SUo6EmPydv0dMqntnKHmwyHEtsKnjXg6BLmqmunpJbpQkxgleb9 QAP0we5LoJyQw2VoFL/FuTsaKwbWxTcPAPJLVLT3ErYRsAkTnVdSLwuBjM92R8uBbVDJWxJ3F DMrKbsuDSax4C03IAEStz6jbCIRgM/BfXNq0LmdBRwelViHszBCqcp9Les+Iu1J5D0w9Qzf4C yrl5pte8/PWrbfQtpnAK+omQODQDxqtjO3qHoCEagryD3Ym1Qi92/O3TN+ccHIg6iFPwRNvcz wSUjlCydXu25FIg0rxiy/k0LHjFLrM9t6QuLLpV5ET38se5sFqa6Ufy84K41RoCB1h8Rv6tL8 NDaeEK1mJT2KvEliYH6IalUrfJjXHG/g+KLUfUSRrGhzAINCUZCh5bjAMO1O21MBLBw3wNvod gk6GWGC+4QlP32UcWI4BU+poNYYBKQu/rdKrQ5KM9tDwW41ZKd4lWqqEQnfmSNhBzNaFJrWiG WnCKG/a9x1PesPgY+uEQ4XT8ImE8/6rO9EzssBmWzJaueeih+gUh9UpuT8iybCP6alxiT/ky5 R3ZK9qy2oT9gpzUiCiuCegEIBmDE455wzk87FbDXvWXd1kyAHcvUwucM52a7aTzkBqmnH4B4F U1eFxftRLxAmFdkF5Hcx61AYfNZSo3evrhLQ==

[ammoniak]

The spamcheck on my server reports the following:

Return-Path: bounce+xxxxxxxxxxxxxxx-xxxxx@mail.openki.net
X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on RTH
X-Spam-Level: 
X-Spam-Status: No, score=-0.6 required=6.3 tests=BAYES_00, RCVD_IN_BL_SPAMCOP_NET,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,URIBL_BLOCKED
 autolearn=no autolearn_force=no version=3.4.0
DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mail.openki.net; q=dns/txt; s=smtp;
 t=1517903665; h=MIME-Version: Date: Content-Transfer-Encoding: Message-ID:
 Subject: To: From: Content-Type: Sender; bh=2YSPoEUxZArqpsqrLW/vgWyiCqYKMrgdvfaWcemyyNw=;
 b=ixOPdRqbhattfR2UIy3UL/p8Kc2YSCNqtvz78CURuu43/SP8S7jd6RMcePVhAlrV2iTHaQb+
 LVraaWRlro38goZMKbUy6yVx2jFZXbgCo/gXWlULwDUImwoukbpmYpQPrrCYLbT7GEf1N2ou
 DYJI6TgjLZCpLsAA+abc8cR7+UE=
X-Mailgun-Sid: WyJlZTM3NyIsICJvcGVua2lAZXNoZWVwLmNoIiwgImU0ZTZmMiJd
X-Mailgun-Sending-Ip: 209.61.151.234
Sender: openki@mail.openki.net
Content-Type: text/plain
From: "Openki.net" <openki@mail.openki.net>
To: xxxxxxx@xxxxxx
Subject: Welcome to the Openki community, 
Message-ID: <e9de53da-22a6-c5e9-677b-42f1dd8452f8@mail.openki.net>
Content-Transfer-Encoding: quoted-printable
Date: Tue, 06 Feb 2018 07:53:59 +0000
MIME-Version: 1.0

This indicated that your sending IP is on a blacklist.
The following page seems to confirm that:
https://mxtoolbox.com/SuperTool.aspx?action=blacklist%3a209.61.151.234&run=toolpage

[ammoniak]

The above Email was from the verification process. The line below is from the "private message":
It might be an issue with the remote images.

X-Spam-Status: No, score=0.2 required=6.3 tests=BAYES_00,HTML_IMAGE_ONLY_32, HTML_MESSAGE,MIME_HTML_ONLY,RCVD_IN_BL_SPAMCOP_NET,RCVD_IN_MSPIKE_H3,
 RCVD_IN_MSPIKE_WL,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0

[1u]

@ammoniak nice! thx for these additional informations. So it's not only the html...
@Openki/seniors someone knows some first steps we could try?

[ammoniak]

This is a good starting point: Mailgun best practises

[1u]

@Openki/contributors who would like to take some responsibility here?

[ammoniak]

I don't have much experience with mailgun and none at all with the current openki server setup. I'm willing to help you, but someone who's familiar with the setup/configuration should have a closer look at it.

[sbalmer]

I see two things that could improve our situation:

1. Switch from free mailgun to another provider or self-host our smtp-sender.
2. Switch to plain-text or plainer-html version for our mails.

The first point means setting up a mailserver and reconfiguring our app to use that. Not a biggie but it means we'll be operating a mailserver. Just another service to watch. I'm also not sure it would help much. Or maybe the paid tiers get cleaner send-hosts with Mailgun, so we could just seitch to a paid version?

With the second point we would lose some liberties in layout. The fact that we include an external resource is not-nice anyway. We could either include the logo or just drop it.

[1u]

@ammoniak you can get in contact with one of us to get our mailgun credentials. Though it seems to me there is not much to find out in the interface there.
related: #933 (Summarize notifications) -> how receivers treat the mails in case they should receive many.
and mentioned above: #874 (Include requesting users to add our sender address to their address-book)
and #802 (Email: Verification mail classified as spam by Apple Mail)

[ammoniak]

Ok. I'll give it a shot.

[ammoniak]

Ok. After going over the entries and configuration, etc. I came to the following conclusion:

• The Api works fine, everything is properly configured.
• One issue which can cause trouble: Since we use the free tier of the mailgun api we share our IP with others. This is a small issue, since all the DKIM, and SPF configs/entries/settings are done properly.
• A bigger issue: The image in the email. As statet before, either include the image as attachment and link to the attached file or don't include the image at all. Same goes for external CSS files, etc.

[sbalmer]

@ammoniak thanks for the detailed analysis. We should try removing the external reference and see whtether that improves things.