Problem with mercure in production

[farestayari]

Hello,

after the deployment of the project on the server without https:

SERVER_NAME=my_ip_adresse:80 APP_SECRET=ChangeMe CADDY_MERCURE_JWT_SECRET=ChangeThisMercureHubJWTSecretKey docker compose -f compose.yaml -f compose.prod.yaml up -d --wait
the deployment is completed successfully and the project is running fine, but i got problems with mercure, all my mercure events are stuck on status pending as you can see in the screenshot below

here is my docker compose file, and i already replaced https with http :
`services:
php:
image: ${IMAGES_PREFIX:-}app-php
restart: unless-stopped
environment:
SERVER_NAME: ${SERVER_NAME:-localhost}, php:80

  MERCURE_PUBLISHER_JWT_KEY: ${CADDY_MERCURE_JWT_SECRET:-!ChangeThisMercureHubJWTSecretKey!}
  MERCURE_SUBSCRIBER_JWT_KEY: ${CADDY_MERCURE_JWT_SECRET:-!ChangeThisMercureHubJWTSecretKey!}
  # Run "composer require symfony/orm-pack" to install and configure Doctrine ORM
  # Run "composer require symfony/mercure-bundle" to install and configure the Mercure integration
  MERCURE_URL: ${CADDY_MERCURE_URL:-http://php/.well-known/mercure}
  MERCURE_PUBLIC_URL: ${CADDY_MERCURE_PUBLIC_URL:-http://${SERVER_NAME:-localhost}/.well-known/mercure}
  MERCURE_JWT_SECRET: ${CADDY_MERCURE_JWT_SECRET:-!ChangeThisMercureHubJWTSecretKey!}
  DATABASE_URL: postgresql://${POSTGRES_USER:-xxx}:${POSTGRES_PASSWORD:-xxxx}@database:5432/${POSTGRES_DB:-xxxxx}?serverVersion=${POSTGRES_VERSION:-15}&charset=${POSTGRES_CHARSET:-utf8}
  MESSENGER_HIGH_PRIORITY_DSN: amqp://guest:guest@rabbitmq:5672/%2f/high_priority
  MESSENGER_TRANSPORT_DSN: amqp://guest:guest@rabbitmq:5672/%2f/messages
depends_on:
  - rabbitmq
volumes:
  - .:/app:rw
  - caddy_data:/data
  - caddy_config:/config
ports:
  - target: 80
    published: ${HTTP_PORT:-80}
    protocol: tcp
  - target: 443
    published: ${HTTPS_PORT:-443}
    protocol: tcp
  - target: 443
    published: ${HTTP3_PORT:-443}
    protocol: udp
networks:
  - my-network`

in my env file i tried these attemtps :

###> symfony/mercure-bundle ###
# See https://symfony.com/doc/current/mercure.html#configuration
# The URL of the Mercure hub, used by the app to publish updates (can be a local URL)
#MERCURE_URL=[http://192.168.xx.xx:80/.well-known/mercure]
# The public URL of the Mercure hub, used by the browser to connect
#MERCURE_PUBLIC_URL=[http://192.168.xx.xx:80/.well-known/mercure]
# The secret used to sign the JWTs
#MERCURE_JWT_SECRET="!ChangeThisMercureHubJWTSecretKey!"
##< symfony/mercure-bundle ###

MERCURE_URL=http://localhost/.well-known/mercure
# The public URL of the Mercure hub, used by the browser to connect
MERCURE_PUBLIC_URL=http://localhost/.well-known/mercure
# The secret used to sign the JWTs
MERCURE_JWT_SECRET="!ChangeThisMercureHubJWTSecretKey!"
##< symfony/mercure-bundle ###

and this is the mercure config :

mercure:
    hubs:
        default:
            url: '%env(MERCURE_URL)%'
            public_url: '%env(MERCURE_PUBLIC_URL)%'
            jwt:
                secret: '%env(MERCURE_JWT_SECRET)%'
                publish: '*'

when i click on the mercure link for testing http://192.168.xx.xx:80/.well-known/mercure on a new tab is giving me a message missing topic ( which is logically normal) but it does not listen on my project and keep waiting for so long and i got a 200 response after a long time and i dont think that's working
note that i'm using a private ip adress on the server and all my configuration is working well on my local host
thanks for help.

[7-zete-7]

Hi @farestayari!

If you have changes from #694 in your current project, try to apply #696. This should help.

[marwenmdoukhi]

hello @7-zete-7
have the same problem as soon as I use http://192.168.xx.xx/.well-known/mercure?topic=apartment%2F217180126.
The URL reloads and blocks the process.
However, if I test with curl, it works.
I have updated Docker to the latest version.
Do you have a solution?

When using curl, I get the expected result, but when accessing the URL directly in a browser, the page reloads.

curl -H "Accept: text/event-stream" http://192.168.xx:xx/.well-known/mercure\?topic\=apartment/217180126

:
id: urn:uuid:48c9ed4c-bd4a-4cdb-8661-ef48dfe71636
data: {"status":"completed"}

thanks for help.

[7-zete-7]

Hi @marwenmdoukhi!

Can you try to apply changes below to temporary revert #694 and #696?

-@phpRoute {
-    not path /.well-known/mercure*
-    not file {path}
-}
-rewrite @phpRoute index.php
-
-@frontController path index.php
-php @frontController
-
-file_server
+php_server

Will it be possible to open a connection to Mercure after this?

[farestayari]

Hello @7-zete-7 thank you for the help,
I tried those changes, still the same issue, it keeps pending for a long time.
I'm still wondering what is the root of the problem, does http/https could be why it's not working or it's a container config i'm missing ?

[7-zete-7]

@farestayari, @marwenmdoukhi, I tried to create a reproducer of the problem you described, but I couldn't get the error you described.

Can you make a minimal reproducer so that it would be possible to analyze the problem?

[marwenmdoukhi]

hello @7-zete-7
I have installed the project and configured the settings, but the same issue persists: I can perform a push, but the reception remains blocked, and the status remains pending. However, after 10 to 15 minutes, the status changes to 200. Please find the attached screenshots to illustrate the situation.

[marwenmdoukhi]

@7-zete-7
do you think there is a port issue or a VPN problem blocking the process on the server?
Do you think port 443 could have an impact, or would another port be more relevant?
I put this command in the terminal
telnet 192.168.xx.xx 443
Trying 192.168.xx.xx...
telnet: connect to address 192.168.xx.xx: Connection refused
telnet: Unable to connect to remote host

[7-zete-7]

Thanks for the information, @marwenmdoukhi!

I have installed the project and configured the settings, but the same issue persists: I can perform a push, but the reception remains blocked, and the status remains pending. However, after 10 to 15 minutes, the status changes to 200. Please find the attached screenshots to illustrate the situation.

It looks like there is response buffering issue. Are you using any reverse proxy (Nginx, Traefik, etc.) for this project?

Try also sending a long message (more than 4 KB). If it is indeed response buffering — a large amount of data in the buffer will push the data to the browser.

---

do you think there is a port issue or a VPN problem blocking the process on the server?

It seems that if it were a port or VPN problem, the site would not open, and not just a separate part of it.

---

Do you think port 443 could have an impact, or would another port be more relevant?
I put this command in the terminal
telnet 192.168.xx.xx 443
Trying 192.168.xx.xx...
telnet: connect to address 192.168.xx.xx: Connection refused
telnet: Unable to connect to remote host

Looking at the configuration, you are not using port 443, only port 80 (the screenshots use http scheme, not https). FrankenPHP (Caddy) is not configured to listen on port 443, which is why it is unable to open a connection to it (which is why the Unable to connect to remote host error occurs).

[marwenmdoukhi]

hello @7-zete-7
thanks again for your response, actually i dont use any reverse proxy in my servers, i'm using only what i'm given in docker symfony template, moreover i tried the reproducer on my personal server which does not have any port problem and does not require a vpn, and you are right i tried to send a message longer than 4kb it works like a charm after that, and i pending status is changed
i would like to know why i have to send a large message to make mercure works? is there any explanation why.
if you want to test the reproducer live here is the link : http://51.75.24.29/hello
and thank you again for your help

[7-zete-7]

Thank you, @marwenmdoukhi, for deploying the reproducer to a public address!

I tried to replicate the problem - the problem does not occur. Data from Mercure arrives immediately.

Recording.2024-12-01.005620.mp4

If you have a problem at the same address - that's interesting.

---

i would like to know why i have to send a large message to make mercure works? is there any explanation why.

This is not really a question for Mercure, but rather for something that buffers responses. Sending data larger than 4 KB is an old trick to bypass some hosting restrictions (when response buffering cannot be disabled in hosting settings) to use protocols like Server-sent events or Long polling.

Perhaps the response can be buffered by something in the middle (between the server and the browser).

I was unable to replicate the problem using Efficiency Mode (as one example of such an intermediary) - I did not experience response buffering.

[marwenmdoukhi]

@7-zete-7 Thank you for your quick response.
it's a little bit weird, here is a video for my browser :
can you explain what is Efficiency Mode and how to enable it ?

enregistrement-de-lecran-2024-11-30-a-232641_MFvnUvKC.mp4

[7-zete-7]

@marwenmdoukhi, thanks for the video!

The Mercure page will continue to load even if it works correctly, this is correct behavior because the server response will not be completed. However, data should appear in it when sending messages.

Efficiency Mode is a built-in (optional) setting in the browser that allows you to optimize traffic (see Microsoft Edge's Efficiency mode, Brave's Energy Saver, etc.). It works through the browser provider's proxy server.
The proxy server may have response buffering.
Usually, I would advise turning off Efficiency Mode to avoid such problems. However, in Google Chrome, Efficiency Mode has already been removed from the browser (see https://support.google.com/chrome/thread/273558539?hl=en&msgid=273627192). In some other browsers, it is still present.

Do you use any proxy? It can be either a proxy for accessing a private network or some kind of ad blocker.
As an option for checking the use of a proxy, you can use the 2ip.io service.