Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[enhancement] [puppeteer] Setup beta1 and memory leak? #412

Open
floviolleau opened this issue Aug 24, 2023 · 9 comments
Open

[enhancement] [puppeteer] Setup beta1 and memory leak? #412

floviolleau opened this issue Aug 24, 2023 · 9 comments

Comments

@floviolleau
Copy link

Hi,

Thanks for all the hard work you are doing by removing dependency to unmaintained phantomjs

I added more cpu and ram to my kubernetes pod and it seems more stable.

Any ideas?
Thanks

Expected behaviour

Long time run without more memory usage consumed

Actual behaviour

Seems to have memory leak
CPU
image (1)

RAM
image

Any ideas?
Thanks

@floviolleau floviolleau changed the title [enhancement] [puppeteer] Memory leak? [enhancement] [puppeteer] Setup beta1 and memory leak? Aug 24, 2023
@jszuminski
Copy link
Contributor

Thanks for creating an issue for this!

Your Docker config is also worth mentioning:

FROM node:alpine

WORKDIR /home/highchart-export-server

ENV ACCEPT_HIGHCHARTS_LICENSE=1
ENV HIGHCHARTS_USE_MAPS=0
ENV HIGHCHARTS_USE_GANTT=0
ENV HIGHCHARTS_VERSION=11.1.0

RUN apk update \
    && apk upgrade \
    && apk add --no-cache git patch \
    && rm -rf /var/lib/apt/lists/*

RUN npm install highcharts-export-server@3.0.0-beta.1

EXPOSE 7801

ENTRYPOINT ["node", "node_modules/highcharts-export-server/bin/cli.js", "--enableServer", "true", "--logDest", "/var/log/", "--logLevel", "2", "--constr", "chart", "--allowCodeExecution", "true", "--enableUi", "true"]

That would be also very helpful if you could:

  1. increase the logLevel to 4
  2. send us your full log file so we can see what happens
  3. describe in more detail how you're using the Export Server
    • what kind of requests are you sending to the server?
    • how many requests are you sending per unit of time?
  4. send us more info about your server/environment/system/etc.

If we gather all the information about your problem maybe we'll be able to reproduce it and find the cause so that's what we'll focus on first.

@floviolleau
Copy link
Author

floviolleau commented Aug 24, 2023

Hi,

I was about to update the first message of this issue with missing details but you did it 😊.

For now, when I run basically a container, I have just after a couple of minutes starting to have:
Thu Aug 24 2023 08:41:09 GMT+0000 [error] - [pool] Error creating a new page in pool entry creation! invalid page

Logs click here
highcharts_export_server  |     __  ___       __         __               __                          
highcharts_export_server  |    / / / (_)___ _/ /_  _____/ /_  ____ ______/ /______                    
highcharts_export_server  |   / /_/ / / __ `/ __ \/ ___/ __ \/ __ `/ ___/ __/ ___/                    
highcharts_export_server  |  / __  / / /_/ / / / / /__/ / / / /_/ / /  / /_(__  )                     
highcharts_export_server  | /_/ /_/_/\__, /_/ /_/\___/_/ /_/\__,_/_/   \__/____/                      
highcharts_export_server  |         ____//___/                  __     _____                          
highcharts_export_server  |        / ____/  ______  ____  _____/ /_   / ___/___  ______   _____  _____
highcharts_export_server  |       / __/ | |/_/ __ \/ __ \/ ___/ __/   \__ \/ _ \/ ___/ | / / _ \/ ___/
highcharts_export_server  |      / /____>  </ /_/ / /_/ / /  / /_    ___/ /  __/ /   | |/ /  __/ /    
highcharts_export_server  |     /_____/_/|_/ .___/\____/_/   \__/   /____/\___/_/    |___/\___/_/     
highcharts_export_server  |               /_/                                                         
highcharts_export_server  |                                                                      vundefined
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [notice] - [cache] Cache and requested modules does not match, need to re-fetch.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [notice] - [cache] Updating cache to Highcharts  
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/highcharts.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/highcharts-more.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/highcharts-3d.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/stock.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/maps/modules/map.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/gantt.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/exporting.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/export-data.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/parallel-coordinates.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/accessibility.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/annotations-advanced.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/boost-canvas.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/boost.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/data.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/draggable-points.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/static-scale.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/broken-axis.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/heatmap.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/tilemap.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/timeline.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/treemap.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/item-series.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/drilldown.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/histogram-bellcurve.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/bullet.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/funnel.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/funnel3d.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/pyramid3d.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/networkgraph.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/pareto.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/pattern-fill.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/pictorial.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/price-indicator.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/sankey.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/arc-diagram.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/dependency-wheel.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/series-label.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/solid-gauge.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/sonification.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/stock-tools.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/streamgraph.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/sunburst.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/variable-pie.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/variwide.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/vector.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/venn.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/windbarb.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/wordcloud.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/xrange.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/no-data-to-display.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/drag-panes.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/debugger.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/dumbbell.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/lollipop.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/cylinder.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/organization.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/dotplot.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/marker-clusters.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/hollowcandlestick.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/modules/heikinashi.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://code.highcharts.com/stock/indicators/indicators-all.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://cdnjs.cloudflare.com/ajax/libs/moment.js/2.29.3/moment.min.js.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] Fetching script https://cdnjs.cloudflare.com/ajax/libs/lodash.js/4.17.20/lodash.min.js.
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [verbose] - [cache] writing new manifest
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 0)
highcharts_export_server  | Thu Aug 24 2023 09:02:28 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:02:32 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 1)
highcharts_export_server  | Thu Aug 24 2023 09:02:32 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:02:36 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 2)
highcharts_export_server  | Thu Aug 24 2023 09:02:36 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:02:40 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 3)
highcharts_export_server  | Thu Aug 24 2023 09:02:40 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:02:44 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 4)
highcharts_export_server  | Thu Aug 24 2023 09:02:44 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:02:48 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 5)
highcharts_export_server  | Thu Aug 24 2023 09:02:48 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:02:52 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 6)
highcharts_export_server  | Thu Aug 24 2023 09:02:52 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:02:56 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 7)
highcharts_export_server  | Thu Aug 24 2023 09:02:56 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:00 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 8)
highcharts_export_server  | Thu Aug 24 2023 09:03:00 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:05 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 9)
highcharts_export_server  | Thu Aug 24 2023 09:03:05 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:09 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 10)
highcharts_export_server  | Thu Aug 24 2023 09:03:09 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:13 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 11)
highcharts_export_server  | Thu Aug 24 2023 09:03:13 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:17 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 12)
highcharts_export_server  | Thu Aug 24 2023 09:03:17 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:21 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 13)
highcharts_export_server  | Thu Aug 24 2023 09:03:21 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:25 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 14)
highcharts_export_server  | Thu Aug 24 2023 09:03:25 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:29 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 15)
highcharts_export_server  | Thu Aug 24 2023 09:03:29 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:33 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 16)
highcharts_export_server  | Thu Aug 24 2023 09:03:33 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:37 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 17)
highcharts_export_server  | Thu Aug 24 2023 09:03:37 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:41 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 18)
highcharts_export_server  | Thu Aug 24 2023 09:03:41 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:45 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 19)
highcharts_export_server  | Thu Aug 24 2023 09:03:45 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:49 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 20)
highcharts_export_server  | Thu Aug 24 2023 09:03:49 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:53 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 21)
highcharts_export_server  | Thu Aug 24 2023 09:03:53 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:03:57 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 22)
highcharts_export_server  | Thu Aug 24 2023 09:03:57 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:04:01 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 23)
highcharts_export_server  | Thu Aug 24 2023 09:04:01 GMT+0000 [notice] - [browser] failed: Error: Failed to launch the browser process! spawn /root/.cache/puppeteer/chrome/linux-115.0.5790.98/chrome-linux64/chrome ENOENT
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  | TROUBLESHOOTING: https://pptr.dev/troubleshooting
highcharts_export_server  | 
highcharts_export_server  | 
highcharts_export_server  |     at ChildProcess.onClose (file:///home/highchart-export-server/node_modules/@puppeteer/browsers/lib/esm/launch.js:268:24)
highcharts_export_server  |     at ChildProcess.emit (node:events:514:28)
highcharts_export_server  |     at ChildProcess._handle.onexit (node:internal/child_process:292:12)
highcharts_export_server  |     at onErrorNT (node:internal/child_process:484:16)
highcharts_export_server  |     at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [notice] - [browser] attempting to get a browser instance (try 24)
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [notice] - [pool] Initializing pool: min 6, max 6.
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [verbose] - [pool] Attaching exit listeners to the process.
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [error] - [pool] Error creating a new page in pool entry creation! invalid page
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [error] - [pool] Error creating a new page in pool entry creation! invalid page
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [error] - [pool] Error creating a new page in pool entry creation! invalid page
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [error] - [pool] Error creating a new page in pool entry creation! invalid page
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [error] - [pool] Error creating a new page in pool entry creation! invalid page
highcharts_export_server  | Thu Aug 24 2023 09:04:05 GMT+0000 [error] - [pool] Error creating a new page in pool entry creation! invalid page

For now, sending very few request per days
It is hosted on kubernetes on an external service provider. I will try to get details for hardware details

@mcharnet
Copy link

Hi @floviolleau,

I have the same error on my docker instance. Did you find out a solution ?

Thanks

@floviolleau
Copy link
Author

Hi,

I'm still waiting an answer from @jakubSzuminski.

Kind regards

@jszuminski
Copy link
Contributor

jszuminski commented Sep 13, 2023

Thank you for your patience.

The most difficult issues to solve are the ones that are not reproducible in a local environment.

  1. We've tried to reproduce it locally on our machines, but this issue does not seem to occur in our environments.
  2. We've recently updated the version of Puppeteer to the latest one (v21.1.1) - could you please try out the latest enhancement/puppeteer branch and let me know if it still appears?
  3. Could you please share your system+hardware info? @mcharnet @floviolleau - that may help us with the investigation.

I'm sorry that it takes so long. This issue is still our priority. We'll get back to it as soon as you give us more details.

@jszuminski
Copy link
Contributor

@floviolleau @mcharnet unfortunately, we did not manage to find a definite cause yet, but we're trying out different ways to improve the Export Server so that this issue does not occur.

However, as we did not manage to reproduce this issue, it would be very helpful if you could try out this branch: https://github.com/highcharts/node-export-server/tree/enhancement/tarn-based-resource-pool (where we've gotten rid of the generic-pool, replacing it with tarn).

If this problem has been solved with this branch then great! If not, please let us know and we will continue our search for the source of the problem.

@jszuminski
Copy link
Contributor

@floviolleau @mcharnet we've recently merged a new PR (#422) where we replaced the generic-pool package with tarn.

This could be a possible fix of this issue. Could you please try out the latest version (from the master branch or from the npm highcharts-export-server@3.0.0-rc.2) and let us know whether it solved it for you?

@floviolleau
Copy link
Author

Hi,

Thanks for your reply. I will try when I will have a some time and get back to you.

@noverby
Copy link

noverby commented May 2, 2024

@floviolleau Did you manage to test, whether it fixed the memory leak?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants