Airflow use more swap of ubuntu

[ThuanDoHung]

Apache Airflow version

2.7.3

What happened

From Airflow 2.7.2, my server warning (High swap space usage (less than 50% free)). This my server use airflow 2.6.x before not warning.

My Server:
OS: Ubuntu 22.04.3 LTS
AIRFLOW: 2.7.2 (upgrade from 2.6.x)
RAM: 8GB (now more 3Gb Free)
SWAP: 4GB (Use more 1.9GB) (if use Ariflow 2.6.x, swap ~= 0GB)

What you think should happen instead

No response

How to reproduce

From Airflow 2.6 i upgrade 2.7.2, after upgrade about 2-3 days, my server warning High swap space usage (less than 50% free). I try reboot server but 2-3 days warning again

Operating System

Ubuntu Server 22.04.3 LTS

Versions of Apache Airflow Providers

apache-airflow[celery,cgroups,dask,statsd,virtualenv,redis]==2.7.3

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[ThuanDoHung]

Status of server:

And Zabbix Warning:

[potiuk]

likely related to #32856
#24694

Can you pleae use https://github.com/bloomberg/memray and share the memray's flamegraph of the memory usage of your airflow after the memory used grows ?

You will ifnd instructions on how to use memray in their docs.

Without it, it is impossible to diagnose the issue - it's likely related to some configuration you have so without more details it is impossible to act on.

[github-actions]

This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.

[github-actions]

This issue has been closed because it has not received response from the issue author.