Memory usage of ckan_default processes increases continuously

[SakshiSharma-India]

I am using CKAN Version 2.7.2.
[Issue]
The memory usage of ckan_default processes increase over time. I want to confirm if there is any memory leak in CKAN?

[Steps to reproduce the issue]

1. Send requests to CKAN through any testing tool (like jmeter) contiuously as below:
   Method: GET
   Request: https://ckan-ip:ckan-port/ckan
   Request frequency - 100 request per sec
2. Monitor the memory usage with every request

[Observation]
The memory usage of ckan_default processes keep on increasing.

Please confirm the reason of increase in memory usage. Is there memory leak in ckan?
Can anyone help me to limit the memory usage of ckan_default processes.

[kowh-ai]

@SakshiSharma-India is CKAN running on Ubuntu? - if so which version?

[SakshiSharma-India]

Hi @kowh-ai ,
I am using RHEL 7.1.

[kowh-ai]

@SakshiSharma-India take a look at this: #4939

[SakshiSharma-India]

Hi @kowh-ai ,

This issue #4939 was also raised by one of my colleagues.
We have tried to change MaxConnectionsPerChild value to non zero (1000 in our environment). But we are still facing the same issue and we haven't found any other solution yet to limit the memory consumption of ckan processes.

[kowh-ai]

Hi @SakshiSharma-India -- When the Apache process(es) seem to be overwhelmed are you able to run an "lsof" command to see what is happening to the process as far as the number of sockets opened? BTW: 100 requests per second is A LOT of requests - is this the number of requests you are getting (or expect to be getting) in your production environments? Can you give some background here please?