Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't show DB Size on PrivacyManager Admin Page #7981

Open
futureweb opened this issue May 23, 2015 · 4 comments
Open

Don't show DB Size on PrivacyManager Admin Page #7981

futureweb opened this issue May 23, 2015 · 4 comments
Labels
Bug For errors / faults / flaws / inconsistencies etc. c: Performance For when we could improve the performance / speed of Matomo.

Comments

@futureweb
Copy link
Contributor

Our Piwik got a 30GB DB and everytime I try to load the PrivacyManager Admin Page our MySQL stalls because this Page tries to figure out the Size of the DB ... (MySQL Process 100% CPU Usage)
DB size should only be shown if requested by User - as it brings Problems for big installations.

thx
Andreas Schnederle-Wagner

@futureweb futureweb changed the title Stop showing DB Size on PrivacyManager Admin Page Don't show DB Size on PrivacyManager Admin Page May 24, 2015
@mattab
Copy link
Member

mattab commented May 24, 2015

Hi @futureweb
thanks for the report.
When Mysql is 100% can you print out the output for SHOW FULL PROCESSLIST \g; ? I'd like to see which part of the DB estimate is slow for you.

@mattab mattab added the Bug For errors / faults / flaws / inconsistencies etc. label May 24, 2015
@futureweb
Copy link
Contributor Author

Hi @mattab,

first it does a "SHOW TABLE STATUS" for about 15 Seconds, then lot's of Queries start to fill the process list and make it a little bit hard to analyze. After 10 Seconds there were about 80 Queries with Status "WAITING FOR TABLE LOCK" ...
But since this Query was the only one actually running - I guess this Query is the troublemaker:

| 103017 | piwik | *ip*:42420 | piwik | Execute |    3 | Sending data                 | SELECT idvisit
FROM piwik_log_visit
WHERE '2014-11-26 00:00:00' > visit_last_action_time
AND idvisit <= '15267659'
AND idvisit > '15167659'
ORDER BY idvisit DESC
LIMIT 1 


| 103017 | piwik | *ip*:42420 | piwik | Execute |    8 | Sending data                 | SELECT idvisit
FROM piwik_log_visit
WHERE '2014-11-26 00:00:00' > visit_last_action_time
AND idvisit <= '15167659'
AND idvisit > '15067659'
ORDER BY idvisit DESC
LIMIT 1          


| 103017 | piwik | *ip*:42420 | piwik | Execute |   19 | Sending data                 | SELECT idvisit
FROM piwik_log_visit
WHERE '2014-11-26 00:00:00' > visit_last_action_time
AND idvisit <= '15067659'
AND idvisit > '14967659'
ORDER BY idvisit DESC
LIMIT 1  


| 103017 | piwik | *ip*1:42420 | piwik | Execute |   24 | Sending data                 | SELECT idvisit 
FROM piwik_log_visit
WHERE '2014-11-26 00:00:00' > visit_last_action_time
AND idvisit <= '14967659'
AND idvisit > '14867659'
ORDER BY idvisit DESC
LIMIT 1 

piwik_log_visit got about ~3 Million entries and is ~1GB in size.
Hope those Information help you find the problem.

@mattab
Copy link
Member

mattab commented Jul 15, 2015

Hi @futureweb

could you please confirm that you still have the problem with 2.14.0? Since we made some improvements to this area, if we are lucky, this problem could have improved. Thanks

@mattab mattab added this to the Short term milestone Jul 15, 2015
@mattab mattab added the c: Performance For when we could improve the performance / speed of Matomo. label Jul 15, 2015
@futureweb
Copy link
Contributor Author

Hi @mattab,

unfortunately it still "stalls" my Piwik MySQL Server when going to Privacy Manager Admin Page :-/

Andreas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug For errors / faults / flaws / inconsistencies etc. c: Performance For when we could improve the performance / speed of Matomo.
Projects
None yet
Development

No branches or pull requests

2 participants