Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

馃悰 Bug Report: Stats shows only last 25days, end of every day, it hides 26th day. #8110

Closed
3 tasks done
xuelink opened this issue May 11, 2024 · 4 comments 路 Fixed by #8117
Closed
3 tasks done

馃悰 Bug Report: Stats shows only last 25days, end of every day, it hides 26th day. #8110

xuelink opened this issue May 11, 2024 · 4 comments 路 Fixed by #8117
Assignees
@stnguyen90
Labels
bug Something isn't working

Comments

@xuelink
Copy link
Contributor

xuelink commented May 11, 2024 •
edited

馃憻 Reproduction steps

I have available enough space on server. That's not the issue.
Interesting but no idea why and whats happening, any idea?

There is a 24-hour gap between the two screenshots.

Screenshot 2024-05-10 at 12 41 53鈥疨M Screenshot 2024-05-11 at 3 53 49鈥疉M

LOGS

$ root@Appwrite#6771:~/appwrite# docker logs appwrite-worker-usage
[Job] Received Job (663ec1cf2e7f18.44255279).
[Job] (663ec1cf2e7f18.44255279) successfully run.
[Job] Received Job (663ec1cf3a2a34.00096276).
[Job] (663ec1cf3a2a34.00096276) successfully run.
[Job] Received Job (663ec1cf3b4a26.20487644).
[Job] (663ec1cf3b4a26.20487644) successfully run.
[Job] Received Job (663ec1f2a7ec87.40288580).
[2024-05-11 00:55:14.690] Aggregated 48 keys
[Job] (663ec1f2a7ec87.40288580) successfully run.
[Job] Received Job (663ec1f301e680.96420073).
[Job] (663ec1f301e680.96420073) successfully run.
[Job] Received Job (663ec1f31091b2.68470278).
[Job] (663ec1f31091b2.68470278) successfully run.
[Job] Received Job (663ec1f31f5c56.22408789).
[Job] (663ec1f31f5c56.22408789) successfully run.
[Job] Received Job (663ec1f3206830.30223697).
[Job] (663ec1f3206830.30223697) successfully run.
[Job] Received Job (663ec2034866a2.21384295).
[Job] (663ec2034866a2.21384295) successfully run.
[Job] Received Job (663ec203719154.69889124).
[Job] (663ec203719154.69889124) successfully run.
[Job] Received Job (663ec203810eb3.08792306).
[Job] (663ec203810eb3.08792306) successfully run.
[Job] Received Job (663ec2038cc792.59530985).
[Job] (663ec2038cc792.59530985) successfully run.
[Job] Received Job (663ec2038dfaa7.69224691).
[Job] (663ec2038dfaa7.69224691) successfully run.
[Job] Received Job (663ec20aef4882.79561108).
[Job] (663ec20aef4882.79561108) successfully run.
[Job] Received Job (663ec20b473296.39832354).
[Job] (663ec20b473296.39832354) successfully run.
[Job] Received Job (663ec20b55aae1.82137677).
[Job] (663ec20b55aae1.82137677) successfully run.
[Job] Received Job (663ec20b6287a6.39422468).
[Job] (663ec20b6287a6.39422468) successfully run.
[Job] Received Job (663ec20b63b715.78696231).
[Job] (663ec20b63b715.78696231) successfully run.
$ root@appwrite:~/appwrite# docker logs appwrite-worker-usage-dump
[Job] Received Job (663eb42f814a97.27890873).
[2024-05-10 23:56:31.530] ProjectId [3] ReceivedAt [2024-05-10 23:56:31.529] 7 keys
[Job] (663eb42f814a97.27890873) successfully run.
[Job] Received Job (663eb450965344.53840528).
[2024-05-10 23:57:04.616] ProjectId [3] ReceivedAt [2024-05-10 23:57:04.615] 7 keys
[Job] (663eb450965344.53840528) successfully run.
[Job] Received Job (663eb46f73b080.51314690).
[2024-05-10 23:57:35.474] ProjectId [3] ReceivedAt [2024-05-10 23:57:35.473] 7 keys
[Job] (663eb46f73b080.51314690) successfully run.
[Job] Received Job (663eb4a7183590.89048165).
[2024-05-10 23:58:31.100] ProjectId [3] ReceivedAt [2024-05-10 23:58:31.099] 7 keys
[Job] (663eb4a7183590.89048165) successfully run.
[Job] Received Job (663eb4c69c3115.45089428).
[2024-05-10 23:59:02.646] ProjectId [3] ReceivedAt [2024-05-10 23:59:02.639] 7 keys
[Job] (663eb4c69c3115.45089428) successfully run.
[Job] Received Job (663eb4ef75da01.63850870).
[2024-05-10 23:59:43.483] ProjectId [3] ReceivedAt [2024-05-10 23:59:43.482] 8 keys
[Job] (663eb4ef75da01.63850870) successfully run.
[Job] Received Job (663eb51fd08dc5.56622408).
[2024-05-11 00:00:31.855] ProjectId [3] ReceivedAt [2024-05-11 00:00:31.854] 7 keys
[Job] (663eb51fd08dc5.56622408) successfully run.
[Job] Received Job (663eb55c4852d3.81129997).
[2024-05-11 00:01:32.297] ProjectId [3] ReceivedAt [2024-05-11 00:01:32.296] 7 keys
[Job] (663eb55c4852d3.81129997) successfully run.
[Job] Received Job (663eb5981d4df9.86638348).
[2024-05-11 00:02:32.121] ProjectId [3] ReceivedAt [2024-05-11 00:02:32.119] 7 keys
[Job] (663eb5981d4df9.86638348) successfully run.
root@appwrite:~/appwrite# docker logs appwrite-maintenance
LOADING Redis is loading the dataset in memory
Appwrite maintenance process v1 has started
[2024-05-08 21:26:53.658] Notifying workers with maintenance tasks every 86400 seconds
Appwrite maintenance process v1 has started
[2024-05-08 21:26:57.571] Notifying workers with maintenance tasks every 86400 seconds
Found 1 projects 0.045945167541504 seconds
[2024-05-08 21:26:57.617] No certificates for renewal.
[2024-05-09 21:26:57.631] Notifying workers with maintenance tasks every 86400 seconds
Found 1 projects 0.01667594909668 seconds
[2024-05-09 21:26:57.648] No certificates for renewal.
[2024-05-10 21:26:57.654] Notifying workers with maintenance tasks every 86400 seconds
Found 1 projects 0.008430004119873 seconds
[2024-05-10 21:26:57.664] No certificates for renewal.
$ root@appwrite:~/appwrite# docker logs appwrite-worker-deletes
Deleted document "184304ab77dc953a340fbeaa007c6946" successfully
Deleting chunk #36. Found 22 documents
Deleted document "736565d4c55d76a9069e072f007f67d7" successfully
Deleted document "9e1c55c4ab0c8433d36ad6c49c6c377e" successfully
Deleted document "2f184acb59a6cdc8cdc7dccefcb5808e" successfully
Deleted document "bfa54b92a5fd924dc40e0ac502c5cfd9" successfully
Deleted document "18ec4b5a9fba3c721e827ea6b01e6256" successfully
Deleted document "571b09b53ca71721dbf3856b3f1c7e8c" successfully
Deleted document "cdd2901a430984ce479b89fb3465e43a" successfully
Deleted document "d7187dac574b0660566dee21ea85b088" successfully
Deleted document "5aef8313410bc5d662d47a8b5553beed" successfully
Deleted document "9fb00d80ce8f95ab61245a7a190bd8a0" successfully
Deleted document "89d212c04c6f7008bdcc1fc42f646b1f" successfully
Deleted document "53a1b0c6e36ec90ab18776579cd1efbb" successfully
Deleted document "9c2b98ee2ec3eeb8aae1cce106ce83af" successfully
Deleted document "a41fcb372558825bb7aba7dd03987b5f" successfully
Deleted document "d225009be2de823be999b1f701ba5f9c" successfully
Deleted document "087fff1b40ca03fdfbfa62bc7eed73b3" successfully
Deleted document "2370ea668783400cdf68135ce137ea44" successfully
Deleted document "9f2a81e9ae97d4f7fb322d33377e411f" successfully
Deleted document "d1346f20270a55c255c4264cd71e0b68" successfully
Deleted document "0025374b99dabc2cf2e89e44c407f448" successfully
Deleted document "c6021667c3e3a90f75e14783ff46b01d" successfully
Deleted document "7254d18f0081d2467e04f5ad93b0f13c" successfully
Deleted 1772 document by group in 15.672917127609 seconds
[Job] (663e9121a1ec54.14999579) successfully run.
[Job] Received Job (663e9121a1f457.44187112).
Deleting chunk #1. Found 0 documents
Deleted 0 document by group in 0.0025320053100586 seconds
[Job] (663e9121a1f457.44187112) successfully run.
[Job] Received Job (663e9121a1ff15.69401810).
Deleting chunk #1. Found 0 documents
Deleted 0 document by group in 0.0021600723266602 seconds
[Job] (663e9121a1ff15.69401810) successfully run.
[Job] Received Job (663e9121a2f169.76552078).
Deleting chunk #1. Found 0 documents
Deleted 0 document by group in 0.0027902126312256 seconds
[Job] (663e9121a2f169.76552078) successfully run.
[Job] Received Job (663e9121a30203.35480408).
Listed 12 document by group in 0.046750068664551 seconds
[Job] (663e9121a30203.35480408) successfully run.
[Job] Received Job (663e9121a31148.91836375).
Deleting chunk #1. Found 0 documents
Deleted 0 document by group in 0.004925012588501 seconds
[Job] (663e9121a31148.91836375) successfully run.
[Job] Received Job (663f3421150e64.34342082).

Notice: PDOStatement::execute(): Send of 225 bytes failed with errno=104 Connection reset by peer in @swoole/library/core/Database/PDOStatementProxy.php on line 44
Deleting chunk #1. Found 0 documents
Deleted 0 document by group in 0.0076529979705811 seconds
[Job] (663f3421150e64.34342082) successfully run.
[Job] Received Job (663f34211817a7.45005806).
Deleting chunk #1. Found 0 documents
Deleted 0 document by group in 0.0028131008148193 seconds
[Job] (663f34211817a7.45005806) successfully run.

馃憤 Expected behavior

Stats will be shown as expected.

馃憥 Actual Behavior

Stats shows only last 25days, everyday it deletes 26th day, we have available space on server.

馃幉 Appwrite version

Version 1.5.5

馃捇 Operating system

Linux

馃П Your Environment

selfhosted appwrite v1.5.5

馃憖 Have you spent some time to check if this issue has been raised before?

馃彚 Have you read the Code of Conduct?
@xuelink xuelink added the bug Something isn't working label May 11, 2024
@xuelink
Copy link
Contributor Author

xuelink commented May 11, 2024

I'm pretty sure your data isn't deleted. There's just a bug with the API.

@stnguyen90 Done

@stnguyen90 stnguyen90 self-assigned this May 11, 2024
@stnguyen90
Copy link
Contributor

@xuelink, thanks for creating this issue! We'll look into this soon!

@stnguyen90
Copy link
Contributor

There might be a bug here as we're not specifying a limit so only 25 documents are returned.

appwrite/app/controllers/api/project.php

Lines 83 to 89 in 5e8a18e

$results = $dbForProject->find('stats', [
Query::equal('metric', [$metric]),
Query::equal('period', [$period]),
Query::greaterThanEqual('time', $firstDay),
Query::lessThan('time', $lastDay),
Query::orderDesc('time'),
]);

@xuelink
Copy link
Contributor Author

xuelink commented May 11, 2024

There might be a bug here as we're not specifying a limit so only 25 documents are returned.

appwrite/app/controllers/api/project.php

Lines 83 to 89 in 5e8a18e

$results = $dbForProject->find('stats', [
Query::equal('metric', [$metric]),
Query::equal('period', [$period]),
Query::greaterThanEqual('time', $firstDay),
Query::lessThan('time', $lastDay),
Query::orderDesc('time'),
]);

genios approach!

@stnguyen90 stnguyen90 mentioned this issue May 13, 2024
Merged
2 tasks
@stnguyen90 stnguyen90 linked a pull request May 13, 2024 that will close this issue
Set limit to retrieve all stats for the usage range #8117
Merged
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@stnguyen90 stnguyen90

Labels
bug Something isn't working
Projects
1.5 release
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Set limit to retrieve all stats for the usage range appwrite/appwrite
2 participants
@stnguyen90 @xuelink