-
Notifications
You must be signed in to change notification settings - Fork 1
query on turbot_active_grant - running out of memory in Linux #57
Comments
I find when I do this query on an environment with user mode enabled that it results in many duplicate records. I wonder of that is the underlying cause of the issue? |
select
grant_id,
resource_id,
identity_profile_id,
identity_display_name,
identity_email,
identity_status,
level_uri,
resource_type_uri,
workspace,
create_timestamp,
resource_trunk_title
from
turbot_active_grant
where
resource_type_uri = 'tmod:@turbot/turbot#/resource/types/turbot'
and level_uri = 'tmod:@turbot/turbot-iam#/permission/levels/superuser' |
both of the where constraints should hit indexes |
Hello @nivethj, I tried to replicate the issue but without much success. To replicate the issue, could you please provide a few more details -
|
Below are the requested details How many plugins other than turbot are you using in the Amazon Linux 2 environment? Do other queries work or is it only the turbot_active_grant table queries which are failing? If you restart steampipe and rerun the query, do you still see the issue? |
updated steampipe to (steampipe version 0.16.3). turbot plugin to 0.9.0. row limit 10 is working with 60% Mem , when i update row limit 100 , max memory reached |
'This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 30 days.' |
im following this request |
Hello @nivethj, we are extremely sorry for the delay. While running the query, could you please grab the plugin logs for us to investigate? I tried to replicate this error but without any success. Hoping to catch something unusual in those logs which might help us in debugging this issue. |
It ran long and timed out. Consolelimit 10; Log file2022-11-29 19:59:22.753 UTC [16105] STATEMENT: select grant_id, |
Apologies for the radio silence on this issue @nivethj!! Are you still seeing this error with the new |
tried on v0.20.5 . still the same issue Welcome to Steampipe v0.20.5 => Same query used net/http: TLS handshake timeout (SQLSTATE HV000) |
Hello @nivethj, I attempted to replicate the issue, but unfortunately, I couldn't succeed. Could you kindly clarify whether by |
We have tested in a similar env with 20+K active grants, with limits 10, 100, 1000 - (Works fine)
Could you please update the CLI version to the latest and try? |
Hey @nivethj, We are closing this issue because we have not heard from you. Please feel free to reopen the issue if you want to share or discuss anything. |
Describe the bug
A clear and concise description of what the bug is.
I am trying to query turbot_active_grant with limit of 10 records in my turbot v5 environment which has 20+k records . i am getting out of memory error . I have 4GB Mem. I tried using latest Steampipe v0.16.0-rc.8 version . but no luck.
Steampipe version (
steampipe -v
) v0.16.0-rc.8Example: v0.3.0
Plugin version (
steampipe plugin list
) 0.5.0Example: v0.5.0
To reproduce
Steps to reproduce the behavior (please include relevant code and/or commands).
run below query in amazon linux 2
select grant_id,
resource_id,
identity_profile_id,
identity_display_name,
identity_email,
identity_status,
level_uri,
resource_type_uri,
workspace,
create_timestamp
from nonprod.turbot_active_grant
where resource_trunk_title = 'turbot'
and level_trunk_title = 'superuser'
limit 10;
Expected behavior
A clear and concise description of what you expected to happen.
retrun limited rows in few seconds
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: