Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

A couple minor state-based options for job queries #96

Merged
merged 2 commits into from
May 18, 2022
Merged

A couple minor state-based options for job queries #96

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d25ff68
Add option to include error counts in tool-popularity query
natefoo May 12, 2022
5fa9bab
add changelog
hexylena May 18, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
18 changes: 14 additions & 4 deletions parts/22-query.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -118,9 +118,9 @@ query_tool-usage-over-time() { ##? [searchterm]: Counts of tool runs by month, f
EOF
}

query_tool-popularity() { ##? [months|24]: Most run tools by month (tool_predictions)
query_tool-popularity() { ##? [months|24] [--error]: Most run tools by month (tool_predictions)
handle_help "$@" <<-EOF
See most popular tools by month
See most popular tools by month. Use --error to include error counts.

$ ./gxadmin query tool-popularity 1
tool_id | month | count
Expand All @@ -138,12 +138,17 @@ query_tool-popularity() { ##? [months|24]: Most run tools by month (tool_predict

fields="count=2"
tags="tool_id=0;month=1"
if [[ -n $arg_error ]]; then
fields="${fields}:error_count=3"
error_count=", count(CASE state WHEN 'error' THEN 1 ELSE NULL END) as error_count"
fi


read -r -d '' QUERY <<-EOF
SELECT
tool_id,
date_trunc('month', create_time AT TIME ZONE 'UTC')::date as month,
count(*)
count(*) as count $error_count
FROM job
WHERE create_time > (now() AT TIME ZONE 'UTC' - '$arg_months months'::interval)
GROUP BY tool_id, month
Expand Down Expand Up @@ -1097,7 +1102,7 @@ query_ts-repos() { ## : Counts of toolshed repositories by toolshed and owner.
EOF
}

query_tool-metrics() { ##? <tool_id> <metric_id> [--like]: See values of a specific metric
query_tool-metrics() { ##? <tool_id> <metric_id> [--like] [--ok]: See values of a specific metric
handle_help "$@" <<-EOF
A good way to use this is to fetch the memory usage of a tool and then
do some aggregations. The following requires [data_hacks](https://github.com/bitly/data_hacks)
Expand All @@ -1118,12 +1123,17 @@ query_tool-metrics() { ##? <tool_id> <metric_id> [--like]: See values of a speci
74.9608 - 85.2655 [ 11]: ∎∎∎∎∎∎∎∎∎∎∎ (2.49%)
85.2655 - 95.5703 [ 3]: ∎∎∎ (0.68%)
95.5703 - 105.8750 [ 1]: ∎ (0.23%)

Use the --ok option to only include jobs that finished successfully
EOF

tool_subquery="SELECT id FROM job WHERE tool_id = '$arg_tool_id'"
if [[ -n "$arg_like" ]]; then
tool_subquery="SELECT id FROM job WHERE tool_id like '$arg_tool_id'"
fi
if [[ -n "$arg_ok" ]]; then
tool_subquery="$tool_subquery AND state = 'ok'"
fi

read -r -d '' QUERY <<-EOF
SELECT
Expand Down