Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cli: debug zip truncates rangelog and event data at 1000 entries #73021

Open
erikgrinaker opened this issue Nov 21, 2021 · 1 comment
Open

cli: debug zip truncates rangelog and event data at 1000 entries #73021

erikgrinaker opened this issue Nov 21, 2021 · 1 comment
Labels
A-debug-automation Issues or feature requests for debug automation C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-observability

Comments

@erikgrinaker
Copy link
Contributor

erikgrinaker commented Nov 21, 2021

When cockroach debug zip retrieves data via the admin APIs, it does not specify a per-request limit:

func makeClusterWideZipRequests(
admin serverpb.AdminClient, status serverpb.StatusClient,
) []zipRequest {
return []zipRequest{
// NB: we intentionally omit liveness since it's already pulled manually (we
// act on the output to special case decommissioned nodes).
{
fn: func(ctx context.Context) (interface{}, error) {
return admin.Events(ctx, &serverpb.EventsRequest{})
},
pathName: eventsName,
},
{
fn: func(ctx context.Context) (interface{}, error) {
return admin.RangeLog(ctx, &serverpb.RangeLogRequest{})
},
pathName: rangelogName,
},
{
fn: func(ctx context.Context) (interface{}, error) {
return admin.Settings(ctx, &serverpb.SettingsRequest{})
},
pathName: settingsName,
},
{
fn: func(ctx context.Context) (interface{}, error) {
return status.ProblemRanges(ctx, &serverpb.ProblemRangesRequest{})
},
pathName: problemRangesName,
},
}
}

This causes it to apply a default limit of 1000 entries for the Events and RangeLog endpoints (which ends up in rangelog.json and events.json).

defaultAPIEventLimit = 1000

This is problematic, since e.g. the rangelog may often contain older data of interest. debug zip should paginate in order to include older data.

Jira issue: CRDB-11387

@erikgrinaker erikgrinaker added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. A-debug-automation Issues or feature requests for debug automation T-server-and-security DB Server & Security labels Nov 21, 2021
@blathers-crl blathers-crl bot added this to To do in DB Server & Security Nov 21, 2021
@thtruo thtruo added T-observability-inf and removed T-server-and-security DB Server & Security labels Feb 18, 2022
@jtsiros jtsiros added this to To do in Observability Infrastructure via automation Feb 22, 2022
@jtsiros jtsiros removed this from To do in DB Server & Security Feb 22, 2022
@github-actions
Copy link

We have marked this issue as stale because it has been inactive for
18 months. If this issue is still relevant, removing the stale label
or adding a comment will keep it active. Otherwise, we'll close it in
10 days to keep the issue queue tidy. Thank you for your contribution
to CockroachDB!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-debug-automation Issues or feature requests for debug automation C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-observability
Projects
No open projects
Development

No branches or pull requests

2 participants