New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add `tootctl domains crawl` #9809

Merged
merged 1 commit into from Jan 15, 2019

Conversation

Projects
None yet
2 participants
@Gargron
Copy link
Member

Gargron commented Jan 14, 2019

Usage:
  tootctl domains crawl [START]

Options:
  c, [--concurrency=N]          
                                # Default: 50
  s, [--silent], [--no-silent]  
  f, [--format=FORMAT]          
                                # Default: summary

Description:
  Crawl the fediverse by using the Mastodon REST API endpoints that expose all known
  peers, and collect statistics from those peers, as long as those peers
  support those API endpoints. When no START is given, the command uses this
  server's own database of known peers to seed the crawl.

  The --concurrency (-c) option controls the number of threads performing HTTP
  requests at the same time. More threads means the crawl may complete faster.

  The --silent (-s) option controls progress output.

  The --format (-f) option controls how the data is displayed at the end. By
  default (`summary`), a summary of the statistics is returned. The other
  options are `domains`, which returns a newline-delimited list of all
  discovered peers, and `json`, which dumps all the aggregated data raw.

@Gargron Gargron force-pushed the feature-tootctl-crawl branch 2 times, most recently from 861b4c5 to 2e6a00d Jan 14, 2019

@Gargron Gargron force-pushed the feature-tootctl-crawl branch from 2e6a00d to fb32304 Jan 14, 2019

@ykzts

ykzts approved these changes Jan 15, 2019

@Gargron Gargron merged commit ee5e248 into master Jan 15, 2019

11 checks passed

ci/circleci: build Your tests passed on CircleCI!
Details
ci/circleci: check-i18n Your tests passed on CircleCI!
Details
ci/circleci: install Your tests passed on CircleCI!
Details
ci/circleci: install-ruby2.4 Your tests passed on CircleCI!
Details
ci/circleci: install-ruby2.5 Your tests passed on CircleCI!
Details
ci/circleci: install-ruby2.6 Your tests passed on CircleCI!
Details
ci/circleci: test-ruby2.4 Your tests passed on CircleCI!
Details
ci/circleci: test-ruby2.5 Your tests passed on CircleCI!
Details
ci/circleci: test-ruby2.6 Your tests passed on CircleCI!
Details
ci/circleci: test-webui Your tests passed on CircleCI!
Details
codeclimate All good!
Details

@ykzts ykzts deleted the feature-tootctl-crawl branch Jan 15, 2019

@dariusk dariusk referenced this pull request Jan 25, 2019

Open

[WIP] Instance only statuses #8427

4 of 6 tasks complete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment