This repository has been archived by the owner on Dec 2, 2021. It is now read-only.
Discourse Categories Processor #45
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Currently collects daily data for `new_users` and `active_users` about a specified Discourse forum instance. Includes tests.
Found a better way of collected daily data using /admin/report. Sadly means I have to remove the cool generator yielding paged api requests into a counter code. You'll always live on in our hearts and git history. Added: - visits - new_posts
Moved from frictionlessdata to oki
Can be shared with other Discourse processors
Collects category data (without expanding subcategories) for `new_topics` and `new_posts`.
The discourse forum category processor can accept a `children` flag that determines how to treat subcategories for a given category. - `none` (default): only collect data for the specified category, ignoreing subcategories. - `aggregate`: add subcategory data values to the parent category rows - `expand`: add subcategory values as separate rows in the resource
And allow `children` to be optional
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request closes #33.
This PR adds a
forum-categoriespipeline andadd_discourse_categories_resourceprocessor. Closely related to theforumspipeline andadd_discourse_resourceprocessor.The processor will collect daily data for each specified category in the config:
new_topicsnew_postsThe processor config can accept a
childrenflag that determines how to treat the subcategories of a given category:none(default): only collect data for the specified category, ignoring subcategoriesaggregate: add subcategory data values to the parent category rowsexpand: add subcategory values as separate rows in the resource