Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source Aggregation #17

Closed
UP2040499 opened this issue Mar 13, 2023 · 1 comment · Fixed by #32
Closed

Source Aggregation #17

UP2040499 opened this issue Mar 13, 2023 · 1 comment · Fixed by #32

Comments

@UP2040499
Copy link
Owner

UP2040499 commented Mar 13, 2023

This consists of the following components:

  • Google Search
  • Social Media Search
  • Source similarity checker
  • Key information gatherer
  • Semantic analyser of key information and headlines
    • Sources with very poor semantics are discarded
  • Each source, along with associated semantic analysis results and web links, stored in a Potential Corroboration Store Create Potential Corroboration Source Store #23.
@UP2040499 UP2040499 linked a pull request Mar 26, 2023 that will close this issue
@UP2040499
Copy link
Owner Author

If back-testing is required using older information. For example, you want to limit the knowledge base up to October 2022. You can add arguments to the source_aggregator.searcher method that filter Google search results between a given date interval.
See: https://developers.google.com/custom-search/v1/reference/rest/v1/cse/list#:~:text=sort,sort%3Ddate.

@UP2040499 UP2040499 added this to the Source Aggregator milestone May 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant