Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v0.6.0 Release #680

Merged
merged 140 commits into from Mar 31, 2021
Merged

v0.6.0 Release #680

merged 140 commits into from Mar 31, 2021

Conversation

pirate
Copy link
Member

@pirate pirate commented Mar 27, 2021

new features:

  • new ArchiveResult admin UI, with full editing ability of individual extractor outputs + list of outputs under each Snapshot admin entry
  • add init --quick and server --quick-init options to quickly update the db version without doing a full re-init (for users with large archive collections this will make version upgrades a lot faster / less painful)
  • new SNAPSHOTS_PER_PAGE=40 and MEDIA_MAX_SIZE=750m config options
  • log all errors with full tracebacks to new data/logs/errors.log file (so users no longer have to run in --debug mode to see error details)
  • allow hotlinking directly to specific extractor output on the snapshot detail page using URL #hash e.g. /archive/<timestamp>/index.html#git
  • add ability to view snapshot matching a given URLs by visiting /archive/https://example.com/some/url -> redirects to -> /archive/<timestamp>/index.html (also works without scheme /archive/example.com)
  • add Django Debug Toolbar + djdt_flamegraph for developers to profile UI performance
  • new archivebox add --tag=tag1,tag2,tag3 ... option and Add page UI form field for tagging new links
  • new archivebox schedule --overwrite flag option that works similarly to add --overwrite

enhancements:

  • lots of performance improvements! (in testing with 50k entries, the main index was brought down from 10-14 second load times to 114ms once cache warms up)
  • speed up main codebae hotspots snapshot_icons, latest_title, archive_size using django cache
  • integrity and correctness improvements to readability, mercury, warc, and other extractors
  • lots of small UI improvements and CLI improvements
  • better archivebox schedule logging and changed logfile location to ./logs/schedule.log

bugfixes:

  • fix stdin/stdout/stderr handling for some edge cases in Docker/Docker-Compose
  • lots of minor template fixes
  • fix UTF-8 encoding encoding problems with file reading/writing on Windows (supporting a Python pkg on Windows is unreasonably painful ya'll)

…r output is missing or multiple snapshots returned
@pirate pirate mentioned this pull request Mar 27, 2021
@github-pages github-pages bot temporarily deployed to github-pages March 27, 2021 09:29 Inactive
@github-pages github-pages bot temporarily deployed to github-pages March 27, 2021 09:32 Inactive
@github-pages github-pages bot temporarily deployed to github-pages March 27, 2021 09:53 Inactive
@github-pages github-pages bot temporarily deployed to github-pages March 30, 2021 18:50 Inactive
dependabot bot and others added 2 commits March 30, 2021 18:50
Bumps [y18n](https://github.com/yargs/y18n) from 5.0.1 to 5.0.5.
- [Release notes](https://github.com/yargs/y18n/releases)
- [Changelog](https://github.com/yargs/y18n/blob/master/CHANGELOG.md)
- [Commits](yargs/y18n@v5.0.1...v5.0.5)

Signed-off-by: dependabot[bot] <support@github.com>
@github-pages github-pages bot temporarily deployed to github-pages March 30, 2021 19:15 Inactive
@github-pages github-pages bot temporarily deployed to github-pages March 31, 2021 03:17 Inactive
@github-pages github-pages bot temporarily deployed to github-pages March 31, 2021 03:39 Inactive
@pirate pirate merged commit fe2b682 into master Mar 31, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant