Skip to content

/hydrus

Latest release

Version 199

@hydrusnetwork hydrusnetwork released this

  • added 'all known files' autocomplete caches, so manage tags dialogs' autocompletes should now always appear quickly
  • the now caches will be created on startup, which may take a few minutes
  • deleted the old tag autocomplete cache
  • wrote a faster initialisation routine for all known files caches
  • fixed an ac_cache cleanup typo
  • the client's (usually gigantic) mappings table is temporarily extracted to an external db file, which should have numerous benefits and perhaps a few drawbacks for now
  • the update will take a few more minutes, and will need lots of disk space, to extract the mappings
  • the server has a very similar external mappings table, so it will also need a while to update, but future admin backup calls will be a lot quicker, due to a much smaller vacuum
  • greatly optimised a mass-membership calculation in tag processing
  • reduced some db check-spam timer that was adding up idle cpu time because of recent ac_cache additions
  • fixed predicate parent sorting
  • if swfrender fails to generate a swf thumbnail within 60 seconds, the client will now dump out (rather than hanging indefinitely)
  • fixed some string-selection dialog layout rules
  • optimised some 'all known files' search queries
  • subscriptions will now append new urls in oldest->newest order, roughly preserving that order in the internal url cache
  • the 8chan thread watcher now accepts .json API urls directly
  • the repository processing routine will handle server_busy errors more gracefully
  • cleaned and refactored most media viewer 'canvas' code, dejankifying a whole bunch of related stuff and generally improving the object hierarchy
  • cleaned up and unified a lot of logic and responsibility for idle checking and shutdown maintenance stop time for some big jobs
  • misc cleanup
  • misc dialog cleanup

Downloads

Version 197

@hydrusnetwork hydrusnetwork released this · 2 commits to master since this release

  • on client boot, autocomplete caches for specific file/tag service cross-references are now initialised and populated. progress is shown on the splash window
  • on client boot, surplus autocomplete caches are deleted
  • on service add, new autocomplete caches are created
  • on file add/delete, autocomplete caches are updated
  • on mappings pend/add/rescind pend/delete, autocomplete caches are updated
  • the new autocomplete caches are consulted for all non-'all known tags' queries
  • the old autocomplete cache no longer stores counts for specific file services, and the remaining associated maintenance calls are deleted
  • databases now start their own mainloops
  • databases now wait for their mainloops to finish prepping any large caches before they return to the controller
  • the client database waits for autocomplete caches to finish before it finishes its own mainloop
  • the padding around flash and the animation bar are included more accurately in some media zoom calculations, which should eliminate some general zoom jankiness and accidental 100% flash zoom coincidences that filled up the whole canvas
  • fixed some clientside server boot error spam when local server or booru had no port set
  • account refreshes that fail due to a network error will spam less to the log
  • fixed .txt unicode tag parsing from import folders, which was not decoding at the correct step
  • administrator immediate repository syncs now sync thumbnail downloads if needed
  • service thumbnail sync will no longer superfluously check the presence of thumbnails whose files are local
  • if a tag entered into the manage tags dialog has a sibling that already exists for all files, then a new 'ignore, as the sibling already exists' choice will appear
  • fixed an overcounting bug in 'selection tags' when importing and adding tags at the same time
  • fixed a typo in repository sync status text that was overcounting total number of updates by one
  • fixed youtube downloader, which broke with the new library on my new dev machine
  • the way that tags and predicates are filtered against a tag autocomplete text entry is now much faster
  • bumped up the default content update chunk threshold from 100 rows to 5,000, which seems to be speeding up processing significantly, with a cost to recovery latency--see how it works for you

Downloads

Version 196

@hydrusnetwork hydrusnetwork released this · 3 commits to master since this release

  • fixed the 8chan thread watcher for boards that host content on media.8ch.net
  • improved the thread watcher url check logic so it won't lag with the new fix
  • cleaned up the ac generation code a little
  • 'all known tags' ac counts are now summed from all the known tag services rather than calculated directly (a <= indicator for when these cases overlap will be forthcoming). this speeds up file add/delete, service reset, a/c fetch time, and general tag processing, and reduces the size of the db
  • ac generation code now deals with 'is the entry text an exact match or not?' better
  • ac generation code will now no longer produce non-exact-match siblings on an exact match search
  • ac generation code will no longer save half complete search text into the db as new tags
  • on update, the a/c cache and its helper table 'existing tags' will be cleaned of a lot of orphans, which may take a few minutes
  • fixed some bad unicode path parsing when importing files in some OSes, I think!
  • fixed some bad read autocomplete sibling substitution
  • fixed a bug where autocomplete predicate lists would not update if the new list was merely a reorder (which can happen in some unusual sibling cases)
  • fixed the tumblr parser for the subtly new API
  • import folders now support loading tags from neighbouring .txt files--check the dialog to set up which tag services you would like to import to
  • the ipfs file downloader now queries DAG object links, determines if the given multihash is a directory or other complicated object, and if so politely dumps out (handling of directory downloads is forthcoming)
  • some db code is cleaned up
  • prepared db code for some future subclasses
  • wrote most of the new ac cache db
  • misc cleanup
  • added some browser addon links to the ipfs help

Downloads

Version 195

@hydrusnetwork hydrusnetwork released this · 4 commits to master since this release

  • wrote up a v1.0 ipfs help page
  • added ipfs services to 'system:file service'
  • added a 'multihash prefix' option to ipfs services in 'services->manage services'--it will prefix thu given text to multihashes copied to the clipboard (e.g. you could use 'http://127.0.0.1:8080/ipfs/')
  • fixed a bad repo sync processing bug that was incorrectly assuming packages were completely processed when they often were not
  • all repos will have their processing timestamps reset on update, forcing a (fast) reprocess of everything they have to cover the previously missed content
  • fixed 8chan OP image parsing, which was sometimes failing due to absent md5s in the json
  • widened the splash screen a little more so repo sync text can fit a bit better
  • a couple of splash status texts are shuffled around
  • updated to sqlite 3.11.0 for windows
  • if sqlite3 reports at least version 3.11.0, the db will stick to WAL for large transactions (lke vacuum and content processing), since these are fast now
  • 'namespace:anything' will now only appear if the a/c input has no 'subtag' component., e.g. 'character:'
  • import and export folders now print simple summaries to the log if they do some work
  • tidied up the 'pages' menu
  • the various hardcoded 'delete' key events are now also triggered by a backspace on os x
  • added a rough 'copy known urls' to the regular thumbnail menu. this is prototype, let me know how you would like this information managed and displayed in future
  • in prep for the new cache layer, the autocomplete dropdowns (and hence search domains of all contexts) no longer support 'all known files' cross referenced with 'all known tags'
  • misc cleanup

Downloads

Version 194

@hydrusnetwork hydrusnetwork released this · 5 commits to master since this release

  • ipfs pins and unpins can now be queued up like file repository pending and petitioned, through the regular thumbnail right-click menu, which also reports some/all ipfs pinned selection status
  • this ipfs action queue is similarly summarised and commited at the normal service 'pending' menu
  • ipfs's 'pinned', 'to pin', and 'to unpin' statuses are displayed on thumbnails with ipfs-specific icons
  • you can copy the focussed file's ipfs multihash or all the selected files' ipfs multihashes from the thumbnail menu's share->copy->ipfs multihash
  • added a .txt tag parser to the 'path tagging' import dialog--it will parse the same sort of txt files the export dialog produces
  • the client's new 'requests' network code is harmonised, generally improved, and now produces hydrus-compatible exceptions
  • updated help re the local server and boorus now defaulting to off
  • db can now remember service-specific filenames (e.g. ipfs multihashes)
  • cleaned up some overly complicated and confused thumbnail menu code
  • the pending menu now specifies what it is about to do more plainly

Downloads

Version 193

@hydrusnetwork hydrusnetwork released this · 6 commits to master since this release

  • the client's local server and local booru can be turned off from their respective management panels, and from now on, the client will initialise with them this way.
  • if the local server or the local booru are not running, their copy/share commands won't appear in right-click menus
  • the welcome dialog is now a simpler popup message
  • incidence sorted tag lists are now sub-sorted by a-z lexicographic
  • pasting many tags that have siblings to the manage tags dialog will ask you if you want to always preference the sibling, saving time
  • added a 'clear deleted file records' button to the local file service on the review services window
  • idle mode now cannot naturally engage within the first two minutes since client boot
  • the autocomplete search logic will not count namespace characters in the autocomplete character threshold, so typing 'character:a' will not typically trigger a (very laggy) full search
  • putting a '*' anywhere in an autocomplete search_text will force a full search, ignoring the a/c character threshold
  • moved some specific 'give gui time to catch up' pause code to the generalised pause/cancel code that a lot of stuff uses, so big jobs should generally be a bit more polite
  • split the daemon class into two--one for big jobs that remains polite, and another for small jobs that triggers regardless of what else is going on. this should increase responsivity for a number of scenarios
  • fixed some bad wal failure detection and hence no-wal file creation on some instances of db cursor reinit (usually after service modification). because of now many superfluous no-wal files, existing no-wal files will be deleted on db update
  • some external storage location errors are improved
  • some internal and external storage location init is improved.
  • if an error is detected in the external storage location manager, it will not attempt to rebalance again until the client is rebooted
  • improved some upnp error catching
  • cleaned up some misc shutdown thread-gui interaction error spam
  • did some prep work on a future rewrite of daemon jobs pipeline
  • split up some mixed file/data/404 'stuff was missing' exception code

Downloads

Version 192

@hydrusnetwork hydrusnetwork released this · 8 commits to master since this release

  • added a 'check on ok' button to the manage subscriptions dialog's subscription panel
  • check file integrity now prints missing paths to the log
  • fixed a typo that was breaking some repo sync download resumes
  • if an external storage location does not exist on client boot, a popup will say so
  • resetting a service is now much faster when the service is large
  • some repo processing stuff is a bit faster
  • improved some image rendering error handling
  • some thumbnail errors are recovered from in a better way
  • improved db update bit rot resilience
  • improved the vacuum disk space error popup with better explanation of the problem and solution
  • misc improvements
  • moved to win 10 dev machine, so several windows libraries are a bit newer
  • updated to opencv 3.1.0 on windows

Downloads

Version 191

@hydrusnetwork hydrusnetwork released this · 8 commits to master since this release

  • added ipfs service type
  • added simple ipfs service gui to manage and review services windows
  • added simple ipfs download and import to pages menu
  • split confused service data object into a bunch of more flexible and readable subclasses
  • raw url downloads are now powered by 'requests' rather than my hacked http engine, and work a hell of a lot better. more to follow
  • raw url downloads now pause and cancel correctly
  • optimised some a/c cache clearing in mapping update processing
  • optimised content update object -> db yield logistics
  • added no-daemons command line switch to disable all daemons
  • added no-wal command line switch to disable WAL journalling for the db
  • if the db fails to read a new WAL-journalled db file it has just created, it will delete the file and attempt to recreate the db, never trying WAL again
  • changed the way the db writes big repo syncs to disk so that the job can be abandoned much more quickly
  • improved local file not found error to state the directory or exact path that was the problem
  • fixed some socket-level error reporting (I think timeout was part of this)
  • the petition approval and denial client-to-server network commit is broken up into smaller steps to reduce server lag and the overall likelihood of timeouts
  • subscriptions will no longer add files to their 'successful files' button when the file's url seemed new but it actually was previously deleted
  • subscriptions will now identify themselves with an additional popup message when they encounter critical errors during sync
  • editing a clientside service will force a reset of the appropriate session cache, so if you change access key, the account changes will be reflected immediately
  • the import files dialog will no longer spam error popups on uninteresting or empty files--its 'parsing complete' statement is more verbose instead
  • the 1.5s gap between parsing complete and the buttons being enabled is also removed. this was supposed to be helpful, to give you a moment to check the files were as expected, but in the end it was just annoying
  • fixed a typo in some thumbnail error catching and regeneration
  • improved my network code syncing, so linux and os x releases are cleared out of many old files
  • misc code cleanup

Downloads

Version 190

@hydrusnetwork hydrusnetwork released this · 11 commits to master since this release

  • fixed some hashing recalculation in collections that meant they reported no files in many cases
  • fixed some hashing recalculation when 'remove files' is called
  • improved the way the client db stores file information and service->file mappings
  • idle processing jobs will now explicitly wake up as soon as the client naturally switches from not idle to idle
  • the minimum allowed value for the 'max cpu %' control in the maintenance and processing options panel is now 5%
  • the maintenance and processing panel is rewritten and laid out a little clearer
  • 'busy' is now 'system busy' on the status bar
  • force idle and force unbusy are now merged into a new 'force idle' that sticks until you explicitly turn it off
  • busy and idle states should now update immidiately after closing the manage options dialog
  • improved exit code event order to be less rude to the OS
  • improved exit code emergency event handling
  • fixed a typo that was not appropriately skipping the 'do you want to run shutdown jobs?' dialog
  • file storage folder rebalancing will now occur on shutdown maintenance
  • the client now closes down more reliably if the db fails to boot
  • the client now closes down more reliably if the gui fails to boot
  • if a client vacuum fails, it'll now also raise the exact error sqlite gave
  • fixed ctrl+a on the autocomplete dropdown (I think the Insert/IME support change broke it)
  • the ways the 'read' tag autocomplete control talks to other gui elements is improved
  • the tag autocompletes will now refresh their results lists on more internal variable changes
  • the query page management controller manages fewer redundant variables
  • updated sqlite for windows
  • the client and server dbs will attempt to change to TRUNCATE journal mode if WAL causes a read disk i/o error
  • misc code cleanup

Downloads

Something went wrong with that request. Please try again.