Skip to content
This repository has been archived by the owner on May 3, 2022. It is now read-only.

Releases: SpecializedGeneralist/whatsnew

v1.0.0-beta.2

15 Nov 22:43
Compare
Choose a tag to compare
v1.0.0-beta.2 Pre-release
Pre-release

Added

  • HTTP requests made by the feed-fetcher worker can be limited with the new
    request_timeout setting.
  • Optimistic locking mechanism for GORM models.
    See: models.OptimisticLockModel, models.OptimisticSave and
    models.ErrStaleObject.

Changed

  • The base GORM model (models.Model) now includes a Version field and
    satisfies the models.OptimisticLockModel interface, allowing
    optimistic locking.
  • Each worker has been modified avoiding long-lasting transactions, extracting
    from them heavy operations, and opting for optimistic locking when
    record updates are involved. Reducing the transactions' duration and removing
    the explicit row-level locks can produce tremendous improvements
    on the performance of the whole system, when under heavy loads (i.e.
    at least thousands of sources).
  • Give ordering priority to sources never retrieved before (i.e.
    last_retrieved_at is null) when looping through sources to schedule from
    feed-scheduler and twitter-scheduler tasks.
  • Improve hnswcloent.Client.SearchKNN performance, making the requests to
    each candidate daily HNSW index concurrently.
  • Minor refactoring and improvements to some log messages and their severity
    level.
  • Upgrade dependencies.

v1.0.0-beta.1

20 Oct 17:32
Compare
Choose a tag to compare
v1.0.0-beta.1 Pre-release
Pre-release

Added

  • hnswclient.Client.FlushAllIndices function.
  • HNSW-Purger task now flushes all remaining indices after deleting the old
    ones.
  • Some tests.

Changed

  • Use weaker database row-level locks wherever possible (FOR SHARE instead
    of FOR UPDATE) to prevent possible slowdowns.
  • Upgrade dependencies.

Removed

  • hnswclient.Client.Index does not flush an HNSW index anymore at each
    vector insertion. This was possibly causing slowdowns in case of
    large indices and many concurrent jobs inserting new vectors.

Fixed

  • A failing configuration test.

v1.0.0-beta

16 Oct 15:33
Compare
Choose a tag to compare
v1.0.0-beta Pre-release
Pre-release

Added

  • HNSW-Purger task (command purge-hnsw).

Changed

  • Avoid long-living gRPC connections moving the dialing from commands
    initialization to workers (see commit a61fcbc for details).
  • Upgrade dependencies.

v1.0.0-alpha.3

11 Oct 23:43
Compare
Choose a tag to compare
v1.0.0-alpha.3 Pre-release
Pre-release

Added

  • Add documentation to the README.
  • AUTHORS.md

Changed

  • Move cmd/whatsnew.go to the project's root path, so that the tool can be
    installed more easily with go install command.
  • Use golang:1.17.1-alpine3.14 as base Builder image in the Dockerfile.
  • Provide a complete docker-compose file and related configurations, now under
    docker-compose folder.
  • Upgrade dependencies.

v1.0.0-alpha.2

01 Oct 15:07
Compare
Choose a tag to compare
v1.0.0-alpha.2 Pre-release
Pre-release

Changed

  • Enable client-side round-robin DNS load balancing for all gRPC connections.

v1.0.0-alpha.1

28 Sep 17:49
Compare
Choose a tag to compare
v1.0.0-alpha.1 Pre-release
Pre-release

Added

  • Allow setting reservation timeout and number of retries for each Faktory job
    from configuration.

Changed

  • Use the WebArticle translated title, when available, as preferred text data
    source in text-classifier, vectorizer, and zero-shot-classifier workers.
  • Upgrade dependencies.

v1.0.0-alpha

26 Sep 11:45
Compare
Choose a tag to compare
v1.0.0-alpha Pre-release
Pre-release

Changed

  • The whole project has been completely rewritten. Most notably, the simplistic
    way of handling workers' jobs with RabbitMQ has been replaced with more
    reliable jobs scheduling using Faktory.

v0.5.0

26 Sep 11:21
Compare
Choose a tag to compare
Handler CORS

v0.4.0

23 Apr 14:27
Compare
Choose a tag to compare
Upgrade spago to v0.5.2 and adapt the code

v0.3.3

23 Mar 16:57
Compare
Choose a tag to compare
Add max tweets number to configuration