v1.27.0 - Improved HNSW Filters (ACORN-based Minority Filters), Multi-target Vector Search, Cancel Stuck Backups

Breaking Changes

None

New Features

Improved HNSW Filters (ACORN-based Minority Filters)

• Acorn1 by @abdelr in #5369
• Minor ACORN fixes by @trengrj in #6010

Multi-target Vector Search

• Allow multiple inputs for a single target vector by @dirkkul in #5529

Cancel Stuck Backups

• feat: backup cancellation by @moogacs in #5736
• feat: add path to list backup response by @moogacs in #5684
• feat: List backups in progress endpoint by @moogacs in #5638
• feat: sketching Cancel Stuck Backups endpoint by @moogacs in #5639
• Extends CANCELED enum to other backup API responses by @tsmith023 in #6017
• Improve error handling for backup cancellation by @parkerduckworth in #6023

Experimental Read Compute Scaling

• feat(exp/query): Add support for propery filters. by @kavirajk in #5872
• Add readme to cmd/weaviate, only search part (no async download) by @nathanwilk7 in #5878
• add testdata for mocking and unit test cases in exp/query/api.go by @kavirajk in #5821
• feat(exp/query): Add support for vector search by @kavirajk in #5785
• feat(exp/query): Return objects from LSMKV store for offloaded tenants by @kavirajk in #5749
• feat: Search api for exp/query by @kavirajk in #5725
• try using MakeAppState to get schema.Manager by @nathanwilk7 in #5693
• exp: Add separate querier component by @kavirajk in #5663

Authorization

• refact:AuthZ: use authorization resources paths instead of custom strings by @moogacs in #5930
• refact:AuthZ: use authorization verbs instead of custom strings by @moogacs in #5917
• refact: unify AuthZ interface & add mocks by @moogacs in #5906

Dynamic RAG Syntax

• Support dynamic RAG syntax through the gRPC API by @tsmith023 in #5649

Module Improvements

• Weaviate hosted embeddings Module by @cdpierse in #4885
• Use AltNames modules feature in google modules by @antas-marcin in #5861
• Rename generative-palm module to generative-google by @antas-marcin in #5856
• Rename multi2vec-palm module to multi2vec-google by @antas-marcin in #5838
• Rename text2vec-palm module to text2vec-google by @antas-marcin in #5816
• Only lowercase vectorization input for specific modules by @dirkkul in #5796
• Generative FriendliAI Module by @snowman39 in #5598
• Add support for JinaAI reranker API by @wregen in #5421
• Enable arrays in generative searches by @dirkkul in #5964
• add support for sending azure deployment id and resource name via request headers by @flipace in #5776
• Use custom number of dimensions also when using Azure OpenAI by @andrewisplinghoff in #5987
• Fix Generative-OpenAI Default 3.5-turbo Max Tokens and add gpt-4o Models by @Dannydoesdev in #5982

Performance & Observability Improvements

• feat(metrics): Add weaviate_build_info prometheus metrics. by @kavirajk in #5865
• Add metrics for batch sizes by @robbespo00 in #5328
• Speed up property unmarshalling by @dirkkul in #5213
• Add SIMD implementation for Bitwise Hamming - x86 and ARM by @ajit283 in #5941
• add progress indicator for schema catchup on restart by @reyreaud-l in #6030
• feat: segments cleanup by @aliszka in #5916
• feat: segments cleanup (roaringsetrange) by @aliszka in #5953

Testing Improvements

• Download SIFT dataset when not present by @jfrancoa in #4013
• Use a more lenient value to reduce flakiness in tombstone cleanup test by @abdelr in #5985
• [lsmkv tests] Reduce expected number of spot checks to reduce CI flake by @etiennedi in #5983
• Add docker login to acceptance tests by @dirkkul in #6014

Fixes

• Fix: Non-blocking segment initialization on LSM segment flush by @etiennedi in #5943
• chore(push_docker): Pass correct branch name to docker build info. by @kavirajk in #5967
• Use comma instead of space to separate array entries in generative search by @dirkkul in #5965
• Fix nil nodes in unreachability function by @robbespo00 in #5691
• Flat dimension persistence by @trengrj in #5554
• Fix classification properties to return by @dirkkul in #5637
• Fix unmarshalling of object arrays by @dirkkul in #5640
• Randomize PQ compression training data by @Wert1996 in #5523
• Add vector generator function for BQ and SQ by @robbespo00 in #5374
• fix: properly consider when obj was deleted when scaning over seconda… by @jeroiraz in #5312
• fix: consider the case when the hashtree has been explicitly set to nil by @jeroiraz in #5306
• Ensure json.encoding/Number types are parsed in UpdateClass by @tsmith023 in #5863
• fix: remove assumption that first node responding full payload provides latest object version by @jeroiraz in #6005
• Fix vendoring in acceptance with go client project by @antas-marcin in #6024
• fix: Validate search vector dimensions before PQ decoding by @parkerduckworth in #5988
• improve raft rejoin error message, increase default raft bootstrap timeout by @reyreaud-l in #6028
• Fix: prevent class creation with invalid replication factor and MT enabled by @parkerduckworth in #6032
• fix: handle partial object deletion by @jeroiraz in #5287
• Rename object deletion to deletion strategy by @dirkkul in #5994

Docs & Chores

• chore: Adjust the tag name in case of main and stable/v* branch builds by @antas-marcin in #5969
• Enable creation of relatd GH issues from main repo by @databyjp in #5921
• Optimize docker push script by @antas-marcin in #5922
• Add aws secret/access key for local minio to querier env vars by @nathanwilk7 in #5920
• doc(README): Update how to setup, ingest and query FROZEN tenat via querier by @kavirajk in #5904
• chore(dev/tools): Log about deleting local persistent state by @kavirajk in #5741
• chore(grpc): Make BatchFromProto public. by @kavirajk in #5618
• chore(docker-compose): Add a usage clarification note by @kavirajk in #5572
• Remove impossible condition: nil != nil by @wxingda in #5358
• rename env variables by @daveatweaviate in #5279
• chore: Push docker script prefix generation improvements by @antas-marcin in #5975
• chore: fix docker push script from CI branch build by @antas-marcin in #5977
• chore(deps): bump grpc-health-probe to v0.4.34 version by @antas-marcin in #6009
• chore: rename deletion strategy envvar by @jeroiraz in #6025

New Contributors

• @wxingda made their first contribution in #5358
• @wregen made their first contribution in #5421
• @Wert1996 made their first contribution in #5523
• @snowman39 made their first contribution in #5598
• @flipace made their first contribution in #5776
• @Dannydoesdev made their first contribution in #5982

Full Changelog: v1.26.6...v1.27.0