CHANGELOG.md

Release Note (0.30.0)

Release time: 2023-04-17 16:35:12

🙇 We'd like to thank all contributors for this new release! In particular, samsja, Charlotte Gerhaher, Alex Cureton-Griffiths, Nan Wang, Anne Yang, Johannes Messner, Nikolas Pitsillos, Kacper Łukawski, Shukri, Saba Sturua, Aman Agarwal, Aziz Belaweid, Jackmin801, AlaeddineAbdessalem, Tanguy Abel, Joan Fontanals, Jina Dev Bot, 🙇

🆕 New Features

• [2ea0acd7] - qdrant document index (#1321) (Kacper Łukawski)
• [046c8deb] - weaviate document index V2! (#1367) (Shukri)
• [bd41ce64] - elasticsearch(v8) document index (#1251) (Anne Yang)
• [95c1eca3] - read from remote csv file (#1362) (Charlotte Gerhaher)
• [444fb40a] - add validate search fields (#1331) (Saba Sturua)
• [02d66ed5] - save image tensor to file (#1335) (Charlotte Gerhaher)
• [9b03d290] - implement document equality (#1329) (Saba Sturua)
• [4e754567] - add pil load (#1322) (samsja)
• [90633c88] - docarray fastapi simple integration (#1320) (Saba Sturua)
• [d4277544] - torch backend basic operation tests (#1306) (Aman Agarwal)
• [a002bca2] - elasticsearch document index (#1196) (Anne Yang)
• [6cd05f8b] - implement push/pull interface from JAC, file and s3 (#1182) (Jackmin801)
• [081a03f8] - test: DocumentArray method tests similar to list methods like reverse, sort, remove, pop (#1291) (Aman Agarwal)
• [70fa4fa7] - create documents from dict (#1283) (Saba Sturua)
• [11d013e8] - add get_paths() instead of v1 from_files() (#1267) (Charlotte Gerhaher)
• [38ee3a55] - add minimal logger (#1254) (Saba Sturua)
• [e2c9b646] - index: index data with union types (#1220) (Johannes Messner)
• [d8d36d77] - ad user defined mapping for python type to db type (#1252) (Charlotte Gerhaher)
• [ed4058cd] - shift to mkdocs (#1244) (samsja)

🐞 Bug fixes

• [f1d3ffd3] - ingore push pull test (#1403) (samsja)
• [c45e3497] - fix push pull (#1384) (samsja)
• [b13b869a] - needs succes all test before pushing to pypi prelease (#1388) (samsja)
• [b2586e83] - add back cd from v1 (#1387) (samsja)
• [8090d659] - add import checks and add weaviate doc index to index init (#1383) (Charlotte Gerhaher)
• [f577fcb2] - fix install (#1382) (samsja)
• [7956a7c2] - default dims=-1 for elastic index (#1368) (Anne Yang)
• [7b472490] - adjust remote file path in test and add toydata (#1364) (Charlotte Gerhaher)
• [760c106f] - DocArrayStack to DocVec in docstrings (#1347) (Aman Agarwal)
• [4d9ff9d6] - in .to_bytes() return type specific bytes (#1341) (Charlotte Gerhaher)
• [996f65f0] - fix type in es test (#1338) (samsja)
• [9b7c3e22] - return audio, image specific types in .load() and .load_bytes() (#1328) (Charlotte Gerhaher)
• [9e03f082] - mark es test as index (#1314) (samsja)
• [d73dc793] - flatten schema of abstract index (#1294) (Anne Yang)
• [842664f8] - remove files (#1305) (samsja)
• [2602472d] - docstring polish typing (#1299) (samsja)
• [d86858d4] - rename DocArrayProto to DocumentArrayProto (#1297) (samsja)
• [89c2a0a9] - hnswlib doc index (#1277) (Johannes Messner)
• [d0656f97] - add int, float and others to doc summary (#1287) (Charlotte Gerhaher)
• [33641271] - proto ser and deser for nested tuple/dict/list (#1278) (samsja)
• [df6dc0bd] - doc summary for dict and set attributes (#1279) (Charlotte Gerhaher)
• [2af14cdf] - bytes type in TextDoc and VideoDoc (#1270) (Charlotte Gerhaher)
• [17892890] - disable pycharm da property detection (#1262) (Charlotte Gerhaher)
• [32b3191d] - move test to integration test (#1260) (samsja)
• [baebc194] - up arrow emoji display in readme on docarray.org (#1034) (Alex Cureton-Griffiths)
• [d594570f] - install docs: consistency, grammar (#1028) (Alex Cureton-Griffiths)

🧼 Code Refactoring

• [fc1af117] - change return type of find batched (#1339) (Nikolas Pitsillos)
• [c48d6c04] - rename stack (#1376) (samsja)
• [18ad2eab] - rename from_pandas to from_dataframe (#1358) (samsja)
• [dffb227f] - remove warning, align naming (#1337) (Johannes Messner)
• [a74b3bb4] - rename DocArray to DocList (#1334) (samsja)
• [221b440c] - remove url validation (#1333) (Saba Sturua)
• [69c7a77e] - map_docs_batch to map_docs_batched (#1312) (Charlotte Gerhaher)
• [d231f38a] - rename Document to Doc (#1293) (samsja)
• [b029b5e6] - bytes to bytes_ in predefined documents (#1273) (Charlotte Gerhaher)
• [64532dd8] - da: remove tensor type from DocumentArray init (#1268) (samsja)
• [6707f4c9] - doc index structure (#1266) (Saba Sturua)
• [d9d7bd78] - rename filter to filter_docs to avoid shadowing of filtern (#1257) (Charlotte Gerhaher)

📗 Documentation

• [21da4625] - add migration guide (#1398) (Charlotte Gerhaher)
• [5729a62a] - polish docs (#1400) (samsja)
• [0872b6b9] - final round of fixes (#1401) (Alex Cureton-Griffiths)
• [2a02635e] - document index (#1346) (Nan Wang)
• [091004b1] - fix style in collapsible box (#1396) (Anne Yang)
• [baa3cbc3] - resolve todos and incomplete sections and missing links (#1394) (Charlotte Gerhaher)
• [ce3fb6ee] - fix doc store code snippet in README.md (#1389) (Charlotte Gerhaher)
• [85d41ef6] - fix represent, intro (#1390) (Alex Cureton-Griffiths)
• [df126173] - adjust file paths to main branch (#1385) (Charlotte Gerhaher)
• [dba02b3e] - check docstrings and clean up (#1373) (Charlotte Gerhaher)
• [42523c7b] - tweak the readme (#1372) (Johannes Messner)
• [13c97fe1] - add storing with file (#1348) (Nan Wang)
• [6c45d4b1] - add missing links and clean up (#1370) (Charlotte Gerhaher)
• [18f2a3f9] - add sending section (#1350) (Nan Wang)
• [f5b0ea32] - menu: consistency, wording fixes (#1363) (Alex Cureton-Griffiths)
• [9a13f93c] - fastapi integration section (#1326) (Saba Sturua)
• [b8f178ee] - multi modalities (#1317) (Charlotte Gerhaher)
• [2f711438] - add DocList and DocVec section (#1343) (samsja)
• [f1bb4e4b] - rewrite readme (#1340) (Johannes Messner)
• [0e18796f] - add torch and tf tensors to Api references section (#1345) (Charlotte Gerhaher)
• [a6f04fbb] - add audio2text showcase (#1336) (Aziz Belaweid)
• [c0718e57] - add user guide (#1292) (samsja)
• [2aa7727b] - fix map docstring (#1311) (samsja)
• [f3948bd3] - fix docstring example of find_batched (#1308) (Johannes Messner)
• [4cba12fc] - add utils section (#1307) (samsja)
• [9728bd5b] - fix up english (#1285) (Alex Cureton-Griffiths)
• [a92c89b1] - add explanation about id field (#1242) (Johannes Messner)
• [9c95f3ad] - remove docsqa (#1214) (AlaeddineAbdessalem)
• [13c8f149] - fix opensearch docker compose yaml file (#997) (AlaeddineAbdessalem)
• [1fec2c24] - fixes for graphql, torch pages (#1205) (Alex Cureton-Griffiths)
• [5de8fd45] - fix small typo in pull (#1158) (Jackmin801)
• [fb72abd2] - remove mention about future support for big data loading (#1118) (Tanguy Abel)
• [34403f7c] - fix urls to docs.docarray.org (#1101) (Alex Cureton-Griffiths)
• [dda41063] - scipy install (#1086) (Johannes Messner)
• [0a2b2736] - remove ecosystem from docs (#1092) (Joan Fontanals)
• [5beeaaa7] - add calendar link to readme (#1060) (Johannes Messner)

🍹 Other Improvements

• [56e11a3c] - install poetry during release (#1404) (samsja)
• [aa346385] - add release template (#1402) (samsja)
• [a32e8e59] - fix install (#1399) (samsja)
• [2452c72f] - fix update of pyproject toml version (#1395) (samsja)
• [3ab98f89] - fix ci to do pre-release (#1393) (samsja)
• [30dee5a8] - fix cd not running (#1392) (samsja)
• [570577dc] - fix readme (#1386) (samsja)
• [aef8b626] - make weaviate dependency optional (#1381) (Johannes Messner)
• [6e9510e6] - fix logo readme (#1380) (samsja)
• [dbf2bba3] - prepare to merge to main branch (#1377) (samsja)
• [0f94d1a5] - ci use different worker for each DocIndex (#1375) (samsja)
• [fb6b02bc] - fix mypy (#1371) (samsja)
• [3f739aef] - add instructions to pip installs and group extras (#1281) (Charlotte Gerhaher)
• [d5e87cd7] - add docstring test (#1298) (samsja)
• [5d48be80] - docs: add ci and fix docs ui (#1295) (samsja)
• [bd34acd8] - version: the next version will be 0.21.1 (Jina Dev Bot)
• [ca2973f0] - bump version (#1023) (Johannes Messner)

Release Note (0.31.0)

Release time: 2023-05-08 09:41:08

🙇 We'd like to thank all contributors for this new release! In particular, samsja, Joan Fontanals, Charlotte Gerhaher, Carren, Aman Agarwal, カレン, Johannes Messner, Alex Cureton-Griffiths, Anne Yang, Yanlong Wang, Scott Martens, Jina Dev Bot, 🙇

🆕 New Features

• [eb693183] - index or collection name will default to doc-type name (#1486) (Joan Fontanals)
• [c4c4b9f8] - add to_json alias (#1494) (Joan Fontanals)
• [b3649b4b] - make DocList an actual Python List (#1457) (Joan Fontanals)
• [a25d1ae2] - store as json-array (#1459) (Carren)
• [f65e0231] - add in-memory doc index (#1441) (Charlotte Gerhaher)
• [83e73847] - add config to load more field that the schema (#1437) (samsja)
• [9bf0512a] - add len into DocIndex (#1454) (カレン)
• [2382ced9] - add google analytics (#1432) (samsja)
• [4fac9a88] - add install instructions for hnswlib and elastic doc index (#1431) (Charlotte Gerhaher)
• [53304cef] - point to older versions when importing Document or DocumentArray (#1422) (Charlotte Gerhaher)

🐞 Bug fixes

• [67c7e6d5] - fix nested doc to json (#1502) (samsja)
• [f5f692d8] - fix extend with itself infinite recursion (#1493) (Joan Fontanals)
• [b77df16b] - allow doclist to have nested optional document (#1472) (samsja)
• [e37a59e8] - fix to dict exclude (#1481) (samsja)
• [baaf5cba] - use pd.concat() instead df.append() in to_dataframe() to avoid warning (#1478) (Charlotte Gerhaher)
• [deb81b93] - fix equal of BaseDoc with nested DocList (#1477) (samsja)
• [d497cba4] - return doclist of same type as input index in find and findbatched (#1470) (Charlotte Gerhaher)
• [815ba889] - from proto for nested List and Dict (#1471) (samsja)
• [9cfe2a6d] - raise error when calling to csv or to dataframe on non homegenou… (#1467) (samsja)
• [0ed8523e] - len check in doc index logger if docs isinstance of BaseDoc (#1465) (Charlotte Gerhaher)
• [7febaca0] - add logs to elasticsearch index (#1427) (Aman Agarwal)
• [77c9d7bc] - docindex urls (#1433) (Alex Cureton-Griffiths)
• [52960981] - torch tensor with grad to numpy (#1429) (Johannes Messner)
• [0c73ad83] - passes max_element when load index in hnswlib (#1426) (Anne Yang)
• [bf2e50c2] - binary format version bump (#1414) (Yanlong Wang)
• [f67508ad] - save index during creation for hnswlib (#1424) (Anne Yang)
• [98dfe69e] - install commands after removing of common (#1421) (Charlotte Gerhaher)
• [427d2a77] - skip push pull (#1405) (samsja)

🧼 Code Refactoring

• [7ba430ce] - rename InMemoryDocIndex to InMemoryExactNNIndex (#1466) (Charlotte Gerhaher)

📗 Documentation

• [091b1802] - change cosine similarity to distance for hnswlib doc index (#1476) (Charlotte Gerhaher)
• [a76cc615] - fix fastapi (#1453) (samsja)
• [a36522ce] - fix typos (#1436) (Johannes Messner)
• [fad1290e] - index predefined documents (#1434) (Johannes Messner)
• [ade63830] - storage: proofread (#1423) (Alex Cureton-Griffiths)
• [3eb7511f] - contributing: basic fixes (#1418) (Alex Cureton-Griffiths)
• [70924065] - clean up data types section (#1412) (Charlotte Gerhaher)
• [ef527c58] - consistent wording (#1419) (Alex Cureton-Griffiths)
• [cdcdcf3e] - migration-guide: fix issues (#1417) (Alex Cureton-Griffiths)
• [4e04c069] - fix README.md (#1411) (Scott Martens)
• [176fd36f] - remove duplicate api reference section (#1408) (Johannes Messner)

🏁 Unit Test and CICD

• [2d426df6] - try to get jac tests back up (#1485) (Joan Fontanals)

🍹 Other Improvements

• [d1f13d68] - remove file (#1499) (samsja)
• [c9d0f719] - ci fix jac by passing secret to workflow (#1492) (samsja)
• [ca6c0e22] - add seperate jac ci (#1487) (samsja)
• [8df9e7f3] - bump version to 0.31.0 (#1458) (samsja)
• [46e55f98] - use temp file for docs build action (#1416) (samsja)
• [fb796680] - fix cd docs, readme and release (#1413) (samsja)
• [ce89d5b7] - bump pyproject version (#1415) (samsja)
• [e6b3700d] - version: the next version will be 0.30.1 (Jina Dev Bot)
• [56e11a3c] - install poetry during release (#1404) (samsja)

Release Note (0.31.1)

Release time: 2023-05-08 16:30:54

🙇 We'd like to thank all contributors for this new release! In particular, samsja, Jina Dev Bot, 🙇

🐞 Bug fixes

• [302b49a9] - json and dict when calling empty doclist (#1512) (samsja)

🧼 Code Refactoring

• [ebecff85] - remove useless step in json encoder (#1513) (samsja)

🍹 Other Improvements

• [8c7eb95f] - bump version (#1514) (samsja)
• [94cccbb5] - fix cd for documentation (#1509) (samsja)
• [04b930f4] - version: the next version will be 0.31.1 (Jina Dev Bot)

Release Note (0.32.0)

Release time: 2023-05-16 11:29:36

🙇 We'd like to thank all contributors for this new release! In particular, samsja, Saba Sturua, Anne Yang, Zhaofeng Miao, Mohammad Kalim Akram, Kacper Łukawski, Joan Fontanals, Johannes Messner, IyadhKhalfallah, Jina Dev Bot, 🙇

🆕 New Features

• [db4cc1a7] - save and load inmemory index (#1534) (Saba Sturua)
• [44977b75] - subindex for document index (#1428) (Anne Yang)
• [096f6449] - search_field should be optional in hybrid text search (#1516) (Anne Yang)
• [e9fc57af] - openapi tensor shapes (#1510) (Johannes Messner)

🐞 Bug fixes

• [2d3bcd2e] - check if filepath exists for inmemory index (#1537) (Saba Sturua)
• [1f2dcea6] - add empty judgement to index search (#1533) (Anne Yang)
• [8dd050f5] - detach the torch tensors (#1526) (Mohammad Kalim Akram)
• [bfebad6b] - DocVec display (#1522) (Anne Yang)
• [cdde136c] - docs link (#1518) (IyadhKhalfallah)

📗 Documentation

• [02afeb9f] - store_jac: remove wrong info (#1531) (Zhaofeng Miao)
• [bc7f7253] - fix link to documentation in readme (#1525) (Joan Fontanals)
• [0ef6772d] - flatten structure (#1520) (Johannes Messner)

🍹 Other Improvements

• [9657d6fb] - bump to 0.32.0 (#1541) (samsja)
• [9705431b] - Add more Qdrant examples (#1527) (Kacper Łukawski)
• [445a72fa] - add protobuf in the hnsw extra (#1524) (Saba Sturua)
• [20fdcd27] - version: the next version will be 0.31.2 (Jina Dev Bot)

Release Note (0.32.1)

Release time: 2023-05-26 14:50:34

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, maxwelljin, Johannes Messner, aman-exp-infy, Saba Sturua, Jina Dev Bot, 🙇

🆕 New Features

• [8651e6e8] - logs added for es8 index (#1551) (aman-exp-infy)

🐞 Bug fixes

• [5d41c13c] - fix None embedding exact nn search (#1575) (Joan Fontanals)
• [7a7a83a5] - support list in document class (#1557) (#1569) (maxwelljin)
• [40549f4a] - fix anydoc deserialization (#1571) (Joan Fontanals)
• [44317570] - dict method for document view (#1559) (Johannes Messner)

🧼 Code Refactoring

• [0bcc956d] - uncaped tests as a nightly job (#1540) (Saba Sturua)

📗 Documentation

• [0e6aa3b6] - update doc building guide (#1566) (Johannes Messner)
• [a01a0554] - explain the state of doclist in fastapi (#1546) (Johannes Messner)

🍹 Other Improvements

• [8a2e92a3] - update pyproject.toml (#1581) (Joan Fontanals)
• [9b5cbeda] - version: the next version will be 0.32.1 (Jina Dev Bot)

Release Note (0.33.0)

Release time: 2023-06-06 14:05:56

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, Saba Sturua, samsja, maxwelljin, Mohammad Kalim Akram, Jina Dev Bot, 🙇

🆕 New Features

• [110f714f] - avoid stack embedding for every search (#1586) (maxwelljin)
• [5e74fcca] - tensor coersion (#1588) (samsja)

🐞 Bug fixes

• [f7371b48] - filter limits (#1618) (Saba Sturua)
• [6903c773] - hnswlib must be able to search with limit more than num docs (#1611) (Joan Fontanals)
• [e24be8d6] - allow update on HNSWLibIndex (#1604) (Joan Fontanals)
• [3cef708c] - dynamically resize internal index to adapt to increasing number of docs (#1602) (Joan Fontanals)
• [a5c90064] - fix simple usage of HNSWLib (#1596) (Joan Fontanals)
• [88414ce2] - fix InMemoryExactNN index initialization with nested DocList (#1582) (Joan Fontanals)
• [5d0e24c9] - fix summary of Doc with list (#1595) (Joan Fontanals)
• [f765d9f4] - solve issues caused by issubclass (#1594) (maxwelljin)
• [5ee87876] - make example payload a string and not bytes (#1587) (Joan Fontanals)

🧼 Code Refactoring

• [f9e504ef] - minor changes in weaviate (#1621) (Saba Sturua)
• [4eec5599] - make AnyTensor a class (#1552) (Mohammad Kalim Akram)

📗 Documentation

• [29c2d23a] - add forward declaration steps to example to avoid pickling error (#1615) (Joan Fontanals)
• [5e6bf755] - fix n_dim to dim in docs (#1610) (Joan Fontanals)
• [de8c654b] - add in memory to documentation as list of supported vector index (#1607) (Joan Fontanals)
• [1e41b5c5] - add a tensor section to docs (#1576) (samsja)

🍹 Other Improvements

• [68194f49] - update version to 0.33 (#1626) (Joan Fontanals)
• [ac2e417e] - fix issue template (#1624) (samsja)
• [e1777144] - add a better looking issue template (#1623) (samsja)
• [692584d6] - simplify find batched (#1598) (Joan Fontanals)
• [91350882] - version: the next version will be 0.32.2 (Jina Dev Bot)

Release Note (0.34.0)

Release time: 2023-06-21 08:15:43

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, Johannes Messner, Saba Sturua, samsja, maxwelljin, Shukri, Nikolas Pitsillos, Joan Fontanals Martinez, maxwelljin2, Kacper Łukawski, Aman Agarwal, Jina Dev Bot, 🙇

🆕 New Features

• [eb3f8570] - tensor type for protobuf deserialization (#1645) (Johannes Messner)
• [a6fdd80c] - sub-document support for indexer (maxwelljin2)
• [78892703] - contain func for qdrant (maxwelljin2)
• [74a683c0] - contain func for weaviate (maxwelljin2)
• [6ca3aa6e] - contain func for elastic (maxwelljin2)
• [66b0f716] - check contain in indexer (maxwelljin2)
• [2c123535] - support subindex on ExactNNSearch (#1617) (maxwelljin)

🐞 Bug fixes

• [c3c8061f] - docvec equality if tensors are involved (#1663) (Johannes Messner)
• [0c27fef6] - bugs when serialize union type (#1655) (maxwelljin)
• [dc96e38a] - pass limit as integer (#1657) (Joan Fontanals)
• [7e211a94] - pass limit as integer (#1656) (Joan Fontanals)
• [c3db7553] - update text search to match client's new sig (#1654) (Shukri)
• [4e7e262a] - doc vec equality (#1641) (Nikolas Pitsillos)
• [eae44954] - default column config should be DBConfig and not RuntimeConfig (#1648) (Joan Fontanals)
• [d13c8c45] - move default_column_config to DBConfig (Joan Fontanals Martinez)
• [cd3efc6f] - summary of legacy document (maxwelljin)
• [c13739b8] - remove get documents method (maxwelljin2)
• [7c807d4f] - remove get all documents method (maxwelljin2)
• [00794486] - mypy issues (maxwelljin2)
• [c8356813] - protobuf (de)ser for docvec (#1639) (Johannes Messner)
• [f36c6211] - find_and_filter for inmemory (#1642) (Saba Sturua)
• [1abdfce0] - legacy document issues (maxwelljin2)
• [b856b0b3] - qdrant: working with external Qdrant collections #1630 (#1632) (Kacper Łukawski)
• [693f877d] - DocList and DocVec are now coerced to each other correctly (#1568) (Aman Agarwal)
• [65afa9a1] - fix update with tensors (#1628) (Joan Fontanals)

🧼 Code Refactoring

• [69dc861b] - implementation of InMemoryExactNNIndex follows DBConfig way (#1649) (Joan Fontanals)

📗 Documentation

• [4e6bf49b] - coming from langchain (#1660) (Saba Sturua)
• [e870eb88] - enhance DocVec section (#1658) (maxwelljin)
• [eedd83ce] - qdrant in memory usage (#1634) (Saba Sturua)

🍹 Other Improvements

• [dc7b681e] - upgrade version to 0.34.0 (#1664) (Joan Fontanals)
• [deb892f1] - fix link on pypi (#1662) (samsja)
• [7f91e217] - remove useless file (#1650) (samsja)
• [67a328f4] - Revert "fix: move default_column_config to DBConfig" (Joan Fontanals Martinez)
• [adc48180] - drop python 3.7 (#1644) (samsja)
• [e66bf106] - version: the next version will be 0.33.1 (Jina Dev Bot)

Release Note (0.35.0)

Release time: 2023-07-03 11:53:25

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, Johannes Messner, Saba Sturua, Han Xiao, Jina Dev Bot, 🙇

🆕 New Features

• [8f25887d] - i/o for DocVec (#1562) (Johannes Messner)
• [e0e5cd8c] - validate file formats in url (#1606) (#1669) (Saba Sturua)
• [a7643414] - add method to create BaseDoc from schema (#1667) (Joan Fontanals)

🐞 Bug fixes

• [bcb60ca6] - better error message when docvec is unusable (#1675) (Johannes Messner)

📗 Documentation

• [b6eaa94c] - fix a reference in readme (#1674) (Saba Sturua)

🏁 Unit Test and CICD

• [b65b385d] - pin pydantic version (#1682) (Joan Fontanals)

🍹 Other Improvements

• [3f089e52] - update version to 0.35.0 (#1684) (Joan Fontanals)
• [3fc6ecb7] - fix docarray v1v2 terms (#1668) (Han Xiao)
• [f507a5f7] - version: the next version will be 0.34.1 (Jina Dev Bot)

Release Note (0.36.0)

Release time: 2023-07-18 14:43:28

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, Saba Sturua, Aman Agarwal, Shukri, samsja, Puneeth K, Jina Dev Bot, 🙇

🆕 New Features

• [b306c80b] - add JAX as Computation Backend (#1646) (Aman Agarwal)
• [069aa3aa] - support redis (#1550) (Saba Sturua)

🐞 Bug fixes

• [15e3ed69] - weaviate handles lowercase index names (#1711) (Saba Sturua)
• [c5664016] - slow hnsw by caching num docs (#1706) (Saba Sturua)
• [d2e18580] - qdrant unable to see index_name (#1705) (Saba Sturua)
• [94a479eb] - fix search in memory with AnyEmbedding (#1696) (Joan Fontanals)
• [62ad22aa] - use safe_issubclass everywhere (#1691) (Joan Fontanals)
• [f6ce2833] - avoid converting doclists in the base index (#1685) (Saba Sturua)

🧼 Code Refactoring

• [0ea68467] - contains method in the base class (#1701) (Saba Sturua)
• [0a1da307] - more robust method to detect duplicate index (#1651) (Shukri)

📗 Documentation

• [5089bdae] - add docs for dict() method (#1643) (Puneeth K)

🏁 Unit Test and CICD

• [e0afb5e7] - do not require black for tests more (#1694) (Joan Fontanals)
• [0dd49538] - do not require black for tests (#1693) (Joan Fontanals)

🍹 Other Improvements

• [ddc73e19] - upgrade version in pyproject (#1712) (Joan Fontanals)
• [528adfc8] - upgrade version to 0.36 (#1710) (Joan Fontanals)
• [a3f6998a] - remove one of the codecov badges (#1700) (Joan Fontanals)
• [b364ae1a] - add codecov (#1699) (Joan Fontanals)
• [64bbf14a] - add code of conduct (#1688) (samsja)
• [d2655238] - version: the next version will be 0.35.1 (Jina Dev Bot)

Release Note (0.37.0)

Release time: 2023-08-03 03:11:16

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, Saba Sturua, Johannes Messner, Jina Dev Bot, 🙇

🆕 New Features

• [31c2bb9c] - add description and example to ID field of BaseDoc (#1737) (Joan Fontanals)
• [efeab90d] - tensor_type for all DocVec serializations (#1679) (Johannes Messner)
• [00e980dc] - filtering in hnsw (#1718) (Saba Sturua)
• [7ad70bfc] - update for inmemory index (#1724) (Saba Sturua)
• [007f1131] - support milvus (#1681) (Saba Sturua)
• [c96707a1] - InMemoryExactNNIndex pre filtering (#1713) (Saba Sturua)

🐞 Bug fixes

• [d2c82d49] - tensor equals type raises exception (#1739) (Johannes Messner)
• [87ec19f8] - add description and title to dynamic class (#1734) (Joan Fontanals)
• [896c20be] - create more info from dynamic (#1733) (Joan Fontanals)
• [0e130100] - fix call to unsafe issubclass (#1731) (Joan Fontanals)
• [4cd58500] - collection and index name in qdrant (#1723) (Joan Fontanals)
• [304a4e9b] - fix deepcopy torchtensor (#1720) (Joan Fontanals)

🧼 Code Refactoring

• [a643f6ad] - hnswlib performance (#1727) (Joan Fontanals)
• [19aec21a] - do not recompute every time num_docs (#1729) (Joan Fontanals)

📗 Documentation

• [7c10295c] - make document indices self-contained (#1678) (Saba Sturua)

🏁 Unit Test and CICD

• [7be038c8] - refactor test to be independent (#1738) (Joan Fontanals)
• [24c00cc8] - refactor hnswlib test subindex (#1732) (Joan Fontanals)

🍹 Other Improvements

• [77b4dc1f] - update version (#1743) (Joan Fontanals)
• [3be6f2b9] - avoid extra debugging (#1730) (Joan Fontanals)
• [24143a1f] - refactor filter in hnswlib (#1728) (Joan Fontanals)
• [410665ad] - add JAX to README (#1722) (Joan Fontanals)
• [2a866aea] - add link to roadmap in readme (#1715) (Joan Fontanals)
• [68b0c5b8] - version: the next version will be 0.36.1 (Jina Dev Bot)

Release Note (0.37.1)

Release time: 2023-08-22 14:09:53

🙇 We'd like to thank all contributors for this new release! In particular, samsja, AlaeddineAbdessalem, TERBOUCHE Hacene, Joan Fontanals, Jina Dev Bot, 🙇

🐞 Bug fixes

• [0ad18a63] - bump version (#1757) (samsja)
• [46c5dfd0] - relax the schema check in update mixin (#1755) (AlaeddineAbdessalem)
• [6c771125] - qdrant: fix non-class type fields #1748 (#1752) (TERBOUCHE Hacene)
• [adb0d014] - fix dynamic class creation with doubly nested schemas (#1747) (AlaeddineAbdessalem)
• [691d939e] - fix readme test (#1746) (samsja)

📗 Documentation

• [a39c4f98] - update readme (#1744) (Joan Fontanals)

🍹 Other Improvements

• [bd3d8f03] - version: the next version will be 0.37.1 (Jina Dev Bot)

Release Note (0.38.0)

Release time: 2023-09-07 13:40:16

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, Johannes Messner, samsja, AlaeddineAbdessalem, Jina Dev Bot, 🙇

🐞 Bug fixes

• [fb174560] - skip doc attributes in annotations but not in fields (#1777) (Joan Fontanals)
• [3dc525f4] - make DocList.to_json() return str instead of bytes (#1769) (Johannes Messner)
• [2af8a0c6] - casting in reduce before appending (#1758) (AlaeddineAbdessalem)

🧼 Code Refactoring

• [08ca686d] - use safe_issubclass (#1778) (Joan Fontanals)

📗 Documentation

• [189ff637] - explain how to set document config (#1773) (Johannes Messner)
• [cd4854c9] - add workaround for torch compile (#1754) (Johannes Messner)
• [587ab5b3] - add note about pickling dynamically created doc class (#1763) (Joan Fontanals)
• [61bf9c7a] - improve filtering docstrings (#1762) (Joan Fontanals)

🍹 Other Improvements

• [7ec88b46] - update minor (#1781) (Joan Fontanals)
• [cc2339db] - remove pydantic ref from issue template (#1767) (samsja)
• [d5cb02fb] - version: the next version will be 0.37.2 (Jina Dev Bot)

Release Note (0.39.0)

Release time: 2023-10-02 13:06:02

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, samsja, lvzi, Puneeth K, Jina Dev Bot, 🙇

🆕 New Features

• [83d2236a] - enable dynamic doc with Pydantic v2 (#1795) (Joan Fontanals)
• [2a1cc9e4] - add BaseDocWithoutId (#1803) (samsja)
• [8fba9e45] - remove JAC (#1791) (Joan Fontanals)
• [715252a7] - hybrid pydantic support for both v1 and v2 (#1652) (samsja)

🐞 Bug fixes

• [c2b08fa5] - docstring tests with pydantic v2 (#1816) (samsja)
• [3da3603b] - allow config extension in pydantic v2 (#1814) (samsja)
• [4a1bc26a] - allow nested model dump via docvec (#1808) (samsja)
• [26d776dd] - validate before (#1806) (samsja)
• [7209b784] - fix double subscriptable error (#1800) (Joan Fontanals)
• [2937e253] - make DocList compatible with BaseDocWithoutId (#1805) (samsja)
• [0148e99c] - milvus connection para missing (#1802) (lvzi)
• [2f3b85e3] - raise exception when type of DocList is object (#1794) (Puneeth K)

🧼 Code Refactoring

• [3718a747] - add is_index_empty API (#1801) (Joan Fontanals)

📗 Documentation

• [061bd81a] - fix documentation for pydantic v2 (#1815) (samsja)
• [d0b99909] - adding field descriptions to predefined mesh 3D document (#1789) (Puneeth K)
• [18d3afce] - adding field descriptions to predefined point cloud 3D document (#1792) (Puneeth K)
• [4ef49394] - adding field descriptions to predefined video document (#1775) (Puneeth K)
• [68cc1423] - adding field descriptions to predefined text document (#1770) (Puneeth K)
• [441db26d] - adding field descriptions to predefined image document (#1772) (Puneeth K)
• [35d2138c] - adding field descriptions to predefined audio document (#1774) (Puneeth K)

🏁 Unit Test and CICD

• [9a6b1e64] - move the pydantic check inside test (#1812) (Joan Fontanals)
• [92de15e6] - remove skip of s3 (#1811) (Joan Fontanals)
• [bfac0939] - remove skips (#1809) (Joan Fontanals)
• [dce39075] - fix test (#1807) (Joan Fontanals)
• [8f32866e] - remove skipif for pydantic (#1796) (Joan Fontanals)

🍹 Other Improvements

• [7693cf7c] - update version to 0.39.0 (#1818) (Joan Fontanals)
• [a4fdb77d] - fix failing test (#1793) (Joan Fontanals)
• [805a9825] - version: the next version will be 0.38.1 (Jina Dev Bot)

Release Note (0.39.1)

Release time: 2023-10-23 08:56:38

🙇 We'd like to thank all contributors for this new release! In particular, Joan Fontanals, Johannes Messner, dependabot[bot], Jina Dev Bot, 🙇

🐞 Bug fixes

• [98d1f1f0] - from_dataframe with numpy==1.26.1 and type handling in python 3.9 (#1823) (Johannes Messner)

🍹 Other Improvements

• [6094854a] - update version before patch release (#1826) (Joan Fontanals)
• [7479f59a] - deps: bump pillow from 9.3.0 to 10.0.1 (#1819) (dependabot[bot])
• [08bfa9cf] - version: the next version will be 0.39.1 (Jina Dev Bot)

Release Note (0.40.0)

Release time: 2023-12-22 12:12:15

🙇 We'd like to thank all contributors for this new release! In particular, 954, Joan Fontanals, Tony Yang, Naymul Islam, Ben Shaver, Jina Dev Bot, 🙇

🆕 New Features

• [ff00b604] - index: add epsilla connector (#1835) (Tony Yang)
• [522811f4] - use literal in type hints (#1827) (Ben Shaver)

🐞 Bug fixes

• [1f86e263] - error type hints in Python3.12 (#1147) (#1840) (954)
• [21e107bd] - fix issue serializing deserializing complex schemas (#1836) (Joan Fontanals)
• [3cfa0b8f] - fix storage issue in torchtensor class (#1833) (Naymul Islam)

📗 Documentation

• [a2421a6a] - epsilla: add epsilla integration guide (#1838) (Tony Yang)
• [82918fe7] - fix sign commit commad in docs (#1834) (Naymul Islam)

🍹 Other Improvements

• [0e183ff0] - upgrade version (#1841) (Joan Fontanals)
• [8de3e175] - refactor test of the torchtensor (#1837) (Naymul Islam)
• [d5d928b8] - version: the next version will be 0.39.2 (Jina Dev Bot)