-
Notifications
You must be signed in to change notification settings - Fork 357
Changelog
5.2.1 is a significant revision to the code that builds ConceptNet, but it retains mostly the same representation and almost all of the same knowledge as 5.2.0. The cases where they differ are largely due to bugs that were discovered in the refactor.
- Reorganized much of the code for working with nodes and edges in ConceptNet.
- Removed a fair amount of dead code.
- Added test cases that cover most of the code; removed tests for 5.0 that clearly wouldn't work anymore.
- Combined assertions (such as what the 5.2 API returns) keep track of their full list of sources and their first-seen dataset, so they can be searched like edges in 5.1.
A change will be noticeable in the Web API, because for a while it was serving the union of ConceptNet 5.1 and 5.2 data structures, with both separate edges and combined assertions. Now it is only serving the combined assertions. The results should be similar, but with less duplication.
- The set of knowledge sources has changed. JMdict is in. ReVerb is out, because we couldn't filter it well enough.
- Some bugs in building from existing sources were fixed.
- ConceptNet can now be built from its raw data using a Makefile. (See Build process)
- The code comes with everything you need to build and query "assoc spaces" -- vector spaces representing semantic connections between concepts -- thanks to the open-source release of assoc_space by Luminoso.
- The API now returns one result per assertion, even if that assertion comes from multiple sources.
- Because of that, the representation of knowledge sources has changed. The sources used to be lists of reasons that an assertion got added, and each one implicitly represented a conjunction. The "sources" field in the API now always contains one element for each assertion, and that element contains the full AND-OR tree of sources.
Version 5.1 has a new, simpler representation of nodes and edges than ConceptNet 4.0 or 5.0, making it suitable to represent ConceptNet 5 with downloadable flat files and efficient search indexes.
- Made base URIs shorter. For example,
/concept/en/dogbecomes/c/en/dog. - Changed the representation of assertions. Assertions are a bundle of edges (hyperedges, really) that connect two arguments and a relation. These edges are labeled with all the appropriate metadata.
- Created JSON and CSV flat-files.
- Created a Solr index and an accompanying API. The MongoDB is deprecated.
ConceptNet 5.1.1 was an incremental update that maintains full API compatibility with 5.1.
- First API for ConceptNet 5.
- All assertions were reified as nodes, with edges for arguments. This turned out to be an ineffective representation.
Starting points
Reproducibility
Details