Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add _semanticPath prop to REST/GraphQL #1168

Closed
9 tasks done
etiennedi opened this issue Jun 12, 2020 · 0 comments · Fixed by #1195
Closed
9 tasks done

Add _semanticPath prop to REST/GraphQL #1168

etiennedi opened this issue Jun 12, 2020 · 0 comments · Fixed by #1195

Comments

@etiennedi
Copy link
Member

etiennedi commented Jun 12, 2020

Taken from #1136 which has grown too big. Original input by @bobvanluijt:


When Weaviate's semantic features are used to provide results to the end-user, we might be able to improve the UX to why Weaviate came to these results by introducing a __meta "property" that contains additional information per class.

Example API

A query might look like this (also includes the proposed values)

Note: results function just as examples

{
  Get {
    Things {
      Article(
        explore: {
          concepts: ["beatles"]
        }
        limit: 1
      ) {
        title
        _semanticPath {
          path {
            concept
            distanceToQuery
            distanceToResult
            distanceToPrevious
            distanceToNext
          }
        }
      }
    }
  }
}

Todos

  • finalize experiments and algorithm to determine meaningful path
  • extract into UC
  • run once per search item
  • add models
  • add to GraphQL API
  • add to traverser/explorer
  • calculate distances
  • add appropriate test coverage (how can we test this in a non-flaky fashion?)
  • replace go-tsne fork with original (the required PRs have been merged in the mean time)
etiennedi added a commit that referenced this issue Jun 30, 2020
… pos

[skip-ci] some issue in the contextionary preventing tests from passing
etiennedi added a commit that referenced this issue Jul 1, 2020
etiennedi added a commit that referenced this issue Jul 8, 2020
etiennedi added a commit that referenced this issue Jul 9, 2020
The overall query limit is 10,000 items, this would be a very long
running request as the path creation is very compute intense
etiennedi added a commit that referenced this issue Jul 10, 2020
It led to consistent results on two different macs, let's see if it will
have the same results on CI?
etiennedi added a commit that referenced this issue Jul 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant