Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Standalone index #53

Merged
merged 13 commits into from Oct 9, 2023
Merged

Standalone index #53

merged 13 commits into from Oct 9, 2023

Conversation

vlofgren
Copy link
Contributor

@vlofgren vlofgren commented Oct 8, 2023

Move all features essential to search away from the marginalia-branded search service and into the index or a new query-service.

This will improve separation of concerns and make it possible to build other search engines applications off the project's back-end, and also enable future multiplexing against multiple backing indices without bothering the clients with the details of this.

Architectural changes:

  • Query parsing is moved into the query service.
  • Result ranking is moved to the index service.
  • The old concept of core and satellite services is changed to core and application services, where application services are essentially user-facing clients of various forms. Search-service is demoted to an application service.

A second design pass will probably be needed to clean up the query service's API and make it more easy to understand and use.

This makes index complete in the sense that you can deploy an index instance and build a complete separate application on top of it, without having to go through the Marginalia-laden search service.
…extraction.

Prefer working on DecoratedSearchResultItem in favor of UrlDetails.
This is an intermediate step in the process of introducing the query-service as a proxy between search and index.
This is a better descriptor, since they now all implement different applications on top of the core services' APIs.
Application services should not have an API, but purely act as clients
to the core services (which should always have an API).
@vlofgren vlofgren marked this pull request as ready for review October 9, 2023 13:40
@vlofgren vlofgren merged commit c8d820c into master Oct 9, 2023
@vlofgren vlofgren deleted the standalone-index branch March 21, 2024 13:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant