Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Massive search overhaul #38

Open
4 tasks
kyle1373 opened this issue Jul 7, 2024 · 0 comments
Open
4 tasks

Massive search overhaul #38

kyle1373 opened this issue Jul 7, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request high priority

Comments

@kyle1373
Copy link
Owner

kyle1373 commented Jul 7, 2024

This contains a bunch of tasks:

  • Search for users by Mii Name (including symbols) and not just NNID
  • Search for text in posts across all communities (including symbols, special characters, and more)
  • Search for text in replies in all posts
  • Search for text in posts in users profiles

Originally I had searching for posts made available on the site which used a trig ram GIN index on the PostgreSQL table. However, doing this made the db go brr, reaching cpu utilization near 100%. This throttled the performance on database queries across the site. To reimplement these search functionalites, a couple approaches could be done...

  1. Use an entirely new elastic search / open search database which mirrors the Postgres database, and this will be used for solely intensive plaintext searching so we can offload the computation costs. Doing this will cost me $70 / mo, hence why I'm waiting for Google adsense to get approved on the site so this cost can be offloaded.

  2. Rethink the original GIN index approach on the PostgreSQL database. There might be a better way to index these columns while minimizing CPU utilization. At the moment, I don't feel that this approach is feasible, as I've done a ton of research on this approach already and came up short. Point 1 seems to be the play here

@kyle1373 kyle1373 added the enhancement New feature or request label Jul 7, 2024
@kyle1373 kyle1373 self-assigned this Jul 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request high priority
Projects
None yet
Development

No branches or pull requests

1 participant