Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New prototype, blogpost, video etc #47

Open
eklem opened this issue Nov 13, 2020 · 3 comments
Open

New prototype, blogpost, video etc #47

eklem opened this issue Nov 13, 2020 · 3 comments
Assignees

Comments

@eklem
Copy link
Owner

eklem commented Nov 13, 2020

Screenshot 2020-11-13 at 12 55 17

@eklem eklem self-assigned this Nov 13, 2020
@eklem
Copy link
Owner Author

eklem commented Nov 13, 2020

Text for audio:

Hi, I'll now present to you how search engines for everybody could work

  • Our take on this is NowSearch.xyz. It's all make-believe, but something we hope we can create, giving you lots of good search engines for small'ish data
  • Because it's browse based you can have as many search engines as you want for free, there will be no tracking of either data or user behaviour, and it will be offline first

Create

  • Let's check out how to create a small search engine
  • Click "create search engine"

Give it a name

  • Give it a name
  • Add some data. We will now prentend you upload some JSON data from a URL
  • Add the URL
  • ... and get the data

Got the data

  • So, now you have the data, and need to set up how to process those

Process data

  • The first thing you can do is define which language to use. We will settle with English.
  • Then you can choose to have an auto-complete. You choose to have auto-complete for phrases containing 2 or 3 words
  • And then you may want to extract important keywords from each document that you can then filter on when searching
  • I'm guessing there is not that many emojis in recipes, so you'll skip that for now and go ahead and just process the data

Make it searchable

  • When the data is processed, you need to make it searchable

Tune it

  • So, then you have your first search engine
  • You can choose to create another one, or continue to the one you just created
  • If you had more search engines and didn't know which of them to search you could do a meta-search, figuring out which search engine that holds the data you are interested in.
  • You only have one, so you'll just go to that one
  • You will have the possibility to tune it
  • ...meaning adding more data, defining search result layout and what to filter on

Danger zone

  • Or, you could remove the data you have, or delete the whole search engine and start fresh

Future

  • One of the future ideas for nowsearch.xyz is to be able to share your search engine with others, using some sort of distributed web technology, keeping away from having to pay for a server
    Let's search
  • Anyway. Let's say you have set up the result layout and want to make a cake and need to find a recipe
  • You go back to your search engine and type in the query "cake" and get some nice recipes back.
  • That's it!
  • Be sure to check out the blog-post if you think this sounds interesting.

@eklem
Copy link
Owner Author

eklem commented Dec 14, 2020

The process step should be able to calculate stopworthieness of each word, creating a stopword-list to use for document process- and query-side.

@eklem
Copy link
Owner Author

eklem commented Apr 12, 2023

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant