Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add FAQ-style QA #44

Merged
merged 15 commits into from
Mar 20, 2020
Merged

Add FAQ-style QA #44

merged 15 commits into from
Mar 20, 2020

Conversation

tholor
Copy link
Member

@tholor tholor commented Mar 17, 2020

Addressing #42 and adding support for FAQ-style question answering.

Motivation:
In many cases, users already have a list of frequently asked questions (+ answers). Using this in combination with an extractive QA model can be very powerful as:

  • FAQs are highly curated content (= very meaningful answers)
  • Matching query with existing questions is computationally cheap and fast
  • FAQs (should) capture the most common queries and can therefore significantly reduce the workload on the GPU

Let's implement a retriever that supports this via a similarity measure of embeddings. While the query embedding needs to be computed at inference time, we can precompute and index the ones from the FAQs. The model could e.g. be Sentence-BERT or a model trained on the Quora duplicate questions dataset.

@tholor tholor changed the title very first draft of major faq components WIP Add FAQ-style QA WIP Mar 17, 2020
@tholor tholor changed the title Add FAQ-style QA WIP Add FAQ-style QA Mar 20, 2020
@tholor tholor requested a review from tanaysoni March 20, 2020 14:07
@tholor tholor merged commit d767f12 into master Mar 20, 2020
@julian-risch julian-risch deleted the faq_style_qa branch November 15, 2021 07:05
masci pushed a commit that referenced this pull request Nov 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants