- build an information retrieval system with Poly Encoder
- use the system as an engine for a chatbot application
Poly-Encoder
backend-api-for-chatbot-with-Poly-Encoder
- Sentence Embedding
- Similarity Score
- Semantic Search
- Bi/Cross/Poly Encoder
- Retrieve and Re-Rank
- Recommendation System
- Pre-Computed Candidate Embeddings on GPU
- R@K / MRR for Performance Measurement
| train/loss | eval/loss | R@1 | R@2 | R@5 | R@10 | MRR |
|---|---|---|---|---|---|---|
| 0.367 | 1.148 | 0.744 | 0.823 | 0.890 | 0.930 | 0.811 |
- Neural Machine Translation by Jointly Learning to Align and Translate
- Attention Is All You Need
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
- Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
- SBERT.net