Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions docs-site/public/images/fda_10pct_scaling.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs-site/public/images/learning_curve_accuracy.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion docs/active-learning-llm-oracle.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ description: Use everyrow's agent_map as an LLM oracle in an active learning loo

# How to Replace Human Data Annotators with LLMs in Active Learning

![Active Learning: Ground Truth vs LLM Oracle](images/learning_curve_accuracy.png)
![Active Learning: Ground Truth vs LLM Oracle](/docs/images/learning_curve_accuracy.png)

Human data labeling is slow and expensive. We replaced the human annotator with an LLM oracle in an active learning loop and achieved identical classifier performance — 200 labels in under 5 minutes for $0.26.

Expand Down
2 changes: 1 addition & 1 deletion docs/scale-deduplication-20k-rows.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ description: Scale LLM-powered deduplication to 20,000 rows with linear cost, ac

LLM-powered deduplication gives you semantic understanding that string matching can't, but naive pairwise comparison is quadratic. At 20,000 rows that's 200 million pairs. Everyrow's dedupe pipeline uses a funnel of embeddings, clustering, and targeted LLM calls to keep cost linear and accuracy high.

![FDA Drug Products — Deduplication at Scale](images/fda_10pct_scaling.png)
![FDA Drug Products — Deduplication at Scale](/docs/images/fda_10pct_scaling.png)

Error rates stay near zero as scale increases. Cost and LLM calls scale linearly. Runtime is under 5 minutes up to 10,000 rows and 25 minutes at 20,000.

Expand Down