Skip to content

Issues: langchain-ai/auto-evaluator

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

20 Open 43 Closed
20 Open 43 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Can I add my local LLM model in Model list in application (https://autoevaluator.langchain.com/)?
#114 opened Dec 25, 2023 by navinchandrac
Labelstudio integration
#110 opened Aug 28, 2023 by nrshrivatsan
Isolated evaluation of retrieval
#108 opened Jul 17, 2023 by TSFelg
Same questions are being generated
#106 opened Jul 3, 2023 by RohanKaran
Support for more document types (HTML, CSV, etc)
#105 opened Jun 12, 2023 by danpechi
Python + Node versions are missing
#104 opened Jun 7, 2023 by saharaquant
Server error when using online Playground
#102 opened May 24, 2023 by klein-t
9
Replicat Vicuna API returning empty response
#101 opened May 16, 2023 by rlancemartin
@dankolesnikov @rlancemartin
How generalizable is this framework?
#97 opened May 8, 2023 by samching
disable sidebar when the experiment is running
#96 opened May 8, 2023 by dankolesnikov
look into hosting vicuna 13B on EC2
#95 opened May 8, 2023 by dankolesnikov
@dankolesnikov
make demo environment mobile friendly
#94 opened May 8, 2023 by dankolesnikov
@dankolesnikov
Chunk size is always larger than allowed, even put the chunk size to '500' which is smallest in parameter list
#93 opened May 7, 2023 by maths369
1
Back-end crashing
#91 opened May 5, 2023 by rlancemartin
@dankolesnikov @benisgold @rlancemartin
OpenAI invalid API key error
#89 opened May 2, 2023 by benisgold
@rlancemartin
1
Anthropic model appears to be deprecated
#87 opened May 2, 2023 by rlancemartin
Missing logging / alert when back-end crashes
#86 opened May 2, 2023 by rlancemartin
@benisgold
API continues to run after connection to client is closed / refreshed
#76 opened Apr 28, 2023 by rlancemartin
@benisgold @rlancemartin
File transfer and reading time is slow in prod
#74 opened Apr 28, 2023 by rlancemartin
@dankolesnikov @hwchase17
@benisgold @rlancemartin
refactor Body.tsx into multiple sub react components
#23 opened Apr 22, 2023 by dankolesnikov
@benisgold
ProTip! Exclude everything labeled bug with -label:bug.