Skip to content

Actions: Stability-AI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
94 workflow runs
94 workflow runs
Event

Filter by event

Loading
Status

Filter by status

Loading
Branch
Actor

Filter by actor

Loading
Update base.py Pull Request #96: Pull request #117 opened by dakotamahan-stability
December 6, 2023 23:50 31s dakotamahan-stability-patch-for-llama-tokenizer
dakotamahan-stability-patch-for-llama-tokenizer
December 6, 2023 23:50 31s
Automate registry registration for tasks Pull Request #95: Pull request #116 opened by polm-stability
November 21, 2023 04:52 39s polm-stability:feature/registry-decorator
polm-stability:feature/registry-decorator
November 21, 2023 04:52 39s
Set up the ability to run eval suites Pull Request #94: Pull request #114 synchronize by polm-stability
November 13, 2023 07:53 26s polm-stability:feature/suite-runs
polm-stability:feature/suite-runs
November 13, 2023 07:53 26s
Set up the ability to run eval suites Pull Request #93: Pull request #114 synchronize by polm-stability
November 13, 2023 03:19 33s polm-stability:feature/suite-runs
polm-stability:feature/suite-runs
November 13, 2023 03:19 33s
Set up the ability to run eval suites Pull Request #92: Pull request #114 synchronize by polm-stability
November 10, 2023 07:53 25s polm-stability:feature/suite-runs
polm-stability:feature/suite-runs
November 10, 2023 07:53 25s
Change default Llama2 prompt to Japananese Pull Request #91: Pull request #115 opened by polm-stability
November 9, 2023 08:17 52s polm-stability:fix/ja-llama2-prompts
polm-stability:fix/ja-llama2-prompts
November 9, 2023 08:17 52s
Set up the ability to run eval suites Pull Request #90: Pull request #114 synchronize by polm-stability
November 9, 2023 08:16 21s polm-stability:feature/suite-runs
polm-stability:feature/suite-runs
November 9, 2023 08:16 21s
Set up the ability to run eval suites Pull Request #89: Pull request #114 synchronize by polm-stability
November 8, 2023 09:05 48s polm-stability:feature/suite-runs
polm-stability:feature/suite-runs
November 8, 2023 09:05 48s
Set up the ability to run eval suites Pull Request #88: Pull request #114 synchronize by polm-stability
November 6, 2023 10:56 38s polm-stability:feature/suite-runs
polm-stability:feature/suite-runs
November 6, 2023 10:56 38s
Set up the ability to run eval suites Pull Request #87: Pull request #114 opened by polm-stability
November 6, 2023 10:51 31s polm-stability:feature/suite-runs
polm-stability:feature/suite-runs
November 6, 2023 10:51 31s
Compare jcommonsense qa prompts with question first vs last Pull Request #86: Pull request #113 synchronize by kumapo
November 4, 2023 09:23 24s kumapo:compare-question-first-vs-last
kumapo:compare-question-first-vs-last
November 4, 2023 09:23 24s
Compare jcommonsense qa prompts with question first vs last Pull Request #85: Pull request #113 synchronize by kumapo
November 4, 2023 09:00 21s kumapo:compare-question-first-vs-last
kumapo:compare-question-first-vs-last
November 4, 2023 09:00 21s
Compare jcommonsense qa prompts with question first vs last Pull Request #84: Pull request #113 opened by kumapo
November 4, 2023 08:56 47s kumapo:compare-question-first-vs-last
kumapo:compare-question-first-vs-last
November 4, 2023 08:56 47s
Argparse Refactor Pull Request #83: Pull request #103 synchronize by polm-stability
November 2, 2023 06:08 28s polm-stability:feature/argparse-refactor
polm-stability:feature/argparse-refactor
November 2, 2023 06:08 28s
need additional_special_tokens argument for HFLM initializer Pull Request #82: Pull request #112 synchronize by kumapo
October 28, 2023 08:39 39s kumapo:add-additional-special-tokens
kumapo:add-additional-special-tokens
October 28, 2023 08:39 39s
need additional_special_tokens argument for HFLM initializer Pull Request #81: Pull request #112 opened by kumapo
October 28, 2023 08:36 46s kumapo:add-additional-special-tokens
kumapo:add-additional-special-tokens
October 28, 2023 08:36 46s
Argparse Refactor Pull Request #80: Pull request #103 synchronize by polm-stability
October 25, 2023 08:38 38s polm-stability:feature/argparse-refactor
polm-stability:feature/argparse-refactor
October 25, 2023 08:38 38s
Argparse Refactor Pull Request #79: Pull request #103 synchronize by polm-stability
October 24, 2023 06:17 1m 4s polm-stability:feature/argparse-refactor
polm-stability:feature/argparse-refactor
October 24, 2023 06:17 1m 4s
Add prompt version 0.2.1 for JCommonsenseQA Pull Request #78: Pull request #104 synchronize by mkshing
October 24, 2023 04:40 42s mkshing/jcomm-0-21
mkshing/jcomm-0-21
October 24, 2023 04:40 42s
preferred templates Pull Request #77: Pull request #107 synchronize by kumapo
October 22, 2023 14:48 39s kumapo:preferred-prompt
kumapo:preferred-prompt
October 22, 2023 14:48 39s
preferred templates Pull Request #76: Pull request #107 synchronize by kumapo
October 22, 2023 10:48 50s kumapo:preferred-prompt
kumapo:preferred-prompt
October 22, 2023 10:48 50s
preferred templates Pull Request #75: Pull request #107 synchronize by kumapo
October 21, 2023 07:14 51s kumapo:preferred-prompt
kumapo:preferred-prompt
October 21, 2023 07:14 51s
preferred templates Pull Request #74: Pull request #107 synchronize by kumapo
October 21, 2023 06:22 56s kumapo:preferred-prompt
kumapo:preferred-prompt
October 21, 2023 06:22 56s
preferred templates Pull Request #73: Pull request #107 synchronize by kumapo
October 21, 2023 05:48 46s kumapo:preferred-prompt
kumapo:preferred-prompt
October 21, 2023 05:48 46s
Add option to do stratified sampling for few-shot examples Pull Request #72: Pull request #111 opened by mrorii
October 20, 2023 07:59 50s stratified-sampling-few-shot
stratified-sampling-few-shot
October 20, 2023 07:59 50s