Skip to content

Actions: EleutherAI/lm-evaluation-harness

All workflows

Actions

Loading...

Showing runs from all workflows
4,895 workflow runs
4,895 workflow runs
Event

Filter by event

Status

Filter by status

Branch
Actor

Filter by actor

Fix for bootstrap_iters = 0 case (#1715) (#1789)
Tasks Modified #2469: Commit b043b05 pushed by haileyschoelkopf
May 24, 2024 15:37 1m 58s main
May 24, 2024 15:37 1m 58s
Fix Brier Score (#1847)
Tasks Modified #2468: Commit 7d747ea pushed by haileyschoelkopf
May 24, 2024 15:37 1m 39s main
May 24, 2024 15:37 1m 39s
Fix Brier Score (#1847)
Unit Tests #2440: Commit 7d747ea pushed by haileyschoelkopf
May 24, 2024 15:37 5m 18s main
May 24, 2024 15:37 5m 18s
add mmlu tasks from pile-t5
Unit Tests #2439: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:31 9m 14s pile-t5
May 24, 2024 15:31 9m 14s
add mmlu tasks from pile-t5
Tasks Modified #2467: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:31 6m 21s pile-t5
May 24, 2024 15:31 6m 21s
add mmlu tasks from pile-t5
Unit Tests #2438: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:31 9m 34s pile-t5
May 24, 2024 15:31 9m 34s
add mmlu tasks from pile-t5
Tasks Modified #2466: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:31 8m 13s pile-t5
May 24, 2024 15:31 8m 13s
Add various social bias tasks
Tasks Modified #2465: Pull request #1185 synchronize by oskarvanderwal
May 24, 2024 15:31 7m 16s winogender
May 24, 2024 15:31 7m 16s
Add various social bias tasks
Unit Tests #2437: Pull request #1185 synchronize by oskarvanderwal
May 24, 2024 15:31 8m 30s winogender
May 24, 2024 15:31 8m 30s
Add various social bias tasks
Tasks Modified #2464: Pull request #1185 synchronize by oskarvanderwal
May 24, 2024 15:30 6m 43s winogender
May 24, 2024 15:30 6m 43s
Add various social bias tasks
Unit Tests #2436: Pull request #1185 synchronize by oskarvanderwal
May 24, 2024 15:30 4m 32s winogender
May 24, 2024 15:30 4m 32s
add mmlu tasks from pile-t5
Tasks Modified #2463: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 2m 30s pile-t5
May 24, 2024 15:30 2m 30s
add mmlu tasks from pile-t5
Unit Tests #2435: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 5m 41s pile-t5
May 24, 2024 15:30 5m 41s
add mmlu tasks from pile-t5
Unit Tests #2434: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 5m 14s pile-t5
May 24, 2024 15:30 5m 14s
add mmlu tasks from pile-t5
Tasks Modified #2462: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 2m 42s pile-t5
May 24, 2024 15:30 2m 42s
add mmlu tasks from pile-t5
Unit Tests #2433: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:29 5m 6s pile-t5
May 24, 2024 15:29 5m 6s
add mmlu tasks from pile-t5
Tasks Modified #2461: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:29 4m 21s pile-t5
May 24, 2024 15:29 4m 21s
Fix for bootstrap_iters = 0 case (#1715)
Tasks Modified #2460: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:27 1m 43s 1715-nostderr-typerror
May 24, 2024 15:27 1m 43s
Fix for bootstrap_iters = 0 case (#1715)
Unit Tests #2432: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:27 5m 13s 1715-nostderr-typerror
May 24, 2024 15:27 5m 13s
Fix batch_size=auto for HF Seq2Seq models (#1765) (#1790)
Unit Tests #2431: Commit 5f3a662 pushed by haileyschoelkopf
May 24, 2024 15:24 6m 41s main
May 24, 2024 15:24 6m 41s
Fix batch_size=auto for HF Seq2Seq models (#1765) (#1790)
Tasks Modified #2459: Commit 5f3a662 pushed by haileyschoelkopf
May 24, 2024 15:24 15s main
May 24, 2024 15:24 15s
[HFLM]Use Accelerate's API to reduce hard-coded CUDA code (#1880)
Tasks Modified #2458: Commit c4c1591 pushed by haileyschoelkopf
May 24, 2024 15:12 11s main
May 24, 2024 15:12 11s
[HFLM]Use Accelerate's API to reduce hard-coded CUDA code (#1880)
Unit Tests #2430: Commit c4c1591 pushed by haileyschoelkopf
May 24, 2024 15:12 5m 15s main
May 24, 2024 15:12 5m 15s
Fix for bootstrap_iters = 0 case (#1715)
Tasks Modified #2457: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:10 1m 41s 1715-nostderr-typerror
May 24, 2024 15:10 1m 41s
Fix for bootstrap_iters = 0 case (#1715)
Unit Tests #2429: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:10 6m 13s 1715-nostderr-typerror
May 24, 2024 15:10 6m 13s