Skip to content

BenchGecko/benchgecko-clojure

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

BenchGecko Clojure SDK

Official Clojure client for the BenchGecko API. Query AI model data, benchmark scores, and run side-by-side comparisons from Clojure applications.

BenchGecko tracks every major AI model, benchmark, and provider. This library wraps the public REST API with idiomatic Clojure patterns using clj-http and Cheshire for JSON parsing.

Installation

Add to your project.clj:

[benchgecko "0.1.0"]

Or deps.edn:

{benchgecko/benchgecko {:mvn/version "0.1.0"}}

Quick Start

(require '[benchgecko.core :as bg])

;; List all tracked AI models
(def models (bg/models))
(println (str "Tracking " (count models) " models"))

;; List all benchmarks
(def benchmarks (bg/benchmarks))
(doseq [b (take 5 benchmarks)]
  (println (:name b)))

;; Compare two models head-to-head
(def comparison (bg/compare ["gpt-4o" "claude-opus-4"]))
(doseq [m (:models comparison)]
  (println (:name m) (:scores m)))

API Reference

(bg/models)

Fetch all AI models tracked by BenchGecko. Returns a sequence of maps, each containing model metadata like name, provider, parameter count, pricing, and benchmark scores.

(bg/benchmarks)

Fetch all benchmarks tracked by BenchGecko. Returns a sequence of maps with benchmark name, category, and description.

(bg/compare model-slugs)

Compare two or more models side by side. Pass a vector of model slugs (minimum 2). Returns a map with :models key containing per-model comparison data.

Configuration

Override the base URL and timeout using dynamic bindings:

(binding [bg/*base-url* "http://localhost:3000"
          bg/*timeout* 10000]
  (bg/models))

Error Handling

API errors throw ExceptionInfo with status code and response body:

(try
  (bg/models)
  (catch Exception e
    (let [data (ex-data e)]
      (println "API error" (:status data) (:body data)))))

Data Attribution

Data provided by BenchGecko. Model benchmark scores are sourced from official evaluation suites. Pricing data is updated daily from provider APIs.

Links

License

MIT

About

Official clojure SDK for the BenchGecko API. Compare AI models, benchmarks, and pricing.

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors