-
Notifications
You must be signed in to change notification settings - Fork 0
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
Benchmark: Add Long Prompt and Cache Simulation Fixtures
area: benchmarksBenchmarks and correctness fixturesBenchmarks and correctness fixturesarea: cachePrompt caching and cache simulationPrompt caching and cache simulationhelp wantedExtra attention is neededExtra attention is neededpriority: mediumMedium priorityMedium prioritystatus: readyReady for implementationReady for implementationtype: benchmarkBenchmark or measurement workBenchmark or measurement workStatus: Open.#8 In ron2111/omnitoken;CLI: Add omni models and omni encodings
area: cliCommand-line interfaceCommand-line interfacegood first issueGood for newcomersGood for newcomerspriority: mediumMedium priorityMedium prioritystatus: readyReady for implementationReady for implementationtype: featureNew feature or capabilityNew feature or capabilityStatus: Open.#7 In ron2111/omnitoken;Feature: Detect Likely Cache Breakers
area: cachePrompt caching and cache simulationPrompt caching and cache simulationhelp wantedExtra attention is neededExtra attention is neededpriority: mediumMedium priorityMedium prioritystatus: needs-designNeeds design discussion before implementationNeeds design discussion before implementationtype: featureNew feature or capabilityNew feature or capabilityStatus: Open.#6 In ron2111/omnitoken;Design: Define cache-sim input format
area: cachePrompt caching and cache simulationPrompt caching and cache simulationarea: cliCommand-line interfaceCommand-line interfacepriority: highHigh priorityHigh prioritystatus: needs-designNeeds design discussion before implementationNeeds design discussion before implementationtype: discussionOpen design discussionOpen design discussionStatus: Open.#5 In ron2111/omnitoken;Docs: Prompt Caching Guide
area: cachePrompt caching and cache simulationPrompt caching and cache simulationarea: docsDocs, examples, and onboardingDocs, examples, and onboardinggood first issueGood for newcomersGood for newcomerspriority: mediumMedium priorityMedium prioritystatus: readyReady for implementationReady for implementationtype: docsDocumentation workDocumentation workStatus: Open.#4 In ron2111/omnitoken;Feature: Context Budget Planner
area: budgetContext and spend budgetingContext and spend budgetinggood first issueGood for newcomersGood for newcomerspriority: highHigh priorityHigh prioritystatus: needs-designNeeds design discussion before implementationNeeds design discussion before implementationtype: featureNew feature or capabilityNew feature or capabilityStatus: Open.#3 In ron2111/omnitoken;Feature: Add Local Cost Estimation API
area: costCost estimation and pricingCost estimation and pricinghelp wantedExtra attention is neededExtra attention is neededpriority: highHigh priorityHigh prioritystatus: needs-designNeeds design discussion before implementationNeeds design discussion before implementationtype: featureNew feature or capabilityNew feature or capabilityStatus: Open.#2 In ron2111/omnitoken;Design: Prompt Cache Simulator for LLM Workloads
area: cachePrompt caching and cache simulationPrompt caching and cache simulationpriority: highHigh priorityHigh prioritystatus: needs-designNeeds design discussion before implementationNeeds design discussion before implementationtype: discussionOpen design discussionOpen design discussionStatus: Open.#1 In ron2111/omnitoken;