cheaper-inference/omniroute

omni-cache

Manage the LLM response cache.

View source

How to use

  1. Copy the installation command and review the source package before installing it in your own agent environment.
  2. Check the source document for required tools, credentials and supported hosts.
  3. Describe your input and desired deliverable; review the output against the source material.
npx skills add https://github.com/cheaper-inference/omniroute --skill omni-cache

Before you start

  • Installation does not include a model subscription, API allowance or permission to access your files.
  • Repository stars and installation counts describe activity, not an independent quality or security test.
Original skill document

Rendered from the source repository. Headings, examples, code, tables, links, and referenced images are preserved.

<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten -->

Overview

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

Authentication

All requests require a valid Bearer token or session cookie. Obtain a token via POST /api/auth/login or configure REQUIRE_API_KEY=false for local development.

Endpoints

GET /api/cache

Get cache statistics

bash
curl http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache

Clear all caches

bash
curl -X DELETE http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

GET /api/cache/stats

Get detailed cache statistics

Returns detailed statistics for all cache layers.

bash
curl http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache/stats

Clear cache statistics

bash
curl -X DELETE http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

GET /api/cache/entries

GET cache › entries

bash
curl http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache/entries

DELETE cache › entries

bash
curl -X DELETE http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

GET /api/cache/reasoning

GET cache › reasoning

bash
curl http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache/reasoning

DELETE cache › reasoning

bash
curl -X DELETE http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

Payloads

See the full OpenAPI specification at GET /api/openapi/spec or docs/openapi.yaml for detailed request/response schemas.

Related by task

from this repository

More skills

All skills