Skip to content

port(omniroute): add opt-in isolated response caching #1123

Closed as not planned

Description

@bloodf

Outcome

DurinDoor has model/session caches and prompt-cache affinity, but no semantic response cache module. Introduce exact caching first, then optional semantic lookup.

Evidence and source state

DurinDoor baseline: 93f6de64c69b17d52f790d6f14d09a74cffc7fa5.

Implementation subtasks and acceptance criteria

  • Include model/provider, caller scope, tools/args/results, output contract, reasoning, generation params and relevant headers in cache identity.
  • Never cache failed/truncated completions or bypass authorization on a hit.
  • Support TTL, purge, opt-out, stream replay and truthful cache-hit cost/usage.

Dependencies

No hard predecessor. Complete source review and reproduction/discovery before implementation.

Parent epic: #1065. Roadmap: #1056. Priority P3. Stage 4.

Delivery contract

Planning ticket only. No implementation, runtime test, live-provider call, deployment or stored-data mutation was performed in this audit. Before a port, confirm a merged final upstream diff or a reachable source commit, compare local equivalents/tests, and preserve local auth/routing/quota/database contracts. Open upstream work remains a review candidate. Use port(omniroute): title and target a focused PR at bloodf/durindoor:main. Behavior changes require a focused test plus docs. Run npm run lint and cd tests && npm run test:ci; never add baseline failures. Pure docs/CI edits may skip runtime tests. Regenerate registry/agent indexes with their scripts. Preserve stored credentials and unrelated work.

Activity

  1. added
    enhancementNew feature or request
    portUpstream port work
    type:taskActionable roadmap work with acceptance criteria
    priority:P3Later: optional capabilities and research
    source:omnirouteSource evidence from diegosouzapw/OmniRoute
    status:needs-triageSource comparison or product/runtime prerequisites remain
    area:data-memoryResponse caching and optional persistent context
    on Oct 8, 2026
  2. added
    type:featureDefined new or extended capability
    and removed
    type:taskActionable roadmap work with acceptance criteria
    status:needs-triageSource comparison or product/runtime prerequisites remain
    on Oct 19, 2026
  3. bloodf commented on Nov 2, 2026

    @bloodf
    OwnerAuthor

    Evaluation 2026-11-01: PORT-LATER

    • Opt-in isolated response caching. Fork: none (only chatgptImageCache). Size M. Cache isolation per key is security-sensitive; needs key scoping design.
    • Read-only check of OmniRoute source scope and local tree; nothing built or run.
  4. bloodf commented on Nov 3, 2026

    @bloodf
    OwnerAuthor

    Closing as not planned per the owner's decision: large OmniRoute feature ports are out of scope for V5. Reopen this issue if the work is picked up after V5.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:data-memoryResponse caching and optional persistent contextenhancementNew feature or requestportUpstream port workpriority:P3Later: optional capabilities and researchsource:omnirouteSource evidence from diegosouzapw/OmniRoutetype:featureDefined new or extended capability

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions