Skip to content

[Feature]: Memory tool: Read-behind feature + When branching, memory chunk of missing messages should disappear + ability to modify memory chunks on the fly #2862

Description

@Navgner

What problem does this solve?

  1. Read-Behind / Lookback Memory:
    There was supposed to be a read-behind feature introduced a few updates ago, but I don't recall ever seeing it implemented. It is an essential tool to avoid wasting tokens on repetitive context. For example, if I have my active context limited to 30 messages, I want the memory tool to only process messages that fall outside of this limit. Perhaps this is already implemented and tied directly to the message limit?

  2. Memory Contamination Across Chat Branches:
    Sometimes I go far back in the chat history and use the branching feature to explore alternative paths. However, the memory chunks carry over from one branch to another, causing memory contamination.

Proposed solution

I have two feature requests to address these issues:

  1. Implement / Restore the Read-Behind Feature: Ensure the memory tool starts creating chunks of memory after the slid out of the active message limit.
  2. Branch Detection or Manual Editing: To prevent memory contamination when switching branches, we could either:
    • Implement message ID detection (Highly Recommended): If a message ID disappears/changes due to branching, the corresponding memory chunks should automatically be removed for the new chat path. This is the ideal solution to save users from unnecessary headaches.
    • Add manual chunk editing: Add the ability to manually edit or delete memory chunks that are no longer relevant to the current branch.

Template check

Please uncheck (untick) the box below before submitting so we know you read the template. It is intentionally pre-checked:

  • I DID NOT read this template and provide the requested details.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions