Hi. Perhaps when developing Agno’s functionality, you assume that almost all sessions will be short, but…
Could you consider the following suggestion:
Add a certain lifespan for storing the results of function executions in the history. Upon expiration of this time, the content of the function call would be removed from the message history (hide or not load, it doesn’t matter).
For example, I store the last 30 “runs” of an LLM bot on Discord. Let’s say the bot performed a web search and got many links. Then Gemini concurrently calls JinaReader 10 times in one request, getting the content of the pages – this is tens of thousands of tokens. The bot analyzes everything, provides an answer, and I might ask it something else in the context. After approximately 5 messages, storing the search content in memory is no longer meaningful.
I just noticed there was already a pull request on GitHub yesterday for similar functionality.
It’s not quite the same thing, of course, but it’s heading in the right direction. I’d still like to be able to specify the exact tools/functions whose results we need to “forget.”