Memory handling in multi-user LLM app

Hi @Rene_Steiner

There are similar post with a lot of discussion on the topic of caching session data as opposed to the global cache performed by default via Streamlit’s caching mechanism that caches data globally across all users.

Hope these helps!