Streaming chat response -> chat history

Using Streamlit
1

I have a streaming response object from an LLM.

I write it in a streaming manner with
st.chat_message(“assistant”).write(response)
That’s great.

Now I want to append the message that I wrote to the chat history:
st.session_state.messages.append({“role”: “assistant”, “content”: msg})

But how do I get the msg from the response object after it has been written?

I do not succeed in doing this…

1 Like
2

I figured it out:

with st.chat_message(“assistant”):
msg = st.write_stream(response)

2 Likes
3

This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.