The script download_modify_data.py will download the data and, if needed, update it. I need that data, stored in pandas dataframes, to be kept when opening other pages that will build upon the dataframes serving different analysis.
At the moment i get this error: NameError: name 'data_matches' is not defined.
How can I save the dataframes letting streamlit know I will need these in the other pages?
I hope I have explained myself
I tried using the @st.experimental_memo decorator before the function I used to download the data in download_modify_data.py as @Adrien_Treuille suggested. However it didn’t work for me. I am not sure why. Furthermore, even if it worked I am not sure it would have been ideal in my case, since my dataset is also modified by the script. The script is used to insert one entry at a time in the database, therefore running it multiple times. So when doing so the dataset itself needs to be updated.
On the other hand, I used @Shawn_Pereira’s suggestion of using the st.session_state. I had always seen the function used with small variables so I was not sure it would have worked ideally with big datasets.