How do i cache multiple file reads from s3?

Using Streamlit
1

Hi. I am having an issue reading multiple parquet files from s3. I can’t pass the URL as the objects aren’t public. How do i work around this?

Thanks for your help.

2

Well that’s not really a streamlit thing, assuming you have S3 credentials it’s standard in python to use boto3 to read from S3 (https://stackoverflow.com/questions/36205481/read-file-content-from-s3-bucket-with-boto3).

From then on caching should be using the @st.cache() decorator like any other streamlit function.