Can we limit the st.cache dependecies?

🎈 Using Streamlit
,
1

Our teammate has run into issues with too many file descriptors being open at the same time in the code and issues with linux having a limit on how many files can be watched. Is there a way to exclude things such as directories being watched to mitigate this issue?

1 Like
2

The exact error is:
OSError: inotify instance limit reached

This happened with a medium sized virtual environment containing numpy, pandas and pytorch. It runs into Linux’s setting fs.inotify.max_user_watches which limits the number of concurrent watches the OS can handle.

1 Like
3

Great question! I believe the answer is setting:

[global]
folderWatchBlacklist = ['*']

in either ~/.streamlit/config.toml or ~/.streamlit/config.toml.

To quote from the streamlit config show option:

# List of folders that should not be watched for changes. This impacts both "Run on Save" and @st.cache.
# Relative paths will be taken as relative to the current working directory.
# Example: ['/home/user1/env', 'relative/path/to/folder']
# Default: []
folderWatchBlacklist = []

Please let us know if that works!

4

I’ve added the following content to ~/.streamlit/config.toml:

[server]
folderWatchBlacklist = ["*"]

I still get the same error message.

5

Work-around: Increasing the limit and restarting - https://stackoverflow.com/a/47094674/562769

2 Likes