Parse and display log of long running process

[timosachsenberg]

Question

A long running process (executable) started from within the streamlit app produces output to the console. Is there a way to display or process the logfile while the process is running (e.g., to translate progress written to the command line to be displayed in a progress bar). So far I only succeeded displaying the log once the process completed.

[dataprofessor]

Hi @timosachsenberg

Could you see if this forum thread addresses your issue:

Save log into a file using streamlit.logger

Summary How can i save a log file during the execution of a streamlit app? Steps to reproduce I use the following lines to declare a log using streamlit api from streamlit.logger import get_logger logger = get_logger(__name__) logger.info('Hello world') But this log is not stored into a file. How can I do that? I run the the app using: streamlit run app.py I do not want to use: streamlit run app.py --logger.level=warning 2>'app_log.log' Because using it, all external tool used in the…

You could also look into using asyncio to perform multiple processes in parallel (such as executing a process while also looking into the log).

Hope this helps!

[timosachsenberg]

Thanks. Will give asyncio a try and report back. The other topic was related but not what I had in mind.