Can we use PySpark dataframes instead of Pandas dataframes in backend while developing app using Streamlit?
Anything you can run in Python should run with Streamlit, since Streamlit only really displays a web frontend for your Python code. As long as you convert Pyspark back to small Pandas Dataframes before displaying with Streamlit, you’ll be good. For example:
- Pyspark Streamlit demo for university (github.com)
- How I keep my master students engaged during Python lectures - YouTube
Have a nice day ,