St.dataframe can only handle 50mb

[calvin]

looks like by default st.dataframe can only handle 50mb. Is there any configure to handle bigger size

[randyzwitch]

Hi @calvin, welcome to the Streamlit community!

Sending more than 50MB of data to the browser is a safeguard, since sending large amounts of data will possibly crash the browser or lead to a poor user experience. A community user posted this solution for paging over data that seems really elegant for a use-case like I’m imagining you’re looking for:

Streamlit app disconnects and stops before displaying data

Adding to @andfanilo’s answer, when I have to show large dataframe to user I do something like this, import pandas as pd import numpy as np import streamlit as st from math import ceil df = pd.DataFrame({"x": np.arange(1_000_000), "y": np.arange(1_000_000)}) page_size = 1000 page_number = st.number_input( label="Page Number", min_value=1, max_value=ceil(len(df)/page_size), step=1, ) current_start = (page_number-1)*page_size current_end = page_number*page_size st.write(df[curr…

Best,
Randy