When I run my app queries in BigQuery console, they take 3-4 seconds to return nearly a million rows in 3-4 seconds. The same queries in my streamlit app (local, community cloud, GCP) all take about 180 seconds to complete including simply writing the results into a dataframe. Has anyone else seen this?
I don’t know about BigQuery, but often what we call “running a query” doesn’t return the actual data. It returns a cursor instead, that still has to be iterated over to get the data (through the network, which adds latency) and put it in a data structure.
Yeah, I did some instrumentation and its the iterating into a Dataframe that is causing all of the delay.
This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.