Hi! Thanks a lot for extending the invitation yesterday. I have made an image captioning app. I am downloading some weights (only during the boot up) and caching them. (Although, i am doing conditional check, I have still cached the function). This could be the reason.
Even my app has gone over the resource limits.
I remove st.cache() from download_data() function and trying again. For now, it’s working. I am also using global variables for my models (Encoder and decoder) which would i would like to avoid since they don’t allow me to cache the load_model() function.
But I think my app does not have expensive computations…
My app went over resource limits again after removing st.cache(). I think I am performing four beam searches with beam indices - 3,4,5,6 which is computationally intensive one after another. But it worked fine for a day.
I don’t know about memory leaks other than dangling pointers in C!