Alternative for Git LFS

Deployment
, ,
1

Hello everyone,
I deployed a uni project on Streamlit Community Cloud but I get this error:

[13:26:44] 🐙 Cloning repository...
[13:26:46] 🐙 Failed
[13:26:56] 🐙 Failed
[13:27:06] 🐙 Failed
[13:27:16] 🐙 Failed
[13:27:26] 🐙 Failed to download the sources for repository: 'stage', branch: 'main', main module: '1_🏠_Home.py'
[13:27:26] 🐙 Make sure the repository and the branch exist and you have write access to it, and then reboot the app.
[13:27:26] 🐙 Pulling code changes from Github...
[13:27:58] ❗️ Updating the app files has failed: git pull: exit status 128: Downloading Ticino_code/checkpoints/rgb_only_lc/checkpoints/last.ckpt (172 MB)
Error downloading object: Ticino_code/checkpoints/rgb_only_lc/checkpoints/last.ckpt (56c8059): Smudge error: Error downloading Ticino_code/checkpoints/rgb_only_lc/checkpoints/last.ckpt (56c8059bbaea01132cf6d4bb9abab5f3e3b6c147709a57e1e640658099b13924): batch request: git@github.com: Permission denied (publickey).: exit status 255
Errors logged to /mount/src/stage/.git/lfs/logs/20240905T132748.210771461.log
Use `git lfs logs last` to view the log.
error: external filter 'git-lfs filter-process' failed
fatal: Ticino_code/checkpoints/rgb_only_lc/checkpoints/last.ckpt: smudge filter lfs failed
[13:29:04] ❗️ Streamlit server consistently failed status checks
[13:29:04] ❗️ Please fix the errors, push an update to the git repo, or reboot the app.

I believe it might be related to reaching the Git LFS bandwidth limit because i have problem only with this project on Streamlit Community Cloud. I also tried to update the repository and reboot the app but still I got this problem and tried git lfs logs lastbut there are no logs to show.

Has anyone experienced a similar issue? Is there an alternative to using Git LFS for handling large files with Streamlit? Or could the problem be caused by something else?

Thanks everyone for helping.

2

Hey @Alessandro1, yeah 170mb for the file to be pulled sounds rather big :slightly_smiling_face: An alternative approach you could try is to exclude the file from being checked-out via git and then download it when the app is starting or upon first interaction. Although I am not sure whether we impose any file limits on Community Cloud on a per-app basis. I might be worth to check it out though!

3

Hello,

I’ve tried removing the file and another large file from Git LFS and Git tracking, but I’m unable to push the changes due to this issue. The folder containing this files was created by my professors, so I’d prefer not to delete them. Additionally, the file paths within this folder are important for my work, and altering them could lead to issues.
If I choose to continue with Git LFS and purchase additional data packs, do you think that I will not have any of these problems?

Thank you for your help!

4

Sorry for the late reply! I am not familiar with GitHub’s data packs etc. so I cannot provide a good answer here.
I can understand that you don’t want to alter the repository and folder structure. Perhaps it is possible for you to fork it and make changes to the fork.