Cloning with large filesizes

[ysebyy]

Hey!

We have been using go-git for our projects for a while ( one of the projects is actually available here: https://github.com/vinted/sbomsftw )

However, we ran into an issue. So we run git clone on our ORG and we have a few jupyter notebook applications. They have pretty hefty filesizes and during the clone, we see a sizeable chunk of memory/CPU increase (kubernetes).

We can't seem to find any option if we could just clone the root dir without sub-dirs or not clone specific files or any of those sorts. Any possible things we could use, or making exceptions for these repos the only one?

We have currently limited the depth size to 1.

I have also searched for an LFS option, but it seems that it is not available due to licensing.

[pjbgf]

@ysebyy have you tried using filter to limit the size of the blob? Just like --filter=blob:limit= would.

[ysebyy]

Hey, @pjbgf ! Thank you for your reply. This indeed would potentially fix the issue, however, We are using go-git v5.14.0 and I did not seem to find this option under CloneOptions: https://github.com/go-git/go-git/blob/v5.14.0/options.go

Is it experimental branch or removed?

[pjbgf]

This is currently on main, which is where we are working towards the next v6 release.