anthology.bib exceeds the file size limit for overleaf

[zeeraktalat]

Hey folks,

Been trying to add the anthology.bib to overleaf through git, upload, and overleaf grabbing it, and it all errors out with that the file is too large - the file size limit seems to be 50 MB. Copying it from the overleaf template doesn't allow refreshing the document.

Not entirely sure what a solution here is but it might be worth reaching out to the overleaf people about it.

[0-KaiKai-0]

same problem

[devrimcavusoglu]

Recently faced with the same problem, with the latest publications the bib file is nearly 60 MB.

Not entirely sure what a solution here is but it might be worth reaching out to the overleaf people about it.

What I think a simple solution would be is to divide the bib file into two separate files ? Idk, but bib file with publications up to 2022 (included) and starting from 2023 a new bib file ?

[devrimcavusoglu]

@zeeraktalat @0-KaiKai-0 and further readers I have created a repo to main these split files you can find the resource at https://github.com/devrimcavusoglu/acl-bib-overleaf

[LSinev]

As an idea:
Add to some sort of instruction for authors something like "cherry-pick needed references to your custom reference file and leave big file behind (delete from your sources)".
Because big file not also "eats" limits of Overleaf, but also slows processing (bibtex have to parse this file).

[cestwc]

I've been thinking about the Overleaf's 50MB limit for .bib files. What if we preprocess the bibliography on our side? A tool like RoBERTa could help us filter out less relevant papers based on titles/topics, keeping the file size under 50MB. It might be a neat solution for handling large bibliographies in LaTeX. Happy to discuss further if this sounds useful!

[devrimcavusoglu]

I've been thinking about the Overleaf's 50MB limit for .bib files. What if we preprocess the bibliography on our side? A tool like RoBERTa could help us filter out less relevant papers based on titles/topics, keeping the file size under 50MB. It might be a neat solution for handling large bibliographies in LaTeX. Happy to discuss further if this sounds useful!

Respectfully, that would be an overkill and not worth to try imho. Splitting the files which are >50MB into multiple files each <50MB works anyway. I've done this, and the split files can be found here as I mentioned earlier.