very slow repository access over web and very slow startup

[airot]

Hi,

we have around 60 repositories whom weight around 12GB.
Server startup: 2016-06-23 22:23:53 [INFO ] Started @174304ms
accessing repository with 8,083 changes 671 tags in past 2 years takes around 20 seconds,
by accessing I mean going to summary page. This repository weights around 700MB.
We've tried to move tickets into redis, but it didn't help so we switched back to file based.

What can we change to make it faster? Is it possible at all in gitblit?

Box is CentOS 6 with 2 CPUs and 4GB of RAM. Current version is 1.8.0
few of settings from gitblit.properties are:
git.cacheRepositoryList = true
git.enableGarbageCollection = false
git.garbageCollectionHour = 0
git.defaultGarbageCollectionThreshold = 500k
git.defaultGarbageCollectionPeriod = 7
git.mirrorPeriod = 30 mins
git.packedGitWindowSize = 8k
git.packedGitLimit = 1500m
git.deltaBaseCacheLimit = 10m
git.packedGitOpenFiles = 256
git.streamFileThreshold = 50m
git.maxObjectSizeLimit = 0
git.maxPackSizeLimit = -1
tickets.service = com.gitblit.tickets.FileTicketService
tickets.perPage = 25

[andy-nicholas]

Try replacing the JGIT java package with the latest one (I think it's around 4.4). We had the same problem. Insane slowness to do anything if the repo was large. After replacing JGIT it's super-fast. The current version of JGIT should be updated to include the better version of JGIT from the Eclipse guys.

https://eclipse.org/jgit/

Good luck.

[airot]

Simply remove jgit* from ext and put latest one will do the trick?

[paulsputer]

Good to hear the latest JGit resolves this, Ticket #1030 will be addressing the latest JGit update in due course. It introduces support for handling .gitattribute files and its own mechanism for handling LFS and as such requires more integration effort hence not squeezed into the 1.8.0 release.

Do you use the LFS/Filestore capabilities?

[airot]

Ok, how to update JGIT to be sure nothing breaks?

[airot]

I've changed the ext/jgit extension from old to latest 4.4 version. From lsof I see that it's loaded:
java 52777 root mem REG 253,0 2357398 2663106 /opt/gitblit-1.8.0/ext/org.eclipse.jgit-4.4.0.201606070830-r.jar
java 52777 root mem REG 253,0 97067 2663107 /opt/gitblit-1.8.0/ext/org.eclipse.jgit.http.server-4.4.0.201606070830-r.jar
java 52777 root 35r REG 253,0 97067 2663107 /opt/gitblit-1.8.0/ext/org.eclipse.jgit.http.server-4.4.0.201606070830-r.jar
java 52777 root 36r REG 253,0 2357398 2663106 /opt/gitblit-1.8.0/ext/org.eclipse.jgit-4.4.0.201606070830-r.jar

no change in performance. Still takes LOTS of time to load. Any other hints?

[gitblit]

The repo Summary page and the project/root Dashboard pages are the most expensive pages to generate.

Things you could try to improve server loading speed....

1. shorten commit cache window (web.activityCacheDays = 3, web.activityDuration = 3)
2. disable commit caching altogether (web.activityCacheDays = 0)
3. disable repo size calculations (web.showRepositorySizes = false)

Things you could try to improve repo Summary page speed...

1. disable repo summary metrics & activity graph (web.generateActivityGraph = false)

[flaix]

Closing this as Fixed, since updating JGit seems to do the trick. Gitblit was updated to JGit 4.5.
eaaf99e