[releasing] Maintenance tasks in fiware-cygnus Git repository

[vgarciag]

At this moment fiware-cygnus repository is very heavy: near 90MB.

This is because in some commits there were added files by error and after were deleted but git still stores this files in the commit history.

Top ten large files:

All sizes are in kB's. The pack column is the size of the object, compressed, inside the pack file.
size   pack   SHA                                       location
34007  31337  31b582d86a41749e0a98e66dcd1867fd05ead8f1  test/acceptance/selenium-server-standalone-2.42.2.jar
7133   6518   a9796450b4bb6dac0cb08ab58a8ef1a3ad1b45d4  flume/neore/rpm/SOURCES/usr/cygnus/tools/flume-ng-log4jappender-1.4.0-jar-with-dependencies.jar
4596   3665   2372d1edfb8b19e4b9160b7b7e78eecd83a3b434  flume/neore/rpm/SOURCES/usr/cygnus/lib/poi-ooxml-schemas-3.8.jar
4383   4367   275dfaebefd25da6dede8f9a30581cff44783f04  flume/neore/rpm/SOURCES/usr/cygnus/lib/lucene-analyzers-kuromoji-4.3.0.jar
4225   3983   deb75868dc3800751e1c3b20428cdefe66838cb1  flume/neore/rpm/SOURCES/usr/cygnus/lib/netcdf-4.2-min.jar
3819   3671   1df3cfb4167b35a368fe68d0391ae1eb293bcc6d  flume/neore/rpm/SOURCES/usr/cygnus/lib/pdfbox-1.7.1.jar
2608   2401   b59555907a6a6d93b9683fb7216cb9da3765b771  flume/neore/rpm/SOURCES/usr/cygnus/lib/derby-10.8.2.2.jar
2604   2213   ccd8163421ba8d0361315fb947f2432f1e6d7a83  flume/neore/rpm/SOURCES/usr/cygnus/lib/xmlbeans-2.3.0.jar
2159   1966   e8cd8b35c27f23be9fbdd3125442e4da35c40903  flume/neore/rpm/SOURCES/usr/cygnus/lib/lucene-core-4.3.0.jar
2136   1982   f9ca93c24b3ed3f8436d21b565eca9de7f56eee1  flume/neore/rpm/SOURCES/usr/cygnus/lib/solr-core-4.3.0.jar

To do this tasks is good idea follow this thread: delete large files

[frbattid]

Nice catch! I did not notice about this until now. Which is the estimated effort in terms of number of men working a full day in this issue (man per day is the used mechanism for estimating techdebt effort)?

[ghost]

I'm taking over. Francisco and me have outlined a strategy to do this:

Using this code [yes, I uploaded an ISO once], I'm deleting all those jars, then I'll force push.

The mitigating measures will be to have Francisco and me another copy of all the branches in our local computers in case something goes wrong, then certificate that we uploaded everything OK, and announce everybody.

[frbattid]

Let's go for it!

[ghost]

OK. These are the large files removed:

test/acceptance/selenium-server-standalone-2.42.2.jar
flume/neore/rpm/BUILD/usr/cygnus/lib/*.jar
flume/neore/rpm/SOURCES/usr/cygnus/lib/*.jar
flume/neore/rpm/BUILD/usr/cygnus/tools/*.jar
flume/neore/rpm/SOURCES/usr/cygnus/tools/*.jar

Repository's .git directory size went from

[ hermanjunge: fiware-cygnus ]$ du -h .git | tail -n1
 91M    .git

to

[ hermanjunge: fiware-cygnus ]$ du -h .git | tail -n1
5.4M    .git

These are the large files now

All sizes are in kB. The pack column is the size of the object, compressed, inside the pack file.
size  pack  SHA                                       location
1562  422   0685e21ca5cc2f9aae82d80cc4b1185511af2dfc  flume/neore/rpm/SOURCES/usr/cygnus/docs/.doctrees/FlumeUserGuide.doctree
1309  97    4afb9994f075845924ecd2a7fec1de593c3aaf00  flume/neore/rpm/SOURCES/usr/cygnus/docs/apidocs/index-all.html
253   44    15a057d0d0a4759cee988320e1484a0311978753  flume/neore/rpm/SOURCES/usr/cygnus/docs/FlumeUserGuide.html
215   154   79e1fdc0fc34849ac54903146e49a8954e5d003d  flume/doc/images/sequence_diagram_hdfs.vsd
213   152   71366ad20f27719a0f64d988898fb12d9ae39270  flume/doc/images/sequence_diagram_ckan.vsd
204   142   6aa1dd1d29b1c305dd8d46b79af3753d913aaed8  flume/doc/images/sequence_diagram_mysql.vsd
183   49    c2868ffb378bb7d7d83153a35c5f22978ff80a84  flume/neore/rpm/SOURCES/usr/cygnus/docs/.doctrees/FlumeDeveloperGuide.doctree
169   109   3fe4a366cff7527fff0ad418e880b94989ee3a83  doc/images/sequence_diagram_notification_handling_default.vsd
161   38    f84cda54e7a0a30a705c3297c713da5b5ca39aca  flume/neore/rpm/SOURCES/usr/cygnus/docs/_sources/FlumeUserGuide.txt
153   11    5654858e05d0047a7f0abe46db89a2726039c2fd  flume/neore/rpm/SOURCES/usr/cygnus/docs/apidocs/overview-tree.html

You can replicate the process I overtook reading this README

[frbattid]

Finally moving this to 0.11.0 since I must release right now... and I'm in the airport (not the best place for doing dangerous operations on the repo xD).

[ghost]

LOL. OK. Let's coordinate the operation soon.

[frbattid]

Fixed in PR #642