Skip to content

Commit

Permalink
initial commit
Browse files Browse the repository at this point in the history
  • Loading branch information
mhwombat committed Nov 4, 2015
1 parent c824073 commit 6330ba1
Show file tree
Hide file tree
Showing 25 changed files with 296,577 additions and 0 deletions.
5 changes: 5 additions & 0 deletions ChangeLog.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Revision history for som-comparison

## 0.1.0.0 -- YYYY-mm-dd

* First version. Released on an unsuspecting world.
674 changes: 674 additions & 0 deletions LICENSE

Large diffs are not rendered by default.

2 changes: 2 additions & 0 deletions Setup.hs
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
import Distribution.Simple
main = defaultMain
37 changes: 37 additions & 0 deletions notes.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
To produce plot from paper, use R:

require(ggplot2)
d <- read.csv('results.csv')
d$classifier <- ordered(d$classifier,
levels=c("SOM, 100 models","SCS, 99 models","SOM, 1024 models","SCS, 941 models"))
ggplot(d, aes(x=d$numeral, y=d$accuracy, fill=d$classifier)) +
labs(x="numeral", y="accuracy") +
geom_bar(position="dodge", stat="identity", width=0.6) +
theme_bw() +
scale_fill_manual(values=c("#cfa271", "#8a9f51", "#956533", "#334632")) +
theme(legend.justification=c(1,1), legend.position=c(0.95,1)) +
guides(fill=guide_legend(title=NULL))
ggsave(file='accuracy.pdf', width=8, height=7);


To calculate wasted models, count the number of lines in the answer key.

small SOM models used:
$ grep '([^,]*,[^,]*)' somSmall.log | wc -l
100
So none of the 100 models were wasted

small SCS models used:
$ grep '([^,]*,[^,]*)' scsSmall.log | wc -l
99
So none of the 99 models were wasted

large SOM models used:
$ grep '([^,]*,[^,]*)' somBig.log | wc -l
849
So 175 out of the 1024 models were wasted, or 17%

large SCS models used:
$ grep '([^,]*,[^,]*)' scsBig.log | wc -l
941
So none of the 941 models were wasted
45 changes: 45 additions & 0 deletions results.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
numeral,classifier,accuracy
"0","SOM, 100 models",0.9408163265306122
"1","SOM, 100 models",0.9911894273127754
"2","SOM, 100 models",0.7025193798449613
"3","SOM, 100 models",0.6257425742574257
"4","SOM, 100 models",0.32077393075356414
"5","SOM, 100 models",0.6569506726457399
"6","SOM, 100 models",0.9498956158663883
"7","SOM, 100 models",0.8249027237354085
"8","SOM, 100 models",0.5636550308008214
"9","SOM, 100 models",0.6917740336967294
"all","SOM, 100 models",0.731
"0","SCS, 99 models",0.8959183673469387
"1","SCS, 99 models",0.9030837004405287
"2","SCS, 99 models",0.8498062015503876
"3","SCS, 99 models",0.8415841584158416
"4","SCS, 99 models",0.5804480651731161
"5","SCS, 99 models",0.6827354260089686
"6","SCS, 99 models",0.9237995824634656
"7","SCS, 99 models",0.7986381322957199
"8","SCS, 99 models",0.6817248459958932
"9","SCS, 99 models",0.37165510406342916
"all","SCS, 99 models",0.7554
"0","SOM, 1024 models",0.9510204081632653
"1","SOM, 1024 models",0.9814977973568282
"2","SOM, 1024 models",0.8294573643410853
"3","SOM, 1024 models",0.8613861386138614
"4","SOM, 1024 models",0.6985743380855397
"5","SOM, 1024 models",0.695067264573991
"6","SOM, 1024 models",0.9603340292275574
"7","SOM, 1024 models",0.8443579766536965
"8","SOM, 1024 models",0.7566735112936345
"9","SOM, 1024 models",0.8037661050545094
"all","SOM, 1024 models",0.8414
"0","SCS, 941 models",0.9459183673469388
"1","SCS, 941 models",0.9726872246696036
"2","SCS, 941 models",0.9011627906976745
"3","SCS, 941 models",0.8584158415841584
"4","SCS, 941 models",0.6975560081466395
"5","SCS, 941 models",0.8150224215246636
"6","SCS, 941 models",0.9519832985386222
"7","SCS, 941 models",0.7363813229571985
"8","SCS, 941 models",0.8141683778234087
"9","SCS, 941 models",0.7750247770069376
"all","SCS, 941 models",0.8484
95 changes: 95 additions & 0 deletions resultsForPaper/scsBig.html

Large diffs are not rendered by default.

Loading

0 comments on commit 6330ba1

Please sign in to comment.