Permalink
Browse files

finish evaluation part of report

  • Loading branch information...
1 parent 7ca74c4 commit dda89404ae1fd012338d0696af1a275f7864aa1c Ming committed Dec 14, 2012
Showing with 55 additions and 25 deletions.
  1. +32 −8 doc/report/eval.tex
  2. +10 −8 doc/report/main.aux
  3. BIN doc/report/main.dvi
  4. +13 −9 doc/report/main.log
View
@@ -251,7 +251,7 @@ \subsection{MRIS Read}
SSD & 3.89 & 4.68 & 5.79 & 7.52 & 8.04 & 7.60 & 7.64 \\
Hybrid & 0.44 & 0.86 & 1.39 & 2.69 & 3.56 & 4.46 & 5.78 \\ \hline
\end{tabular}
- \caption{Speedup of SSD and Hybrid over SATA in term of ops/sec.}
+ \caption{Speedup of SSD and Hybrid over SATA (ops/sec).}
\label{tbl:speedup}
}
\end{table}
@@ -350,9 +350,11 @@ \subsection{MRIS Read}
mb/sec results, along with the benchmarked mb/sec results, are
presented in Figure~\ref{fig:thputpred}. We observed that there exists
significant discrepancy in Hybrid's mb/sec results when ratio is
-small.
-
-% TODO: This is something we need to further investigate.
+small. This is because the average operation size is large when ratio
+is small, as we can see from (\ref{eqn:opsize}). The distances between
+predicted ops/sec and benchmarked ops/sec of small ratios, in
+Figure~\ref{fig:mrisopssec}, are magnfied when turned to mb/sec by
+multiplying the average operation size.
\begin{figure}[t]
\begin{centering}
@@ -362,13 +364,38 @@ \subsection{MRIS Read}
\end{centering}
\end{figure}
+As presented in Table~\ref{tbl:spdupmb}, Hybrid improves SATA's mb/sec
+throughput by at least 45\%. The improvement grows to as high as
+5.86$\times$ when ratio is 64. Specifically, the speedup is
+2.61$\times$ and 3.73$\times$ when ratio is 8 and 16, which
+approximate to the ratios in the workloads of Wikipedia and Facebook.
+
+\begin{table}[tc]
+{\centering \footnotesize
+\begin{tabular}{c|c|c|c|c|c|c|c}
+\hline
+ Speedup & \multicolumn{7}{c}{Ratio} \\ \cline{2-8}
+ over SATA & 1 & 2 & 4 & 8 & 16 & 32 & 64 \\ \hline
+ SSD & 3.88 & 4.68 & 5.67 & 7.33 & 8.35 & 7.87 & 7.76 \\
+ Hybrid & 0.45 & 0.88 & 1.33 & 2.61 & 3.73 & 4.62 & 5.86 \\ \hline
+\end{tabular}
+ \caption{Speedup of SSD and Hybrid over SATA (mb/sec).}
+\label{tbl:spdupmb}
+}
+\end{table}
+
\NOTE{Ming}{TODO: consitify terms, such as images and objects, HDD and
SATA}
We have also measured the throughput (mb/sec) went to each drive using
iostat. The results are shown in Figure~\ref{fig:mrisiostat}. We
observed that the throughput reported by iostat is much larger than
-that in Figure~\ref{fig:mrisopssec}.
+that in Figure~\ref{fig:mrisopssec}. Three factors contribute to the
+extra throughput: 1) the read-ahead in the file system, 2) extra read
+of file system metadata, and 3) extra read of database metadata.
+However, it is interesting to notice that the data read from SSD for
+the SSD setup is quite stable even when ratio varies dramatically.
+This is something we need to further investigate.
\begin{figure}[t]
\begin{centering}
@@ -378,9 +405,6 @@ \subsection{MRIS Read}
\end{centering}
\end{figure}
-The results are shown in Figure~\ref{fig:mrisopssec}. Specifically,
-the speedup for Facebook and Wikipedia workload is XXX and YYY.
-
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% For Emacs:
% Local variables:
View
@@ -39,7 +39,7 @@
\@writefile{toc}{\contentsline {subsection}{\numberline {3.4}MRIS Read}{5}}
\@writefile{lof}{\contentsline {figure}{\numberline {9}{\ignorespaces MRIS Read Performance (ops/sec). Each operation represents a read of an image.}}{5}}
\newlabel{fig:mrisopssec}{{9}{5}}
-\@writefile{lot}{\contentsline {table}{\numberline {2}{\ignorespaces Speedup of SSD and Hybrid over SATA in term of ops/sec.}}{5}}
+\@writefile{lot}{\contentsline {table}{\numberline {2}{\ignorespaces Speedup of SSD and Hybrid over SATA (ops/sec).}}{5}}
\newlabel{tbl:speedup}{{2}{5}}
\newlabel{eqn:ssdops}{{1}{5}}
\newlabel{eqn:sataops}{{2}{5}}
@@ -54,11 +54,9 @@
\newlabel{eqn:opsize}{{4}{6}}
\@writefile{lof}{\contentsline {figure}{\numberline {12}{\ignorespaces Predicted and benchmarked read performance (mb/sec).}}{6}}
\newlabel{fig:thputpred}{{12}{6}}
-\@writefile{lof}{\contentsline {figure}{\numberline {13}{\ignorespaces MRIS Read Performance (mb/sec) by iostat}}{6}}
-\newlabel{fig:mrisiostat}{{13}{6}}
+\@writefile{lot}{\contentsline {table}{\numberline {4}{\ignorespaces Speedup of SSD and Hybrid over SATA (mb/sec).}}{6}}
+\newlabel{tbl:spdupmb}{{4}{6}}
\newlabel{eqn:hybridthput}{{5}{6}}
-\@writefile{toc}{\contentsline {section}{\numberline {4}Related Work}{6}}
-\newlabel{sec:related}{{4}{6}}
\citation{tablefs}
\citation{Seltzer09hfad}
\citation{evans2002study}
@@ -77,11 +75,15 @@
\bibcite{memcached}{8}
\bibcite{lsm}{9}
\bibcite{tablefs}{10}
+\@writefile{lof}{\contentsline {figure}{\numberline {13}{\ignorespaces MRIS Read Performance (mb/sec) by iostat}}{7}}
+\newlabel{fig:mrisiostat}{{13}{7}}
+\@writefile{toc}{\contentsline {section}{\numberline {4}Related Work}{7}}
+\newlabel{sec:related}{{4}{7}}
+\@writefile{toc}{\contentsline {section}{\numberline {5}Conclusions}{7}}
+\newlabel{sec:conc}{{5}{7}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {5.1}Future work}{7}}
\bibcite{Seltzer09hfad}{11}
\bibcite{level_lifetime}{12}
\bibcite{wikimedia-foundation}{13}
\bibcite{wikipedia-web}{14}
\bibcite{eurosys_hfs}{15}
-\@writefile{toc}{\contentsline {section}{\numberline {5}Conclusions}{7}}
-\newlabel{sec:conc}{{5}{7}}
-\@writefile{toc}{\contentsline {subsection}{\numberline {5.1}Future work}{7}}
View
Binary file not shown.
View
@@ -1,4 +1,4 @@
-This is pdfTeX, Version 3.1415926-1.40.10 (TeX Live 2009/Debian) (format=latex 2011.6.28) 14 DEC 2012 12:43
+This is pdfTeX, Version 3.1415926-1.40.10 (TeX Live 2009/Debian) (format=latex 2011.6.28) 14 DEC 2012 14:15
entering extended mode
%&-line parsing enabled.
**main.tex
@@ -552,11 +552,15 @@ File: figures/ratio_thput_predict.eps Graphic file (type eps)
<figures/ratio_thput_predict.eps>
File: figures/mris_ratio_iostat_thput.eps Graphic file (type eps)
<figures/mris_ratio_iostat_thput.eps>)
-(./related.tex [6]
+(./related.tex
+Underfull \vbox (badness 2197) has occurred while \output is active []
+
+ [6]
Missing character: There is no � in font ptmr7t!
Missing character: There is no � in font ptmr7t!
Missing character: There is no � in font ptmr7t!
-) (./conclusion.tex) (./main.bbl
+)
+(./conclusion.tex) (./main.bbl [7]
Underfull \hbox (badness 10000) in paragraph at lines 82--87
\OT1/ptm/m/n/10 life-time. $\OT1/ptm/m/sl/8 https : / / groups . google . com
/ d / topic / leveldb /
@@ -568,16 +572,16 @@ Underfull \hbox (badness 10000) in paragraph at lines 94--96
org / wiki /
[]
-[7]) [8
+) [8
] (./main.aux) )
Here is how much of TeX's memory you used:
- 9182 strings out of 495062
- 153713 string characters out of 1182644
- 211126 words of memory out of 3000000
- 12092 multiletter control sequences out of 15000+50000
+ 9183 strings out of 495062
+ 153726 string characters out of 1182644
+ 211134 words of memory out of 3000000
+ 12093 multiletter control sequences out of 15000+50000
20631 words of font info for 64 fonts, out of 3000000 for 9000
29 hyphenation exceptions out of 8191
54i,11n,51p,376b,345s stack positions out of 5000i,500n,10000p,200000b,50000s
-Output written on main.dvi (8 pages, 51224 bytes).
+Output written on main.dvi (8 pages, 53236 bytes).

0 comments on commit dda8940

Please sign in to comment.