Skip to content

Commit

Permalink
Gather all tables in improvements section at the end of the section.
Browse files Browse the repository at this point in the history
  • Loading branch information
tohojo committed Jun 5, 2012
1 parent 539b7e9 commit f224f60
Showing 1 changed file with 21 additions and 20 deletions.
41 changes: 21 additions & 20 deletions report2/improvements.tex
Original file line number Diff line number Diff line change
Expand Up @@ -28,12 +28,24 @@ \subsection{Statistical analysis of calibration}
For each image, we tested Tsai calibration over all calibration points on the calibration object, and also calibration performed on exactly those points that did \emph{not} belong to an outermost column. Our hypothesis was that these points, being most distant from the camera and at the greatest angle, would be the greatest source of error in calibration.

Our statistical analysis is done via Student's (unpaired) t-tests. If $p < 0.05$, we call the difference significant. The tool used is the GraphPad online $t$-test calculator provided by \citet{testcalc}.

n
Error was measured by \emph{radius of ambiguity in ray tracing} as described by \citet{TSAI}. We back-traced each ray from the optical centre to the real-world calibration point according to our calibration data. The error is the absolute distance from the point $P_{1}$ at which the ray intersects the plane of the calibration object, and the point $P_{2}$ representing the real location of the calibration point on the calibration object.

Consider Table~\ref{tbl:stats090}, which shows the six variations on calibration error for our low-quality image.

\begin{table}[bp]
As expected, there appears to be an improvement (decrease) in the error when we do not use the outermost columns of the calibration points. The difference in calibration results when we remove the edge columns from our calibration function is statistically significant for the barrel-distorted image.

The barrel-distorted image has somewhat higher error than the normal image, and the pincushion-distorted image \emph{much} higher. The errors in the pincushion image were extremely statistically significantly worse than those in the normal image ($p < 0.01$), both in the case with all points and with the outer columns removed. This suggests that calibration is better able to model `barrel' type lens distortion than `pincushion' type.

The same results for the higher-quality image are given in Table~\ref{tbl:statsDSC}. We observe essentially the same trends, except that removing the outermost columns from the barrel-distorted image appears to increase error (to a highly statistically signifcant degree; $p < 0.01$). We consider this anomaly to very likely be an artifact of the process of artificial image distortion.

The opposite effect is seen for pincushion distortion, as expected: there is a highly statistically significant improvement ($p < 0.01$) when removing the outermost columns of calibration points before calibrating. The errors in the pincushion image were statistically significantly worse than those in the normal image, both in the case with all points included and that with the outer columns removed. With the edges removed, this difference had $p < 0.01$. Similarly, the case with barrel distortion and edges removed was statistically significantly worse than the normal image. None of the other apparent differences were statistically significant.

Tsai's original experiments found an average radius of ambiguity (error) of 0.7 mm (0.028 inches). The maximum error was 1.3 mm (0.051 inches). Our mean error is four times that of Tsai. \cite{TSAI} Our maximum error is 4.5 times that of Tsai, but reduced somewhat when we don't use the outermost columns. These values are for normal images, not the artificially distorted ones.

Although Tsai's paper is 25 years old, we find this `subpar' performance to actually be quite acceptable, given the non-rigorous experiments we conducted and somewhat approximate nature of our calculations. For instance, we did not use Tsai's ``super resolution interpolation scheme" [subpixel accuracy] when extracting image coordinates. Our automated calculation of calibration points on the image was done by the naive method of averaging the coordinates of all pixels in a `spot' representing the calibration point on a picture of a calibration object. The (homemade) calibration object itself may also not have been exactly aligned along orthonormal vectors. Finally, we only performed calibration on four different images.\\[2cm]

\begin{table}[hbp]
\centering
\begin{tabular}{c c c c}
\toprule
Expand All @@ -48,11 +60,7 @@ \subsection{Statistical analysis of calibration}
\label{tbl:stats090}
\end{table}

As expected, there appears to be an improvement (decrease) in the error when we do not use the outermost columns of the calibration points. The difference in calibration results when we remove the edge columns from our calibration function is statistically significant for the barrel-distorted image.

The barrel-distorted image has somewhat higher error than the normal image, and the pincushion-distorted image \emph{much} higher. The errors in the pincushion image were extremely statistically significantly worse than those in the normal image ($p < 0.01$), both in the case with all points and with the outer columns removed. This suggests that calibration is better able to model `barrel' type lens distortion than `pincushion' type.

\begin{table}[bp]
\begin{table}[hbp]
\centering
\begin{tabular}{c c c c}
\toprule
Expand All @@ -67,11 +75,8 @@ \subsection{Statistical analysis of calibration}
\label{tbl:statsDSC}
\end{table}

The same results for the higher-quality image are given in Table~\ref{tbl:statsDSC}. We observe essentially the same trends, except that removing the outermost columns from the barrel-distorted image appears to increase error (to a highly statistically signifcant degree; $p < 0.01$). We consider this anomaly to very likely be an artifact of the process of artificial image distortion.

The opposite effect is seen for pincushion distortion, as expected: there is a highly statistically significant improvement ($p < 0.01$) when removing the outermost columns of calibration points before calibrating. The errors in the pincushion image were statistically significantly worse than those in the normal image, both in the case with all points included and that with the outer columns removed. With the edges removed, this difference had $p < 0.01$. Similarly, the case with barrel distortion and edges removed was statistically significantly worse than the normal image. None of the other apparent differences were statistically significant.

\begin{table}[tbp]
\begin{table}[hbp]
\centering
\begin{tabular}{c c c}
\toprule
Expand All @@ -87,7 +92,7 @@ \subsection{Statistical analysis of calibration}
\label{tbl:calibration-stats-090-1}
\end{table}

\begin{table}[tbp]
\begin{table}[hb]
\centering
\begin{tabular}{c c c}
\toprule
Expand All @@ -103,7 +108,7 @@ \subsection{Statistical analysis of calibration}
\label{tbl:calibration-stats-090-2}
\end{table}

\begin{table}[tbp]
\begin{table}[htbp]
\centering
\begin{tabular}{c c c}
\toprule
Expand All @@ -119,7 +124,7 @@ \subsection{Statistical analysis of calibration}
\label{tbl:calibration-stats-090-3}
\end{table}

\begin{table}[tbp]
\begin{table}[htbp]
\centering
\begin{tabular}{c c c}
\toprule
Expand All @@ -135,7 +140,7 @@ \subsection{Statistical analysis of calibration}
\label{tbl:calibration-stats-dsc-1}
\end{table}

\begin{table}[tbp]
\begin{table}[htbp]
\centering
\begin{tabular}{c c c}
\toprule
Expand All @@ -151,7 +156,7 @@ \subsection{Statistical analysis of calibration}
\label{tbl:calibration-stats-dsc-2}
\end{table}

\begin{table}[tbp]
\begin{table}[htbp]
\centering
\begin{tabular}{c c c}
\toprule
Expand All @@ -166,7 +171,3 @@ \subsection{Statistical analysis of calibration}
\caption[Results of calibration for Image DSC-025 (high-quality camera) with pincushion distortion]{Results of calibration for Image DSC-025 (high-quality camera), with artificial pincushion distortion introduced. $\kappa_{1}$ is the first distortion coefficient. $\kappa_{2}$ is the second distortion coefficient. `Highest error' refers to the single highest point error for this image (in inches), as projected backwards into real-world coordinates.}
\label{tbl:calibration-stats-dsc-3}
\end{table}

Tsai's original experiments found an average radius of ambiguity (error) of 0.7 mm (0.028 inches). The maximum error was 1.3 mm (0.051 inches). Our mean error is four times that of Tsai. \cite{TSAI} Our maximum error is 4.5 times that of Tsai, but reduced somewhat when we don't use the outermost columns. These values are for normal images, not the artificially distorted ones.

Although Tsai's paper is 25 years old, we find this `subpar' performance to actually be quite acceptable, given the non-rigorous experiments we conducted and somewhat approximate nature of our calculations. For instance, we did not use Tsai's ``super resolution interpolation scheme" [subpixel accuracy] when extracting image coordinates. Our automated calculation of calibration points on the image was done by the naive method of averaging the coordinates of all pixels in a `spot' representing the calibration point on a picture of a calibration object. The (homemade) calibration object itself may also not have been exactly aligned along orthonormal vectors. Finally, we only performed calibration on four different images.

0 comments on commit f224f60

Please sign in to comment.