Skip to content

Commit

Permalink
report basic structure
Browse files Browse the repository at this point in the history
  • Loading branch information
stefan-k committed Jun 19, 2012
1 parent 2e5b929 commit 3a18dc7
Show file tree
Hide file tree
Showing 11 changed files with 150 additions and 0 deletions.
12 changes: 12 additions & 0 deletions report/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
*.aux
*.swp
*.log
*.idx
nov.pdf
main.pdf
*.nav
*.vrb
*.toc
*.snm
*.out
*.svg
2 changes: 2 additions & 0 deletions report/compile
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
pdflatex main.tex
pdflatex main.tex
1 change: 1 addition & 0 deletions report/discussion.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
\section{Diskussion}\label{diskussion}
1 change: 1 addition & 0 deletions report/evaluation.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
\section{Evaluierung}\label{evaluierung}
1 change: 1 addition & 0 deletions report/evolib.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
\section{evolib}\label{evolib}
35 changes: 35 additions & 0 deletions report/frontpage.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
\date{\today}

\begin{titlepage}
\pagestyle{empty}

\begin{center}
{\sc\Large Joris Bayer (0530330), Stefan Kroboth (0730144)}

\vspace*{3cm}

{\sffamily\bfseries\Huge Implementation of an Evolutionary Optimization Framework and Application to the Open Job Shop Problem\\}
\vspace*{0.5cm}
{\sffamily\bfseries\Large Report}

\vspace*{2cm}

{\sc\Large Numerische Optimierungsverfahren}

\vspace*{3cm}

\begin{figure}[H]
\begin{center}
\includegraphics[width=7cm]{tug.pdf}
\end{center}
\end{figure}

\vspace*{1.5cm}

\vspace*{2cm}

\vspace*{\fill}

Graz, June 2012
\end{center}
\end{titlepage}
1 change: 1 addition & 0 deletions report/introduction.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
\section{Einleitung}\label{einleitung}
27 changes: 27 additions & 0 deletions report/main.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
\documentclass[a4paper, 11pt, parskip=half,DIV13]{scrartcl}

\usepackage[]{graphicx}
\usepackage{setspace}
\usepackage[utf8x]{inputenc}
\usepackage[english]{babel}
\usepackage{amsmath}
\usepackage{float}
\usepackage{subfigure}
\usepackage{multirow}
\usepackage{makeidx}
\usepackage{verbatim}
\usepackage{fancyvrb}
\usepackage{lscape}
\usepackage{booktabs}
\usepackage{longtable}
\usepackage{cite}

\begin{document}
\input{frontpage}
\input{introduction}
\input{evolib}
\input{ojsp}
\input{evaluation}
\input{discussion}

\end{document}
1 change: 1 addition & 0 deletions report/ojsp.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
\section{Open Job Shop Problem}\label{ojsp}
69 changes: 69 additions & 0 deletions report/results.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
\section{Results}\label{results}

The tracking of the pupil works pretty well, as even in darker areas the pupil isn't lost. This can be seen in Fig.~\ref{fig:pupil1}, where the fitted ellipse is shown as well as the computed center of the pupil. The right side of the Figure shows the thresholded image.

\begin{figure}[h]
\centering
\includegraphics[width=0.9\textwidth]{fin_dark.png}
\caption{Tracking of the pupil.}\label{fig:pupil1}
\end{figure}

When the eye movement is too strong, the pupil becomes the shape of an ellipse which is harder to find using \texttt{HoughCircles()} (Fig.~\ref{fig:pupillost}). In practice, movements this big do not occur.

\begin{figure}[h]
\centering
\includegraphics[width=0.9\textwidth]{fin_lost.png}
\caption{The tracking is lost when the eyemovement is too strong.}\label{fig:pupillost}
\end{figure}

When the pupil isn't visible at all, the tracking looks for the darkest circle-like shape in the frame. Therefore the tracking also is off (Fig.~\ref{fig:pupilclosed}). As soon as the pupil is visible again, the algorithm finds it again.

\begin{figure}[h]
\centering
\includegraphics[width=0.9\textwidth]{fin_closed.png}
\caption{The tracking is also lost when the eye is closed.}\label{fig:pupilclosed}
\end{figure}

The temporal filtering becomes apparent when the eye movement is very fast. This leads to a tracking, that lags behing the actual pupil position (Fig.~\ref{fig:pupiltemporal}). This makes the tracking smoother but also a bit slower.

\begin{figure}[h]
\centering
\includegraphics[width=0.9\textwidth]{fin_temporal.png}
\caption{For fast movements the effect of the temporal filtering becomes apparent.}\label{fig:pupiltemporal}
\end{figure}

In the calibration routine as shown in Fig.~\ref{fig:calibration} the homography is estimated.
After this step, the mapping can be performed as illustrated in Fig~\ref{fig:mapping}.

\begin{figure}[h]
\centering
%\includegraphics[width=0.5\textwidth]{fin_calibration.png}
\subfigure[Calibration sequence.]{\includegraphics[width=0.45\textwidth]{fin_calibration.png}\label{fig:calibration}}
\subfigure[Mapping the eye position onto the screen.]{\includegraphics[width=0.45\textwidth]{fin_mapping.png}\label{fig:mapping}}
\caption{Calibration and Mapping.}\label{fig:calibrationandmapping}
\end{figure}


%\begin{figure}[h]
%\centering
%\includegraphics[width=0.5\textwidth]{fin_mapping.png}
%\caption{The mapping maps the eye position onto the screen.}\label{fig:mapping}
%\end{figure}

Figure~\ref{fig:headmarkers} shows the tracking of the four markers mounted on the spectacle frame.

\begin{figure}[h]
\centering
\includegraphics[width=0.5\textwidth]{fin_head.png}
\caption{Tracking of the four markers.}\label{fig:headmarkers}
\end{figure}

To get an idea of the whole process, please see the attached video. This video first shows how the eye tracking works in general. Some problems are shown as well, for instance the behaviour of the pupil tracking when the eye is closed or when the eye movement is too big and the tracking can not distinguish between the pupil and shadows. Keep in mind that movements this big do not occur in normal usage, as the movement of the eye is rather limited when looking at a computer screen.

The next part shows the calibration process, where the user has to look at several points on the screen.

After his process, all the necessary information is gathered to perform the mapping, which is shown subsequently. The user looks at several points on the screen and the position of the pupil is mapped onto the screen.

The result shown in this video lacks the head tracking, as we weren't able to implement this properly due to several tough problems. These problems are discussed in the next section.


Binary file added report/tug.pdf
Binary file not shown.

0 comments on commit 3a18dc7

Please sign in to comment.