added new figure comparing good vs bad int results

This commit is contained in:
toni
2016-05-09 14:00:41 +02:00
parent 533a3783ef
commit 89f764e22f
24 changed files with 8307 additions and 1508 deletions

View File

@@ -42,7 +42,7 @@ Additionally, we used five \docIBeacon{}s for slight enhancements in some areas.
The empirically chosen values for \docWIFI{} were $P_{0_{\text{wifi}}} = \SI{-46}{\dBm}, \mPLE_{\text{wifi}} = \SI{2.7}{}, \mWAF_{\text{wifi}} = \SI{8}{\dB}$, and $\mPLE_{\text{ib}} = \SI{1.5}{}$ for the \docIBeacon{}s, respectively.
The system was tested by omitting any time-consuming calibration processes for those values.
We therefore expect the localisation process to perform generally worse compared to standard fingerprinting methods \cite{Ville09}.
However, incorporating prior knowledge and smoothing will often compensate for those poorly chosen system parameters.
However, smoothing will often compensate for those poorly chosen system parameters.
For the filtering we used $\sigma_\text{wifi} = \sigma_\text{ib} = 8.0$ as uncertainties, both growing with each measurement's age.
While the pressure change was assumed to be \SI{0.105}{$\frac{\text{\hpa}}{\text{\meter}}$}, all other barometer-parameters are determined automatically (see \ref{sec:eval}).
@@ -63,7 +63,7 @@ By adding the activity recognition to the system of \cite{Ebner-16}, we are able
The approximation error decreases by an average of \SI{XX}{\centimeter} for all 4 paths on 10 MC runs.
Due to this additional knowledge, the state transition samples mostly depending upon the current activity and therefore limits the possibility of false floor changes.
Fig. \ref{fig:activityRecognition} shows the recognized activities for path 4 using the Nexus 6.
Despite a short misdetection caused by faulty pressure readings, the recognition can be considered to be very robust and accurate.
Despite a short misdetection in seg. 2, caused by faulty pressure readings, the recognition can be considered to be very robust and accurate.
%Fixed Interval Smoothing
At first, both FBS and BS are compared in context of fixed-interval smoothing.
@@ -75,35 +75,43 @@ Thus, we calculate only the positional error between estimation and ground truth
\caption{particles. green = avg50, black = avg. gnuplot zickt bei der legende}
\label{fig:particles}
\end{figure}
In contrast to BS, the FBS is not able to improve the results using the weighted arithmetic mean for estimating the current position.
As illustrated in fig. \ref{fig:particles}, the estimated position (black dot) for filtering and FBS is identical although the weights are highly different.
To address this problem, we are calculating the average state using the \SI{50}{\percent} best weighted particles (green dot).
For evaluating the FBS this estimation method was applied to filtering and smoothing likewise.
We deployed 10 MC runs using \SI{2500}{} particles for approximation.
%The resulting positional error between estimated and ground truth along path 4 can be seen in fig. \ref{}.
Now, the positional average error along all 4 paths could be improved from \SI{2.49}{\meter} to \SI{2.2}{\meter} for the Galaxy and from \SI{1.76}{\meter} to \SI{1.54}{\meter} for the Nexus.
%Similar outcomes can be observed by adding a resampling step at the end of every smoothing iteration.
In contrast to BS, the FBS is not able to improve the results using the weighted arithmetic mean for estimating the current position.
Fig. \ref{fig:particles} illustrates the filtered and smoothed particle set at a certain time step on path 4.
It can be seen that the estimated position (black dot) for filtering and FBS is identical although the particle weights are highly different.
To address this problem, we are extending the FBS by adding a resampling step.
Here, particles with large weights are likely to be drawn multiple times.
This focuses the computational resources of the FBS into regions with high probability mass and finally improves the estimation.
Since smoothing operates on known states, the danger of sample impoverishment is negligible.
However, BS still outperforms the FBS with an average error of \SI{1.74}{\meter} for the Galaxy and \SI{1.41}{\meter} for the Nexus on all 4 paths using the same number of particles and $500$ sample realisations.
A visual example comparing both smoothing methods on path 4 is illustrated in fig. \ref{fig:intcomp}.
We deployed 10 MC runs using \SI{2500}{} particles for approximation and a multinomial resampling step to every smoothing interval of the FBS.
Now, the positional average error along all 4 paths using the Nexus and the Galaxy could be improved from \SI{2.08}{\meter} to \SI{1.37}{\meter}.
Using the same number of particles and $500$ sample realisations the BS performs with an average error of \SI{2.21}{\meter} for filtering and \SI{1.51}{\meter} for smoothing.
The difference between both filtering steps is of course based upon the randomized behaviour of the respective probabilistic models.
It is interesting to note, that the positional error is very similar for both used smartphones, although the approximation error varies greatly as we will see later.
A visual example of the smoothing outcome for path 3 is illustrated in fig. \ref{fig:int_path3_a}.
The estimation of BS looks way more realistic and adapts better to the ground truth path.
However, in this particular example the FBS starts at an earlier position (cf. fig. \ref{fig:intcomp} seg. 2), better handling the initial uniform distribution.
Another advantage of BS over FBS, is the ability to still improve the filtering results even while reducing the number of particles radical.
For example \SI{50}{} particles and \SI{25}{} sample realisations are providing reliable estimations similar to above experiments, though the risk of losing track is higher.
\begin{figure}
\input{gfx/eval/interval_path4_comp/path4_interval}
\caption{Comparison between FBS (red) and BS (blue) on path 4 (black). Both were approximated using $2500$ particles and \SI{500}{} sample realisations for BS. The measurements were recorded using the Nexus 6. }
\label{fig:intcomp}
\todo{Filter mit rein}
\end{figure}
%However, in this particular example the FBS starts at an earlier position (cf. fig. \ref{fig:intcomp} seg. 2), better handling the initial uniform distribution.
%Another advantage of BS over FBS, is the ability to still improve the filtering results even while reducing the number of particles radical.
%For example \SI{50}{} particles and \SI{25}{} sample realisations are providing reliable estimations similar to above experiments, though the risk of losing track is higher.
\begin{figure}
\input{gfx/eval/interval_path3_bad/path3_interval}
\caption{A situation where BS smoothing (blue) was not able to improve the filtering results (green). Two main factors are causing this: an initial position within a detached room and inaccurate pressure readings given by the Galaxy S5.}
\label{fig:intervalbad}
\begin{subfigure}{0.175\textwidth}
\input{gfx/eval/interval_path3_good/path3_interval_good}
\caption{}
\label{fig:int_path3_a}
\end{subfigure}
\begin{subfigure}{0.175\textwidth}
\input{gfx/eval/interval_path3_bad/path3_interval}
\caption{}
\label{fig:int_path3_b}
\end{subfigure}
\caption{a) Exemplary comparison between BS (blue) and filtering (green) using 2500 particles and 500 sample realisations. b) A situation where BS smoothing was not able to improve the filtering results. Two main factors are causing this: an initial position within a detached room and inaccurate pressure readings given by the Galaxy S5.}
\label{fig:int_path3_comp}
\end{figure}
Despite the very good outcomes provided by both interval smoother, there are some rare situations in which smoothing does not improve the filtered estimation or even improves the visual path.
For example fig. \ref{fig:intervalbad} depicts such a situation for path 3 using BS and measurements provided by the Galaxy S5.
For example fig. \ref{fig:int_path3_b} depicts such a situation for path 3 using BS and measurements provided by the Galaxy S5.
Here, the estimation was not able to change floors correctly due to faulty pressure readings. Additionally, the initial position was located within a detached room.
This shows that the smoothing results are of course highly depend upon the filtering performance.
@@ -142,7 +150,7 @@ It is obvious that a lag of \SI{30}{} time steps has access to much more future
Considering an update interval of \SI{500}{\milli\second}, a lag of \SI{30}{} would however mean that the smoother is \SI{15}{\second} behind the filter.
Nevertheless, there are practical applications like accurately verifying hit checkpoints or continuously optimizing a recurring segment of the path.
%verlgeich noch zwischen bs und fbs. bs weniger partikel und somit schneller. ändern der estimations kann aber auch ein möglichkeit sein.