update: methodology done

master
phga 4 years ago
parent 1842be490a
commit 3a30760762

@ -264,7 +264,7 @@ func calculateFRE(txt string) float64 {
\end{listing} \end{listing}
\end{enumerate} \end{enumerate}
\subsection{Finger strength measurement device} \subsection{Finger Strength Measurement Device}
\label{sec:force_meas_dev} \label{sec:force_meas_dev}
\begin{figure}[ht] \begin{figure}[ht]

@ -23,7 +23,7 @@ performance and user satisfaction while using four different keyboards,
including our adjusted keyboard, to values obtained with the participant's own including our adjusted keyboard, to values obtained with the participant's own
keyboards. keyboards.
\subsection{Preliminary telephone interview} \subsection{Preliminary Telephone Interview}
\label{sec:telephone_interview} \label{sec:telephone_interview}
Some of the studies we found that researched implications of actuation force on Some of the studies we found that researched implications of actuation force on
speed, preference or other metrics were published between 1984 and 2010. That is speed, preference or other metrics were published between 1984 and 2010. That is
@ -63,7 +63,7 @@ Web\footnote{\url{https://web.whatsapp.com/}}, Signal
Desktop\footnote{\url{https://signal.org/download/}}, Telegram Desktop\footnote{\url{https://signal.org/download/}}, Telegram
Desktop\footnote{\url{https://desktop.telegram.org/}}). Desktop\footnote{\url{https://desktop.telegram.org/}}).
\subsection{Market analysis of available mechanical keyswitches} \subsection{Market Analysis of Available Mechanical Keyswitches}
\label{sec:market_forces} \label{sec:market_forces}
To gather information about available actuation forces, we collected the product To gather information about available actuation forces, we collected the product
lines of keyswitches for all well known manufacturers, namely lines of keyswitches for all well known manufacturers, namely
@ -90,7 +90,7 @@ actuation force is 35 g ($\approx$ 0.34 \gls{N}) the most common one is 50 g
\label{fig:keyswitches_brands} \label{fig:keyswitches_brands}
\end{figure} \end{figure}
\subsection{Preliminary study of finger strength} \subsection{Preliminary Study of Finger Strength}
To evaluate the impact of an adjusted keyboard (keyboard with non-uniform To evaluate the impact of an adjusted keyboard (keyboard with non-uniform
actuation forces) on performance and satisfaction we first needed to get an actuation forces) on performance and satisfaction we first needed to get an
understanding on how to distribute keyswitches with different actuation forces understanding on how to distribute keyswitches with different actuation forces
@ -255,7 +255,7 @@ which is discussed in more detail in the following section.
\label{fig:adjusted_layout} \label{fig:adjusted_layout}
\end{figure} \end{figure}
\subsection{Main user study} \subsection{Main User Study}
\label{sec:main_study_meth} \label{sec:main_study_meth}
\subsubsection{Hypotheses} \subsubsection{Hypotheses}
\label{sec:main_hypotheses} \label{sec:main_hypotheses}
@ -352,13 +352,14 @@ researchers were tested with antigen tests prior to every appointment.
\label{sec:main_keyboards} \label{sec:main_keyboards}
Additionally to the reference tests conducted with the participant's own Additionally to the reference tests conducted with the participant's own
keyboards, we provided four keyboards which only differed in terms of actuation keyboards, we provided four keyboards which only differed in terms of actuation
force. We decided to assign pseudonyms in the form of Greek goddesses to the force (Appendix \ref{app:equipment}). We decided to assign pseudonyms in the form
keyboards to make fast differentiation during the sessions easier and reduce of Greek goddesses to the keyboards to make fast differentiation during the
ambiguity. The pseudonyms for each keyboard and the corresponding actuation sessions easier and reduce ambiguity. The pseudonyms for each keyboard and the
force can be found in Table \ref{tbl:kb_pseudo}. All keyboards used the standard corresponding actuation force can be found in Table \ref{tbl:kb_pseudo}. All
ISO/IEC 9995 \cite{iso9995-2} physical layout and provided keycaps representing keyboards used the standard ISO/IEC 9995 \cite{iso9995-2} physical layout and
the German \gls{QWERTZ} layout, which all participants were already familiar provided keycaps representing the German \gls{QWERTZ} layout, which all
with. All four keyboards used in the experiment were participants were already familiar with. All four keyboards used in the
experiment were
\textit{\gls{GMMK}}\footnote{\url{https://www.pcgamingrace.com/products/gmmk-full-brown-switch}} \textit{\gls{GMMK}}\footnote{\url{https://www.pcgamingrace.com/products/gmmk-full-brown-switch}}
equipped with \textit{Gateron} mechanical equipped with \textit{Gateron} mechanical
keyswitches\footnote{\url{http://www.gateron.com/col/58459?lang=en}}. The order keyswitches\footnote{\url{http://www.gateron.com/col/58459?lang=en}}. The order
@ -411,10 +412,10 @@ information about privacy, the \gls{EMG} measurements and questionnaires used
during the experiment. Next, participants filled out a pre-experiment during the experiment. Next, participants filled out a pre-experiment
questionnaire to gather demographic and other relevant information e.g., touch questionnaire to gather demographic and other relevant information e.g., touch
typist, average \gls{KB} usage per day, predominantly used keyboard type, typist, average \gls{KB} usage per day, predominantly used keyboard type,
previous medical conditions affecting the result of the study e.g., \glsfirst{RSI}, previous medical conditions affecting the result of the study e.g.,
\glsfirst{CTS}, etc. The full questionnaire can be observed in the appendix \glsfirst{RSI}, \glsfirst{CTS}, etc. The full questionnaire can be observed in
\ref{app:gott}. Further, participants could adjust the chair, table and monitor Appendix \ref{app:gott}. Further, participants could adjust the chair, table and
to a comfortable position. monitor to a comfortable position.
\textbf{\gls{EMG} Measurements} \textbf{\gls{EMG} Measurements}
@ -443,13 +444,13 @@ and 0\%\gls{MVC}), which are used later to calculate the percentage of muscle
activity for each test, we performed three measurements. First, participants activity for each test, we performed three measurements. First, participants
were instructed to fully relax the \gls{FDS}, \gls{FDP} and \gls{ED} by were instructed to fully relax the \gls{FDS}, \gls{FDP} and \gls{ED} by
completely resting their forearms on the table. Second, participants exerted completely resting their forearms on the table. Second, participants exerted
maximum possible force with their fingers against the top of the table maximum possible force with their fingers (volar) against the top of the table
(\gls{MVC} - flexion) and lastly, participants applied maximum possible force (\gls{MVC} - flexion) and lastly, participants applied maximum possible force
with their fingers to the bottom of the table while resting their forearms on with their fingers (dorsal) to the bottom of the table while resting their
their thighs (\gls{MVC} - extension). We decided to also measure 0\%\gls{MVC} forearms on their thighs (\gls{MVC} - extension). We decided to also measure
before and after each typing test and used these values to normalize the final 0\%\gls{MVC} before and after each typing test and used these values to
data instead of the 0\%\gls{MVC} we retrieved from the initial \gls{MVC} normalize the final data instead of the 0\%\gls{MVC} we retrieved from the
measurements. initial \gls{MVC} measurements.
\textbf{Familiarization with \glsfirst{GoTT} and the Keyboards} \textbf{Familiarization with \glsfirst{GoTT} and the Keyboards}
@ -479,78 +480,72 @@ almost identical \gls{FRE} scores (mean = 80.10, SD = 0.48).
To receive feedback about several aspects that define a satisfactory user To receive feedback about several aspects that define a satisfactory user
experience while using a keyboard, we decided to incorporate two questionnaires experience while using a keyboard, we decided to incorporate two questionnaires
into our experiment. The first questionnaire was the \glsfirst{KCQ} provided by into our experiment. The first questionnaire was the \glsfirst{KCQ} provided by
\cite[56]{iso9241-411} and was filled out after each individual typing test. The \cite[56]{iso9241-411} and was filled out after each individual typing test
second survey, that was filled out every time the keyboard was changed, was the (\glsfirst{PTTQ}). The second survey, that was filled out every time the keyboard
\glsfirst{UEQ-S} \cite{schrepp_ueq_handbook} with an additional question―``How was changed, was the \glsfirst{UEQ-S} \cite{schrepp_ueq_handbook} with an
satisfied have you been with this keyboard?''―that could be answered with the additional question―``How satisfied have you been with this keyboard?''―that
help of an \gls{VAS} ranging from 0 to 100 \cite{lewis_vas}. The short version could be answered with the help of an \gls{VAS} ranging from 0 to 100
of the \gls{UEQ} was selected, because of the limited time participants had to (\glsfirst{PKQ})\cite{lewis_vas}. The short version of the \gls{UEQ} was selected, because of
fill out the questionnaires in between typing tests (2 - 3 minutes) and also the limited time participants had to fill out the questionnaires in between
because participants had to rate multiple keyboards in one session typing tests (2 - 3 minutes) and also because participants had to rate multiple
\cite{schrepp_ueq_handbook}. keyboards in one session \cite{schrepp_ueq_handbook}.
\textbf{Post Experiment Interview \& UX-Curves}
\item Initial typing test with own keyboard. (5 min) \\
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ To give participants the chance to recapitulate their experience during the
Pause with light stretching exercises. (3 min) whole experiment, we conducted a semi-structured interview, after all typing
tests were completed. We recorded audio and video for the whole duration of the
\item \textbf{Main Part of the Experiment:} In this part the subject had interviews and afterwards categorized common statements about each
to take two, 5 minute, typing tests per keyboard, with a total of 4 keyboard.
keyboards (\textit{Nyx, Aphrodite, Athena, Hera}). After each typing
test, the subject had to fill out the post typing test survey Further, we prepared two different graphs were participants had to draw
(\gls{KCQ}). Keyboards A, B and C are equipped with one set of UX-Curves related to subjectively perceived typing speed and subjectively
keyswitches and therefore each of the keyboards provides one of the perceived fatigue for every keyboard and corresponding typing test. The graphs
following, uniform, actuation forces across all keyswitches: 35 \gls{g}, always reflected the order of keyboards for the group the current participant
50 \gls{g} or 80 \gls{g}. These specific values are the results of a was part of. Furthermore, before the interview started, participants were given
self conducted comparison between the product lines of most major a brief introduction on how to draw UX-Curves and that it is desirable to
keyswitch manufacturers. The results shown in appendix explain the thought process while drawing each curve \cite{kujala_ux_curve}. An
\ref{app:keyswitch} yield, that the lowest broadly available force for example of the empty graph for perceived fatigue (group 1) can be seen in Figure
keyswitches is 35 \gls{g}, the highest broadly available force is 80 \ref{fig:empty_ux_g1}.
\gls{g}, and the most common offered force is 50 \gls{g}. Keyboard D is
equipped with different zones of keyswitches that use appropriate \begin{figure}[ht]
actuation forces according to finger strength differences and key \centering
position. The keyboards used in this experiment are visually identical, \includegraphics[width=1.0\textwidth]{images/empty_ux_g1}
ISO/IEC 9995-1 conform \cite{iso9995-1} and provide a \gls{QWERTZ} \caption{Empty graph for participants of group 1 to draw an UX-curve related
layout to resemble the subjects day-to-day layout and keyboard format as to perceived fatigue during the experiment}
close as possible. All keyboards are equipped with linear mechanical \label{fig:empty_ux_g1}
keyswitches from one manufacturer to minimize differences in haptic and \end{figure}
sound while typing. To mitigate order effects, the order of the
keyboards is counterbalanced with the help of the latin square method \textbf{Main Part of the Experiment}
and the text snippets for the individual tests are randomized
\cite{statist_counterbalancing}. \textbf{(total: 80 min)} Each subject had to take two, 5 minute, typing tests per keyboard, with a total
of 5 keyboards, namely \textit{Own (participant's own keyboard)}, \textit{Nyx
\begin{enumerate} (35 g, uniform), Aphrodite (50 g, uniform), Athena (80 g uniform)} and
\item \textbf{\gls{KB} A, Part 1:} Typing test. (5min) \\ \textit{Hera (35 g - 60 g, adjusted)} (Table \ref{tbl:kb_pseudo}). As described
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ in Section \ref{sec:main_keyboards}, the order of the keyboards \textit{Nyx,
Pause with light stretching exercises. (3 min) Aphrodite, Athena} and \textit{Hera} was counterbalanced with the help of a
\item \textbf{\gls{KB} A, Part 2:} Typing test. (5min) \\ balanced latin square to reduce order effects. The keyboard \textit{Own} was
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ used to gather reference values for all measured metrics. Thus, typing tests
Pause with light stretching exercises. (3 min) with \textit{Own} were conducted before (one test) and after (one test) all
\item \textbf{\gls{KB} C, Part 1:} Typing test. (5min) \\ other keyboards, to also capture possible variations in performance due to
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ fatigue. Participants were allowed, but not forced to, correct mistakes during
Pause with light stretching exercises. (3 min) the typing tests. The typing test application allowed no shortcuts to delete or
\item \textbf{\gls{KB} C, Part 2:} Typing test. (5min) \\ insert multiple characters and correction was only possible by hitting the
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ \textit{Backspace} key on the keyboard. The \textit{Capslock} key was disable
Pause with light stretching exercises. (3 min) during all typing tests, because there was only visual feedback in form of
\item \textbf{\gls{KB} B, Part 1:} Typing test. (5min) \\ coloring of correct and incorrect input and no direct representation of entered
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ characters (Figure \ref{fig:gott_colorblind}), which could lead to confusion
Pause with light stretching exercises. (3 min) when the \textit{Capslock} key is activated on accident.
\item \textbf{\gls{KB} B, Part 2:} Typing test. (5min) \\
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ \subsection{Summary}
Pause with light stretching exercises. (3 min) \label{sec:meth_summary}
\item \textbf{\gls{KB} D, Part 1:} Typing test. (5min) \\ The preliminary telephone interview and the market analysis of available
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ mechanical keyswitches allowed us to gather profound information concerning
Pause with light stretching exercises. (3 min) user's preferences and availability of hardware components. Additionally, the
\item \textbf{\gls{KB} D, Part 2:} Typing test. (5min) \\ preliminary study, where we measured the maximum applicable force onto a
Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\ keyswitch for each finger of the right hand in different positions, yielded
Pause with light stretching exercises. (3 min) necessary data for the design of the adjusted keyboard layout. Throughout the
\end{enumerate} main user study, where we compared five different keyboards, we were able to
obtain various qualitative and quantitative data regarding performance and
\item Post-Test semi-structured interview: The participant has to draw three satisfaction. The statistical evaluation of this data will be presented in the
different UX curves \cite{kujala_ux_curve} to evaluate how fatigue, next Section.
performance and overall usability of the individual keyboards were perceived
during the experiment. While drawing the UX curve, participants should
describe their thought process. To reduce errors in the later evaluation of
the UX curves, the entire interview is recorded. (10 min)
\end{enumerate}

@ -1,5 +1,10 @@
% A rapid method that creates many corrected errors, has efficient error correction, and leaves
% few uncorrected errors can still be considered a successful method, since it produces
% accurate text in relatively little time. pp. 56 MacKenzie
\section{Results} \section{Results}
A rapid method that creates many corrected errors, has efficient error correction, and leaves \label{sec:results}
few uncorrected errors can still be considered a successful method, since it produces This section addresses the statistical analysis of the data obtained throughout
accurate text in relatively little time. pp. 56 MacKenzie the main, within-subject, user study (n = 24) that consisted of five repeated
\label{sec:label} measurements. Because the data was from related, dependent groups, we used
repeated measurement \gls{ANOVA} if all required assumption were met and
Friedman's Test otherwise.

@ -36,6 +36,8 @@
\newacronym{OLED}{OLED}{organic light-emitting diode} \newacronym{OLED}{OLED}{organic light-emitting diode}
\newacronym{GMMK}{GMMK}{Glorious Modular Mechanical Keyboards} \newacronym{GMMK}{GMMK}{Glorious Modular Mechanical Keyboards}
\newacronym{ANOVA}{ANOVA}{analysis of variance}
\newglossaryentry{N}{ \newglossaryentry{N}{
name={N}, name={N},
description={Newton: 1 N $ \approx $ 101.97 g} description={Newton: 1 N $ \approx $ 101.97 g}

Binary file not shown.

After

Width:  |  Height:  |  Size: 39 KiB

Loading…
Cancel
Save