bachelor-thesis/chap4/methodology.tex

\section{Methodology}
\label{sec:methodology}
\subsection{Research Approach}
Because of the controversial findings about the impact of key actuation forces
on speed \cite{akagi_keyswitch, loricchio_force_speed} and the fact, that
keyboard related work can increase the risk for \gls{WRUED} \cite{ccfohas_wrued,
  pascarelli_wrued}, we decided to further investigate possible effects of
different actuation forces and even a keyboard equipped with non-uniform
actuation forces on speed, error rate and satisfaction. To our best knowledge,
to this date, there is no published work about the influence of a keyboard with
non-uniform actuation forces on these metrics. Therefore, we first asked
seventeen people about their preferences, experiences and habits related to
keyboards to get a better understanding on what people might prefer as a
baseline for the design of the adjusted keyboard (keyboard with non-uniform
actuation forces) and to complement the findings obtained through our literature
review. Further, we collected information about available mechanical keyswitches
on the market. Additionally, we conducted a small preliminary experiment with 6
subjects, where we measured the peak forces each individual finger of the right
hand was able to apply to distinct keys in different locations. We then created
the design for the adjusted keyboard based on those measurements. Lastly, an
experiment with twenty-four participants was conducted, where we compared the
performance and user satisfaction while using four different keyboards,
including our adjusted keyboard, to values obtained with the participant's own
keyboards.

\subsection{Preliminary telephone interview}
\label{sec:telephone_interview}
Some of the studies we found that researched implications of actuation force on
speed, preference or other metrics were published between 1984 and 2010. That is
why we wanted to ascertain if and how, with the advance of technology in recent
years and especially the capabilities modern smartphones offer, keyboard usage
has changed. Further, we wanted to gather information about the preference of
key resistance, keyswitch type and experiences with \gls{WRUED}. Therefore, we
conducted a structured interview with seventeen volunteers (59\% females) via
telephone. The age of the subjects ranged between 22 and 52 with a mean age of
29 years. The professions of subjects were distributed among medical workers,
students, office employees, computer engineers and community workers. The first
question we asked was \textit{``Which keyboard in terms of actuation force would
  be the most satisfying for you to use in the long run?''}. Thirteen (76\%) out
of the seventeen subjects mentioned, that they would prefer a keyboard with
light actuation force over a keyboard with higher resistance. The next question
\textit{``Have you ever had pain when using a keyboard and if so, where did you
  have pain?''} yielded, that 41\% of those polled experienced pain at least
once while using a keyboard. The areas affected described by the seven who
already experienced pain were the wrist \underline{and} forearm (3 out of 7),
wrist only (2 out of 7), fingers (1 out of 7) and forearm only (1 out of 7). The
results for the third question \textit{``Which keyboard are you currently using
  and for how many hours a day on average?''} were in line with the statements
we found during our literature review \cite{ergopedia_keyswitch,
  peery_3d_keyswitch}. Nine answered that they use a notebook (scissor-switches,
membrane), six stated that they use an external keyboard with rubber dome
switches and only two responded that they use a keyboard featuring mechanical
keyswitches. The average, self-reported, usage ranged between half an hour and
10 hours with a mean of 4.71 hours. It is important to note, that a study by
Mikkelsen et al. found, that self-reported durations related to computer work
can be inaccurate \cite{mikkelsen_duration}. The last question \textit{``Which
  tasks do you still prefer to perform with a keyboard rather than your mobile
  phone?''} revealed, that all of the subjects preferred to use a keyboard when
entering greater amounts of data (emails, applications, presentations,
calculations, research), but also surprisingly 41\% preferred to use a keyboard
to write instant messages (chatting via Whatsapp
Web\footnote{\url{https://web.whatsapp.com/}}, Signal
Desktop\footnote{\url{https://signal.org/download/}}, Telegram
Desktop\footnote{\url{https://desktop.telegram.org/}}).

\subsection{Market analysis of available mechanical keyswitches}
\label{sec:market_forces}
To gather information about available actuation forces, we collected the product
lines of keyswitches for all well known manufacturers, namely
Cherry\footnote{\url{https://www.cherrymx.de/en/mx-original/mx-red.html}},
Kailh\footnote{\url{https://www.kailhswitch.com/mechanical-keyboard-switches/}},
Gateron\footnote{\url{http://www.gateron.com/col/58459?lang=en}},
Matias\footnote{\url{http://matias.ca/switches/}},
Razer\footnote{\url{https://www.razer.com/razer-mechanical-switches}} and
Logitech\footnote{\url{https://www.logitechg.com/en-us/innovation/mechanical-switches.html}}. Since
some of the key actuation forces listed on the manufacturers or resellers
websites were given in cN and most of them in g or gf, the values were adjusted
to gram to reflect a trend that is within a margin of ± 2 g of accuracy. The
results shown in Figure \ref{fig:keyswitches_brands} are used to determine the
minimum, maximum and most common actuation force for broadly available
keyswitches. According to our findings, the lowest commercially available
actuation force is 35 g ($\approx$ 0.34 \gls{N}) the most common one is 50 g
($\approx$ 0.49 \gls{N}) and the highest resistance available is 80 g ($\approx$
0.78 \gls{N}).

\begin{figure}[ht]
  \centering
  \includegraphics[width=0.9\textwidth]{images/keyswitches_brands}
  \caption{Available actuation forces for keyswitches of major keyswitch manufacturers}
  \label{fig:keyswitches_brands}
\end{figure}

\subsection{Preliminary study of finger strength}
To evaluate the impact of an adjusted keyboard (keyboard with non-uniform
actuation forces) on performance and satisfaction we first needed to get an
understanding on how to distribute keyswitches with different actuation forces
across a keyboard. Our first idea was to use a similar approach to the keyboard
we described in Section \ref{sec:lr_sum}, were the force required to activate
the keys decreased towards the left and right ends of the keyboard. This rather
simple approach only accounts for the differences in finger strength when all
fingers are in the same position, but omits possible differences in applicable
force depending on the position a finger has to enter to press a certain key.
To detect possible differences in peak force depending on the position of the
fingers, we conducted an experiment with six volunteers (50\%
females). Subject's ages ranged from 20 to 26 with a mean age of 24 years. The
subjects were all personal contacts. Subjects professions were distributed as
follows: computer science students (3/6), physiotherapist (1/6), user experience
consultant (1/6) and retail (1/6). All Participants were given instructions to
exert maximum force for approximately one second onto the key mounted to the
measuring device described in Section \ref{sec:force_meas_dev}. We also used a
timer to announced when to press and when to stop. We provided a keyboard to
every participant, which was used as a reference for the finger position before
every measurement. To reduce order effects, we used a balanced latin square to
specify the sequence of rows (top, home, bottom) in which the participants had
to press the keys \cite{bradley_latin_square}. Additionally, because there were
only six people available, we alternated the direction from which participants
had to start in such a way, that every second subject started with the little
finger instead of the index finger. An example of four different positions of
the finger while performing the measurements for the keys \textit{Shift, L, I}
and \textit{Z} can be observed in Figure \ref{fig:FM_example}.

\begin{figure}[ht]
  \centering
  \includegraphics[width=1.0\textwidth]{images/FM_example}
  \caption{Prototype of the force measuring device used to gather data about the
    maximum applicable force to a key with different finger positions. The
    positions for certain keys are simulated by aligning the wrist pad (left
    picture) to the scale of the device. The four different positions for the
    keys \textit{Shift, L, I, Z} (right pictures) are color coded according to
    the keys on the scale}
  \label{fig:FM_example}
\end{figure}

The results of the measurements are given in Table \ref{tbl:finger_force}. The
median of the means (15.47 N) of all measurements was used to calculate the
actuation forces in gram for the keyswitches later incorporated in the layout
for the adjusted keyboard. We used Eq. (\ref{eq:N_to_g}) and
Eq. (\ref{eq:actuation_forces}) to calculate the theoretical gram values for
each measured keyswitch.

\begin{equation}
  \label{eq:N_to_g}
  GFR = \frac{50 g}{M_{maf}} = \frac{50 g}{14.47 N} = 3.23 \frac{g}{N}
\end{equation}

\begin{equation}
  \label{eq:actuation_forces}
  AF_{key} = GFR * MAF_{key}
\end{equation}

With $M_{maf}$ the median of the means of applicable forces, $50 g$ the most
commonly found actuation force on the market (Section \ref{sec:market_forces}),
$GFR_{key}$ the gram to force ratio, $MAF_{key}$ the median of applicable force
for a specific key and $AF_{key}$ the actuation force for that specific key in
grams.

An example where we calculated the theoretical actuation force for the \textit{P}
key can be seen in Eq. (\ref{eq:force_example}).

\begin{equation}
  \label{eq:force_example}
  AF_{P} = GFR * MAF_{P} = 3.23 \frac{g}{N} * 10.45 N \approx 33.75 g
\end{equation}

We then assigned the each theoretical actuation force to a group that resembles
a spring resistance which is available on the market or can be adjusted to that
value. We matched the results from Table \ref{tbl:finger_force} to the groups
representing the best fit shown in Table \ref{tbl:force_groups}.


% Custom spring stiffness
% https://www.engineersedge.com/spring_comp_calc_k.htm
% https://www.eng-tips.com/viewthread.cfm?qid=198360


\begin{table}
  \centering
  \ra{1.3}
  \begin{tabular}{?l^l^l^l^l^l^l^l^l^l^l}
    \toprule
    \textbf{Bottom Row} & \multicolumn{2}{c}{\emph{F5}} & \phantom{.} & \multicolumn{1}{c}{\emph{F4}} & \phantom{.} & \multicolumn{1}{c}{\emph{F3}} &  \phantom{.} &\multicolumn{3}{c}{\emph{F2}}\\
    \cmidrule{2-3}\cmidrule{5-5}\cmidrule{7-7}\cmidrule{9-11}
    \rowstyle{\itshape}
    Key                        & ↑     & -     && :     && ;     && M     & N     & B    \\
    \midrule
    \emph{Mean Force (N)}      & 11.23 & 10.84 && 14.22 && 15.34 && 16.38 & 15.60 & 14.36\\
    \emph{Actuation Force (g)} & 36.27 & 35.01 && 45.93 && 49.55 && 52.91 & 50.39 & 46.38\\
  \end{tabular}
  \begin{tabular}{?l^l^l^l^l^l^l^l^l^l^l}
    \\
    \textbf{Home Row} & \multicolumn{2}{c}{\emph{F5}} & \phantom{.} & \multicolumn{1}{c}{\emph{F4}} & \phantom{.} & \multicolumn{1}{c}{\emph{F3}} &  \phantom{.} &\multicolumn{2}{c}{\emph{F2}}\\
    \cmidrule{2-3}\cmidrule{5-5}\cmidrule{7-7}\cmidrule{9-10}
    \rowstyle{\itshape}
    Key                        & Ä     & Ö     && L     && K     && J     & H     &\\
    \midrule
    \emph{Mean Force (N)}      & 11.88 & 12.27 && 15.84 && 18.56 && 17.78 & 18.43 & \phantom{69.69}\\
    \emph{Actuation Force (g)} & 38.37 & 39.63 && 51.16 && 59.95 && 57.43 & 59.53 &\\
  \end{tabular}
  \begin{tabular}{?l^l^l^l^l^l^l^l^l^l^l}
    \\
    \textbf{Top Row} & \multicolumn{3}{c}{\emph{F5}} & \phantom{.} & \multicolumn{1}{c}{\emph{F4}} & \phantom{.} & \multicolumn{1}{c}{\emph{F3}} &  \phantom{.} &\multicolumn{2}{c}{\emph{F2}}\\
    \cmidrule{2-4}\cmidrule{6-6}\cmidrule{8-8}\cmidrule{10-11}
    \rowstyle{\itshape}
    Key                        & +     & Ü     & P     && O     && I     && U     & Z    \\
    \midrule
    \emph{Mean Force (N)}      & 10.80 & 10.70 & 10.45 && 14.34 && 17.95 && 17.00 & 16.80 \\
    \emph{Actuation Force (g)} & 34.88 & 34.56 & 33.75 && 46.32 && 57.98 && 54.91 & 54.26\\
    \bottomrule
  \end{tabular}
  \caption{Maximum force measurements for all digits of the right hand in
    different positions. The mean force of six participants is shown in the
    first row of each table and the resulting actuation force for the
    corresponding keyswitch in the following row. The columns indicate the label
    of the scale on the measuring device which can be seen in Figure
    \ref{fig:FM_example}. \textit{↑} stands for the shift key. \textit{F5} :=
    little finger, ..., \textit{F2} := index finger}
  \label{tbl:finger_force}
\end{table}

\begin{table}
  \centering
  \ra{1.3}
  \begin{tabular}{?l^c^c^c^c^c^c^c}
    \toprule
    \rowstyle{\itshape}
    \textbf{Spring Stiffness:} &              35 g & 40 g  & 45 g  & 50 g  & 55 g  & 60 g \\
    \midrule
    \emph{\textbf{F5:} Key (g)} & \centered{P&(33.75)\\Ü&(34.56)\\+&(34.56)\\-&(35.01)\\↑&(36.27)}& \centered{Ä&(38.37)\\Ö&(39.63)}&&&&&\\
    \midrule
    \emph{\textbf{F4:} Key (g)} &&& \centered{:&(45.93)\\O&(46.32)} &\centered{L&(51.16)}&&\\
    \midrule
    \emph{\textbf{F3:} Key (g)} &&&&\centered{;&(49.55)}&&\centered{I&(57.98)\\K&(59.95)}\\
    \midrule
    \emph{\textbf{F2:} Key (g)} &&&\centered{B&(46.38)}&\centered{N&(50.39)\\M&(52.91)}&\centered{Z&(54.26)\\U&(54.91)\\J&(57.43)}&\centered{H&(59.53)}\\
    \bottomrule
  \end{tabular}
  \caption{Categorization of theoretical actuation forces acquired with
    Eq. (\ref{eq:actuation_forces}), into groups of more commonly available
    stiffnesses of springs. The rows indicate which finger is used to press the
    key. \textit{F5} := little finger, ..., \textit{F2} := index finger}
  \label{tbl:force_groups}
\end{table}

We simply mirrored the results of the right hand, for keys operated by the left
hand and copied the values to keys which are out of reach without lifting the
hand. Finally, we created the adjusted keyboard layout that can be examined in
Figure \ref{fig:adjusted_layout}. This layout was used in our main experiment
where we compared it to four different keyboards with uniform actuation forces
which is discussed in more detail in the following section.

\begin{figure}[ht]
  \centering
  \includegraphics[width=1.0\textwidth]{images/adjusted_layout}
  \caption{Adjusted keyboard layout based on the measurements conducted in this section}
  \label{fig:adjusted_layout}
\end{figure}

\subsection{Main user study}
\label{sec:main_study_meth}
\subsubsection{Hypotheses}
\label{sec:main_hypotheses}
Based on the literature review and preliminary telephone interviews, we derived
the following hypotheses concerning the impact of actuation force on different
metrics related to performance and user experience to ultimately answer our
research question―\textit{``Does an adjusted actuation force per key have a positive
impact on efficiency and overall satisfaction while using a mechanical
keyboard?.''}

\begin{longtable}{p{0.3cm} p{0.5cm} p{13cm} p{0.5cm}}
  & \textbf{H1}	& Lower key actuation force improves typing speed over higher key actuation force (efficiency - speed). & \\
  \\
  & \textbf{H2}	& Higher key actuation force decreases typing errors compared to lower key actuation force (efficiency - error rate). & \\
  \\
  & \textbf{H3}	& Keys with lower actuation force are perceived as more satisfactory to type with than keys with higher actuation force. & \\
  \\
  & \textbf{H4}	& An adjusted keyboard (non-uniform actuation forces) improves typing speed compared to standard keyboards (uniform actuation forces) (efficiency - speed).& \\
  \\
  & \textbf{H5}	& An adjusted keyboard decreases typing errors compared to standard keyboards (efficiency - error rate).& \\
  \\
  & \textbf{H6}	& An adjusted keyboard is perceived as more satisfactory to type with compared to standard keyboards. & \\
  \\
  & \textbf{H7}	& Differences in actuation force influence muscle activity while typing. & \\
\end{longtable}

\subsubsection{Method}
\label{sec:main_method}
In our laboratory study, twenty-four participants were required to perform two
typing test with each of the four keyboards provided by us and two extra typing
test with their own keyboards as a reference. The four keyboards differed only
in actuation force and were the independent variable. The dependent variable
were, typing speed (\gls{WPM} and \gls{KSPS}), error rate (\gls{CER}, \gls{TER})
and satisfaction (preference, usability, comfort, forearm muscle activity
measured via \gls{EMG}, post experiment semi structured interview and ux-curves)

\subsubsection{Participants}
\label{sec:main_participants}
There were no specific eligibility criteria for participants (n=24) of this
study beside the ability to type on a keyboard for longer durations and with all
ten fingers. The style used to type was explicitly not restricted to schoolbook
touch typing to also evaluate possible effects of the adjusted keyboard on
untrained typists. All participants recruited were personal contacts. 54\% of
subjects were females. Participant's ages ranged from 20 to 58 years with a mean
age of 29. Sixteen out of the twenty-four subjects (67\%) reported that they
were touch typists. Subjects reported the following keyboard types as their
daily driver, notebook keyboard (12, 50\%), external keyboard (11, 46\%) and
split keyboard (1, 4\%). The keyswitch types of those keyboards were distributed
as follows: scissor-switch (13, 54\%), rubber dome (8, 33\%) and mechanical
keyswitches (3, 13\%). We measured the actuation force of each participants own
keyboard and the resulting distribution of actuation forces can be observed in
Figure \ref{fig:main_actuation_force}. The self-reported average daily usage of
a keyboard ranged from 1 hour to 13 hours, with a mean of 6.69 hours. As already
mentioned in Section \ref{sec:telephone_interview} it is important to note, that
a study by Mikkelsen et al. found, that self-reported durations related to
computer work can be inaccurate \cite{mikkelsen_duration}. All participants used
the \gls{QWERTZ} layout and therefore were already used to the layout used
throughout the experiment.

\begin{figure}[ht]
  \centering
  \includegraphics[width=0.8\textwidth]{images/main_actuation_force}
  \caption{Distribution of actuation forces from participant's own
    keyboards. The colors represent the type of keyboard. \textit{EXT:} external
    keyboard, \textit{NOTE:} notebook, \textit{SPLIT}, split keyboard}
  \label{fig:main_actuation_force}
\end{figure}

\subsubsection{Experimental Environment}
\label{sec:main_environment}
The whole experiments took place in a room normally used as an office. Chair,
and table were both height adjustable. The armrests of the chair were also
adjustable in height and horizontal position. The computer used for all
measurements featured an Intel i7-5820K (12) @ 3.600GHz processor, 16 GB RAM and
a NVIDIA GeForce GTX 980 Ti graphics card. The operating system on test machine
was running \textit{Arch Linux}\footnote{\url{https://archlinux.org/}}
(GNU/Linux, Linux kernel version: 5.11.16). The setup utilized two 1080p (Full
HD, Resolution: 1920x1080, Refresh-rate: 144Hz) monitors were participants were
allowed to adjust the angle, height and brightness prior to the start of the
experiment. The only two applications that were used during the experiment were
the typing test application described in Section \ref{sec:gott} inside of the
\textit{Chromium}\footnote{\url{http://www.chromium.org/Home}} browser (Version:
v90.0.4430.93-r857950) and \textit{FlexVolt
  Viewer}\footnote{\url{https://www.flexvoltbiosensor.com/software/}} (Version:
0.2.15, Chrome App). The FlexVolt Viewer app was used to collect \gls{EMG} data
via a bluetooth dongle (\textit{Plugable USB 2.0 Bluetooth®
  Adapter}\footnote{\url{https://plugable.com/products/usb-bt4le/}}) from the
\textit{FlexVolt 8-Channel Bluetooth Sensor}. Because of the ongoing COVID-19
pandemic\footnote{\url{https://www.who.int/emergencies/diseases/novel-coronavirus-2019}},
we ensured proper ventilation of the room and all participants including the
researchers were tested with antigen tests prior to every appointment.

\subsubsection{Independent Variable: Keyboards}
\label{sec:main_keyboards}
Additionally to the reference tests conducted with the participant's own
keyboards, we provided four keyboards which only differed in terms of actuation
force.  We decided to assign pseudonyms in the form of Greek goddesses to the
keyboards to make fast differentiation during the sessions easier and reduce
ambiguity. The pseudonyms for each keyboard and the corresponding actuation
force can be found in Table \ref{tbl:kb_pseudo}. All keyboards used the standard
ISO/IEC 9995 \cite{iso9995-2} physical layout and provided keycaps representing
the German \gls{QWERTZ} layout, which all participants were already familiar
with. All four keyboards used in the experiment were
\textit{\gls{GMMK}}\footnote{\url{https://www.pcgamingrace.com/products/gmmk-full-brown-switch}}
equipped with \textit{Gateron} mechanical
keyswitches\footnote{\url{http://www.gateron.com/col/58459?lang=en}}. The order
in which participants would use the four keyboards during the experiment was
defined by a balanced latin square to reduce order effects. Additionally, the
mentioned reference tests with \textit{Own} were conducted at the start and end
of each session to detect possible differences in performance due to
exhaustion. The resulting groups used during the whole experiment were as
follows:

\begin{itemize}
  \item \textbf{Group 1:} \textit{Own $\rightarrow$ Hera $\rightarrow$ Athena $\rightarrow$ Nyx
    $\rightarrow$ Aphrodite $\rightarrow$ Own}
  \item \textbf{Group 2:} \textit{Own $\rightarrow$ Athena $\rightarrow$ Aphrodite $\rightarrow$ Hera
    $\rightarrow$ Nyx $\rightarrow$ Own}
  \item \textbf{Group 3:} \textit{Own $\rightarrow$ Aphrodite $\rightarrow$ Nyx $\rightarrow$ Athena
    $\rightarrow$ Hera $\rightarrow$ Own}
  \item \textbf{Group 4:} \textit{Own $\rightarrow$ Nyx $\rightarrow$ Hera $\rightarrow$ Aphrodite
    $\rightarrow$ Athena $\rightarrow$ Own}
\end{itemize}

\begin{table}
  \centering
  \ra{1.3}
  \begin{tabular}{?l^l^l^l}
    \toprule
    \rowstyle{\itshape}
    Pseudonym & Actuation Force && Description\\
    \midrule
    \textbf{Own}       & 35 g - 65 g & $\approx$ 0.34 N - 0.64 N & Participant's own keyboard (Figure \ref{fig:main_actuation_force})\\
    \textbf{Nyx}       & 35 g & $\approx$ 0.34 N & Uniform\\
    \textbf{Aphrodite} & 50 g & $\approx$ 0.49 N & Uniform\\
    \textbf{Athena}    & 80 g & $\approx$ 0.78 N & Uniform\\
    \textbf{Hera}      & 35 g - 60 g & $\approx$ 0.34 N - 0.59 N & Non-uniform / Adjusted (Figure \ref{fig:adjusted_layout})\\
    \bottomrule
  \end{tabular}
  \caption{Pseudonyms used for the keyboards throughout the experiment.}
  \label{tbl:kb_pseudo}
\end{table}

\subsubsection{Experimental Design}
\label{sec:main_design}
\textbf{Preparation and Demographics}

The whole laboratory experiment was conducted over a total time span of 3
weeks. Participants were tested one at a time in sessions that in total took
$\approx$ 120 minutes. Prior to the evaluation of the different keyboards, the
participant was instructed to read the terms of participation which included
information about privacy, the \gls{EMG} measurements and questionnaires used
during the experiment. Next, participants filled out a pre-experiment
questionnaire to gather demographic and other relevant information e.g., touch
typist, average \gls{KB} usage per day, predominantly used keyboard type,
previous medical conditions affecting the result of the study e.g., \glsfirst{RSI},
\glsfirst{CTS}, etc. The full questionnaire can be observed in the appendix
\ref{app:gott}. Further, participants could adjust the chair, table and monitor
to a comfortable position.

\textbf{\gls{EMG} Measurements}

Since we measured muscle activity during all typing tests, electrodes were
placed on the \glsfirst{FDS}/\glsfirst{FDP} and \glsfirst{ED} of both
forearms. As already discussed in Section \ref{sec:meas_emg}, the main function
of the \gls{FDS} and \gls{FDP} is the flexion of the medial four digits, while
the \gls{ED} mainly extends the medial four digits. Therefore, these muscles are
primarily involved in the finger movements required for typing on a keyboard
\cite[650-653]{netter_anatomy}. We used ECG-Electrodes (Ag/AgCI/Solid Adhesive,
Pregelled, Size: 43mm) from TIGA-MED Deutschland
GmbH\footnote{\url{https://www.tiga-med.de/Diagnostik-Geraete/EKG-Elektroden-Zubehoer/EKG-Klebeelektrode-Festgel-50-Stueck-Pack}}.
To identify the correct locations for the electrodes, participants were
instructed to wiggle their fingers till contractions of the \gls{FDS}, \gls{FDP}
or \gls{ED} could be felt \cite{kim_typingforces}. A reference electrode was
placed next to the pisiform bone onto the dorsal side of the wrist. The
locations were then shaved and subsequently cleaned with alcohol before applying
the electrode. The distance between electrodes was 20mm. The correct placement
was then confirmed, by observing the data received by the \textit{FlexVolt
  8-Channel Bluetooth Sensor} in the \textit{FlexVolt Viewer} application while
the participant performed flexion and extension of the wrist. The
\textit{FlexVolt 8-Channel Bluetooth Sensor} used following hardware settings to
record the data: 8-Bit sensor resolution, 32ms \gls{RMS} window size and
Hardware smoothing filter turned off. To gather reference values (100\%\gls{MVC}
and 0\%\gls{MVC}), which are used later to calculate the percentage of muscle
activity for each test, we performed three measurements. First, participants
were instructed to fully relax the \gls{FDS}, \gls{FDP} and \gls{ED} by
completely resting their forearms on the table. Second, participants exerted
maximum possible force with their fingers against the top of the table
(\gls{MVC} - flexion) and lastly, participants applied maximum possible force
with their fingers to the bottom of the table while resting their forearms on
their thighs (\gls{MVC} - extension). We decided to also measure 0\%\gls{MVC}
before and after each typing test and used these values to normalize the final
data instead of the 0\%\gls{MVC} we retrieved from the initial \gls{MVC}
measurements.


\textbf{Familiarization with \glsfirst{GoTT} and the Keyboards}

Participants could familiarize themselves with the typing test application
(\gls{GoTT}) for up to five minutes with a keyboard that was not used during the
experiment. Further, representative of the other keyboard models used in the
experiment (\gls{GMMK}), participants could familiarize themselves with
Aphrodite (50 g). Additionally, because of a possible height difference between
\gls{GMMK} compared to notebook or other keyboards, participants were given the
choice to use wrist rests of adequate height in combination with all four
keyboards during the experiment. If during this process participants reported
that an electrode is uncomfortable and that it would influence the following
typing test, this electrode was relocated and the procedure in the last section
was repeated (Happened one time during the whole experiment).

\textbf{Texts Used for Typing Tests}

As described in Section \ref{sec:gott}, we acquired ten, non-overlapping, texts
so that every keyboard could be tested twice. The texts were labeled T0\_1,
T0\_2, T1\_1, ..., T4\_1, T4\_2 and could be selected before each typing
test. The order of the texts did not change during the experiment. All texts had
almost identical \gls{FRE} scores (mean = 80.10, SD = 0.48).

\textbf{Questionnaires}

To receive feedback about several aspects that define a satisfactory user
experience while using a keyboard, we decided to incorporate two questionnaires
into our experiment. The first questionnaire was the \glsfirst{KCQ} provided by
\cite[56]{iso9241-411} and was filled out after each individual typing test. The
second survey, that was filled out every time the keyboard was changed, was the
\glsfirst{UEQ-S} \cite{schrepp_ueq_handbook} with an additional question―``How
satisfied have you been with this keyboard?''―that could be answered with the
help of an \gls{VAS} ranging from 0 to 100 \cite{lewis_vas}. The short version
of the \gls{UEQ} was selected, because of the limited time participants had to
fill out the questionnaires in between typing tests (2 - 3 minutes) and also
because participants had to rate multiple keyboards in one session
\cite{schrepp_ueq_handbook}.


  \item Initial typing test with own keyboard. (5 min) \\
        Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
        Pause with light stretching exercises. (3 min)

        \item \textbf{Main Part of the Experiment:} In this part the subject had
        to take two, 5 minute, typing tests per keyboard, with a total of 4
        keyboards (\textit{Nyx, Aphrodite, Athena, Hera}). After each typing
        test, the subject had to fill out the post typing test survey
        (\gls{KCQ}). Keyboards A, B and C are equipped with one set of
        keyswitches and therefore each of the keyboards provides one of the
        following, uniform, actuation forces across all keyswitches: 35 \gls{g},
        50 \gls{g} or 80 \gls{g}. These specific values are the results of a
        self conducted comparison between the product lines of most major
        keyswitch manufacturers. The results shown in appendix
        \ref{app:keyswitch} yield, that the lowest broadly available force for
        keyswitches is 35 \gls{g}, the highest broadly available force is 80
        \gls{g}, and the most common offered force is 50 \gls{g}. Keyboard D is
        equipped with different zones of keyswitches that use appropriate
        actuation forces according to finger strength differences and key
        position. The keyboards used in this experiment are visually identical,
        ISO/IEC 9995-1 conform \cite{iso9995-1} and provide a \gls{QWERTZ}
        layout to resemble the subjects day-to-day layout and keyboard format as
        close as possible. All keyboards are equipped with linear mechanical
        keyswitches from one manufacturer to minimize differences in haptic and
        sound while typing. To mitigate order effects, the order of the
        keyboards is counterbalanced with the help of the latin square method
        and the text snippets for the individual tests are randomized
        \cite{statist_counterbalancing}. \textbf{(total: 80 min)}

  \begin{enumerate}
    \item \textbf{\gls{KB} A, Part 1:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
    \item \textbf{\gls{KB} A, Part 2:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
    \item \textbf{\gls{KB} C, Part 1:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
    \item \textbf{\gls{KB} C, Part 2:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
    \item \textbf{\gls{KB} B, Part 1:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
    \item \textbf{\gls{KB} B, Part 2:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
    \item \textbf{\gls{KB} D, Part 1:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
    \item \textbf{\gls{KB} D, Part 2:} Typing test. (5min) \\
    Adjusted follow-up ISO keyboard comfort questionnaire. (2 min) \\
    Pause with light stretching exercises. (3 min)
  \end{enumerate}

  \item Post-Test semi-structured interview: The participant has to draw three
  different UX curves \cite{kujala_ux_curve} to evaluate how fatigue,
  performance and overall usability of the individual keyboards were perceived
  during the experiment. While drawing the UX curve, participants should
  describe their thought process. To reduce errors in the later evaluation of
  the UX curves, the entire interview is recorded. (10 min)

\end{enumerate}