- Open Access
Predicting upper-bound text entry speeds for discrete-tilt-based input on smartphones
© Ljubic et al.; licensee Springer. 2014
- Received: 23 July 2014
- Accepted: 18 September 2014
- Published: 30 September 2014
Motion sensors integrated into contemporary smartphones allow the introduction of new mobile interaction paradigms, here including tilt-based input control in the mobile context. Namely, as opposed to existing implementations that typically apply continuous feedback on tilting, we define Pitch and Roll movement sequences that change the orientation of the mobile device as discrete-tilt input primitives. The respective commands are then used to manage text entry within three discrete-tilt-based methods thus introduced: keyboard bisection, single cursor, and quad cursor. Each method is based on the use of a particular QWERTY-based keyboard layout with related strategy for character input. We model upper-bound text entry speeds for the input methods, taking into account both movement aspects and language context. The movement model corresponds to both the tilt-based shortest path between two consequent characters, which is theoretically defined, and the time of discrete-tilt execution, which is obtained from user testing experiment we conducted. The linguistic model, comprising digraph statistics, is constructed basing on available English corpora. This modeling approach provides discrete-tilt-based text entry speed predictions representing efficiency rates for expert behavior, i.e. for optimal performance. The results obtained enable the evaluation of the proposed designs without need to test with real users, and can furthermore serve as a baseline for efficiency of text entry implementations that rely on discrete tilt.
- Text entry
- Tilt interaction
- Mobile devices
- Predictive models
"Texting on the move" has become a dominant phenomenon in the current mobile computing environment. The concept of quick message exchange has evolved from using feature mobile phones and SMS to taking advantage of touchscreen smartphones and messaging and social networks services. Furthermore, text entry tasks once projected for desktop-based usage only, such as writing e-mails or Web searches, are now also regularly executed in the mobile domain. However, one problem seems to persist: typing on a mobile touchscreen device is slow, uncomfortable, inaccurate, and generally less efficient in comparison to typing on physical keyboards . On the other hand, touchscreen keyboards are software based, so they can support different types of customizations and built-in algorithms for automatic adaptations. They can be easily programmed to accommodate different layouts, screen sizes, device orientations, and languages, as well as be provided with dictionary support and auto-correction features. Many HCI-based research efforts now focus on developing novel soft keyboard models and related input methods in order to provide trouble-free and more efficient text entry.
In general, users are unwilling to waste their time in order to learn new text-input techniques , which could be the reason why QWERTY still stands as the default keyboard layout in contemporary mobile touchscreen devices. When it comes to interaction modalities, the prevailing technique used for text entry across the most of the available soft keyboards consists of direct touch (Tap), although gestural text input has also attained some acceptance with Swipe,. As contemporary smartphones are in addition provided with built-in motion sensors (e.g. accelerometer, gyroscope, magnetometer) which allow monitoring device movements, such as tilt, shake, rotation or swing, tilt-based interaction in the mobile context is made available, as well as its utilization for text entry. Nevertheless, tilt interaction modality is hardly ever considered to be a part of the final text entry solution, even when multimodal techniques were being addressed. In this paper we provide three text entry methods that (i) rely on the discrete-tilt concept, (ii) support typing by wrist motions only, and (iii) work with a QWERTY-based layout. We are fully aware that tilt-only methods cannot provide high text entry rates, but believe that they could support short messaging scenarios where typing on small screens appears to be particularly inconvenient. The proposed methods are analyzed a priori with the use of predictive modeling, focusing on discrete-tilt-based text entry efficiency.
The paper is structured as follows. In Related work section we describe existing tilt-based text entry solutions that usually do not use the QWERTY layout, and/or rely on continuous application feedback. Pitch and Roll as input primitives for mobile devices section introduces the tilt-based concept which supports an interaction less relying on visual feedback; here we define Pitch and Roll movement sequences as discrete-tilt input primitives for mobile devices. In Discrete-tilt Pitch and Roll based text entry methods section we apply the proposed input commands on text entry in the mobile, by introducing three different text entry methods that utilize both QWERTY-based keyboard layouts and discrete-tilt-based strategies for character selection. Modeling upper-bound text entry speeds section deals with the proposed methods, targeting error-free interaction and expert-level input efficiency. We describe the used modeling methodology which consists of: (i) user experiment which is conducted to determine the time of discrete-tilt execution, (ii) movement models able to predict the total time required to enter a particular character, (iii) a constructed linguistic model for the English language that provides a matrix of digraph probabilities, and (iv) calculated predictions for discrete-tilt-based text entry speeds. In Discussion section we evaluate the proposed designs with respect to the predictions hence obtained, and discuss the model limitations. The last section offers a brief recapitulation, including the outline of our future research plan.
The concept of interpreting data from a mobile device's motion sensors as user's intentional control action has already been examined as a prospective mobile interaction technique. Initial research efforts have resulted with implementations that provide possibilities for scrolling, changing screen orientation, as well as navigation through lists and menus. Mobile gaming has also benefited from both speed and direction control based on motion (a typical example would be a simple game wherein moving a virtual ball through a maze is achieved with device tilting).
Tilt-based text entry techniques, which are of particular importance in this work, were firstly addressed by Unigesture, TiltType, and TiltText prototypes. The Unigesture system relies on specially developed hardware, and uses a zone-based keyboard layout with characters grouped into eight input zones, hence abandoning the QWERTY outline. Each zone, containing 4 characters at most, corresponds to a distinct tilt direction. When using the Unigesture approach, individual letters are not inputted directly, but a word is predicted by an inference engine, basing on zones been "visited" in the tilting sequence. TiltType was designed for small watch-like devices and requires a two-hand interaction. Its interface is multimodal, since character selection requires both button pressing (for letter group selection) and device tilting (for the desired letter pick). Just like in the Unigesture prototype, zone-based keyboard layout and tilts with eight compass directions are used. The TiltText system is a tilt-to-write solution with multimodal interaction that augments text entry on the standard 12-button keypads with multiple letters mapped to a particular key. The MultiTap technique, regularly used for character disambiguation in such designs, is replaced with tilt support: selection of a character is achieved by pressing a key followed by tilting the phone in one of the four directions.
More recent research on this topic includes more sophisticated accelerometer-based text input. GesText represents a mid-air text entry design that relies solely on tilt input, with the respective prototype being based on the Wiimote device and a remote 32″ screen. Two keyboard layouts were proposed in the respective work, and test results confirmed that the zone-based layout supported by a small set of simple tilt gestures is both more efficient and subjectively preferred in comparison to the alphabetically ordered layout. Here, the QWERTY layout was not included in the study. WalkType represents an adaptive text entry system which does not use tilt-based interaction, but is worth mentioning in this place because it applies accelerometer data to improve typing on a smartphone with a standard QWERTY keyboard. Automatic compensation of the extraneous movement while walking appeared to be a valuable support, since typing speed and accuracy increased in experiments with walking participants. The Dasher project  provides a novel text entry method which discards the traditional keyboard concept, and introduces zoom-and-point interaction for selecting "flying letters" in the 2D space. Its main advantage is a well-designed word-completion feature supported by pointing gestures. While pointing can be achieved with various techniques/devices in different contexts of use (e.g. joystick, touchscreen, trackball, mouse, head-tracking, eye-tracking), in the smartphone domain the Dasher assumes tilt movements. Fitton et al.  provided the experimental interface for investigating the performance of tilt-based target selection intended for text input on mobile devices. The respective keyboard layout was reduced to a 5 × 3 grid with 15 alphabetically ordered characters. Selection was achieved by tilt-based positioning of a rolling ball within the appropriate square and maintaining its position for a particular amount of time. This solution was tested by a set of teenage users, on a 7″ tablet device, but related tasks were based on target selection exclusively, rather than on a "real world" text entry scenario. However, qualitative results demonstrated enthusiasm for tilt-based text entry as an idea.
Finally, in our previous work we introduced a fully functional text entry prototype for Android devices in which the standard touch modality could be used in combination with Pitch and Roll movements . We used the concept of discrete tilts for input primitives, as well as a special QWERTY-based keyboard layout and an original input scheme for character selection. The prototype was successfully tested on four devices from both smartphone and tablet class. This proposed text entry method inspired us to develop two additional tilt-based solutions that are described in detail in the following, together with the original one, and comparatively analyzed using predictive modeling.
Since it is very cumbersome to keep a mobile device in its neutral position with zero pitch/roll angles, especially when walking, we define a neutral position zone - an angle-based offset wherein the device is assumed to be motionless. Basically, tilting within the neutral position zone will never invoke any particular action, hence involuntary movements will be filtered out. When the device leaves the neutral position zone, it means that the user is starting to execute the tilt sequence intentionally. To make a valid discrete tilt, the pitch/roll threshold angle should be exceeded by tilting in the wanted direction. The threshold angle is introduced in order to augment the disambiguation between spontaneous and deliberate movements, as well as to provide required wrist strokes in line with natural interaction. It is reasonable to define separate threshold angles for Pitch and Roll because constraints of different wrist movements (flexion, pronation, supination, ulnar and radial deviation) are not equal . Once the threshold angle has been surpassed, the device is assumed to be positioned in the valid tilt zone. Finally, an immediate backward movement from the valid tilt zone to the neutral position zone results with the input primitive invocation.
We furthermore enriched the discrete-tilt concept with the possibility of dwelling in the valid tilt zone. Specifically, if the smartphone is retained in the valid tilt zone for a well-defined amount of time before returning to the neutral position zone, a different input primitive could be invoked. We call this type of movement sequence a long tilt. Since the previously described interaction can result either with the regular or the long tilt, we can state that altogether eight input primitives can be generated using our discrete-tilt concept.
Pilot testing during the discrete-tilt implementation phase helped us in defining both the angle and the time values that appear to be the most convenient for our text entry solution. Consequently, we use: ±10° offset for the neutral position zone, 45° threshold angle for Roll movements, 30° threshold angle for Pitch movements, and 2 sec dwell time to differentiate between regular and long tilts.
In this section we introduce three different text entry methods that rely on the discrete-tilt concept. The design and interaction are described with special emphasis being on keyboard layouts and corresponding input schemes description. For every interaction method we calculate the number of discrete tilts (input primitives) required to select a given character.
Keyboard bisection method
The KB method benefits from multimodal interaction, as character selection is also enabled through direct touch from Level-2 onwards. Since layout bisection results with larger buttons, each user is enabled to individually decide which level is most suitable for precise touch selection. Hence, altogether three modalities can be used for text entry with the KB method: tap-only, tilt-only, and tilt-and-tap. In the continuation of the paper we investigated tilt-only.
The largest element in the initial keyboard layout contains four symbols for the following characters/actions: backspace, period, comma, and space. Corresponding buttons are highlighted using different background color in order to notify the user on the possibility of shortcut activation. Namely, these four common options can be alternatively selected using long tilts, without the need to "navigate" through several layout levels. Shortcut options can be selected regardless of the currently active character layout (Level-1 - Level-5).
Single cursor method
Obviously, the time required to input a particular character (or to activate some control option such as shift or enter) will depend on the chosen tilt-based path between the cursor initial position and the location of the target symbol. Just like the KB method, the SC method also includes the same four shortcuts which can be alternatively selected using long tilts. There are scenarios in which long tilts will herein provide faster access to shortcut options in comparison with the basic navigational input scheme.
While refers to the shortcut set which contains four characters/actions accessible both with regular and long tilts, represents the set of all other available characters from the proposed keyboard layout that can be selected with regular tilts only. The N SC values are in the range from 1 to 7.
Quad cursor method
In comparison with the SC method, quad cursor navigation allows faster positioning within the keyboard layout, but in addition requires one extra tilt for the final 4-letter disambiguation. This letter resolving is performed exactly the same way as in the final level within the KB method.
In the expression above, the +1 term refers to the extra tilt required for final 4-letter disambiguation. Definitions for both and sets remain the same. Since D OPT(QC) corresponds to the cursor navigation path whose tilt number can range between 1 and 2, the N QC values are in the range from 1 to 3. Obviously, N QC = 1 is valid for the long tilts usage only.
The transformation above is based on the usual definition from the typing measurement domain which determinates a word to be five characters long, including spaces and punctuation. The final metric represents the theoretical upper-bound text entry rate (therefore the suffix max), because the predictive model relies exclusively on the time to input characters, and assumes no additional time cost for mental activities such as thinking or visual searching.
In their initial work with text entry modeling , Soukoreff and MacKenzie used Fitts' law in order to predict the movement time between keys on a stylus-operated soft keyboard. The same approach has later been successfully applied for predicting text entry rates on a 12-key mobile phone physical keypad , as well as on several variations of soft keyboard layouts . A model of two-thumb text entry on miniature QWERTY keyboards was also proposed using the same principle . Beside Fitts' law for the movement model, the same linguistic model was used in the whole aforementioned research, basing on the digraph-frequency list with 27×27 = 729 digraphs, which is constructed for the English language with a limited character set consisting of 26 letters (a-z) and the space character. Hence, text entry methods are modeled without punctuation marks. Adapting the linguistic model to another language requires changing the digraph probabilities according to that particular language. Consequently, the existing prediction technique is not culture-specific, as it can even be used with non-Latin-based alphabets. Proof of concepts can be found in works related to predictive evaluation of Korean text entry  and Chinese text entry  on a multitap-based mobile phone keypad with 12 buttons.
In our proposed text entry solutions, Fitts' law cannot be used for the movement model because it does not apply for a discrete-tilt-based interaction. Instead, we have to model the total time required to enter a character by taking into account: (i) the minimal number of discrete tilts required for character selection, (ii) the average time for a single discrete-tilt execution, and (iii) the dwelling time, which applies to cursor-based text entry methods only (SC, QC). In order to find the discrete-tilt execution time, we carried out a user testing experiment. Furthermore, we calculated new digraph probabilities for the English language, according to the available corpora, so as to include two additional punctuation marks (period and comma).
Experimental evaluation of discrete-tilt execution time
In addition, if the smartphone device is not held in the neutral position zone at the beginning of the task, a special warning note ("Please align") becomes visible on the screen.
Twenty eight users, mostly students, were involved in the experiment (24 males, 4 females), their age ranging from 21 to 34 with an average of 23.5 years. Every participant had previous experience in operating touchscreen smartphones equipped with motion sensors, with the average experience of all users being 20.5 months. Sixteen users declared their preference for single-handed usage, in comparison with twelve that opted for a two-handed smartphone handling. Only two participants were left-handed.
A Samsung Galaxy S II (model I9100) was used as a smartphone platform for the testing application. This device comes with a 4.3″ display screen, weights 116 grams, and runs under Android OS version 2.3.4 (Gingerbread). Data from both the accelerometer and the magnetometer sensor were used for software-based determination of the device orientation. The sensor data sampling rate was set to the option SENSOR_DELAY_FASTEST in order to enable the most precise available measurement. For the same reason, SystemClock.elapsedRealtime() was used for time measurement in the application, as the respective clock is guaranteed to be monotonic, tolerant to power saving modes, and the recommend basis for general purpose interval timing . Finally, all network-based services on the smartphone were turned off during the experiment.
At the beginning of the test, participants were involved in a short practice session (about 10 minutes) in order to familiarize with both the smartphone device and testing application features. Within the practice session they were able to consider the assigned angle thresholds (45° for Roll, 30° for Pitch) and the neutral position zone ("10" angle offset), and thus to experience the difference between valid and invalid discrete-tilt movements. In actual testing, they were instructed to perform given tasks by executing discrete tilts "quickly, but in a natural way, without awkward wrist motions".
Since two factors, each with two levels, were considered within the experiment, four test conditions were altogether assigned: (i) Roll tilting with the single-handed usage in portrait mode, (ii) Pitch tilting with the single-handed usage in portrait mode, (iii) Roll tilting with two hands in landscape mode, and (iv) Pitch tilting with two hands in landscape mode. Each participant completed 24 discrete tilts in total: 6 tasks per distinct test condition. Both Roll and Pitch tasks uniformly addressed two possible tilt directions, hence there was an equal number of RL, RR, PU, and PD tasks. Obviously, a repeated measures design was utilized, thus a possible learning effect had to be properly compensated. For that purpose we applied counterbalancing, by dividing participants into four groups with different order of test conditions according to the 4×4 balanced Latin square design .
Results: descriptive statistics summary for time and angle of discrete-tilt execution
Discrete-tilt timeT tilt [ms]
Angle achieved [°]
426.56 ± 105.22
62.20 ± 6.98
Two hands, landscape
424.54 ± 106.80
55.53 ± 3.86
422.84 ± 115.06
60.94 ± 6.88
Two hands, landscape
431.29 ± 102.16
53.60 ± 4.29
To analyze the obtained data, a 2×2 repeated measures ANOVA was performed, with Tilt Type and Interaction Style being the within-subjects factors. The mean time difference between Pitch tasks completion (425.56 ms) and Roll tasks completion (427.07 ms) was not statistically significant (F1,27 = 0.024, ns). Discrete tilt executed by using one hand in the portrait orientation lasted 424.70 ms on the average, as opposed to 427.92 ms for two-handed interaction in the landscape orientation. However, the respective difference was also not statistically significant (F1,27 = 0.089, ns). Finally, the interaction effect Tilt Type × Interaction Style showed to be non-significant as well (F1,27 = 0.351, ns).
Since there were no statistically significant main effects found on discrete-tilt execution time, claiming different times for observed conditions would not be justified. Therefore, it was decided to assign a single time value for discrete-tilt duration. We used the grand mean for task completion time (426.31 ms) and, in order to simplify further calculations, rounding to the hundredth. In conclusion, for single-valued discrete-tilt execution time we suggest: T tilt = 0.43 s.
Movement models for discrete-tilt-based text entry methods
As already mentioned afore, a movement model for a particular text entry method predicts the total time CT ij required to enter character j preceded by a previously entered character i. Since we already defined the minimal number of discrete tilts required for a particular character selection, as well as the discrete-tilt execution time, we can now provide movement models for the proposed text entry methods.
The KB is the only method among the proposed ones in which the time to input a particular character does not depend on the previously entered one. Actually, every character, if not from the shortcut set, requires exactly five regular discrete tilts, i.e. 5×0.43 = 2.15 seconds. Of course, this holds for expert behavior, assuming no time is wasted for finding the desired character, or thinking about bisection strategy. Another characteristic of the expertise is performing long discrete tilts of duration of exactly 2.43 seconds (0.43 s for discrete-tilt movements and precisely 2 s for dwelling). However, this is extremely difficult, since a user will usually dwell in a valid tilt zone for a little longer. Shortcut activation times seem strange at first. Namely, the model predicts faster shortcut activation using regular tilts (4×0.43 = 1.72 s) in comparison with the single long tilt (2.43 s), thus the shortcut concept can be questioned. At this point we state that shortcuts do not always provide time gain, but are extremely valuable in lowering the interaction burden. Doing four regular tilts instead of one long tilt will certainly increase the fatigue level.
Hence, the total time for character input in this case depends on the tilt-based distance between a previously entered character and the target character. If the same character needs to be entered consecutively, two tilts are required (2×0.43 = 0.86 s) before dwelling in the neutral position zone. Shortcut activations using long tilts do not involve T dwell , since the related input primitives (2sRL, 2sRR, 2sPU, and 2sPD) are directly assigned to the one of four available options.
Just like in the SC movement model, when long tilts are used, T dwell is not accounted for. Repeating an already entered character (i = j) assumes 3 regular tilts altogether (3×0.43 = 1.29 s): two tilts before dwelling - for selecting the proper quadruple, and one tilt after dwelling - for 4-character disambiguation.
A new linguistic model for the English language has been constructed since we use a specific character set consisting of exactly 29 elements, including the letters a-z (lowercase), the space character, and two punctuation characters (period, and comma). The model therefore provides a 29×29 matrix of digraph probabilities P ij (probabilities that the character i is followed by the character j).
For the computation of the P ij matrix values, we used the compiled English text corpus containing more than 969 thousands of sentences. The corpus was assembled using three different sources: (i) SETimes - a parallel corpus of English and south-east European languages, based on the content published on the SETimes.com news portal, (ii) hrenWaC - a Croatian-English parallel web corpus, and (iii) TED talks parallel corpus - a collection of parallel sentences extracted from the Croatian-English TED talks transcripts. All of the said corpora are published under the CC-BY-SA or CC-BY-NC-SA-3.0 license, and were obtained from the website of the Natural Language Processing group  which operates within the Faculty of Humanities and Social Sciences at the University of Zagreb, Croatia. Only English parts of available corpora were used, all the text was transposed to lowercase, and only the said 29 characters were considered valid for the language statistics computation. In other words, digraphs with characters not defined in our 29-character set were not included in P ij calculation.
Ten most frequent digraphs from the used English text corpus (total number of digraphs: 119,157,501)
Eight digraphs from the presented Table 2 are listed in the similar top-ten table provided in  which was constructed on the grounds of the 27×27 matrix (English character set with space and without any punctuation mark) and a much smaller corpus with digraph count of 107,199. Although the respective probability values do not exactly match, we believe that our linguistic model fairly characterizes everyday English.
Speed predictions for discrete-tilt-based text entry
All equations and parameters needed were previously defined, with the exception of T dwell . The power of predictive modeling now becomes even more apparent: we could easily obtain several input rate predictions for different T dwell values, without the need to test a text entry method with real users. We could furthermore observe the effect of dwelling time on upper-bound text entry speed predictions. The value T dwell = 1.2 s will be used in further calculations, as initial tests in the implementation phase showed the respective time to be the suitable pause between sequences of active tilting.
When computing time predictions, we assume that two input strategies can be applied for every proposed discrete-tilt-based text entry method: (i) shortcut usage allowed: if the target character resides in the shortcut set, it will be entered with a single long tilt, and (ii) shortcut usage not allowed: all characters have to be entered using regular discrete tilts only. In such a way we are able to provide two predictions for the same text entry method, and to accordingly analyze the effects of long tilts.
Upper-bound text entry speed predictions for proposed discrete-tilt-based input methods
Text entry method
Long tilts not enabled
Long tilts enabled
Keyboard Bisection (KB)
Single Cursor (SC)
Quad Cursor (QC)
The obtained predictions, totaling approximately 5 WPM on the average, indicate rather low text entry rates for all discrete-tilt-based input methods. Such results are expected and understandable as tilt-based text entry cannot compete with standard touch-based texting. Nevertheless, tilt-to-text concept could provide certain benefits in situations when typing on small touchscreens becomes particularly inconvenient, and especially when users' visual contact with the device display is obstructed. Indeed, the discrete-tilt-based interaction provides the possibility for "blind typing" using the proposed methods, once both keyboard layouts and bisection patterns have been memorized.
The KB method is predicted to be the most efficient. According to the results, when long tilts are not enabled, it can produce 3.15 characters per minute more than QC, and 7.9 characters per minute more than SC. Taking into account the number of discrete tilts required for a single character input, these differences seems important. On the other hand, text entry with the KB method is supposed to be the most burdensome, since both physical and mental activities at a higher level are expected. Unlike with SC and QC, there is no dwelling time which could be used for "wrist resting", while at the same time the layout is constantly changing, hence imposing a considerable cognitive load.
As opposed to the KB method, cursor-based methods are more straightforward and include a consistent full QWERTY layout, hence better learnability is assumed. However, when it comes to efficiency, the predicted input rates show the lowest WPM values for the SC method. The reason for that are sometimes very lengthy tilt-based paths between two characters that have to be covered by cursor switching. In the worst-case scenario altogether seven discrete tilts have to be activated in order to select a target character. Interestingly, the most frequent English digraph e-space corresponds to a 7-tilts distance in the proposed keyboard layout. This can be a motive to find a "better place" for the space character, and to propose a possibly more efficient design. The QC method involves much shorter tilt-based distances, thus better efficiency predictions in comparison with the SC are no surprise. According to the trade-off between the obtained predictions and the expected ease of use, QC seems to be the most convenient method to use; however, this has to be further investigated.
The effect of long tilt on text entry speed depends on the observed input method. Results show that using long discrete tilts: (i) decreases text entry speed within the KB method, (ii) enhances input efficiency within the SC method, and (iii) has no particular impact if the QC method is applied. Respective differences in predicted text entry speeds are almost negligible, resulting with limited variations in the respective characters per minute metric (0.05-1.65). On the other hand, long tilts are especially worthwhile in lowering the interaction burden, hence using them in all proposed text entry methods appears to be a good choice.
All predicted values hold for the highest possible level of discrete-tilt-based text entry expertise. Text input without making any errors is assumed. Cognitive activities such as visual search, thinking, and decision making are not included in the described predictive modeling, hence upper-bound entry rates are addressed only. It can be observed that it is very hard, if not impossible, to achieve such proficiency, especially with completely new text entry methods. A considerable learning time is required to become familiarized with the bisection principle and the corresponding layout (KB), as well as to gain experience in finding the optimal tilt-based path between two characters or quadruples (SC, QC). Novice users are expected to use the introduced input methods with noticeably lower text entry speeds with respect to the ones obtained by model predictions. However, predictive modeling is undoubtedly valuable in providing benchmarks and possibilities to both analyze and discuss designs prototypes in advance.
Although we consider both our movement and linguistic models to be good estimates for deriving expert-level text entry rate predictions, they nevertheless show some limitations which are discussed in the following. The movement model relies on the user's motor characteristics, i.e. the time needed to complete the discrete-tilt action. This parameter was empirically determined within the respective experiment in which a single smartphone device was used for testing. Since different smartphone manufacturers do not necessarily embed the same motion sensors in their device models, a further study should investigate if discrete-tilt time is in fact device-independent. The testing application used in this work can be applied for evaluating discrete-tilt handling on various smartphones under the Android OS. When it comes to the linguistic model, it should be noted that it is limited to a 29×29 digraph matrix, and does not include uppercase letters, numbers, or supplementary symbols. However, unlike some previous work in this domain, the punctuation marks period and comma exist in the model. While numbers and supplementary symbols (such as ampersand, asterisk, backslash, etc.) are less frequent in the language corpus, uppercase letters are more common, hence their involvement could improve the accuracy of the linguistic model. Adding new 26 letters to the available character set would require a new calculation of digraph probabilities in a 55×55 matrix. The movement model would have to be modified then as well, with minimal number of tilts being calculated on the ground of alternating keyboard layouts (between lowercase and uppercase, via the shift function).
We have introduced the discrete-tilt concept for text entry, which is a special case of tilt-based interaction wherein the input primitive is triggered after a well-defined sequence of Pitch or Roll movements of the mobile device. As opposed to solutions that use continuous-tilt approach, discrete-tilt-based interaction in great deal does not rely on visual feedback. Altogether eight input primitives have been proposed and applied for text entry.
Three different methods for discrete-tilt-based text entry have been designed, including respective QWERTY-like keyboard layouts and appropriate strategies for character selection/input. Long discrete tilts, intended for shortcut activation, can be concurrently used with regular tilts in all of the proposed methods. Theoretical predictions for expert text entry rates are provided, according to the combination of movement and linguistic models. The movement model corresponds to both the time of discrete-tilt execution (which has been experimentally determined), and the minimal number of tilts required for target character input (which has been calculated for every particular method). The linguistic model, comprising digraph statistics, has been built basing on available English corpora. Obtained predictions revealed different upper-bound text entry speeds for proposed discrete-tilt-based input methods. The KB method showed to be the fastest one, with a more prominent difference when compared with the low-efficient SC method. According to the results, long tilts generally have no major effect on input efficiency. In conclusion, predictive modeling has been successfully applied to discrete-tilt-based text entry, resulting with upper-bound efficiency estimates that can be used as a baseline for similar designs relying on tilt interaction.
Our future work plan includes several directions. Most importantly, the proposed text entry method prototypes necessitate formal usability testing. We expect to get a detailed insight into the correlation between theoretical predictions and empirically obtained text entry rates. In addition to efficiency, other usability attributes should be carefully observed as well. E.g., learnability, errors, and satisfaction play important role for overall acceptance of newly proposed methods. Required physical and mental efforts have to be tackled in order to get a better understanding of ease-of-use constraints.
Further work needs to be done in order to investigate the discrete-tilt-based text entry in a real-life mobile context, with simulation of walking scenarios, attention shifts, and external distractions. We hope that "blind typing" could be helpful in some of these circumstances. In addition, different form factors of mobile devices should be encompassed in the future studies, here including both tablet and phablet classes.
Finally, we find the idea of combining discrete-tilt and continuous-tilt within cursor-based text entry methods an idea worth to consider. Such an approach would assume continuous input primitive invocations once the device leaves the neutral position zone, but with distinct audio and/or tactile feedback for every single invocation. Consequently, the cursor could be continuously moved in a particular direction, with the corresponding interaction still less relying on any visual feedback. The implementation of the proposed design is already underway.
SL modeled the proposed text entry methods, programmed the respective prototypes, calculated digraph probabilities, organized the user testing experiment, and wrote a preliminary version of the paper. VG has formed the main research idea and has provided substantial guidance for the development of the models. MK participated in the design of the user testing experiment and helped with statistical analysis. All authors read and approved the final manuscript.
This paper describes the results of research being carried out within the project 036-0361994-1995 Universal Middleware Platform for e-Learning Systems, as well as within the program 036-1994 Intelligent Support to Omnipresence of e-Learning Systems, both funded by the Ministry of Science, Education and Sports of the Republic of Croatia.
- Findlater L, Wobbrock JO: From plastic to pixels: in search of touch-typing touchscreen keyboards. ACM Interactions 2012,19(3):44–49. 10.1145/2168931.2168942View ArticleGoogle Scholar
- Zhai S, Kristensson PO, Gong PF, Greiner M, Peng SA, Liu LM, Dunnigan A: ShapeWriter on the iPhone - From the Laboratory to the Real World. In Proc. CHI EA 2009 (pp. 2667-2670). ACM, New York; 2009.Google Scholar
- Swype. . Accessed 12 Jul 2014., [http://www.swype.com]
- Sazawal V, Want R, Borriello G: The Unigesture Approach. In Proc. Mobile HCI 2002 (pp. 256-270). ACM, New York; 2002.Google Scholar
- Partridge K, Chatterjee S, Sazawal V, Borriello G, Want R: TiltType: Accelerometer-Supported Text Entry for Very Small Devices. In Proc. UIST 2002 (pp. 201-204). ACM, New York; 2002.View ArticleGoogle Scholar
- Wigdor D, Balakrishnan R: TiltText: Using Tilt for Text Input to Mobile Phones. In Proc. UIST 2003 (pp. 81-90). ACM, New York; 2003.View ArticleGoogle Scholar
- Jones E, Alexander J, Andreou A, Irani P, Subramanian S: GesText: Accelerometer-Based Gestural Text-Entry Systems. In Proc. CHI 2010 (pp. 2173-2182). ACM, New York; 2010.View ArticleGoogle Scholar
- Goel M, Findlater L, Wobbrock J: WalkType: Using Accelerometer Data to Accommodate Situational Impairments in Mobile Touch Screen Text Entry. In Proc. CHI 2012 (pp. 2687-2696). ACM, New York; 2012.View ArticleGoogle Scholar
- Inference Group: The Dasher Project. . Accessed 12 Jul 2014., [http://www.inference.phy.cam.ac.uk/dasher/]
- Fitton D, MacKenzie IS, Read JC, Horton M: Exploring Tilt-Based Text Input for Mobile Devices with Teenagers. In: Proc. HCI 2013. British Computer Society, London; 2013.Google Scholar
- Ljubic S, Kukec M, Glavinic V: Tilt-Based Support for Multimodal Text Entry on Touchscreen Smartphones: Using Pitch and Roll. In Proc. HCI International 2013, UAHCI/HCII 2013, Part III, LNCS 8011 (pp. 651-660). Springer, Heidelberg; 2013.Google Scholar
- Rahman M, Gustafson S, Irani P, Subramanian S: Tilt Techniques: Investigating the Dexterity of Wrist-based Input. In Proc. CHI 2009 (pp. 1943-1952). ACM, New York; 2009.View ArticleGoogle Scholar
- Soukoreff RW, MacKenzie IS: Theoretical upper and lower bounds on typing speed using a stylus and soft keyboard. Behaviour & Information Technology 1995, 14: 370–379. 10.1080/01449299508914656View ArticleGoogle Scholar
- Silfverberg M, MacKenzie IS, Korhonen P: Predicting Text Entry Speed on Mobile Phones. In Proc. CHI 2000 (pp. 9-16). ACM, New York; 2000.Google Scholar
- MacKenzie IS, Zhang SX, Soukoreff RW: Text entry using soft keyboards. Behaviour & Information Technology 1999,18(4):235–244. 10.1080/014492999118995View ArticleGoogle Scholar
- MacKenzie IS, Soukoreff RW: A Model of Two-Thumb Text Entry. In Proc. GI 2002 (pp. 117-124). Canadian Information Processing Society, Toronto; 2002.Google Scholar
- Ilinkin I, Kim S: Design and Evaluation of Korean Text Entry Methods for Mobile Phones. In Proc. CHI EA 2008 (pp. 2853-2858). ACM, New York; 2008.Google Scholar
- Liu Y, Raiha K-J: Predicting Chinese Text Entry Speeds on Mobile Phones. In Proc. CHI 2010 (pp. 2183-2192). ACM, New York; 2010.Google Scholar
- Android Developers: SystemClock. . Accessed 12 Jul 2014., [http://developer.android.com/reference/android/os/SystemClock.html]
- MacKenzie, IS. (2013). Human-Computer Interaction: An Empirical Research Perspective. Elsevier.Google Scholar
- Natural Language Processing group: Corpora. . Accessed 12 Jul 2014., [http://nlp.ffzg.hr/resources/corpora/]