Dasher

Submitting Institution

University of Cambridge

Unit of Assessment

Physics

Summary Impact Type

Technological

Research Subject Area(s)

Information and Computing Sciences: Artificial Intelligence and Image Processing, Computer Software
Language, Communication and Culture: Linguistics


Download original

PDF

Summary of the impact

In 1997 Professor David MacKay of the University of Cambridge Department of Physics developed Dasher, a software accessibility tool for entering text by zooming through letters displayed on a screen. Dasher has since transformed computing for tens of thousands of individuals unable to use a normal keyboard, and is recommended by many charities involved in assistive technologies, such as the European Platform for Rehabilitation network. Since 2008, Dasher has been downloaded over 75,000 times and has been ported to smart phones, making use of input devices such as tilt sensors and joysticks. Linking Dasher's information-efficient text generation from gestures or gaze direction to text-to-speech or real-time-text output channels has made Dasher an ideal component of augmentative and alternative communication (AAC) systems which address digital exclusion.

Underpinning research

During the second half of the 1990s the University of Cambridge Department of Physics' Inference Group, led by David MacKay (then University Lecturer, now Professor), conducted human-computer interface research to develop an information-efficient text-entry interface, driven by natural continuous pointing gestures. The first prototype of the resulting software, Dasher, was released in 1997.

In Dasher's zooming interface, the user writes by steering through a continuously-expanding two-dimensional world containing alternative continuations of the text, arranged alphabetically. Dasher was designed to use a language model to predict which letters might come next, and makes those letters easier to write by allocating more space on the screen to them. The language model can be trained on example documents in almost any language, and it adapts to the user's language as s/he writes. Part of the research of the Dasher project involved enhancing the language model, which is based on a text compression model called prediction by partial match.

The early development of Dasher was supported by partnership awards from IBM Zurich research laboratories, awarded in 1999 and 2001. The first research version of Dasher, released in 2002, could be driven by mouse or by gaze-tracker. The record-breaking performance of Dasher with a gaze-tracker was described in Nature in 2002 [Ref 2]. In 2002, the Gatsby Charitable Foundation's interest in the research underpinning Dasher led them to offer funding which continues to support a post of project manager/developer. This funding enabled significant research into producing enhancements to Dasher, including support for almost all languages, and the development of versions of Dasher driven by small numbers of buttons. MacKay also developed a "breath mouse" and demonstrated efficient communication by breath-Dasher.

Dasher has been ported to a wide variety of computer platforms including iPhone and Android (Dr Alan Lawrence, Research Associate 2009-2011) and interoperability with the evolving GNOME and Windows desktops is actively maintained (Patrick Welche, Research Associate 2008-present). Enhancements to support the disabled community include MacKay and Lawrence's 2009 development of one-switch Dasher for impaired users who can communicate with only a single switch, while Dr Emli-Mari Fanner (neé Nel, Research Associate 2009-2013) worked on the development of a gesture switch and head tracking algorithm (using images from a cheap web-cam) to interact with Dasher in 2010. Lawrence, Nel and Welche all worked with MacKay in the Inference Group. As is usual in open source software development of this type, many other developers volunteered their time privately, and most but not all were members of the Cavendish.

Collaborators who tested Dasher in the field include SU-DART (Swedish university hospital rehabilitation centre) and the Ace Centre in Oxford (which specialises in helping children with severe disabilities), and the Inference Group had a technical collaboration with IDRC OCAD Toronto who developed "Tecla" which allows one to control an Android mobile phone using a wheelchair joystick, which the Inference Group interfaced with Dasher in one-button mode.

References to the research

1. *Dasher — a Data Entry Interface using Continuous Gestures and Language Models — by David J Ward, Alan F Blackwell and David JC MacKay, UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology, Pages 129 — 137, ACM New York, NY, USA 2000, ISBN:1-58113-212-3, DOI: 10.1145/354401.354427. Peer-reviewed proceedings.

 

2. *Fast Hands-free Writing by Gaze Direction — by David J Ward and David J C MacKay; Nature 22 August 2002 418, 838, DOI:10.1038/418838a. Peer-reviewed journal.

 
 

3. Fast and flexible selection with a single switch — by T Broderick, David J C MacKay in PLoS ONE 4 (10) 2009, e7481, DOI:10.1371/journal.pone.0007481. Peer-reviewed journal.

 
 
 
 

4. *Opengazer, Dasher and Nomon: Hands-free error tolerant communication — by Patrick R L Welche In: Proceedings of the 6th Cambridge Workshop on Universal Access and Assistive Technology (CWUAAT 2012), Cambridge, UK (CUED/C-EDC/TR158 ISSN 0963-5432). Peer-reviewed proceedings.

5. EU Deliverable D4.6.2b Alternate text entry system for mobile devices for users with motor disabilities — by Patrick R L Welche (2011).

6. EU Deliverable D2.5.2 Gesture switch, head pose estimation, head tracking and Ticker: from research to real-time — by Emli-Mari Nel (2011)

*References which best represent the quality of the underpinning research
In 2008, the EU Commission awarded MacKay 75% of 920,104 euros for 4 years' funding in the context of the ÆGIS project, an integrated project within the ICT programme of FP7, grant agreement 224348, to port Dasher to smart phones to create an AAC system, and to carry out research on very-low-cost gaze-tracking, the remaining 25% of the grant being provided by the Gatsby Charitable Foundation.

Details of the impact

Dasher is a fast and easy to learn text-entry interface using natural continuous pointing gestures, so taking advantage of humans' natural ability to make high-speed analogue movements. It can also use button presses, clicking and tapping gestures as input. As well as being faster, it is simpler to use than conventional writing systems and produces considerably fewer errors. In contrast to most writing systems, the Dasher approach enables efficient communication in almost all languages, regardless of alphabet. All that is required is an alphabet file that defines the alphabetical order, and a training text in the target language. Alphabet files have been created for 136 languages, and training texts have been produced in 20 European, 4 Asian, 15 Indian, 12 African, and 3 Middle-Eastern Languages. Special prototypes of Dasher were developed in 2011 for writing in Japanese and Chinese, making Dasher's transformational impact on users global.

Dasher is an open source product — the source code was released under the GNU public licence (GPL) in 2002 and all subsequent versions have been issued similarly. This guarantees free access to the Dasher source code, and allows it to be stored in the publicly accessible GNOME repository. Dasher was included in the GNOME 2 desktop in January 2004, and agreement was reached in November 2011 to include it in GNOME 3. The GNOME desktop is the default desktop environment for the Sun MicroSystems (now Oracle) Solaris operating system and most Linux distributions.

Since its release, Dasher has been downloaded from the Inference Group website over 120,000 times of which 71,000 times since 2008. It has also been included in software packages distributed by others, including Ubuntu, Solaris, and Tobii (who sell gaze-tracking systems).

Dasher was designed to use hardware that may be much smaller than conventional keyboards and is therefore particularly useful for smart phones and tablet computers. As a result of the Inference Group's continued research into porting Dasher to mobile devices [Ref 5], Dasher was made available for the Android market and the iPhone, iPod touch and iPad in 2010. It has been downloaded to Android devices over 5000 times with a user-review rating of 4.2/5 and from the Apple Store over 400 times since October 2012.

Dasher has transformed computing for those unable to use a conventional keyboard because it can be driven using any pointing device, such as a mouse, rollerball, touchpad, joystick or gaze-tracker. Since 2008, significant advances have been made in the usability of Dasher with pointing devices, particularly with gaze-trackers and joysticks. Dasher has proven to be ideally suited to be used with a gaze-tracker as it is mode free: you look at what you are writing, and do not need to escape into an error-correction mode, nor an "accept-model-predictions" mode as in systems which offer word-completions. Unlike other systems it is also robust to blinks and can infer and correct poor calibration. Dasher adapts to an individual's writing style to such an extent that it is sometimes possible to write several words using a single glance.

One issue which Dasher faced was that commercial gaze-trackers are expensive, and typically use special-purpose high resolution, high frame rate infra-red cameras. The significant cost of commercial gaze-trackers motivated research into gaze-tracking and head-tracking using ordinary cheap web-cams. So far, a gesture switch — an algorithm which learns and detects facial gestures such as "look up" or "smile" — and a head tracker suitable for hands-free writing with Dasher have been developed [Ref 6].

Dasher can also write text using discrete button presses as input, either by selecting a screen region, or using precise timing information. This feature prompted collaboration with IDRC (Toronto) who developed Tecla, a hardware device which converts wheelchair joystick controls into bluetooth keypresses with an on-screen keyboard to be able to use an Android smart phone using the joystick. As a result of the Inference Group's research [Ref 5], it is now possible to switch between the Tecla on-screen keyboard and Dasher so that writing a text message on a mobile phone using a single wheelchair button and Dasher in a new one-button mode became easy. Tecla was commercialised by Komodo OpenLab Inc. in 2012.

The Dasher development team receives positive feedback from users on a weekly basis confirming the transformative impact Dasher has made on their lifestyle quality and well-being. Examples of user testimony include:
"I am an occupational therapist in London who has been using Dasher for many years with children and adults with significant physical disabilities that prevent them from using a standard keyboard or mouse." (20 September 2012)
"I found your software on the web and think it is wonderful! My mother has ALS and although she can still use her hands typing is a one finger time consuming tiring effort, yet she has a lot to say. In addition she writes to many who live in Turkey in Turkish as she and her husband lived there for 25 years. Having that language available was a very happy surprise. I live in another state and your software will allow her to communicate with me and others via email and in the future using speech and eye gaze programs as needed. For that I say thank you." (18 September 2012)
"I have a personal example — an acquaintance of mine who had ALS. I installed Dasher on his computer, and in short order he was able to communicate with his wife and family much more rapidly, was able to compose documents and e-mails, etc. Made a very significant improvement in the quality of his life." (Accessibility Principal at Oracle — 5 April 2013).

Sources to corroborate the impact

[1] Rerelease of Dasher on iPhone, iPod, iPad:
https://itunes.apple.com/en/app/dasher-text-entry/id568895508?mt=8

[2] Dasher on Android:
https://play.google.com/store/apps/details?id=dasher.android&hl=en

[3] Mobile Dasher review:
http://www.techsupportalert.com/best-free-onscreen-keyboard-osk.htm

[4] BBC Digital Planet 1 September 2009: Husband and wife team Kevin and Sarah Brown talk about their joint project to help stroke patients communicate more effectively using a simple tech solution:
http://www.bbc.co.uk/worldservice/science/2009/09/090901_digitalplanet_010909_1.shtml

[5] Dasher used with an Emotiv head set:
http://eightbar.co.uk/2012/06/08/even-more-mqtt-enabled-tvs/

[6] User testimony 1 on file

[7] User testimony 2 on file

[8] Accessibility Principal at Oracle statement on file