A research-led approach to the design, implementation and evaluation of risk communications to promote safe behaviour
Submitting Institution
Plymouth UniversityUnit of Assessment
Psychology, Psychiatry and NeuroscienceSummary Impact Type
SocietalResearch Subject Area(s)
Medical and Health Sciences: Public Health and Health Services
Psychology and Cognitive Sciences: Psychology
Summary of the impact
The Human Factors Group (HFG) has established an evidence base to inform
the design, implementation and evaluation of risk communications in
promoting safe behaviour. They have delineated a range of design,
linguistic and personal variables that influence the effectiveness of risk
communications, as well as identifying important demographic and
psychological variables that affect personal safety, particularly in
relation to driving. This evidence has been used to inform the development
of road safety interventions and tools/guidelines for communication in
civil emergencies. There has been impact at national and local government
level, driving changes in policy and practice. Evidence has been
integrated into the road safety policy and interventions of local
government, and into government guidance on communicating during civil
emergencies. Emergency preparedness documents for public use have been
developed and validated. Our success at embedding research evidence into
practice has received national and international recognition (e.g. Prince
Michael International Road Safety Award, 2012; HM Government Emergency
Preparedness Guidance - case study illustrating good practice; and a
request for dissemination to World Health Organisation).
Underpinning research
The work described was led by Dr Elizabeth Hellier (Reader) and Professor
Judy Edworthy. Edworthy has worked in the school since 1985 and Hellier
since 2000. Staff employed and supervised by Hellier and Edworthy to work
on the research described were Dr Lex Newbold (2007-9), Dr Kirsteen
Aldrich (now Titchener) (2006-9), Dr Donna Reid (2006-7), Dr Elizabeth
Gabe-Thomas (2007-11, including PhD), Mr Phil Jefferies (2010-11), Dr
Jonathan Rolison (2011- 12), and Ms Vicky Dunn (2010-11). Ms Poppy Husband
was employed as a KTP associate from 2008-2010 and Ms Laura Hurst as a KTP
Associate from 2010-2012. Both KTP associates were supervised by Dr
Hellier. Dr Paul Hewson is an Associate Professor in the School of
Mathematics and Computing at the University of Plymouth who has
collaborated on the work.
Research in this area has covered four main topics: people's
interpretation of visual warnings; compliance with visual warnings; the
demographics of risky behaviour, particularly in relation to road safety;
and the psychological factors predicting road safety. In terms of people's
interpretation of visual warnings, the HFG has described how a range of
design, linguistic, and personal variables influence the judged
effectiveness of risk communications (e.g., how communications are
interpreted) and predict risky behaviour. Early work considered the
effects of design features on judgements of the hazard implied by
warnings, demonstrating for example, that increasing font and border size
increases the perceived hazardousness of warnings, as does using the
colour red rather than black (Edworthy and Adams, 1995).This was followed
by work looking at how linguistic factors impact on the perception of risk
communications. For example, signal words (single words like `Danger',
`Warning', `Caution', used to draw attention to hazards) were shown to
vary consistently and reliably in terms of the degree of severity
indicated by those words and to be able to function as a scale of
perceived hazard (Hellier, Edworthy, Wright and Newstead, 2000). Further
work demonstrated that while perceived hazard/danger is an important
attribute of signal words, other meanings they are associated with make
them more or less appropriate for use in different risk communication
contexts (Hellier, Aldrich, Wright, Edworthy and Daunt, 2007).
In terms of actual compliance with warnings, studies have been carried
out using simulation tasks collecting direct behavioural evidence of
compliance (Edworthy, Hellier, Lambell, Grey, Aldrich and Lee, 2004).
Here, warnings were created that varied systematically along linguistic
dimensions such as explicitness/implicitness (the degree to which the risk
is described exactly, and in detail), definite/probable (the degree to
which the risk is described as likely to occur), active/passive (a
linguistic device determining the extent to which the risk is the direct
subject of a statement) and the use (or no use) of personal pronoun (which
determines the extent to which the observer is directly addressed). When
these warnings were rated, there was more anticipated compliance for the
first style, rather than the second style, of each pair. The findings were
generalised to simulated tasks where the same effects were revealed for
actual compliance. This work also showed that warning information is most
effective (in terms of actual compliance) when placed within `Directions
for use' so that it is received contemporaneously with the task.
Simultaneously we explored personal variables that influence safety
behaviour, which also have implications for safety-related communications
and interventions. For example we demonstrated that older drivers are no
more at risk than older pedestrians or passengers, suggesting that
interventions should consider older road users, not older drivers
explicitly (Rolison, Hewson, Hellier and Husband, 2012).
Other work demonstrates how the tendency for older motorcyclists to
drive more powerful motorcycles negates the protective effect of age on
fatality rate found for road users (Rolison, Hewson, Hellier and Hurst,
2013). This road safety research was conducted in collaboration with Devon
and Cornwall County Councils [DCC & CCC] and influenced practice
before it was cleared for general publication, hence publication follows
impact in this particular case.
References to the research
Edworthy, J & Adams, A (1995) Quantifying and predicting the effects
of basic text display variables on the perceived urgency of warning labels
- trade-offs involving font size, border width and colour. Ergonomics,
38, 2221-37. DOI:10.1080/00140139508925264
Citations: 57. Impact factor 2011: 1.409; 5-year IF: 1.620. Ranked 3/16 in
`Ergonomics' for IF and 2/16 for Eigenfactor (JCR)
Hellier, E., Aldrich, K., Wright, D., Edworthy, J. & Daunt, D.
(2007). A Multidimensional Analysis Of Warning Signal Words. Journal
of Risk Research, 10, 323-338. DOI:
10.1080/13669870601066963
Impact factor 2011: 0.880; 5-year IF 1.173. Ranked 33/89 in `Social
Sciences, Interdisciplinary' for IF and 19/89 for Eigenfactor (JCR)
Edworthy, J, Hellier, E J, Lambell, N, Grey, C, Aldrich, K & Lee, A.
(2004) Linguistic and location effects in compliance to pesticide warning
labels. Human Factors, 46, 1-21. DOI: 10.1518/hfes.46.1.11.30383
Citations: 21. Impact factor 2011: 1.187; 5-year IF 1.885. Ranked 7/16 in
`Ergonomics' for IF and 5/16 for Eigenfactor (JCR)
Rolison, J., Hewson, P., Hellier, E., Husband, P (2012) Risk of fatal
injury in older adult drivers, passengers, and pedestrians. Journal of
the American Geriatrics Society, 60, 1504-8. DOI:
10.1111/j.1532-5415.2012.04059. Impact factor, 2011: 3.737; 5-year IF
4.315. Ranked 2/30 in `Gerontology' for IF and 1/30 for Eigenfactor (JCR)
Rolison, J., Hewson, P., Hellier, E & Hurst, L (2013) Risks of
High-powered Motorcycles among Younger Adults. American Journal of
Public Health, Online ahead of print, Jan 2013:e1-e4 http://pearl.plymouth.ac.uk:8080/pearl_xmlui/handle/10026.1/1259
Impact factor 2011: 3.926; 5-year IF 4.764. Ranked 3/131 in `Public,
Environmental and Occupational Health' for IF and 2/131 for Eigenfactor
(JCR)
Grants
2000-1 Health and Safety Executive The effectiveness of pesticide
labelling (Edworthy and Hellier), £74,000
2006-8 Home Office/Cabinet Office: `Factors influencing information
spread and reliability' (Hellier and Edworthy) £292,000
2008-9 Home Office/Cabinet Office: `Evaluating the Application of
Evidence-Based Guidance to the Design of Emergency Communication
Literature' (Hellier, Newbold and Edworthy) £63,000
2009-10 NHS Connecting for Health: `Efficacy of prompts and alerts in
eprescribing' (Edworthy and Hellier) £80,000
Details of the impact
The impact of this work has been in four areas
1. Staff Movement from Academia to Local Government
Knowledge Transfer Partnerships (KTPs) were established between the
University and both Cornwall County Council and Devon County Council
[1,2]. The explicit aim of these KTPs was to transform the councils into
evidence-led organisations, and to embed the research evidence into
practice locally and nationally. Following the awards, a permanent
position, `Evidence-Based Researcher' was created in DCC (post filled by
Poppy Husband formerly employed by the KTP) [2]
The awards were as follows:
- 2010-2012 Knowledge Transfer Partnership with ESRC/Cornwall County
Council (Hewson and Hellier). To improve road safety programme delivery
through evidence and research led practice, specifically focussing on
fatalities within the elderly, the young and motorcyclists (£116,000).
- 2008-2010 Knowledge Transfer Partnership in collaboration with
ESRC/Devon County Council (Hellier and Hewson). Evidence based practice
for road safety practitioners. (£109, 635).
2. Changes to National and Local Government guidelines
In 2009 the group was commissioned to produce a Public Information
Booklet for the MoD on Nuclear Emergency at Devonport Dockyard. This
booklet incorporates specific research findings (in particular, from
Edworthy et al. 2004 and Edworthy and Adams, 1995), for example, the use
of the personal pronoun, definitive language, increased readability and
print size/colour). The booklet has been distributed to 30,000 homes
within a 3km radius of Devonport Dockyard and has been shown to be more
understandable, more memorable and preferred to the previous booklet [3].
This work was cited by HM Government Emergency Preparedness Guidance
(Chapter 7: Communicating with the Public) [4] as a case study of good
practice for using research evidence to inform the design and evaluation
of guidance for the public. The key findings have also more generally
informed HM Government Emergency Preparedness Guidance on Part 1 of the
Civil Contingencies Act (2004, guidance revised in March 2012) [5]. Front
line responders nationwide are required to use this guidance to develop
and implement their emergency communications.
The key research findings on warning perception and compliance (Edworthy
and Adams, 1995; Edworthy et al. 2004; Hellier et al. 2000; Hellier et al.
2007) have been incorporated into DCC's Guidelines on Persuasive
Communication (2011) which guide the design of communication with the
public across all Council Departments [2]. The guidelines are also
incorporated into DCC's `Evidence-Based Practice for Road Injury
Prevention' course which has been delivered to 50 road safety
professionals in Devon and 40 nationally, with 100 participants
anticipated in 2013 [6]. The course has been designed to ensure that road
safety practitioners use research evidence to inform their professional
practice. In DCC amendments have been made to on-road text warnings, to
bring them into line with the guidance [2] and research
findings.
3. Changes to national/local Government Practice
The research findings in their entirety (warning perception and
compliance; psychological factors of and demographic factors in road
safety) have been applied to road and driver safety. The research into
road safety (Rolison et al., 2012; Rolison et al., 2013) identifies
problem areas in driver safety which can be addressed through behavioural
change programmes. Through Knowledge Transfer Partnerships awarded to
Hellier and Hewson, and Devon and Cornwall County Councils from 2008
onwards (see above), the application of the HFG's work has been translated
into a number of practical outputs. Reports applying the evidence to
promoting safe behaviour in older drivers (2009), younger drivers (2010),
motorcyclists (2010), and work-related drivers(2010), as well as the
influence of deprivation on safe behaviour and the effectiveness of
cognitive training and behaviour change techniques, were published on the
Road Safety Knowledge Centre (2266 subscribers, approximately 1400 views a
month) [7] . These reports are disseminated to road safety professionals
nationally and now influence practice. For example, the deprivation report
resulted in the introduction of 20mph zones in deprived areas in Cornwall,
and was included in the Cornwall and Isles of Scilly Alcohol Awareness
Strategy [8], leading to interventions for drunken and teenage pedestrians
in deprived areas [9]. The behaviour change report led to a revision of
all CCC's road safety initiatives in line with the recommendations that
they include a variety of behaviour change techniques. This initiative won
the Prince Michael International Road Safety Award (2012), and has been
adopted by other local authorities. The Director of Road Safe has asked to
share this work with the World Health Organisation [1]. The report on
young drivers led to the re-design of Devon and Cornwall's `Learn2Live'
programme (a road safety intervention delivered to 14,000 17-18 year olds
pa [2]. The motorcycle report (and subsequent paper, Rolison et al. 2013)
resulted in a campaign to prompt anticipated regret amongst riders and
awareness campaigns for specific risk factors of motorcycling such as
engine size [1].
The research evidence was also integrated into the Department of
Transport's National Evaluation Toolkit 2010 for road safety practitioners
[10] (Husband was National Champion for this toolkit, hosting workshops to
embed it in practice) and into the monitoring and evaluation framework for
the Local Transport Plan. The toolkit is for use by all UK road safety
practitioners to evaluate road safety interventions. The HFG's evaluation
of DCC's `Honest Truth' intervention won the Chartered Institute of Public
Relations West of England PRide award for best Use of Measurement and
Evaluation 2012 http://www.cipr.co.uk/content/events-awards/pride-
awards/results-2012/west-england
In addition, change management teams have been created within DCC and CCC
to embed the research evidence into practice. The change management teams
go beyond road safety professionals and also include fire service, police,
driving instructors, and neighbourhood groups [1,2,8].
4. Participation in national public policy/advisory committees
The HFG have been invited as research experts to several policy/advisory
committee meetings. These committees shape national and local government
policy and practice. These are: Cabinet Office Civil Contingencies
Secretariat Warning and Informing Workshop 2009 (Hellier); Parliamentary
Advisory Committee for Transport Working Party on Young Drivers 2010
(Husband); and Cabinet Office Civil Contingencies Secretariat Cell
Broadcast Feasibility Working Group 2009 (Edworthy)
Sources to corroborate the impact
[1] Casualty Reduction Manager, Transportation Service. Environment,
Planning & Economy, Cornwall Council, Redruth Tel. 01872 327237
(corroborating email available on request)
[2] Road Safety Operations and Partnership Programme Manager, Devon
County Council. Environment Economy and Culture Directorate (corroborating
email available on request)
[3] Civil Protection Manager, Plymouth City Council, Plymouth, Devon
(corroborating email available on request)
[4] Civil Contingencies Act Enhancement Programme 2012, Chapter 7:
Communicating with the Public http://www.cabinetoffice.gov.uk/sites/default/files/resources/Chapter-7-Communicating-with-
the-Public_18042012.pdf. pages 17, 32, 40
[5] High Impacts Team Policy Manager, Civil Contingencies Secretariat,
Cabinet Office (corroborating email available on request)
[6] Devon County Council's Evidence-Based Practice for Road Injury
Prevention course http://system.newzapp.co.uk/GPage.asp?LID=OSwxODE3MDU1NDc=
[7] Road Safety Knowledge Centre Links (some only visible for review via
CCC website due to password restrictions). Work related drivers: http://www.roadsafetygb.org.uk/news/1618.html
Deprivation report : http://www.cornwall.gov.uk/default.aspx?page=30370.
Motorcyclists: http://www.cornwall.gov.uk/default.aspx?page=30370.
Behaviour Change: http://www.roadsafetyknowledgecentre.org.uk/sections/research-
reports/knowledge/571.html
[8] Cornwall and the Isles of Scilly Alcohol Awareness Strategy https://www.amethyst.gov.uk/Download_Documents/Strategies
Audits/CIOS%20Alcohol%20Needs%20Assessment%202010-11%20FINAL.pdf (pg
100)
[9] County Council Meeting Minutes available on request to corroborate
the use of 300,000 flash animations on www.motorcyclenews.com
which ran from 1-5-12 to 31-7-12, and petrol pump stickers on 14
forecourts in Cornwall for 8 weeks
[10] The toolkit evaluation website http://www.roadsafetyevaluation.com/index.html