Clinical Outcome Modelling Saves Lives
Submitting Institution
University of PortsmouthUnit of Assessment
Computer Science and InformaticsSummary Impact Type
HealthResearch Subject Area(s)
Medical and Health Sciences: Nursing, Public Health and Health Services
Summary of the impact
    
      - 
Practitioner/professional service impact. Our work on clinical
        outcome modelling has
        influenced the Royal College of Physicians' (RCP) new standard for the
        assessment of the
        severity of acute illness (known as the "National Early Warning Score"
        or NEWS). The specific
        recommendation is for adoption by NHS bodies, but is already being
        adopted internationally.
 
      - 
Health impact. The chairman of the RCP working party estimated
        that our work could result in
        the saving of thousands of lives per year.
 
      - 
Economic impact. Our work is incorporated in the VitalPAC
        system developed by The
        Learning Clinic Ltd (TLC), and currently deployed to more than 20
        hospitals.
 
    
    Underpinning research
    Outline of research
    The impact arises from the health informatics research carried out in
      Portsmouth by Professor
      David Prytherch and Dr Jim Briggs, supported by Bernie Higgins, Jeff Sirl
      and others. Our
      collaborators included Portsmouth Hospitals NHS Trust (PHT), Bournemouth
      University and The
      Learning Clinic. Our approach is extremely inter-disciplinary, but
      embedded in all we do are the
      fundamental principles that information must be acquired by reliable means
      and reasoned about
      rigorously; all applied in a clinical context.
    We collect and use clinical data to model adverse patient outcome. The
      models enable clinicians to
      predict which patients are at risk of deterioration, and medically
      intervene. Our research has built
      on work done in the late 1990s and up to 2003 to develop models (P-POSSUM)
      of outcomes in
      surgery (1). P-POSSUM was a success and has been widely adopted, but is
      only applicable to
      surgical cases. This led us to investigate ways to model outcomes in
      general medicine cases,
      using pathology data. We have shown that biochemistry and haematology
      outcome models
      (BHOM) can be used to identify patients at risk of mortality with very
      high discrimination (2, 3).
      Other monitoring and surveillance systems (e.g., Dr Foster,
      CHKS and HES) require coded
      administrative data only available after discharge. Our techniques add
      clinical context to these, and
      have obvious uses in clinical governance and clinical performance
      management as well as direct
      patient care. Our approach only uses data routinely collected and
      available immediately after a
      patient's admission to hospital.
    We know that serious physiological abnormalities frequently precede
      primary events (defined as in-hospital
      deaths, cardiac arrests, and unanticipated intensive care unit admissions)
      (4). The P-POSSUM / BHOM
      work led to our collaboration with The Learning Clinic Ltd (TLC). In
      return, TLC
      provided a means to collect vital signs data quickly and accurately in an
      electronic format. As a
      result we have access to probably the biggest database of vital signs data
      anywhere in the world.
      Using that data we have shown that:
    
      - innovative techniques can be used to join different databases in such
        a way that clinical
        significance is not lost or corrupted (unpublished work due to
        commercial confidentiality)
 
      - vital signs data can be used to devise an early warning score (EWS)
        system that can both
        identify patients whose condition is deteriorating and minimise
        unnecessary false alarms (5)
 
      - an EWS devised from vital signs data (ViEWS) performs better than any
        of the 33 other
        EWS systems in the literature (6)
 
      - decision tree data mining techniques can be used to develop new early
        warning score
        systems (DT-EWS) quickly (Badriyah, Briggs, Prytherch, Smith, Schmidt,
        to appear)
 
    
    Our EWS models can be applied to any patient under clinical care, but are
      increasingly used to
      allow nurses to determine which of their patients are deteriorating and
      when to summon assistance
      (e.g. a doctor), without causing too many false alarms (which would
      overburden hospital
      resources).
    BHOM and the VIEWS/DT-EWS/NEWS family of models are applicable to
      virtually all hospital in-patients.
    University of Portsmouth Researchers
    
      - Prof David Prytherch (Visiting Senior Research Fellow seconded to UoP
        2001-2011;
        Visiting Professor 2011-present).
 
      - Drs Paul Schmidt and Peter Featherstone (Honorary Medical Senior
        Lecturers, appointed
        2000)
 
      - Dr Jim Briggs (currently Principal Lecturer and Director of the Centre
        for Healthcare
        Modelling and Informatics (CHMI), appointed 1995).
 
      - Jeffrey Sirl (Research Associate 2002-2004).
 
      - Bernard Higgins (Senior Lecturer in Mathematics; submitted in the
        Allied Health
        Professions, Dentistry, Nursing and Pharmacy UOA, appointed 1979).
 
    
    References to the research
    
1. Prytherch DR, Whiteley MS, Higgins B, Weaver PC, Prout WG, Powell SJ.
      (1998).
      POSSUM and Portsmouth POSSUM for predicting mortality. Physiological and
      Operative Severity
      Score for the enUmeration of Mortality and morbidity. Br J Surg.
      85(9):1217-20.
      http://www.ncbi.nlm.nih.gov/pubmed/9752863
     
2. * Prytherch DR, Sirl JS, Schmidt P, Featherstone PI, Weaver PC, Smith
      GB. (2005). The
      use of routine laboratory data to predict in-hospital death in medical
      admissions. Resuscitation.
      66(2):203-7.
        http://www.ncbi.nlm.nih.gov/pubmed/15955609
     
3. Prytherch DR, Briggs JS, Weaver PC, Schmidt P, Smith GB. (2005).
      Measuring clinical
      performance using routinely collected clinical data. Med Inform Internet
      Med; 30(2):151-6.
      http://www.ncbi.nlm.nih.gov/pubmed/16338803
     
4. Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K, et al.
      (2004). A comparison
      of antecedents to cardiac arrests, deaths and emergency intensive care
      admissions in Australia
      and New Zealand, and the United Kingdom — the ACADEMIA study.
      Resuscitation;62(3):275-82.
      http://www.ncbi.nlm.nih.gov/pubmed/15325446
     
6. * Prytherch DR, Smith GB, Schmidt PE, Featherstone PI. (2010).
      ViEWS--Towards a
      national early warning score for detecting adult inpatient deterioration.
      Resuscitation;81(8):932-7.
      DOI: 10.1016/j.resuscitation.2010.04.014
     
* Papers that best indicate quality of underpinning research
    Funding
    Briggs, Knowledge Transfer Partnership with TigerTeam
      Software Ltd (former name of TLC),
      Technology Strategy Board, 2006-2008, £114,000.
    Briggs, The Hospital of the Future, Oxford University (Prof
      Tarassenko's group) — a sub-contract
      on their EPSRC-funded project, 2012-2013, £10,036.
    Details of the impact
    Our research has had three types of impact during the period 2008-2013:
    
      - economic impact by increasing the prosperity of TLC Ltd
 
      - practitioner/professional service impact on the RCP (and its members)
        in its development of
        the National Early Warning Score (NEWS)
 
      - health impact by the lives saved by the adoption of NEWS
 
    
    Economic impact on TLC
    TLC have incorporated our ViEWS (VitalPAC Early Warning Score) model (and
      more recently,
      NEWS, see below) into their VitalPAC family of products. This work was
      done as part of a KTP
      (April 2006 — April 2008) to give them that capability. The KTP associate
      was also involved in the
      development of the doctor interface to the system. TLC became aware of us
      because of our BHOM
      work and our links with the Vascular Society of GB & Ireland.
    VitalPAC replaces the typical paper chart at the foot of a hospital
      patient's bed by recording
      (electronically on a mobile device) the vital signs measurements,
      typically taken by a nurse every
      few hours. ViEWS/NEWS translates the vital sign measurements into a single
      number known as
      an early warning score (EWS). Depending on the value, the nurse is
      instructed to take some
      action, which (in increasing order of severity) involves taking further
      observations more frequently,
      calling a doctor to see the patient, or calling a doctor urgently. Our
      research identified
      recommended thresholds for these actions.
    The economic benefits to TLC included increased turnover (13-fold over 3
      years), created 15 new
      jobs, and allowed them to attract over £1m from private investors (source
      1). The VitalPAC product
      generates 80% of their revenue.
    Policy impact on RCP work
    In 2012, the Royal College of Physicians (RCP) published a report
      recommending adoption across
      the NHS of a new National Early Warning Score (NEWS) for monitoring
      patients in hospital (source
      0, source 3). NEWS is (with only a couple of small changes) based on ViEWS
      as published in our
      2010 paper (research reference 6).
    The background to this was that the RCP had set up a NEWS Development and
      Implementation
      Group (NEWSDIG). One of the members of the group was Professor Gary Smith,
      our long-time
      collaborator and a former Consultant Physician at PHT, now affiliated to
      Bournemouth University.
      David Prytherch and Gary Smith undertook (on behalf of NEWSDIG) the
      performance analysis that
      confirmed the weightings, triggers and escalation criteria.
    Health impact and the ultimate beneficiaries
    Ultimately the research impacts everyone who is admitted to a hospital
      that uses the system.
      Portsmouth Hospitals Trust led the way — it served as the development site
      for the VitalPAC
      software. PHT began piloting the software in 2006 and by 2010 its use had
      spread to the whole
      hospital. Currently, ViEWS/NEWS is used in 20 hospitals via the VitalPAC
      system, but it has also
      been carefully designed to be used in hospitals still using paper records.
      An ongoing survey of 116
      UK hospitals by the National Outreach Forum (source 4) revealed that (as
      of September 2013)
      28% had already implemented NEWS, a further 31% planned to introduce it
      within a year and a
      further 9% had longer-term plans. Only 8% were not considering it. NEWS
      has 100% adoption by
      NHS Wales (source 5) and it has been adopted by the Health Service
      Executive in the Republic of
      Ireland (source 6).
    Since introducing VitalPAC, initial findings are that hospitals have seen
      fewer unanticipated
      intensive care unit admissions, shorter lengths of stay (source 7) and (in
      one hospital) a 22%
      decrease in seasonally-adjusted mortality (source 8). A paper evidencing
      this is in preparation.
      A 2012 study published in the journal BMJ Quality and Safety found there
      were nearly 12,000
      avoidable deaths of adults in English acute hospitals annually. In the
      publicity surrounding the
      RCP's publication of NEWS, the chairman of the Working Party (Professor
      Bryan Williams from
      UCL) estimated that up to half of those lives might be saved. Not only
      does NEWS aid in
      identifying deteriorating patients in need of additional clinical
      intervention, but its adoption
      nationally results in savings in the training of nurses. This attracted
      much press attention, for
      example by the BBC (source 9) and the Independent (source 10).
    Finally, the collaboration between PHT and TLC for the development of the
      VitalPAC system has
      won three national awards (the NHS Connecting for Health Leadership in
      Health Information
      Accolades Scheme 2006, the "Technology and IT to improve Patient Safety"
      category in the 2010
      Health Service Journal/Nursing Times Patient Safety Awards, and the Bupa
      Foundation Patient
      Safety Award 2010).
    Sources to corroborate the impact 
    
      - Letter of support from the Chief Executive of TLC, on the economic
        benefits to TLC, 16th
        September 2013
 
      - Royal College of Physicians. National Early Warning Score (NEWS):
        Standardising the
        assessment of acute-illness severity in the NHS. Report of a working
        party. London: RCP,
        2012. http://www.rcplondon.ac.uk/resources/national-early-warning-score-news.
        Report by the RCP recommending the adoption of NEWS in all NHS hospitals.
 
      - New National Early Warning Score could save 6,000 lives, http://www.rcplondon.ac.uk/press-releases/new-national-early-warning-score-could-save-6000-lives.
        RCP press release relating
        to the publication of the report above.
 
      - 
http://www.norf.org.uk/news_implementation_forum.
        Evidence from the National Outreach
        Forum that NEWS is being adopted by 68% of NHS hospitals.
 
      - 
http://www.1000livesplus.wales.nhs.uk/sitesplus/documents/1011/Rapid%20response%202%2
          0page%20leaflet.pdf. Leaflet describing Wales as the first country
        to adopt NEWS nationally.
 
      - 
http://www.hse.ie/eng/about/Who/clinical/natclinprog/acutemedicineprogramme/earlywarningsc
          ore/. Evidence of the adoption of NEWS in Ireland (as National
        Clinical Guideline No. 1, and as
        part of the national COMPASS education programme).
 
      - 
http://www.thelearningclinic.co.uk/documents/response_to_RCP.pdf.
        Open letter from the Medical Director of TLC relating to the RCP's report.
 
      - 
http://www.rcplondon.ac.uk/sites/default/files/6.1.5_-_lunchtime_tue_schmidt_greengross_tues_12.55_wolfson.pd.
        Preliminary results of a study showing reduced mortality from the introduction of VitalPAC, presented
        at RCP.
 
      - 
http://www.bbc.co.uk/news/health-19001271.
        BBC coverage of the RCP report.
 
      - 
http://www.independent.co.uk/life-style/health-and-families/health-news/new-patient-chart-to-save-6000-lives-a-year-in-the-uk-7979658.html.
        An example of the extensive newspaper
        coverage of the RCP report.