Development of novel adaptive designs to improve efficiency in clinical trials
Submitting Institution
University of ReadingUnit of Assessment
Mathematical SciencesSummary Impact Type
PoliticalResearch Subject Area(s)
Medical and Health Sciences: Clinical Sciences, Oncology and Carcinogenesis, Pharmacology and Pharmaceutical Sciences
Summary of the impact
Clinical trials are costly to the pharmaceutical industry and public
funding bodies, require major commitment from volunteer patients and take
significant time to lead to patient benefit. Adaptive designs are one
approach which seeks to improve the efficiency of such studies.
Statistical research at Reading has led to novel methodology for the
design and analysis of clinical drug trials within the framework of
adaptive designs which has the potential to reduce the time taken for
effective drugs to reach the market and thus benefit specific patient
groups. To date the research has had impact in three major ways: i) it has
been adopted by pharmaceutical companies as a means of improving the
efficiency of their clinical trials, ii) the research has been cited in
the regulatory guidance on adaptive clinical trial design, and iii) it has
increased awareness by clinicians and other medical professionals of the
potential benefit of the adaptive design methodology to their patient
groups. Hence, the research has influenced industry, regulatory and health
professionals with potential significant economic benefit and improved
outcome for patients.
Underpinning research
Traditionally the introduction of a new drug onto the market involves the
implementation of a series of clinical trials, progressing through Phases
I, II (sometimes split into IIa and IIb), III trials, with the studies
increasing in size, duration, and thereby costs and complexity, in order
to unequivocally demonstrate the efficacy and safety of a drug or drug
combinations, in defined patient groups. Phase I trials are often
first-in-man studies to consider safety, phase II trials are looking for
evidence of efficacy (IIa trials sometimes called proof-of-concept
studies, with IIb trials considering the question of finding an
appropriate dose or treatment format) and phase III trials are the
definitive comparison of, usually, a single experimental treatment with a
control, either the current standard or placebo. These trials take many
years to complete with most phase III trials for cancer treatment, for
example, taking up to 8-10 years to reach conclusion.
Conventionally the later phases of the drug development process (IIb and
III) are designed as what are known as `fixed sample size trials'. In such
designs the number of patients to be recruited to the particular trial is
calculated in advance of the study and data are collected on all of the
patients before any analyses are carried out. This statistical approach
was originally developed in the context of agricultural trials where all
measurements naturally occur simultaneously at harvest. In the medical
context, all observations are not available simultaneously as patients are
recruited to trials sequentially over a period of months, if not years.
This difference in the method of data accrual led to a different approach
being proposed for use in some clinical settings — for example where
patient recruitment is slow and over a long duration, combined with
rapidly observable measurements — that of `sequential trials' / `group
sequential trials'. In such a trial, data from patients are analysed at
one or more interim points in the trial as they accumulate, in order to
determine whether there is already sufficient evidence to draw valid
conclusions about the efficacy and safety of the treatment under study.
Research into this methodology peaked around the mid-to late-1990's.
Meanwhile, interest was growing in the possibility that clinical trials
could be designed with other adaptive features (not just stopping
for efficacy / futility), such as changing the patient population under
study, changing the primary endpoint, changing the treatment regimens
being tested. Such adaptations have significant potential to reduce the
time taken for definitive results to be obtained from clinical trials and
are therefore of great interest to the pharmaceutical industry in reducing
the cost of drug development and to medical professionals in accelerating
the availability of new treatment regimens for their patients. The
over-arching term now commonly used for trials where adaptations are
planned as part of their conduct is `adaptive designs'.
Partially funded by grants for methodological research from the
pharmaceutical company, Novartis, researchers at the University of Reading
were one of the first groups to begin work on developing methodology in
this field. The setting envisaged was where it is desirable to take more
than one experimental treatment into phase III, along with the control
treatment and then to make a selection, at a first interim analysis, of
the most promising of these treatments to continue in the trial along with
the comparator (treatment selection). This approach might be appropriate
when a stand alone phase IIb trial has not been conducted perhaps because
there are only a small number of candidate doses or treatments of
interest, or where the phase IIb study has been conducted but a single
experimental treatment was not identified. Taking the existing `group
sequential framework', we introduced a treatment selection element into
the design ([1] in Section 3). The methodological development was further
progressed: i) to allow the treatment selection to be made using a
different, (usually available earlier), endpoint to that which is the
primary interest ([3] in Section 3), ii) with associated consideration of
correlation ([2] in Section 3) and then, iii) to a consideration of how
further flexibility could be introduced by allowing the treatment
selection to happen over a number of successive stages, not just at the
first interim stage ([4] in Section 3). Once such designs had been
developed it was necessary to determine a new analysis framework since
traditional methods of statistical analysis are no longer appropriate.
Methodology for analysis was also developed ([5] in Section 3). Because
these new designs combine the dose-finding / treatment selection element
of the traditional phase II (in particular IIb) trial, along with the
definitive confirmatory analysis of phase III, they have become known by
several terms including seamless phase II/III (or sometimes IIb/III)
clinical trials, adaptive seamless designs, adaptive group sequential
designs.
The research was conducted by Dr Nigel Stallard and Dr Susan Todd (both
Senior Research Fellows in the Medical and Pharmaceutical Statistics
Research Unit at that time). Dr Todd (now Professor Todd) is still at the
University of Reading, whereas Dr Stallard (now Professor Stallard) moved
to the University of Warwick in 2005. The work described in [4] in Section
3 included a contribution by Dr Patrick Kelly who was also employed at the
University of Reading as a Research Fellow at that time.
References to the research
1. Stallard N, Todd S (2003) Sequential designs for phase III clinical
trials incorporating treatment selection. Stat Med 22,
689-703. DOI:10.1002/sim.1362
2. Todd S (2003) An adaptive approach to implementing bivariate group
sequential clinical trial designs. J Biopharm Stat 13, 605-619.
DOI:10.1081/BIP-120024197
3. Todd S, Stallard N (2005) A new clinical trial design combining phases
2 and 3: Sequential designs with treatment selection and a change of
endpoint. Drug Inf J 39, 109-118. ISSN 0092-8615/2005
4. Kelly, P.J., Stallard, N. and Todd, S. (2005). An adaptive
group-sequential design for phase II/III clinical trials that select a
single treatment from several. J. Biopharmaceutical Stat 15,
641-658. DOI: 10.1081/BIP-200062857
5. Stallard N, Todd S (2005) Point estimates and confidence regions for
sequential trials involving selection. J Stat Plan Inference 135,
402-419. DOI: 10.1016/j.jspi.2004.05.006
These five publications have received a total of 138 citations, including
68 for [1] and 26 for [3].
Grants
"Combined phase II/III clinical trial designs". Four grants totalling £104,400
from Novartis Pharma (with Dr N. Stallard and Professor J. Whitehead, then
MPS Research Unit). January 2000 — December 2004.
"Comparison of adaptive designs with group sequential designs when
treatment selection and evaluation are required". £20,000 from
Novartis Pharma (with Dr N. Stallard, then MPS Research Unit). September
2002 — February 2003.
Details of the impact
The impact of the research has taken place through three routes: i) the
uptake of the methodology in the implementation of clinical trials by two
pharmaceutical companies, ii) citation of the research in the regulatory
guidance on adaptive clinical trial design, and iii) increased awareness
by clinicians and other medical professionals of the benefit of the
adaptive design methodology in their patient groups.
i) Uptake of the research by pharmaceutical companies
The underpinning research was initially disseminated through conference
presentations attended by industry professionals. The full publication of
the research in the statistical literature in 2003 and 2005, led to two
companies independently approaching Drs Stallard and Todd to discuss the
research who each subsequently adopted the phase II/III adaptive design
approach proposed by the Reading team in their drug development
programmes, as outlined below.
AstraZeneca:
Based on the Reading team's approach, AstraZeneca designed a phase II/III
multi-national pivotal trial ([1,2] in Section 5), HORIZON III, for
cediranib (Recentin). The impact of the team's work in this setting was
illustrated in a press release ([3] in Section 5) to the investment
community in February 2008, which contained a quote by John Patterson,
AstraZeneca's Executive Director for Development, who said: "Due to the
Phase II/III trial design, HORIZON III is able to move directly into
Phase III utilizing all the Phase II data and this saves valuable time
in assessing the potential benefit of RECENTIN in the first line
metastatic colorectal cancer setting". By adopting this new
methodology there is clear utility for pharmaceutical companies in terms
of greater efficiency in clinical trials via potential for reducing the
numbers of patients entered into trials with significant ethical benefits.
The AstraZeneca development programme continues today through further
clinical trials, although cediranib is not yet available in the UK.
The study by AstraZeneca was, to our knowledge, one of the first seamless
phase II/III trials to be conducted by any pharmaceutical company. To date
the total number of seamless phase II/III studies remains small whilst
companies assess the benefits of these new approaches. The results of the
completed trial have been presented by AstraZeneca at international
medical conferences ([4] in Section 5) and in 2012, a presentation was
given at the PSI (Statisticians in the Pharmaceutical Industry) annual
conference entitled "Adaptive Trial Designs: Lessons Learned in Oncology
in AstraZeneca" ([5] in Section 5). Through this outreach the concept of
seamless adaptive designs as a plausible approach to clinical trial study
design has been highlighted to the medical community and to industry.
AstraZeneca have indicated that they would consider the adaptive design
approach in future trials and have developed their own code for
implementation, based on the methodological concepts described in
Reading's underpinning research.
Avexa:
Avexa, an Australian company, was the second pharmaceutical company to
implement a trial design based on the underpinning research in the
development of apricitabine, a treatment for drug-resistant HIV ([6] in
Section 5). The study, AVX301, began recruiting in February 2008 and
closed recruitment in January 2010. It was stopped for reasons not
associated with the trial design. Avexa press releases discuss the
progress of the study, with positive reference to the adaptive trial
approach ([7] in Section 5).
ii) Use in regulatory guidance on clinical trial design
Novel adaptive designs and the associated analytical frameworks, such as
those developed by the team at Reading, are having an increasing impact on
current thinking in clinical trial design within the pharmaceutical
industry. Indeed, two key regulatory authorities have recently produced
guidance documents on adaptive designs (US Food and Drug Administration
(FDA), 2010; European Medical Agency, 2007); both organisations anticipate
that more clinical trials will be designed using this framework and the
FDA cite the Reading work ([4, 5] in Section 3) in their guidance document
([8] in Section 5). Whilst it is incorrect to state that the research
undertaken at Reading was the sole catalyst for driving such change in
clinical trial approach, the citation of our work in global guidelines
such as these provides indication of our contribution.
iii) Increased awareness by clinicians and other medical professionals
of the benefit of adaptive design methodology in their patient groups.
The Reading team developed a Continuing Professional Development course
entitled "Phase II/III Clinical Trials". This was delivered at Reading in
November 2006 to disseminate adaptive trial methodology in general and the
research undertaken at Reading in particular. Dr Jeremy Chataway (St
Mary's Hospital), a Multiple Sclerosis (MS) specialist participated in the
course. Several years later, Dr Chataway contacted Dr Todd about the
possibility of initiating work on adaptive designs in this therapeutic
area. A colleague of Dr Chataway's, Dr Richard Nicholas was tasked with
the asking the same question of the team at Warwick University (where
Professor Stallard is now working). The joint Warwick-Reading team was
commissioned by the Multiple Sclerosis Society to conduct further work on
adaptive design methodology in the specific setting of Secondary
Progressive MS. The Society funded two projects to develop a bespoke
adaptive trial design that could be used for a study of MS. The results of
this work have been published and presented in several conferences in 2009
([9] in Section 5). Clinicians in the MS field are, therefore, being made
more aware of adaptive designs and their advantages.
Sources to corroborate the impact
Sources to corroborate the AstraZeneca implementation of the phase II/III
design:
1. The study is registered (mentioning the phase II/III design) at:
www.clinicaltrials.gov/ct2/show/NCT00384176?term=HORIZON+AstraZeneca&rank=3
2. A publication of the trial design is available at:
jco.ascopubs.org/content/early/2012/09/10/JCO.2012.42.5355/suppl/DC1
The protocol (linked at the end of the abstract) cites the research ([3]
in Section 3) on p31.
3. Press release: www.astrazeneca.com/Media/Press-releases/Article/20080227--AstraZeneca-
Provides-Update-On-RECENTIN-Clinical-Deve
4. Medical conference presentations on the HORIZON study: Oral
presentation: Schmoll H, et al. "mFOLFOX6 + cediranib vs mFOLFOX6
+ bevacizumab in previously untreated metastatic colorectal cancer (MCRC):
a randomized, double-blind, phase II/III study (HORIZON III). Annals
of Oncology 21 (Supplement 8): viii189-viii224, 2010. Abstract 580O.
bit.ly/1ae6QZA.
Poster: Wilson D, et al. Application of adaptive study designs:
Phase II and III results from the cediranib (CED) horizon (HZ) II and III
studies. 2011 ASCO Meeting. meetinglibrary.asco.org/content/83624-102
5. Statistical conference presentation on the HORIZON study: Presentation
slides available for the presentation on "Adaptive Trial Designs: Lessons
Learned in Oncology in AstraZeneca" Sources to corroborate the Avexa
implementation of the phase II/III design:
6. The study is registered (mentioning the phase 2b/3 design) at:
http://www.clinicaltrials.gov/ct2/show/NCT00612898?term=AVX301&rank=2
7. Press releases related to the study on aprictiabine are on the
company's website under the tab `News': http://www.avexa.com.au/
Releases on Mar 24 2009 and Jun 4 2009, amongst others, discuss study
AVX301
Source to corroborate the regulatory documentation:
8. FDA Guidance: http://www.fda.gov/downloads/Drugs/.../Guidances/ucm201790.pdf
Lines 1928-1930 and 1996-1997give references 4 and 5 of Section 3,
respectively. Sources to corroborate the increased awareness by clinicians
and other medical professionals
9. Conference abstracts:
"Developing a new trial design in secondary progressive multiple
sclerosis: A seamless adaptive approach." Presented at: ABN Joint Annual
Meeting/Spanish Society of Neurology, Liverpool, UK, Jun 22-26 2009.
DOI:10.1136/jnnp.2009.195214r.
"Adaptive seamless trial designs in neurology: a case study in secondary
progressive multiple sclerosis." Presented at the 19th World Congress of
Neurology, Bangkok, Thailand, Oct 24-30 2009.
DOI:10.1016/S0022-510X(09)70456-3.
"Adaptive clinical trials incorporating treatment selection and
evaluation: methodology and application in progressive multiple
sclerosis." Presented at the 25th Congress of the European Committee for
Treatment and Research in Multiple Sclerosis, Dusseldorf, Germany, Sep
09-12 2009.