Evaluating Community-Based Parenting Programmes: TOPSE
Submitting Institution
University of HertfordshireUnit of Assessment
Allied Health Professions, Dentistry, Nursing and PharmacySummary Impact Type
SocietalResearch Subject Area(s)
Medical and Health Sciences: Public Health and Health Services
Psychology and Cognitive Sciences: Psychology
Summary of the impact
From 2004, researchers at the university's Centre for Research in Primary
and Community Care developed the `Tool to Measure Parenting Self-Efficacy'
(TOPSE). This allowed community-based parenting support practitioners to
evaluate and demonstrate, for the first time, the effectiveness of their
services and providing, for example, quantifiable data to their funders.
Parents too could rate the help they received, as well as their own
efficacy as parents, and they subsequently reported increased confidence
in their parenting ability and improved parent-child relationships. By
2008 the tool had spread nationally and internationally, and has since
been used by more than 300 practitioners and researchers worldwide.
Underpinning research
The UK's Department of Health regards early intervention in parenting as
a high-priority strategy: it views such intervention as the key approach
to ensuring that parents are supported, and children provided with
positive parenting that will improve their life chances.
Our research in this field originated in 2004 when health visitors in
Hertfordshire approached the university's Centre for Research in Primary
and Community Care (CRIPACC) to request help in developing a method of
measuring the effect of the support they were offering to parents in their
area. Until that point there was a lack of UK-based effectiveness
evaluations covering the range of parenting programmes that were developed
and delivered by various organisations. The result of our research was the
`Tool to Measure Parenting Self-Efficacy' (TOPSE) (see section 3, Ref. 6).
The key investigators associated with this research project were Sally
Kendall, Professor of Nursing, Director of CRIPACC and lead investigator
(in post since 2001, 1fte) and Linda Bloomfield, research fellow, CRIPACC
(in post since 2001 0.8fte, currently 0.4fte). The Hertfordshire health
visiting practitioners were active participants in the research and
co-authors of the first publication.
TOPSE consists of forty-eight self-efficacy statements that address six
domains of parenting. Parents indicate how much they agree with each
statement by responding to a Likert scale. The TOPSE booklet is completed
by parents on the first session of a parenting programme, and again on the
final session to determine any change in self-efficacy scores. Scores are
collected and tabulated by programme facilitators. We found that
self-efficacy is of particular relevance to group-based parenting
programmes. Parenting self-efficacy — a person's perception of their
competency in the parenting role — is encouraged by providing
opportunities for parents to develop their skills through learning and
achieving positive behaviours, experiencing other parents' successes, and
receiving encouragement from programme facilitators and other parents.
Evaluations using TOPSE demonstrated an increase in parenting
self-efficacy after attending a parenting programme. Parents felt more
confident with all aspects of their role, and their positive expectations
and sense of the effect this would have on their children lasted four
months after the programme came to an end (section 3, Refs 2 and 4). A
2012 study (section 3, Ref. 1) demonstrated a correlation between
parenting self-efficacy and parenting stress. Higher parenting stress was
related to lower TOPSE scores, while increased TOPSE scores correlated
with lower parenting stress.
Further research included an adaptation of TOPSE for parents with
learning disabilities (section 3, Ref. 3). This simplified tool has been
used by practitioners working with parents who have learning disabilities,
and those with low literacy skills, and is an effective evaluation tool in
this context.
As a direct result of our work, the British Council's PM12 programme, a
five-year strategy to strengthen the UK's position in international
education, awarded us funding in 2008 to collaborate with academics and
public health nurses in Japan, both to compare the effects of parenting
support and to explore cultural difference in relation to parenting, using
the TOPSE tool as an evaluation measure. Jane Appleton (Reader at Oxford
Brookes University) and Jane Petrie (Health Visitor and Parenting
Co-ordinator, currently Child Protection Awareness and Promotion Officer
for Parenting at NSPCC) were also on the research team.
References to the research
Peer-reviewed Papers
- REF2 Output
2. Bloomfield L and Kendall S (2012). `Parenting
self-efficacy, parenting stress and child behaviour before and after a
parenting programme', Primary Health Care Research and Development
13(4): 364-72. doi: 10.1017/S1463423612000060
- REF2 Output
3. Bloomfield L and Kendall S (2010). `Audit as evidence:
The effectiveness of "123 Magic" programmes', Community Practitioner
83(1): 26-9.
4. Bloomfield L, Kendall S, and Fortuna S (2010). `Supporting
parents: development of a tool to measure self-efficacy of parents with
learning disabilities', British Journal of Learning Disabilities
38(4): 303-309. doi: 10.1111/j.1468-3156.2009.00607.x
- REF2 Output
5. Bloomfield L and Kendall S (2007). `Testing a
parenting programme evaluation tool as a pre-and post-course measure of
parenting self-efficacy', Journal of Advanced Nursing 60(5):
487-93. doi: 10.1111/j.1365-2648.2007.04420.x
6. Kendall S and Bloomfield L (2005). `TOPSE: Developing
and validating A Tool to Measure Parenting Self-Efficacy', Journal of
Advanced Nursing 51(2): 174-81. doi:
10.1111/j.1365-2648.2005.03479.x
Selected Research Awards
2004-2006. Funder: HertNet (Hertfordshire Primary Care Research
Network Consortium). Amount: £20,000. Small award to S Kendall and
L Bloomfield, which supported the development of the TOPSE tool in
Hertfordshire.
2008-2010. Funder: British Council PMI2 award. Amount:
£34,000. For S Kendall, L Bloomfield, J Appleton and K Kitaoka to
undertake a comparative study of parenting evaluation in England and
Japan.
Details of the impact
The Tool to Measure Parenting Self-Efficacy has been used by local
government, health care and voluntary organisations to inform strategy and
parenting practice. TOPSE filled a gap, initially locally, then nationally
and internationally, by providing evidence that parenting support could
make a difference. Practitioners inform us that parents report
improvements in their confidence and parenting abilities.
TOPSE can be downloaded from a website (www.topse.org.uk).
Between its launch in October 2010 and June 2013, we received 545 website
enquiries: fifty percent were from parenting programme leads,
co-ordinators and practitioners at UK-based organisations, including
county councils, schools, children's centres and voluntary organisations;
the remainder include researchers and overseas practitioners.
International enquiries have led to the tool's translation into eight
languages (Welsh, Japanese, Hebrew, Greek, Rumanian, Danish, Swedish and
Dutch) for use abroad.
National
TOPSE is used across Wales, in four English county councils (Durham,
Buckingham, Newport, Hertfordshire) and by four voluntary organisations,
including Barnardo's. Hertfordshire's parenting programme providers
(including Families in Focus, running sessions for 500 parents annually,
and Supporting Links) use it to evaluate all county-wide programmes. In
Hertsmere, TOPSE is used in ten children's centres to evaluate six
programmes each term, amounting to 180 parents annually, and Children's
Centres use TOPSE to demonstrate to their funders the value of parenting
support.
As awareness of our research spreads, we have received numerous requests
to use TOPSE as part of national programme evaluations. Evidence suggests
that a substantial number of organisations have translated this into their
evaluation policies.
For example, IPSOS MORI conducted a longitudinal evaluation of Flying
Start for the Welsh government (2011), using TOPSE as an outcome measure.
As part of a baseline survey, TOPSE was completed by 1,694 parents of
children aged 0-2 years. TOPSE and TOPSE for parents with learning
disabilities are also used by Welsh co-ordinators to evaluate Incredible
Years and Family Links Nurturing programmes. The number of programmes in
Wales using TOPSE is growing: in Pontypool, ten groups of six to twelve
parents each term, and in Newport twenty-three groups of ten parents each,
have used TOPSE to evaluate programme outcomes.
In Leeds the tool has previously been used to evaluate twenty-five
programmes (250 parents); and in Buckinghamshire 63 parenting groups (512
parents) have completed TOPSE evaluations, providing evidence that
Incredible Years had a greater impact on parent-child relationships than
other programmes. County Durham, which has used TOPSE since 2009, found in
2012 that 95% of parents reported an improvement in self-efficacy. The
county wrote the tool into its Quality Standards and Good Practice
Guidance, and uses it to identify which aspects of child and family
support to address.
Practitioner feedback consistently reports increased self-efficacy scores
after parenting programmes, in turn providing evidence that parents
benefit from the programmes, and assisting funding decisions. The
following selected comments indicate how TOPSE allows facilitators to
determine whether their programmes benefit parents:
`TOPSE shows how parents have changed during the time of the programme,
we have found the largest shift to a higher score is play and enjoyment,
discipline and boundaries and learning and knowledge.' (Newport City
Council)
`95% of parents who completed TOPSE at evidence based Parenting
Programmes . . . felt more confident to address and deal with the issues
they face as parents.' (County Durham)
`Unlike many other evaluation tools, it has been found that the results
from TOPSE's self-reporting measures are good indicators of actual
parental behaviour.' (`Evaluation of Flying Start', report commissioned by
the Welsh government).
International
Organisations, practitioners and researchers in Australia, Canada, USA,
Denmark, Sweden, Israel, Japan, Greece, the Netherlands, Romania, Hungary
and Germany have implemented TOPSE as part of their strategies to
demonstrate improvements in parenting. In Stockholm, the tool was used to
evaluate a universal parenting programme involving 1,000 parents of
children aged 3-13, with plans for further evaluation in a deprived area.
In Israel TOPSE was adapted for use with parents of children with ADHD,
and in the Netherlands the Department of Rehabilitation used TOPSE in a
264-parent study.
Our collaborative study with Kanazawa Medical University, Japan led the
mayor of Uchinada to fund his region's parenting programmes for a further
year, allowing local families to benefit beyond our research period. Japan
is concerned about child abuse in the context of parenting stress and
isolation, and the Sasakawa Foundation viewed the project as being of
civic and public health value; accordingly, it provided funding to
Professor Kendall for dissemination into policy and practice in Tokyo. The
Foundation's support for this phase, completed in February 2012,
facilitated discussions with public health nurses in Tokyo and Uchinada
that confirmed our qualitative research: Japanese parents were less likely
to openly discuss parenting stress than English parents, but support
lowered their parenting stress scores and increased their confidence.
Sources to corroborate the impact
Reports
The following selected reports describe disparate parenting programmes
that used TOPSE as the sole or an integral evaluation tool.
[text removed for publication]
Welsh Government Social Research (2011). `Evaluation of Flying Start:
Findings from the Baseline Survey of Families — Mapping Needs and
Measuring Early Influence among Families with Babies aged 7 to 20 Months.
Main Report.' Social research number 28/2011. (The third quote in section
4 above is on p.141.) Report available online:
<http://wales.gov.uk/docs/caecd/research/111214EvalFlyStart-7-20monthsmainen.pdf>
Institutional Corroboration
Contact details are provided separately for individuals based at the
following organisations who are able to corroborate aspects of the impact
detailed in this case study:
- Childhood Support Services, Hertfordshire County Council
- Children and Adult Services, Durham County Council
- Kanazawa Medical University, Japan
- Family Resilience Team, Buckinghamshire County Council
- Family Links (UK national charity)
Other
The confidential database containing details of TOPSE
website registrants and their enquiries can be made available if required.