Rapid response reports: a quick but rigorous service for policy-makers

Submitting Institution

University College London

Unit of Assessment

Education

Summary Impact Type

Political

Research Subject Area(s)

Medical and Health Sciences: Public Health and Health Services
Studies In Human Society: Policy and Administration, Social Work


Download original

PDF

Summary of the impact

Rapid response reports, commissioned from the IOE's Thomas Coram Research Unit (TCRU) by the Departments for Education and Health specifically to inform policy-making, have helped to determine the financial and practical support for disadvantaged families and children in England for more than a decade. This important series of reports has achieved impact not only by producing robust findings that government departments can rely on but by building relationships of trust and mutual understanding between national policy-makers and researchers.

Underpinning research

The approach: In 2000, TCRU began pioneering a new way for academic research groups to work with government, led by Professor June Statham. The approach allowed politicians and civil servants to have quick access to evidence that could inform decision-making, and to scientifically rigorous scoping work to inform new policy directions. It also provided a single point of contact giving government access to a wide pool of relevant research knowledge. The rapid response reports have drawn on TCRU's wealth of research into support for children and families (e.g. research references R1 & R2), but have also benefited from researchers' individual expertise. Working closely with policy-makers has made it possible to negotiate the best way of addressing their immediate needs for evidence, and to agree what would be feasible within often tight time frames. Other factors supporting this way of working were:

  • Sensitivity to constraints facing policy-makers, including short timescales to respond to ministerial requests;
  • Flexibility in response to unexpected policy developments.

Breadth of work: TCRU has completed nearly 50 rapid response projects since 2003. Their themes overwhelmingly relate to child and family welfare, and encompass issues such as adoption, foster care, family justice, child protection, childcare, children's rights, children with disabilities, mental health and Black and ethnic minority children. The work typically comprises small-scale studies (including, for example, literature reviews, secondary data analysis or costing exercises), as well as scoping exercises, that bring together evidence in a new field, and feasibility studies to test the ground before the roll-out of large-scale research or development work. It also encompasses more direct input to policy debate and development — including, for example, analysis to inform ministerial briefings and the development of national guidance and guidelines. This case study focuses on the underpinning concept and methodology of these reports as well as a small selection of high impact rapid response studies published since 2008.

Illustrative rapid response reports:
Family breakdown: The high quality evidence analysed for this 2009 Department for Children, Schools and Families (DCSF) review (R3) helped to dispel some myths about single-parent families and challenged the assumption that family breakdown is always harmful for children. The evidence showed that family functioning, rather than family type, made a difference and that family breakdown is a process, not a one-off event. The review built its authority on a large body of work by Professor Marjorie Smith.

Methods: This report drew primarily on review-level evidence; key texts were supplemented by others identified through targeted searches of bibliographic databases and the Internet.

National Child Measurement Programme (NCMP): This 2011 evaluation of the delivery of the NCMP (R4) showed that the programme had provided much-needed evidence on the scale of the childhood obesity problem and had allowed targets to be set to address it. The report pointed to areas for improvement and suggested how the NCMP could be adapted in response to new structures proposed for public health services.

Methods: This report was based on document analysis, interviews with key stakeholders and an online survey of professionals across England.

Health of looked-after children: This study (R5) provided an evidence base to help DCSF and the Department of Health (DH) revise national health guidance on looked-after children. It investigated the gap between guideline requirements and existing practice, and identified good practice.

Methods: This report included interviews with key stakeholders and an overview of research and statistics.

References to the research

R1: Smith, M. (2004) Parental mental health: disruptions to parenting and outcomes for children, Child and Family Social Work, 9(3) 3-11.

 
 
 

R2: Statham, J. (2004) Effective services to support children in special circumstances, Child Care, Health and Development, 30(6) 589-598.

 
 
 
 

R3: Mooney, A., Oliver, C. & Smith, M. (2009) Impact of family breakdown on children's well-being: evidence review, DCSF-RR113.

R4: Statham, J., Mooney, A., Boddy, J. & Cage, M. (2011) Taking stock: a rapid review of the National Child Measurement Programme, Report to the DH, London: TCRU.

 
 
 

R5: Mooney A., Statham J., Monck, E. & Chambers, H. (2009) Promoting the health of looked after children — A study to inform revision of the 2002 guidance, DCSF-RR125.

Funding: TCRU received funding from DCSF and DH to carry out programmes of policy-relevant research. Between 2006 and 2010, some 20% (nearly £300,000 a year) of the budget was allocated to rapid response work. Since 2010, TCRU has continued rapid response work through the DfE-funded Childhood Wellbeing Research Centre (see section 4). Grant holder: Ann Phoenix.

Indicators of Quality:

IQ1: As part of a scientific review of TCRU's work in 2004, an independent peer reviewer said the responsive studies "display a rigour in the methodology and clarity in the presentation. The work needed to complete these short pieces of work should not be underestimated. This makes the achievements in the responsive mode in terms of quality and quantity outstanding". (S1)

IQ2: The great majority of rapid response reports, including the three examples cited (R3, R4 and R5) were independently assessed by at least one academic reviewer in addition to policy reviewers.

Details of the impact

Principal beneficiaries and dates of impact: Politicians and civil servants and, by corollary, children in England, especially those with health, social and/or economic disadvantages. Impact occurred throughout the REF period, but 2011-12 was a high point, as the influential `family breakdown' research fed into a string of policies.

Reach and significance: TCRU's rapid response reports have informed government policy on health, families and children for more than a decade. The range of areas covered is extensive. Examples include a scoping study on FE students' mental health and wellbeing; a literature review on improving access to psychological therapies for children and young people, and a briefing paper on international perspectives on social work. As the evidence below shows, the reports have had considerable `instrumental' impact1 (influencing the development of policy or practice) and `conceptual' impact (enhancing understanding or informing debates).

The rapid response programme as a whole:
What distinguishes rapid response work from other policy-relevant research is the ability to provide high quality information at relative speed (from two weeks to several months) and the relationships of collaboration and trust built up with government officials — an important impact in itself. The rapid response programme has helped to change attitudes among policy-makers, raising expectations about the value of research in policy-making and encouraging `joined-up' education and health research agendas (many studies have brought together policy-makers in joint advisory groups). Richard Bartholomew, chief research officer at the DfE (see impact source S2), said the responsive mode's speed and quality enabled his Department to commission "very urgent pieces of original research to inform live policy debates", overcoming the major problem of the "very different speeds of the policy and the research cycles". Statham's intellectual leadership and understanding of how to relate research to policy questions underpinned the mode's success, he said, adding that it was so popular with policy colleagues that "we have often had to turn down some requests because of overload". The relationship between the reports' authors and government makes the process of conveying findings to the policy-makers who most need to hear them much less haphazard. For example, in 2008 Professor Smith was asked to speak about the findings on family breakdown to a policy seminar attended by 60 representatives of the DCSF, Home Office, Treasury, Ministry of Justice, DH and Department for Work and Pensions.

Childhood Wellbeing Research Centre: By 2009, when the IOE won a £2m DfE contract to establish the Childhood Wellbeing Research Centre (CWRC) in collaboration with the Universities of Loughborough and Kent (January 2010-March 2014), the value to government of rapid response reports was firmly established. The specification of all the new Policy Research Programme centres commissioned by the Departments for Education and Health required that a substantial proportion of the budget be allocated to providing this facility. The CWRC itself can be seen as an `impact' of the earlier work. It carries out rapid response studies, and its expertise in methodology as well as subject matter enables it to provide evidence to underpin government-commissioned reviews and to do joint work with DfE analysts. The CWRC provided evidence for the Bailey Review on commercialisation and sexualisation of childhood, which (as Richard Bartholomew confirms) formed the basis for recommendations on how the retailing and entertainment sectors could work with government and parents to reduce the risks to children (S2). It also conducted an international evidence review that helped policy-makers develop the role of the Children's Commissioner for England by providing clear examples of models used in other countries which could be adapted (S2).

Illustrative study: Family breakdown and children's wellbeing:
This TCRU report has helped support arguments for fairer taxation of single-parent families and policies aimed at promoting better relationships within families before and after breakdowns occur. It concluded that policies which focus on supporting mothers' mental health, facilitating cooperative parenting and communication, encouraging good parent-child relationships, and reducing financial hardship can help to maximise positive child outcomes following parental separation. These findings have proved very influential. Even before publication, the report heavily informed a 2008 Cabinet Office Strategy Unit/DCSF paper, Families in Britain: an evidence paper. It was subsequently cited in a number of government publications and had a direct impact on several important policy decisions. For example, the government — using TCRU's evidence about the importance of relationship quality and stability — committed £30m over four years to provide relationship support for couples, £20m over three years to help separated and separating parents to work together in the best interests of their child and £10m on legal aid for family mediation (S3, pp15-18). The TCRU study is also cited in the:

  • Equality and Human Rights Commission's Parliamentary briefing on the Equality Bill, 2010 (supporting non-discriminatory taxation of single-parent families) (S4).
  • DWP's 2011 impact assessment of proposals on child maintenance.
  • Child Maintenance and Enforcement Commission's Delivery Plan 2011/12 (the findings are used to argue that parents should be encouraged to make family-based arrangements for children before resorting to the courts).
  • Social Security Advisory Committee's response to the coalition Government's 2010 consultation paper, Tackling Child Poverty and Improving Life Chances. (The Committee pointed to the finding that children thrive in families characterised by consistent care.)
  • DfE's Families in the Foundation Years (2012), which set out the government's vision for early healthcare and education (S5, section on Encouraging Independence).

The study attracted extensive press coverage and links to the report can now be found on the websites of organisations such as Gingerbread, One Plus One (S10), Against Violence and Abuse, and the Centre for Social Justice. Through its impact on policy-making, this research brought potential benefit for all children and families experiencing relationship breakdown.

Illustrative study: Review of the Delivery of the National Child Measurement Programme (NCMP): TCRU conducted two studies on the NCMP. The first, a 2009 rapid response study of how height and weight measurements were being fed back to parents, identified concerns about the potential to stigmatise overweight children. It led to changes being made to the DH templates for feedback letters. These changes have improved the information received by all parents. The 2011 review of the national delivery of the programme was built on the earlier study. It took stock of progress and challenges since the NCMP's launch in 2005, and reflected on how it could be improved. DH officials later praised the report's "quality and timeliness" and confirmed that the DH was already taking action to address some of the delivery issues highlighted (S6). Key recommendations that influenced the 2012-13 national guidance for local providers of the programme (S7) included those on the need for further explanation and debate about NCMP's purpose. This reflected concerns that professionals had raised with the researchers that the NCMP was changing from a monitoring to a screening programme. The guidance also echoed the TCRU report's conclusion that local authorities and the general public needed to be made more aware of the programme. Through its impact on the feedback letters and guidelines, this study brought potential benefit to all families with primary children in Reception and Year 6.

Illustrative study: Promoting the Health of Looked-after Children: Commissioned by the DH to inform statutory guidance in 2009, this IOE report was published alongside that guidance on the DCSF's Healthy Care Programme website (it is now on the National Children's Bureau website, along with an NCB briefing on corporate parenting citing the study [S8], and in the national archives [S9]). Recommendations arising from the study's fieldwork were incorporated into the statutory guidance. An example at a strategic level was the importance of Joint Strategic Needs Assessments taking into account the health requirements of looked-after children, and at an operational level the need for better communication when a child is placed with carers outside their local authority. Through its impact on the government guidance this research brought potential benefit to all looked-after children.

Sources to corroborate the impact

S1: Comments from TCRU Scientific Report peer reviewer (2004) (hard copy available)

S2: Testimonial from Richard Bartholomew, Chief Research Officer, DfE (available).

S3: DWP (2012), Social Justice: Transforming Lives http://www.dwp.gov.uk/docs/social-justice-transforming-lives.pdf

S4: Equality and Human Rights Commission Parliamentary briefing on Equality Bill (Lords committee stage) January 11, 2010. http://www.equalityhumanrights.com/legal-and-policy/equality-act/equality-bill-parliamentary-briefings/

S5: DH and DfE (2011) Families in the Foundation Years Evidence Pack
https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/177034/DFE-00214-2011.pdf

S6: Letter and email from DH welcoming child measurement review (2011, on request).

S7: NCMP: Operational guidance for the 2012/13 school year
https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/146720/dh_133677.pdf.pdf

S8: National Children's Bureau briefing on corporate parenting
http://www.ncb.org.uk/media/967560/corp_parenting2_health_of_looked_after_children_topic_briefing.pdf

S9: Statutory guidance on promoting the health and well-being of looked-after children:
http://webarchive.nationalarchives.gov.uk/20130401151715/https://www.education.gov.uk/publications/standard/Healthanddisabilities/Page1/DCSF-01071-2009

S10: Coleman, L. and Glenn, F. (2012, One Plus One), When Couples Part
http://www.oneplusone.org.uk/wp-content/uploads/2012/03/WHEN-COUPLES-PART-FINAL-VERSION.pdf


1 Using Evidence: How Research can Inform Public Services (Nutley, S., Walter, I., Davis, H. 2007)
2 All web links accessed 11/11/13