How well does government show its working?

The first ever review of whether the UK government is transparent about its use of evidence when developing policies finds that the public and researchers would struggle to follow the government’s reasoning, with standards of transparency varying widely between and within departments.

Transparency of evidence: an assessment of government policy proposals May 2015 to May 2016 is published by Sense about Science, from research conducted in partnership with the Institute for Government and the Alliance for Useful Evidence, funded by the Nuffield Foundation. Using a framework the three partner organisations produced last year, it asks, ‘Can someone outside government work out what the government is proposing to do, and why?’.

The report highlights examples where the government is transparent about the use of evidence and warns against practices that obscure it. The findings include:

  • Departments often appear to have assembled an evidence base to inform policy decisions but don’t share it openly, making it hard for the public or parliament to understand or scrutinise their thinking.
  • Policies based on manifesto pledges can be transparent about their evidence base – particularly where the commitment is to an outcome rather than a means to achieve it. However our sample suggested that policies announced in the Budget and Autumn Statement were less transparent about the underlying evidence than other policies.
  • The best proposals demonstrated a clear chain of reasoning from the assessment of the problem to the choice of policy intervention and a discussion about the limitations of the evidence.

Researchers counted a total of 593 policy announcements between May 2015 and May 2016 from 13 domestic government departments. They scored a sample of the underlying policies against the evidence transparency framework, asking ‘Can we tell what evidence has been used? Can we tell how the government has assessed or used this evidence?’ under each of the following headings:

  • Diagnosis (the issue the policy is designed to address)
  • Proposal (the government’s chosen intervention)
  • Implementation (how the intervention will be introduced and run)
  • Testing and evaluation (plans to assess whether the policy has worked)

Today’s report highlights good and bad practice. Next year Sense about Science, together with the Alliance for Useful Evidence and Institute for Government, is planning to score and rank departments on their evidence transparency. Today’s report demonstrates what departments need to improve to perform well in that exercise.

Tracey Brown, director, Sense about Science and main author of the report, said: “We found cases of very good practice, such as discussion of gaps in the evidence base. But there were many areas where departments need to be more open with the public about the evidence they are using to justify and shape policies. People need to see government’s reasoning to understand what the government is trying to do and whether they think it will work. Without transparency, the public cannot understand or question proposals, and researchers can’t evaluate the evidence the government is using, or improve on it.”

Jill Rutter, programme director, Institute for Government, said: “Being clear on the evidence base behind policy – and its limitations – is an essential first step toward better policymaking. It is particularly worrying that policies announced in the Budget and Autumn Statement appear so prone to be unclear on the thinking behind them. The good news is that the examples of good practice we highlight suggest there is no barrier to transparency – we just need all policies to meet the standards of the best.”

Related


Explore our projects

Older-man-reads-textbook-Assembling-data-jigsaw-Greater-Manchester-PROJ
In progress

Welfare | 2020 - 2024

Assembling the data jigsaw: powering robust population research in MSK disease

View project
Medical-professional-massages-patient-knee-Understanding-joint-replacement-surgery-decision-making-for-older-patients-PROJ
In progress

Welfare | 2020 - 2023

Supporting older patients to make informed decisions about knee surgery

View project
New

Education | 2020 - 2022

Evaluating the short- and medium-term impacts of Sure Start

View project
Woman-medical-professional-treats-patient-impact-MSK-conditions-outcomes-other-illnesses-PROJ
In progress

Welfare | 2020 - 2022

The impact of musculoskeletal conditions on outcomes of other illnesses

View project
Female-nurse-sees-patient-in-office-Integrating-enriched-longitudinal-data-North-Staffordshire-Stoke-on-Trent-PROJ
In progress

Welfare | 2020 - 2025

Enriched data integration for population musculoskeletal health intelligence

View project
New

Education | 2020 - 2021

Ethical principles underpinning co-production with young people

View project
Older-man-and-woman-walk-together-Geographical-mapping-prevalence-outcomes-MSK-conditions-Wales-Scotland-PROJ
In progress

Welfare | 2020 - 2022

Mapping rheumatic and musculoskeletal disease in Scotland and Wales

View project
In progress

Welfare | 2020 - 2022

Older people in England: the geography of challenges and opportunities

View project
Senior-woman-enjoys-video-call-on-smartphone-Social-cohesion-in-context-of-COVID-19-PROJ
In progress

Welfare | 2020 - 2021

Social cohesion in the context of COVID-19

View project
Toddler-gleefully-eats-baked-beans-How-COVID-19-is-affecting-food-security-proj
In progress

Welfare | 2020 - 2021

How the COVID-19 crisis is affecting food security

View project
In progress

Welfare | 2020 - 2022

Vulnerability, migration and well-being: experiences, perceptions and barriers

View project
In progress

Welfare | 2020 - 2022

COVID-19 social study

View project
New

Education | 2020 - 2022

Evaluating the short- and medium-term impacts of Sure Start

View project
New

Education | 2020 - 2021

Ethical principles underpinning co-production with young people

View project
In progress

Welfare | 2020 - 2022

Vulnerability, migration and well-being: experiences, perceptions and barriers

View project
Toddler-gleefully-eats-baked-beans-How-COVID-19-is-affecting-food-security-proj
In progress

Welfare | 2020 - 2021

How the COVID-19 crisis is affecting food security

View project
In progress

Welfare | 2020 - 2022

Older people in England: the geography of challenges and opportunities

View project
Senior-woman-enjoys-video-call-on-smartphone-Social-cohesion-in-context-of-COVID-19-PROJ
In progress

Welfare | 2020 - 2021

Social cohesion in the context of COVID-19

View project
Teenage-girl-looks-at-smartphone-next-to-laptop-Growing-up-under-COVID-19-PROJ
In progress

Education | Welfare | 2020 - 2021

Growing up under COVID-19

View project
In progress

Welfare | 2020 - 2022

COVID-19 social study

View project
In progress

Welfare | 2020 - 2021

COVID realities: families on low incomes during the pandemic

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
In progress

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
Woman-medical-professional-treats-patient-impact-MSK-conditions-outcomes-other-illnesses-PROJ
In progress

Welfare | 2020 - 2022

The impact of musculoskeletal conditions on outcomes of other illnesses

View project
Man-massages-own-hand-Longitudinal-evidence-how-arthritis-affects-earnings-PROJ
In progress

Welfare | 2020 - 2022

How arthritis affects earnings over time

View project
Older-man-reads-textbook-Assembling-data-jigsaw-Greater-Manchester-PROJ
In progress

Welfare | 2020 - 2024

Assembling the data jigsaw: powering robust population research in MSK disease

View project
Medical-professional-massages-patient-knee-Understanding-joint-replacement-surgery-decision-making-for-older-patients-PROJ
In progress

Welfare | 2020 - 2023

Supporting older patients to make informed decisions about knee surgery

View project
New

Education | 2020 - 2022

Evaluating the short- and medium-term impacts of Sure Start

View project
Woman-medical-professional-treats-patient-impact-MSK-conditions-outcomes-other-illnesses-PROJ
In progress

Welfare | 2020 - 2022

The impact of musculoskeletal conditions on outcomes of other illnesses

View project
Female-nurse-sees-patient-in-office-Integrating-enriched-longitudinal-data-North-Staffordshire-Stoke-on-Trent-PROJ
In progress

Welfare | 2020 - 2025

Enriched data integration for population musculoskeletal health intelligence

View project
New

Education | 2020 - 2021

Ethical principles underpinning co-production with young people

View project
Older-man-and-woman-walk-together-Geographical-mapping-prevalence-outcomes-MSK-conditions-Wales-Scotland-PROJ
In progress

Welfare | 2020 - 2022

Mapping rheumatic and musculoskeletal disease in Scotland and Wales

View project
In progress

Welfare | 2020 - 2022

Older people in England: the geography of challenges and opportunities

View project
Senior-woman-enjoys-video-call-on-smartphone-Social-cohesion-in-context-of-COVID-19-PROJ
In progress

Welfare | 2020 - 2021

Social cohesion in the context of COVID-19

View project
In progress

Welfare | 2020 - 2022

Vulnerability, migration and well-being: experiences, perceptions and barriers

View project
Toddler-gleefully-eats-baked-beans-How-COVID-19-is-affecting-food-security-proj
In progress

Welfare | 2020 - 2021

How the COVID-19 crisis is affecting food security

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
In progress

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
Reported

Welfare | 2019 - 2020

Valuing data: foundations for data policy

View project
Reported

Welfare | 2019 - 2020

Revaluation and reform: bringing council tax into the 21st century

View project
Reported

Welfare | 2018 - 2019

Atlas of inequality: understanding the local nature of a global phenomenon

View project
Woman-carries-daughter-to-council-house-COVID-19-families-low-income-poverty-in-pandemic-PROJ
Reported

Justice | 2018 - 2020

Paths to administrative justice in Wales

View project
Reported

Welfare | 2018 - 2020

The intergenerational transmission of family wealth

View project
Reported

Welfare | 2018 - 2018

Interdisciplinary conference on evidence use in policy

View project
Reported

Welfare | 2018 - 2019

Overview of the major ethical issues arising from data, algorithms and AI

View project
Reported

Welfare | 2018 - 2018

Improving survey representation of non-resident parents

View project
Reported

Justice | Welfare | 2018 - 2019

Pathways of incarcerated children in care

View project
Reported

Welfare | 2018 - 2018

Council tax support schemes’ impact on claimants & local authorities

View project
Reported

Justice | Welfare | 2017 - 2018

Visualising data in care proceedings

View project
Reported

Justice | Welfare | 2017 - 2018

Addressing the ‘care cases’ crisis: a sector-led review

View project
Search projects

We improve people’s lives by funding research that informs social policy, primarily in Education, Welfare and Justice. We also fund student programmes that give young people skills and confidence in science and research.

We offer our grant-holders the freedom to frame questions and enable new thinking. Our research must stand up to rigorous academic scrutiny, but we understand that to be successful in effecting change, it also needs to be relevant to people’s experience.

Profile