How transparent is government in sharing evidence behind policies?

By Nuffield Foundation

A new report, funded by the Nuffield Foundation, scores 94 government policies produced by 12 departments, to assess how transparent they were about the evidence behind the policy.

Produced by Sense about Science, Transparency of evidence: a spot check of government policy proposals July 2016 to July 2017, scored policies against a framework looking at the Diagnosis, Proposal, Implementation and Testing & Evaluation plans of policy proposals.

Why spot check evidence transparency? Without clarity on what the government has looked at, it is very difficult for citizens to understand the motivations for policy, decide whether they agree with it, participate or consider whether it is working.

This report follows on from Sense about Science’s assessment of good and bad practice across government – the first ever review of whether the UK government is transparent about its use of evidence when developing policies. That report, published in November 2016, found that the public and researchers would struggle to follow the government’s reasoning, with standards of transparency varying widely between and within departments.

The report’s findings

This report shows a general improvement since we highlighted good and bad practice in 2016’s report. But there were also large discrepancies and some frustrating cases where an otherwise transparent policy lost points on one section of the framework.

The findings include:

  • The scores reveal considerable variation in practice between departments, but more consistency within departments.
  • There were fewer examples of departments failing to publish evidence. One of the most alarming findings of the 2016 report was the discovery that many departments held valuable evidence but did not publish it. However, there were still some significant omissions, including on areas likely to be of considerable public interest.
  • Policies with Impact Assessments scored more highly, and were rarely awarded 0s.
  • Testing & Evaluation – evidence about whether the policy works, or plans to gather it – showed the most disappointing results and gave little indication of improvement since 2016.
  • The highest scoring policy was Department for Transport’s ‘Cutting down on noise from night flights’, which scored 3 against every section of the framework. It was commended by scorers for a range of innovative citizen-centred ways of presenting the government’s thinking and how the department had arrived at conclusions.
  • The lowest scoring policy was Department for Education’s ‘Modern foreign languages A and AS level content’, to remove the speaking assessments from some examinations. This was given 0 for every section of the framework. Scorers could form no idea of what it was based on.

Related


Explore our projects

Woman-medical-professional-treats-patient-impact-MSK-conditions-outcomes-other-illnesses-PROJ
New

Welfare | 2020 - 2022

The impact of musculoskeletal conditions on outcomes of other illnesses

View project
Female-nurse-sees-patient-in-office-Integrating-enriched-longitudinal-data-North-Staffordshire-Stoke-on-Trent-PROJ
New

Welfare | 2020 - 2024

Enriched data integration for population musculoskeletal health intelligence

View project
Older-man-and-woman-walk-together-Geographical-mapping-prevalence-outcomes-MSK-conditions-Wales-Scotland-PROJ
New

Welfare | 2020 - 2022

Mapping rheumatic and musculoskeletal disease in Scotland and Wales

View project
New

Welfare | 2020 - 2022

Older people in England: the geography of challenges and opportunities

View project
Older-man-reads-textbook-Assembling-data-jigsaw-Greater-Manchester-PROJ
New

Welfare | 2020 - 2023

Assembling the data jigsaw: powering robust population research in MSK disease

View project
Senior-woman-enjoys-video-call-on-smartphone-Social-cohesion-in-context-of-COVID-19-PROJ
New

Welfare | 2020 - 2021

Social cohesion in the context of COVID-19

View project
New

Education | 2020 - 2020

The impact of COVID-19 on mainstream schools in England

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
New

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
New

Welfare | 2020 - 2021

COVID-19 and families on a low income: poverty in the pandemic

View project
Empty-street-with-cyclist-and-pedestrian-in-distance-Law-and-compliance-during-COVID-19-PROJ
New

Justice | 2020 - 2021

Law and compliance during COVID-19

View project
Father-working-from-home-while-his-two-children-do-schoolwork-nearby-COVID-19-social-study-PROJ
New

Welfare | 2020 - 2022

COVID-19 social study

View project
New

Education | 2020 - 2021

Post-16 educational trajectories and social inequalities in political engagement

View project
New

Education | 2020 - 2020

The impact of COVID-19 on mainstream schools in England

View project
New

Welfare | 2020 - 2022

Older people in England: the geography of challenges and opportunities

View project
Senior-woman-enjoys-video-call-on-smartphone-Social-cohesion-in-context-of-COVID-19-PROJ
New

Welfare | 2020 - 2021

Social cohesion in the context of COVID-19

View project
Teenage-girl-looks-at-smartphone-next-to-laptop-Growing-up-under-COVID-19-PROJ
New

Education | Welfare | 2020 - 2021

Growing up under COVID-19

View project
Young-boy-wearing-glasses-watches-laptop-school-lesson-with-notepad-The-effects-COVID-19-on-families-time-use-child-development-PROJ
New

Education | 2020 - 2022

The effects of COVID-19 on families’ time-use and child development

View project
Father-working-from-home-while-his-two-children-do-schoolwork-nearby-COVID-19-social-study-PROJ
New

Welfare | 2020 - 2022

COVID-19 social study

View project
Empty-street-with-cyclist-and-pedestrian-in-distance-Law-and-compliance-during-COVID-19-PROJ
New

Justice | 2020 - 2021

Law and compliance during COVID-19

View project
New

Welfare | 2020 - 2021

COVID-19 and families on a low income: poverty in the pandemic

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
New

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
Woman-medical-professional-treats-patient-impact-MSK-conditions-outcomes-other-illnesses-PROJ
New

Welfare | 2020 - 2022

The impact of musculoskeletal conditions on outcomes of other illnesses

View project
Man-massages-own-hand-Longitudinal-evidence-how-arthritis-affects-earnings-PROJ
New

Welfare | 2020 - 2022

How arthritis affects earnings over time

View project
Medical-professional-massages-patient-knee-Understanding-joint-replacement-surgery-decision-making-for-older-patients-PROJ
New

Welfare | 2020 - 2022

Supporting older patients to make informed decisions about knee surgery

View project
Woman-medical-professional-treats-patient-impact-MSK-conditions-outcomes-other-illnesses-PROJ
New

Welfare | 2020 - 2022

The impact of musculoskeletal conditions on outcomes of other illnesses

View project
Female-nurse-sees-patient-in-office-Integrating-enriched-longitudinal-data-North-Staffordshire-Stoke-on-Trent-PROJ
New

Welfare | 2020 - 2024

Enriched data integration for population musculoskeletal health intelligence

View project
Older-man-and-woman-walk-together-Geographical-mapping-prevalence-outcomes-MSK-conditions-Wales-Scotland-PROJ
New

Welfare | 2020 - 2022

Mapping rheumatic and musculoskeletal disease in Scotland and Wales

View project
New

Welfare | 2020 - 2022

Older people in England: the geography of challenges and opportunities

View project
New

Education | 2020 - 2020

The impact of COVID-19 on mainstream schools in England

View project
Older-man-reads-textbook-Assembling-data-jigsaw-Greater-Manchester-PROJ
New

Welfare | 2020 - 2023

Assembling the data jigsaw: powering robust population research in MSK disease

View project
Senior-woman-enjoys-video-call-on-smartphone-Social-cohesion-in-context-of-COVID-19-PROJ
New

Welfare | 2020 - 2021

Social cohesion in the context of COVID-19

View project
New

Education | 2020 - 2021

Post-16 educational trajectories and social inequalities in political engagement

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
New

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
New

Welfare | 2020 - 2021

COVID-19 and families on a low income: poverty in the pandemic

View project
Father-working-from-home-while-his-two-children-do-schoolwork-nearby-COVID-19-social-study-PROJ
New

Welfare | 2020 - 2022

COVID-19 social study

View project
Young-boy-wearing-glasses-watches-laptop-school-lesson-with-notepad-The-effects-COVID-19-on-families-time-use-child-development-PROJ
New

Education | 2020 - 2022

The effects of COVID-19 on families’ time-use and child development

View project
Reported

Welfare | 2019 - 2020

Valuing data: foundations for data policy

View project
Reported

Welfare | 2019 - 2020

Revaluation and reform: bringing council tax into the 21st century

View project
Reported

Welfare | 2018 - 2019

Atlas of inequality: understanding the local nature of a global phenomenon

View project
Reported

Welfare | 2018 - 2018

Interdisciplinary conference on evidence use in policy

View project
Reported

Welfare | 2018 - 2019

Overview of the major ethical issues arising from data, algorithms and AI

View project
Reported

Welfare | 2018 - 2018

Council tax support schemes’ impact on claimants & local authorities

View project
Reported

Welfare | 2018 - 2018

Improving survey representation of non-resident parents

View project
Reported

Justice | Welfare | 2018 - 2019

Pathways of incarcerated children in care

View project
Reported

Justice | Welfare | 2017 - 2018

Visualising data in care proceedings

View project
Reported

Education | 2017 - 2018

Growing up digital

View project
Reported

Justice | Welfare | 2017 - 2018

Addressing the ‘care cases’ crisis: a sector-led review

View project
Reported

Welfare | 2017 - 2018

Vulnerable migrants and well-being: A pilot study

View project
Search projects

We improve people’s lives by funding research that informs social policy, primarily in EducationWelfare and Justice. We also fund student programmes that give young people skills and confidence in science and research.

We offer our grant-holders the freedom to frame questions and enable new thinking. Our research must stand up to rigorous academic scrutiny, but we understand that to be successful in effecting change, it also needs to be relevant to people’s experience.

Profile