AI ethics must move beyond lists of ‘principles’: new report

By Nuffield Foundation

An ethical approach to the development and deployment of algorithms, data and AI (ADA) requires clarity and consensus on ethical concepts and resolution of tensions between values, according to a new report from the Nuffield Foundation and the Leverhulme Centre for the Future of Intelligence at the University of Cambridge.

This report sets out a broad roadmap for work on the ethical and societal implications of ADA-based technologies. The roadmap identifies the questions for research that need to be prioritised in order to inform and improve the standards, regulations and systems of oversight of ADA-based technologies. Without this, the report’s authors conclude the recent proliferation of various codes and principles for the ethical use of ADA-based technologies will have limited effect.

The report is based on an examination of current research and policy literature related to the ethical and societal implications of ADA-based technologies. The impact of these technologies shapes practically every question of public policy, but the report reveals a lack of consensus on the core ethical issues relevant to the use of data and AI, and how they apply to specific situations. While there is some agreement on the values that should underpin an ethical approach, there is insufficient consideration of the tensions between these values. There is also a lack of evidence on the current uses and impact of ADA-based technologies, their future capabilities, and of the perspectives of different groups of people.

To address these gaps, the roadmap sets out detailed questions for research based around three main tasks.

  • Uncovering and resolving the ambiguity inherent in commonly used terms, such as privacy, bias, and explainability. This will require identifying how these terms are used in different disciplines, sectors, publics and cultures, and building consensus in ways that are culturally and ethically sensitive. Where consensus cannot be reached, there is a need to develop terminology to prevent different groups from talking past one another.
  • Identifying and resolving tensions between the ways technology may both threaten and support different values. The roadmap identifies four central tensions:
    • Using algorithms to make decisions and predictions more accurate versus ensuring fair and equal treatment.
    • Reaping the benefits of increased personalisation in the digital sphere versus enhancing solidarity and citizenship.
    • Using data to improve the quality and efficiency of services versus respecting the privacy and informational autonomy of individuals.
    • Using automation to make people’s lives more convenient versus promoting self-actualisation and dignity.
  • Building a more rigorous evidence base for discussion of ethical and societal issues. This should include research on the impacts of ADA-based technologies on different groups, particularly those that might be disadvantaged or underrepresented. It should also include public engagement, to understand the perspectives of different groups of people.

Dr Stephen Cave, Executive Director of the Leverhulme Centre for the Future of Intelligence at Cambridge said: “In recent years, there has been a lot of attention on how to manage these powerful new technologies. Much of it has centred on agreeing ethics ‘principles’ like fairness and transparency. Of course, it’s great that corporations, governments and others are talking about this, but principles alone are not enough. Instead of representing the outcome of meaningful ethical debate, to a significant degree they are just postponing it – because they are vague and come into conflict in practice. They also risk distracting from developing measures with real bite, like regulation. This report points the way to the hard thinking that we as a society must do in order to really harness these technologies for good and avoid the kind of scandals we saw so much of last year.”

Tim Gardam, Chief Executive of the Nuffield Foundation said: “The report reveals just how far there is to go to address the question of how society should equitably distribute the transformative power and benefits of data and AI while mitigating harm. The questions identified will be valuable in stimulating new ideas for the Nuffield Foundation’s digital society research funding, and for informing the work of the Ada Lovelace Institute, a new independent research and deliberative body that we have established to ensure data and AI work for people and society.”

Related


Explore our projects

New

Welfare | 2024 - 2027

Gypsy, Roma, Traveller Youth: mitigating exclusions using the digital?

View project
A woman is sat on the edge of a bed staring at her phone while her daughter is in the background.
In progress

Welfare | 2023 - 2025

Virtual parent support portals: a new research and practice agenda

View project
Dad holding baby walking with two kids
In progress

Justice | 2022 - 2024

Administrative fairness in the digital welfare state

View project
Primary school children using tablets and laptops
In progress

Education | 2022 - 2024

NewsWise in primary education: news, digital literacy and civic engagement

View project
A crowded street with passers-by wearing face masks: Full Fact
In progress

Welfare | 2022 - 2025

Full Fact 2022 – 2025

View project
The future of work and wellbeing. A man working from home during the COVID-19 crisis, having a video meeting with colleagues
In progress

Welfare | 2021 - 2024

The Future of Work and Well-being: The Pissarides Review

View project
A girl using a smartphone
In progress

Justice | 2021 - 2023

Children’s experiences of crime in Britain survey

View project
Young-boy-uses-tablet-with-mother-for-maths-learning-Can-maths-apps-add-value-to-learning-PROJ
Reported

Education | 2020 - 2022

Can maths apps add value to learning?

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
Reported

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
Siblings play ball in a playground - Siblings Contact and the Law
Reported

Justice | 2020 - 2021

Guidance to judges on the anonymisation of children judgements

View project
In progress

Education | 2019 - 2022

The SWAN game-based approach to learning foundational number language

View project
In progress

Welfare | 2019 - 2022

Living with data: knowledge, experiences and perceptions of data practices

View project
New

Welfare | 2024 - 2027

Gypsy, Roma, Traveller Youth: mitigating exclusions using the digital?

View project
A woman is sat on the edge of a bed staring at her phone while her daughter is in the background.
In progress

Welfare | 2023 - 2025

Virtual parent support portals: a new research and practice agenda

View project
Dad holding baby walking with two kids
In progress

Justice | 2022 - 2024

Administrative fairness in the digital welfare state

View project
Primary school children using tablets and laptops
In progress

Education | 2022 - 2024

NewsWise in primary education: news, digital literacy and civic engagement

View project
A crowded street with passers-by wearing face masks: Full Fact
In progress

Welfare | 2022 - 2025

Full Fact 2022 – 2025

View project
The future of work and wellbeing. A man working from home during the COVID-19 crisis, having a video meeting with colleagues
In progress

Welfare | 2021 - 2024

The Future of Work and Well-being: The Pissarides Review

View project
A girl using a smartphone
In progress

Justice | 2021 - 2023

Children’s experiences of crime in Britain survey

View project
Siblings play ball in a playground - Siblings Contact and the Law
Reported

Justice | 2020 - 2021

Guidance to judges on the anonymisation of children judgements

View project
Young-boy-uses-tablet-with-mother-for-maths-learning-Can-maths-apps-add-value-to-learning-PROJ
Reported

Education | 2020 - 2022

Can maths apps add value to learning?

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
Reported

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
In progress

Education | 2019 - 2022

The SWAN game-based approach to learning foundational number language

View project
Reported

Education | 2017 - 2018

Growing up digital

View project
A woman is sat on the edge of a bed staring at her phone while her daughter is in the background.
In progress

Welfare | 2023 - 2025

Virtual parent support portals: a new research and practice agenda

View project
Dad holding baby walking with two kids
In progress

Justice | 2022 - 2024

Administrative fairness in the digital welfare state

View project
Primary school children using tablets and laptops
In progress

Education | 2022 - 2024

NewsWise in primary education: news, digital literacy and civic engagement

View project
A crowded street with passers-by wearing face masks: Full Fact
In progress

Welfare | 2022 - 2025

Full Fact 2022 – 2025

View project
The future of work and wellbeing. A man working from home during the COVID-19 crisis, having a video meeting with colleagues
In progress

Welfare | 2021 - 2024

The Future of Work and Well-being: The Pissarides Review

View project
A girl using a smartphone
In progress

Justice | 2021 - 2023

Children’s experiences of crime in Britain survey

View project
In progress

Education | 2019 - 2022

The SWAN game-based approach to learning foundational number language

View project
In progress

Welfare | 2019 - 2022

Living with data: knowledge, experiences and perceptions of data practices

View project
In progress

Justice | 2011 - 2023

Juries, the digital courtroom and special measures

View project
New

Welfare | 2024 - 2027

Gypsy, Roma, Traveller Youth: mitigating exclusions using the digital?

View project
Siblings play ball in a playground - Siblings Contact and the Law
Reported

Justice | 2020 - 2021

Guidance to judges on the anonymisation of children judgements

View project
Young-boy-uses-tablet-with-mother-for-maths-learning-Can-maths-apps-add-value-to-learning-PROJ
Reported

Education | 2020 - 2022

Can maths apps add value to learning?

View project
Woman-looks-at-smartphone-screen-How-the-UK-public-gets-information-about-COVID-19-PROJ
Reported

Welfare | 2020 - 2020

How the UK public gets information about COVID-19

View project
Reported

Education | 2017 - 2018

Growing up digital

View project
Reported

Welfare | 2019 - 2020

Valuing data: foundations for data policy

View project
Birds-eye view of a virtual reality crowd
Reported

Welfare | 2019 - 2021

Me and my big data: developing citizens’ data literacy

View project
Birds-eye view of virtual reality crowd
Reported

Welfare | 2018 - 2019

Overview of the major ethical issues arising from data, algorithms and AI

View project
Reported

Welfare | 2015 - 2016

Our world in data

View project
Man reading the newspaper in the kitchen
Reported

Welfare | 2018 - 2020

Communicating uncertainty in data without undermining trust

View project
Reported

Welfare | 2014 - 2021

Full Fact 2014 – 2022

View project
Reported

Justice | Welfare | 2017 - 2022

Visualising data in care proceedings

View project
Reported

Justice | Welfare | 2008 - 2008

Sharing children’s personal data

View project
Search projects

We improve people’s lives by funding research that informs social policy, primarily in Education, Welfare and Justice. We also fund student programmes that give young people skills and confidence in science and research.

We offer our grant-holders the freedom to frame questions and enable new thinking. Our research must stand up to rigorous academic scrutiny, but we understand that to be successful in effecting change, it also needs to be relevant to people’s experience.

Profile