Exclusion by design

intersections of social, digital and data exclusion

Sora Park, Justine Humphry

Research output: Contribution to journalArticle

Abstract

As smart technologies such as artificial intelligence (AI), automation and Internet of Things (IoT) are increasingly embedded into commercial and government services, we are faced with new challenges in digital inclusion to ensure that existing inequalities are not reinforced and new gaps that are created can be addressed. Digital exclusion is often compounded by existing social disadvantage, and new systems run the risk of creating new barriers and harms. Adopting a case study approach, this paper examines the exclusionary practices embedded in the design and implementation of social welfare services in Australia. We examined Centrelink’s automated Online Compliance Intervention system (‘Robodebt’) and the National Disability Insurance Agency’s intelligent avatar interface ‘Nadia’. The two cases show how the introduction of automated systems can reinforce the punitive policies of an existing service regime at the design stage and how innovative AI systems that have the potential to enhance user participation and inclusion can be hindered at implementation so that digital benefits are left unrealised.
Original languageEnglish
Pages (from-to)934-953
Number of pages20
JournalInformation Communication and Society
Volume22
Issue number7
DOIs
Publication statusPublished - 7 Jun 2019

Fingerprint

Artificial intelligence
exclusion
Insurance
artificial intelligence
Automation
inclusion
automation
social welfare
insurance
regime
Internet
participation
Compliance
Internet of things

Cite this

@article{756e26cdf64d463cbacd07ad149b819f,
title = "Exclusion by design: intersections of social, digital and data exclusion",
abstract = "As smart technologies such as artificial intelligence (AI), automation and Internet of Things (IoT) are increasingly embedded into commercial and government services, we are faced with new challenges in digital inclusion to ensure that existing inequalities are not reinforced and new gaps that are created can be addressed. Digital exclusion is often compounded by existing social disadvantage, and new systems run the risk of creating new barriers and harms. Adopting a case study approach, this paper examines the exclusionary practices embedded in the design and implementation of social welfare services in Australia. We examined Centrelink’s automated Online Compliance Intervention system (‘Robodebt’) and the National Disability Insurance Agency’s intelligent avatar interface ‘Nadia’. The two cases show how the introduction of automated systems can reinforce the punitive policies of an existing service regime at the design stage and how innovative AI systems that have the potential to enhance user participation and inclusion can be hindered at implementation so that digital benefits are left unrealised.",
keywords = "Social exclusion, data exclusion, digital exclusion, digital technologies, disabilities, mobile",
author = "Sora Park and Justine Humphry",
year = "2019",
month = "6",
day = "7",
doi = "10.1080/1369118X.2019.1606266",
language = "English",
volume = "22",
pages = "934--953",
journal = "Information Communication and Society",
issn = "1369-118X",
publisher = "Brunner-Routledge",
number = "7",

}

Exclusion by design : intersections of social, digital and data exclusion. / Park, Sora; Humphry, Justine.

In: Information Communication and Society, Vol. 22, No. 7, 07.06.2019, p. 934-953.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Exclusion by design

T2 - intersections of social, digital and data exclusion

AU - Park, Sora

AU - Humphry, Justine

PY - 2019/6/7

Y1 - 2019/6/7

N2 - As smart technologies such as artificial intelligence (AI), automation and Internet of Things (IoT) are increasingly embedded into commercial and government services, we are faced with new challenges in digital inclusion to ensure that existing inequalities are not reinforced and new gaps that are created can be addressed. Digital exclusion is often compounded by existing social disadvantage, and new systems run the risk of creating new barriers and harms. Adopting a case study approach, this paper examines the exclusionary practices embedded in the design and implementation of social welfare services in Australia. We examined Centrelink’s automated Online Compliance Intervention system (‘Robodebt’) and the National Disability Insurance Agency’s intelligent avatar interface ‘Nadia’. The two cases show how the introduction of automated systems can reinforce the punitive policies of an existing service regime at the design stage and how innovative AI systems that have the potential to enhance user participation and inclusion can be hindered at implementation so that digital benefits are left unrealised.

AB - As smart technologies such as artificial intelligence (AI), automation and Internet of Things (IoT) are increasingly embedded into commercial and government services, we are faced with new challenges in digital inclusion to ensure that existing inequalities are not reinforced and new gaps that are created can be addressed. Digital exclusion is often compounded by existing social disadvantage, and new systems run the risk of creating new barriers and harms. Adopting a case study approach, this paper examines the exclusionary practices embedded in the design and implementation of social welfare services in Australia. We examined Centrelink’s automated Online Compliance Intervention system (‘Robodebt’) and the National Disability Insurance Agency’s intelligent avatar interface ‘Nadia’. The two cases show how the introduction of automated systems can reinforce the punitive policies of an existing service regime at the design stage and how innovative AI systems that have the potential to enhance user participation and inclusion can be hindered at implementation so that digital benefits are left unrealised.

KW - Social exclusion

KW - data exclusion

KW - digital exclusion

KW - digital technologies

KW - disabilities

KW - mobile

UR - http://www.scopus.com/inward/record.url?scp=85065775957&partnerID=8YFLogxK

UR - https://www.tandfonline.com/doi/full/10.1080/1369118X.2019.1606266

UR - http://www.mendeley.com/research/exclusion-design-intersections-social-digital-data-exclusion

U2 - 10.1080/1369118X.2019.1606266

DO - 10.1080/1369118X.2019.1606266

M3 - Article

VL - 22

SP - 934

EP - 953

JO - Information Communication and Society

JF - Information Communication and Society

SN - 1369-118X

IS - 7

ER -