The Problems of the Automation Bias in the Public Sector: A Legal Perspective

Kurzanzeige
dc.contributor.authorRuschemeier, Hannah
dc.date.accessioned2023-10-30T14:23:41Z
dc.date.available2023-10-30T14:23:41Z
dc.date.issued2023
dc.description.abstractThe automation bias describes the phenomenon, proven in behavioural psychology, that people place excessive trust in the decision suggestions of machines. The law currently sees a dichotomy—and covers only fully automated decisions, and not those involving human decision makers at any stage of the process. However, the widespread use of such systems, for example to inform decisions in education or benefits administration, creates a leverage effect and increases the number of people affected. Particularly in environments where people routinely have to make a large number of similar decisions, the risk of automation bias increases. As an example, automated decisions providing suggestions for job placements illustrate the particular challenges of decision support systems in the public sector. So far, the risks have not been sufficiently addressed in egislation, as the analysis of the GDPR and the draft Artificial Intelligence Act show. I argue for the need for regulation and present initial approaches.
dc.description.sponsorshipThis work has been funded by the Federal Ministry of Education and Research of Germany (BMBF) (grant no.: 16DII121, 16DII122, 16DII123, 16DII124, 16DII125, 16DII126, 16DII127, 16DII128 – “Deutsches Internet-Institut”).
dc.identifier.citationRuschemeier, H. (2023). The Problems of the Automation Bias in the Public Sector: A Legal Perspective. Weizenbaum Conference Proceedings 2023. AI, Big Data, Social Media, and People on the Move, 59–69. https://doi.org/10.34669/wi.cp/5.6
dc.identifier.doihttps://doi.org/10.34669/wi.cp/5.6
dc.identifier.issn2510-7666
dc.identifier.urihttps://doi.org/10.34669/wi.cp/5.6
dc.identifier.urihttps://www.weizenbaum-library.de/handle/id/397
dc.language.isoeng
dc.publisherWeizenbaum Institute
dc.relation.ispartofhttps://doi.org/10.34669/wi.cp/5
dc.relation.ispartofseriesWeizenbaum Conference Proceedings
dc.rightsopen access
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectArticifial Intelligence
dc.subjectBias
dc.subjectAdm-Decisions
dc.subjectGdpr
dc.subjectDiscrimination
dc.subjectAI-Act Pes
dc.subject.ddc600 Technik
dc.subject.ddc340 Recht
dc.titleThe Problems of the Automation Bias in the Public Sector: A Legal Perspective
dc.typeConferencePaper
dc.type.statuspublishedVersion
dcmi.typeText
dcterms.bibliographicCitation.originalpublisherplaceBerlin
dcterms.bibliographicCitation.pageend69
dcterms.bibliographicCitation.pagestart59
Dateien
OriginalbĂĽndel
Gerade angezeigt 1 - 1 von 1
Vorschaubild
Name:
WI.CP.5.6_Ruschemeier.pdf
Größe:
306.18 KB
Format:
Adobe Portable Document Format
Beschreibung:
Herunterladen
Sammlungen
Proceedings of the Weizenbaum Conference 2023. AI, Big Data, Social Media and People on the Move