The disciplinary power of predictive algorithms: a Foucauldian perspective

• Published in: Ethics and information technology Vol. 21; no. 4; pp. 319 - 329
• Main Author: de Laat, Paul B.
• Format: Journal Article
• Language: English
• Published: Dordrecht Springer Netherlands 01-12-2019; Springer Nature B.V
• Subjects: Algorithms; Artificial intelligence; Computer Science; Epidemics; Ethics; Foucault, Michel; Innovation/Technology Management; Library Science; Machine learning; Management of Computing and Information Systems; Modelling; Original Paper; Prediction models; Predictions; Smallpox; User Interfaces and Human Computer Interaction; Transparency; Algorithms; Panopticon; Machine learning; Prediction; Normation; Risk; Discipline; Foucault
• ISSN: 1388-1957; 1572-8439
• DOI: 10.1007/s10676-019-09509-y

Big Data are increasingly used in machine learning in order to create predictive models. How are predictive practices that use such models to be situated? In the field of surveillance studies many of its practitioners assert that “governance by discipline” has given way to “governance by risk”. The individual is dissolved into his/her constituent data and no longer addressed. I argue that, on the contrary, in most of the contexts where predictive modelling is used, it constitutes Foucauldian discipline. Compliance to a norm occupies centre stage; suspected deviants are subjected to close attention—as the precursor of possible sanctions. The predictive modelling involved uses personal data from both the focal institution and elsewhere (“Polypanopticon”). As a result, the individual re-emerges as the focus of scrutiny. Subsequently, small excursions into Foucauldian texts discuss his discourses on the creation of the “delinquent”, and on the governmental approach to smallpox epidemics. It is shown that his insights only mildly resemble prediction as based on machine learning; several conceptual steps had to be taken for modern machine learning to evolve. Finally, the options available to those subjected to predictive disciplining are discussed: to what extent can they comply, question, or resist? Through a discussion of the concepts of transparency and “gaming the system” I conclude that our predicament is gloomy, in a Kafkaesque fashion.