Robodebt: A Socio-Technical Case Study of Public Sector Information Systems Failure
DOI:
https://doi.org/10.3127/ajis.v28.4681Keywords:
IS Failure, Public Sector Information Systems, Socio-technical systems, Case Study, DigitalisationAbstract
Large-scale public sector information systems (PSIS) that administer social welfare payments face considerable challenges. Between 2014 and 2023, an Australian government agency conceived and implemented the Online Compliance Intervention (OCI) scheme, widely referred to as Robodebt. The scheme's primary purpose was to apply digital transformation in order to reduce labour costs and increase recovery of overpayments. Among its key features were a simplified, but inherently erroneous, estimation method called income averaging, and a new requirement that welfare recipients produce documentation for income earned years earlier. Failure by welfare recipients to comply with mandates resulted in the agency recovering what it asserted to be overpayments. This article presents a case study of Robodebt and its effects on over 1 million of its clients. The detailed case study relies on primary data through Senate and other government hearings and commissions, and secondary data, such as media reports, supplemented by academic sources. Relevant technical features include (1) the reliance on the digital persona that the agency maintains for each client, (2) computer-performed inferencing from client data, and (3) automated decision-making and subsequent action. This article employs a socio-technical systems approach to understanding the factors underlying a major PSIS project failure, by focusing on the system's political and public service sponsors; its participants (users); the people affected by it (usees); and the broader economic, social, and political context. Practical and theoretical insights are presented, with the intention of highlighting major practical lessons for PSIS, and the relevance of an articulated socio-technical frame for PSIS.
References
Abbas, R. & Michael, K. (2022). Socio-Technical Theory: A Review. In S. Papagiannidis (Ed) 'TheoryHub Book', at: https://open.ncl.ac.uk/theories/9/socio-technical-theory/
Abbas R., Michael K., Michael M.G., Perakslis C. and Pitt J. (2022). Machine Learning, Convergence Digitalization, and the Concentration of Power: Enslavement by Design Using Techno-Biological Behavior. IEEE Transactions on Technology and Society 3, 2 (June 2022) 76-88, doi: 10.1109/TTS.2022.3179756
Abbas R., Pitt J., & Michael K. (2021). Socio-technical design for public interest technology. IEEE Transactions on Technology and Society 2,2 (2021) 55-61
Abbas R., Michael K., Sargent J.P. & Scornavacca E. (2021). Anticipating Techno-Economic Fallout: Purpose-Driven Socio-Technical Innovation. IEEE Transactions on Technology and Society 2,3 (September 2021) 111-113, at https://ieeexplore.ieee.org/iel7/8566059/9500078/09500093.pdfhttps://ieeexplore.ieee.org/iel7/8566059/9500078/09500093.pdf.
Akter, S., McCarthy, G., Sajib, S., Michael, K., Dwivedi, Y.K., D’Ambra, J. & Shen, K.N. (2021). Algorithmic bias in data-driven innovation in the age of AI. International Journal of Information Management, 60, 102387.
Amato (2019). Amato v The Commonwealth of Australia (Federal Court VID611/2019), at https://www.comcourts.gov.au/file/Federal/P/VID611/2019/3859485/event/30114114/document/1513665.
Avison D.E. & Wood-Harper A.T. (1990). Multiview: An Exploration in Information Systems Development. Blackwell, 1990.
Bajkowski J. (2022). Services Australia handed $5.6m more work to robodebt collector Panthera following ACCC prosecution. The Mandarin, 3 November 2022, at https://www.themandarin.com.au/204378-services-australia-handed-5-6m-more-work-to-robodebt-collector-panthera-following-accc-prosecution/
Bajkowski J. (2023). Jane Halton links ‘chilling. effect of FOI to robodebt’s 'frank and fearless advice' epic fail. The Mandarin, 11 July 2023, at https://www.themandarin.com.au/224898-jane-halton-links-foi-to-robodebt-failure-of-frank-fearless-advice/
Barbaschow A. (2017). Privacy Foundation calls for human intervention in Centrelink debt collection. zdNet, 2 April 2017, at https://www.zdnet.com/article/privacy-foundation-calls-for-human-involvement-in-centrelink-automated-debt-collection-process/
Baumer E.P.S. (2015). Usees. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15), April 2015.
Belot H. (2017a). Centrelink debt recovery: Government knew of potential problems with automated program. ABC News, 12 Jan 2017, at https://www.abc.net.au/news/2017-01-12/government-knew-of-potential-problems-with-centrelink-system/8177988
Belot H. (2017b). Centrelink's controversial data matching program to target pensioners and disabled, Labor calls for suspension. ABC News, 17 Jan 2017, at https://www.abc.net.au/news/2017-01-17/labor-calls-for-suspension-of-centrelink-debt-recovery-program/8187934
Belot H. & McGhee A. (2017). Centrelink debt recovery program to undergo changes following public criticism. ABC News, 16 Jan 2017, at https://www.abc.net.au/news/2017-01-16/government-to-change-centrelink-debt-recovery-program/8185366
Berleur J. & Drumm J. (Eds.) (1991). Information Technology Assessment. Proc. 4th IFIP-TC9 International Conference on Human Choice and Computers, Dublin, July 8-12, 1990, Elsevier Science Publishers (North-Holland), 1991.
Bostrom, R. P., & Heinen, J. S. (1977). MIS Problems and Failures: A Socio-Technical Perspective. Part I: The Causes. MIS Quarterly 1,3 (1977) 17–32, at https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=e092be3120ce51aaa35af673fabd07b6513e702e
Bower C.M. & Christensen C.M. (1995). Disruptive Technologies: Catching the Wave. Harvard Business Review (January-February 1995) 43-53.
Braithwaite V. (2020). Beyond the bubble that is Robodebt: How governments that lose integrity threaten democracy. Aust J Soc Issues 55,3 (September 2020) 242–259, at https://static1.squarespace.com/static/5c05f8595cfd7901fc57139d/t/5f8a808b459ade460acd28dc/1602912397885/Beyond+the+bubble+that+is+Robodebt+How+governments+that+lose+integrity+threaten+democracy.pdf
Brennen S. & Kreiss D. (2016). Digitalization and Digitization. International Encyclopedia of Communication Theory and Philosophy, October 2016, PrePrint at http://culturedigitally.org/2014/09/digitalization-and-digitization/
Brookes J. (2022). 197,000 notices wiped from ‘shameful' robodebt scheme. Innovation Australia, 12 October 2022, at https://www.innovationaus.com/197000-notices-wiped-from-shameful-robodebt-scheme/
Bryson J.M. (2004). What to do when stakeholders matter: stakeholder identification and analysis techniques. Public Management Review 6,1 (2004) 21-53, at https://ftms.edu.my/images/Document/MOD001074%20-%20Strategic%20Management%20Analysis/WK3_SR_MOD001074_Bryson_2004.pdf
Burgess K. (2019). Robodebt Centrelink compliance program cost $600m to recoup $785m so far. The Canberra Times, October 28 2019, at https://www.canberratimes.com.au/story/6407984/four-of-five-robodebt-reviews-hit-with-a-debt-as-cost-revealed/
Carney T. (2019). Robo-debt illegality: The seven veils of failed guarantees of the rule of law?. Alternative Law Journal 44,1 (2019) 4–10, at https://journals.sagepub.com/doi/pdf/10.1177/1037969X18815913
Checkland P. (1981). Systems Thinking, Systems Practice. Wiley, 1981.
Cherns A. (1976). The principles of sociotechnical design. Human Relations 29,8 (1976) 783-792.
Cherns A. (1987). Principles of sociotechnical design revisited. Human Relations, 40,3 (1987) 153-161.
Christensen C.M., Raynor M. & McDonald R. (2015). What Is Disruptive Innovation?. Harvard Business Review (December 2015) 2-11.
Clarke R. (1987). Just Another Piece of Plastic for your Wallet: The 'Australia Card' Scheme. Computers & Society 18,1 (January 1988), Addendum in Computers & Society 18,3 (July 1988), PrePrint at http://www.rogerclarke.com/DV/OzCard.html
Clarke R. (1992a). The Resistible Rise of the National Personal Data System. Software Law Journal 5,1 (January 1992), PrePrint at http://www.rogerclarke.com/DV/SLJ.html
Clarke R. (1992b). Extra-Organisational Systems: A Challenge to the Software Engineering Paradigm. Proc. IFIP World Congress, Madrid, September 1992, PrePrint at http://www.rogerclarke.com/SOS/PaperExtraOrgSys.html
Clarke R. (1994a). The Digital Persona and its Application to Data Surveillance. The Information Society 10,2 (June 1994), PrePrint at http://www.rogerclarke.com/DV/DigPersona.html
Clarke R. (1994b). Dataveillance by Governments: The Technique of Computer Matching. Information Technology & People 7,2 (December 1994) 46-85, PrePrint at http://www.rogerclarke.com/DV/MatchIntro.html
Clarke R. (2014). Promise Unfulfilled: The Digital Persona Concept, Two Decades Later. Information Technology & People 27, 2 (Jun 2014) 182-207, PrePrint at http://www.rogerclarke.com/ID/DP12.html
Clarke R. (2015). Not Only Horses Wear Blinkers: The Missing Perspectives in IS Research. Keynote Presentation, Proc. ACIS'15, at https://arxiv.org/pdf/1611.04059
Clarke R. (2016). An Empirical Assessment of Researcher Perspectives. Proc. Bled eConf., Slovenia, June 2016, PrePrint at http://www.rogerclarke.com/SOS/BledP.html
Clarke R. & Davison R.M. (2020). Through Whose Eyes? The Critical Concept of Researcher Perspective. J. Assoc. Infor. Syst. 21, 2 (March-April 2020) 483-501, PrePrint at http://rogerclarke.com/SOS/RP.html
Clarke R., Davison R.M. & Jia W. (2020). Researcher Perspective in the IS Discipline: An Empirical Study of Articles in the Basket of 8 Journals. Information Technology & People 33, 6 (October 2020) 1515-1541, PrePrint at http://www.rogerclarke.com/SOS/RPBo8.html
Clarke R., Michael K. & Abbas R. (2024). Robodebt: An Exemplary Case Study of a Failed Transformative IT Project in the Public Sector. Working Paper, Xamax Consultancy Pty Ltd, July 2024, at http://rogerclarke.com/DV/RDCS.html
Cornish, A. (2023). Record-keeping deficiencies exposed in robodebt royal commission report. Informaa Quarterly Official Bulletin of the Records Management Association of Australia, 39,3 (2023) 8–8.
CPI (2022). Delay and Decay: Australia’s Freedom of Information Crisis. Briefing Paper, The Centre for Public Integrity, August 2022, at https://publicintegrity.org.au/wp-content/uploads/2022/09/FOI-Delay-and-Decay-Final.pdf
Creswell, John W. & J. David Creswell. ‘Research Design: Qualitative, Quantitative, and Mixed Methods Approaches’. Fifth edition. Los Angeles, SAGE, 2018.
Cukier K. & Mayer-Schönberger V. (2013). The Rise of Big Data. Foreign Affairs (May/June 2014) 35.
Deloitte (2023a). The use of data and automation in the Robodebt scheme: A report to the Royal Commission into the Robodebt Scheme. Royal Commission into the Robodebt Scheme, March 2023, at https://robodebt.royalcommission.gov.au/system/files/2023-03/Use-of-data-and-automation-in-the-Robodebt-Scheme.pdf
Deloitte (2023b). Robodebt Process Maps. Royal Commission into the Robodebt Scheme, March 2023, at https://robodebt.royalcommission.gov.au/publications/deloitte-robodebt-process-maps
DMP (1994). Guidelines for the Conduct of the Data-Matching Program. Delegated Legislated under the Data Matching Program (Assistance and Tax) Act 1990, October 1994, nominally enforceable, but applicable only if the matching process uses the Tax File Number (TFN), at https://www.legislation.gov.au/Details/F2009B00268
Dreborg, K. H., 1996. Essence of backcasting”, Futures 28,9 (1996) 813-828, at https://doi.org/10.1016/S0016-3287(96)00044-4.
Emery F. (1959). Characteristics of socio-technical systems. In 'The Social Engagement of Social Science: A Tavistock Anthology Volume 2, University of Pennsylvania Press, pp.157-186).
Farrell P. (2019). Government halting key part of robodebt scheme, will freeze debts for some welfare recipients. ABC News, 19 November 2019, at https://www.abc.net.au/news/2019-11-19/robodebt-scheme-human-services-department-halts-existing-debts/11717188
Fischer-Huebner S. & Lindskog H. (2001). Teaching Privacy-Enhancing Technologies. Proceedings of the IFIP WG 11.8 2nd World Conference on Information Security Education, Perth, Australia.
Freeman R.E. & Reed D.L. (1983). Stockholders and Stakeholders: A New Perspective on Corporate Governance. California Management Review 25, 3 (1983) 88-106.
Goggin, G. & Soldatić, K. (2022). Automated decision-making, digital inclusion and intersectional disabilities. New Media & Society, vol. 24, no. 2, pp. 384–400.
GR (2017). Government Response to the Senate Committee Report', Australian Government, September 2017, at https://www.aph.gov.au/Parliamentary_Business/Committees/Senate/Community_Affairs/SocialWelfareSystem/Additional_Documents?docType=Government%20Response
Graycar A. & Masters A. B. (2022). Bureaucratic bastardry: robodebt/debt recovery, AI and the stigmatisation of citizens by machines and systems. International Journal of Public Policy 16,5-6 (2022) 333-344.
Hammer M. (1990). Reengineering Work: Don’t Automate, Obliterate. Harvard Business Review (July-August 1990) 104-112.
Hanks, P. (2021). Administrative law and welfare rights: A 40-year story from ‘Green v Daniels’ to ‘robot debt recovery’ - closing the chapter. AIAL Forum, 103 (2021) 19–31.
Henriques-Gomes L. (2020). All Centrelink debts raised using income averaging unlawful, Christian Porter concedes. The Guardian, 31 May 2020, at https://www.theguardian.com/australia-news/2020/may/31/all-centrelink-debts-raised-using-income-averaging-unlawful-christian-porter-concedes
Hevner A.R., March S.T. & Park S. (2004). Design Science in Information Systems Research. MIS Quarterly 28,1 (2004) 75-105.
Hirschheim R.A. (1985). User Experience with and Assessment of Participative Systems Design. MIS Quarterly (December 1985), at https://www.academia.edu/download/51009081/viewcontent.pdf
Hogan-Doran D. (2017). Computer says "no": automation, algorithms and artificial intelligence in Government decision-making. The Judicial Review 13 (2017) 1-39, at https://www.academia.edu/38540521/Computer_says_no_automation_algorithms_and_artificial_intelligence_in_Government_decision_making?email_work_card=view-paper
IxDF - Interaction Design Foundation. (2021, June 14). What are Complex Socio-Technical Systems?. Interaction Design Foundation - IxDF. 28 February 2024, at https://www.interaction-design.org/literature/topics/complex-socio-technical-systems
Klapdor M. (2020). Social Security and Welfare. Parliament of Australia, October 2020, at https://www.aph.gov.au/About_Parliament/Parliamentary_Departments/Parliamentary_Library/pubs/rp/BudgetReview202021/SocialSecurityWelfare#:~:text=Social%20security%20and%20welfare%20expenditure,Australian%20Government's%20total%20expenditure%20(p.
Knaus C. (2016). Centrelink officer says only a fraction of debts in welfare crackdown are genuine. The Guardian, 23 December 2016, at https://www.theguardian.com/australia-news/2016/dec/23/centrelink-officer-says-only-a-fraction-of-debts-in-welfare-crackdown-are-genuine
Knaus C. (2017). 'Reasonably clear' Alan Tudge's office broke law in Centrelink case, says Labor legal advice. The Guardian, 3 Apr 2017, at https://www.theguardian.com/australia-news/2017/apr/03/reasonably-clear-alan-tudges-office-broke-law-in-centrelink-case-says-labor-legal-advice
Knaus C. & Bassano J. (2019). How a flawed freedom-of-information regime keeps Australians in the dark. The Guardian, 2 January 2019, at https://www.theguardian.com/australia-news/2019/jan/02/how-a-flawed-freedom-of-information-regime-keeps-australians-in-the-dark
Land F. & Hirschheim R. (1983). Participative systems design: Rationale, tools and techniques. Journal of Applied Systems Analysis, 1983.
Laplume A.O., Sonpar K. & Litz R.A. (2008). Stakeholder theory: Reviewing a theory that moves us. Journal of Management 34,6 (2008) 1152-1189.
Lindebaum, D., Glaser, V., Moser, C. & Ashraf, M. (2023). When Algorithms Rule, Values Can Wither. Sloan Management Review, vol. 64, no. 2, pp. 1–5.
Liu K., Sun L. & Bennett K. (2002), 'Co-Design of Business and IT Systems. Introduction by Guest Editors, Information Systems Frontiers, 4,3 (2002) 251–256.
LSD (2017). Legal Services Directions 2017', 2 July 2018, at https://www.legislation.gov.au/Details/F2018C00409
Lunde A.S. (1980). The person-number systems of Sweden, Norway, Denmark, and Israel. US Department of Health and Human Services, Public Health Service, Office of Health Research, Statistics, and Technology, National Center for Health Statistics, Vol. 80, No. 1358.
Lycett M. (2014), Datafication: Making Sense of (Big) Data in a Complex World, European Journal of Information Systems, 22, 4 (December 2014) 381-386, at http://v-scheiner.brunel.ac.uk/bitstream/2438/8110/2/Fulltext.pdf
Lyytinen K. & Rose G.M. (2003), 'The Disruptive Nature of Information Technology Innovations: The Case of Internet Computing in Systems Development Organizations', MIS Quarterly, 27, 4 (December 2003), 557-595.
Macleod, L. (2017). Lessons learnt about digital transformation and public administration: Centrelink’s online compliance intervention. AIAL Forum, no. 89, pp. 59–68.
Mann, M. (2020). Technological Politics of Automated Welfare Surveillance: Social (and Data) Justice through Critical Qualitative Inquiry. Global Perspectives (Oakland, Calif.), vol. 1, no. 1.
Marjanovic, O., Cecez-Kecmanovic, D., & Vidgen, R. (2022). Theorising algorithmic justice. European Journal of Information Systems, 31(3), 269-287.
Sarah Martin. (2016). Welfare debt squad hunts for $4bn. The Australian, 5 December 2016, at http://www.theaustralian.com.au/national-affairs/welfare-debt-squad-hunts-for-4bn-in-overpayments/news-story/e19c5b0d4a39aa07364a41269fdc11c9
Mead, G. & Neves, B. (2023). Contested delegation: Understanding critical public responses to algorithmic decision-making in the UK and Australia. The Sociological Review (Keele), vol. 71, no. 3, pp. 601–623.
Medhora S. (2019). Over 2000 people died after receiving Centrelink robo-debt notice, figures reveal. ABC TripleJ, 18 Feb 2019, at https://www.abc.net.au/triplej/programs/hack/2030-people-have-died-after-receiving-centrelink-robodebt-notice/10821272
Michael, K. (2003). The technological trajectory of the automatic identification industry: the application of the systems of innovation (SI) framework for the characterization and prediction of the auto-ID industry. PhD thesis, School of Information Technology and Computer Science, University of Wollongong, 2003, at http://ro.uow.edu/theses/309. See in particular 'Section 4.3 The Evolution of the Citizen ID Number'.
Michael K. & Michael M.G. (2006). Historical lessons on ID technology and the consequences of an unchecked trajectory. Prometheus 24,4 (2006) 365-377.
Miller, K. (2017). Connecting the dots: a case study of the Robodebt communities. AIAL Forum, no. 89, pp. 50–58.
Mitchell R.K., Agle B.R. & Wood D.J. (1997). Toward a Theory of Stakeholder Identification and Salience: Defining the Principle of Who and What Really Counts. Academy of Management Review 22,4 (1997) 853-886.
MRR (2015). Welfare Integrity, Fairness and Sustainability for all Australians. Minister for Social Security, Scott Morrison, Budget Media Release, 12 May 2015, at https://formerministers.dss.gov.au/15850/welfare-integrity-fairness-and-sustainability-for-all-australians/
Mumford E. (2000). A socio-technical approach to systems design. Requirements Engineering 5,2 (2000) 125-133.
Mumford E. (2006). The story of socio-technical design: reflections on its successes, failures and potential. Information Systems Journal 16 (2006) 317–342, at https://executiveinsight.typepad.com/files/the-story-of-socio-technical-design.pdf
Naylor, S. (2023). Robodebt, Kafka and institutional absurdism in Australia. Alternative Law Journal, vol. 48, no. 4, pp. 299–302.
Newell S. & Marabelli M. (2015). Strategic Opportunities (and Challenges) of Algorithmic Decision-Making: A Call for Action on the Long-Term Societal Effects of 'Datification'. The Journal of Strategic Information Systems 24, 1 (2015) 3-14, at http://marcomarabelli.com/Newell-Marabelli-JSIS-2015.pdf
Ng, Y-F. & Gray, S. (2022). Disadvantage and the automated decision. Adelaide Law Review, vol. 43, no. 2, pp. 641–677.
Nikidehaghani, M., Andrew, J. & Cortese, C. (2023). Algorithmic accountability: robodebt and the making of welfare cheats. Accounting, Auditing & Accountability Journal, vol. 36, no. 2, pp. 677–711.
Noone, M.A. (2020). Innovation and Disruption: Exploring the Potential of Clinical Legal Education. International Journal of Clinical Legal Education, vol. 27, no. 3, pp. 5–32.
Norman, D. (2013), The Design of Everyday Things: Revised and Expanded Edition Paperback, Basic Books, New York.
OAIC (2014) 'Guidelines on data matching in Australian Government administration' Office of the Australian Information Commissioner, rev. 18 June 2014, at https://www.oaic.gov.au/privacy/guidance-and-advice/guidelines-on-data-matching-in-australian-government-administration
Omb (2017). Centrelink’s automated debt raising and recovery system: A Report about the Department of Human Services. Online Compliance Intervention System for Debt Raising and Recovery. Australian Ombudsman, April 2017, at https://www.ombudsman.gov.au/__data/assets/pdf_file/0022/43528/Report-Centrelinks-automated-debt-raising-and-recovery-system-April-2017.pdf
Park, S. & Humphry, J. 2019. Exclusion by design: intersections of social, digital and data exclusion. Information, Communication & Society, vol. 22, no. 7, pp. 934–953.
Parnell S. (2024). Tax Office rejects one in four calls to fudge waiting time figures. The Sydney Morning Herald, 25 March 2024, at https://www.smh.com.au/national/tax-office-rejects-one-in-four-calls-to-fudge-waiting-time-stats-20240325-p5fez8.html
Piller G., Schubert P., Koch M. & Moeslein K. (2004). From Mass Customization to Collaborative Customer CoDesign. Proc. ECIS 2004, 118.
Podger A. (2023). Report to the Royal Commission into the Robodebt Scheme. Royal Commission into the Robodebt Scheme, February 2023, at https://robodebt.royalcommission.gov.au/system/files/2023-02/andrew-podger-report-to-robodebt-royal-commission.pdf
Ponterotto, J.G. (2006). Brief Note on the Origins, Evolution, and Meaning of the Qualitative Research Concept “Thick Description”, The Qualitative Report, vol. 11, no. 3, September 2006 538-549, http://www.nova.edu/ssss/QR/QR11-3/ponterotto.pdf
Pry (2021) Prygodicz v Commonwealth of Australia (No 2) [2021] FCA 634 (11 June 2021) - the eventual judgment, at http://www.austlii.edu.au/cgibin/viewdoc/au/cases/cth/FCA/2021/634.html?context=1;query=Prygodicz;mask_path
Ray, A., Adams, B. & Thampapillai, D. (2022). Access to algorithms post-Robodebt: Do freedom of information laws extend to automated systems?. Alternative Law Journal, vol. 47, no. 1, pp. 10–15.
RCR (2023). Report of the Royal Commission into the Robodebt Scheme', 7 July 2023, at https://robodebt.royalcommission.gov.au/publications/report Simister, N. (2017) “Case studies and stories of change”, Intrac for Civil Society, https://www.intrac.org/resources/case-studies-stories-change/
Redden J. (2018). The Harm That Data Do. Scientific American, 1 November 2018, https://www.scientificamerican.com/article/the-harm-that-data-do/
Rinta-Kahila T., Someh I., Gillespie N., Indulska M. & Gregor S. (2022). Algorithmic decision-making and system destructiveness: A case of automatic debt recovery. European Journal of Information Systems 31,3 (2022) 313-338, at https://www.tandfonline.com/doi/pdf/10.1080/0960085X.2021.1960905?needAccess=true
Robert (2019). Media Releases – 2019. Minister responsible for Services Australia, at https://web.archive.org/web/20200319204601/https://minister.servicesaustralia.gov.au/media-releases
RRC (2022a). Transcript of Proceedings for Monday, 5 December 2022. Royal Commission into the Robodebt Scheme, December 2022, at https://robodebt.royalcommission.gov.au/system/files/2022-12/transcript-hearing-day-13-5-december-2022.pdf
RRC (2022b). Transcript of Proceedings for Monday, 6 December 2022. Royal Commission into the Robodebt Scheme, December 2022, at https://robodebt.royalcommission.gov.au/system/files/2022-12/transcript-6-december.pdf
RRC (2022c). Transcript of Proceedings for Monday, 7 December 2022. Royal Commission into the Robodebt Scheme, December 2022, at https://robodebt.royalcommission.gov.au/system/files/2022-12/transcript-hearing-day-16-8-december-2022.pdf
RRC (2023a). Transcript of Proceedings for Monday, 20 February 2023. Royal Commission into the Robodebt Scheme, February 2023, at https://robodebt.royalcommission.gov.au/system/files/2023-02/transcript-hearing-day-32-20-february-2023.pdf
RRC (2023b). Transcript of Proceedings for Monday, 2 March 2023. Royal Commission into the Robodebt Scheme, March 2023, at https://robodebt.royalcommission.gov.au/system/files/2023-03/transcript-hearing-day-40-2-march.pdf
SA (2022). A guide to Australian Government payments. Services Australia, at https://www.servicesaustralia.gov.au/sites/default/files/co029-2207.pdf
SCA (2017). Design, scope, cost-benefit analysis, contracts awarded and implementation associated with the Better Management of the Social Welfare System initiative. The Senate Community Affairs References Committee, Australian Parliament House, June 2017, at https://www.aph.gov.au/Parliamentary_Business/Committees/Senate/Community_Affairs/SocialWelfareSystem/Report
SCA (2022). Accountability and justice: Why we need a Royal Commission into Robodebt. Senate Community Affairs References Committee, May 2022, at https://parlinfo.aph.gov.au/parlInfo/download/committees/reportsen/024846/toc_pdf/AccountabilityandjusticeWhyweneedaRoyalCommissionintoRobodebt.pdf;fileType=application%2Fpdf
Trist E.L. (1981). The evolution of socio-technical systems. Ontario Quality of Working Life Centre, Vol. 2, 1981.
TT (2016). Guilty until proven innocent ... Centrelink gone rogue .... Tasmanian Times, 5 December 2016, at https://tasmaniantimes.com/2016/12/guilty-until-proven-innocent-centrelink-gone-rogue/
Twomey, A. (2023). The Coronation, the Commonwealth and government integrity. Round Table (London), vol. 112, no. 4, pp. 367–375.
Venkatraman N. (1994). IT-Enabled Business Transformation: From Automation to Business Scope Redefinition', Sloan Management Review 35,2, (Winter 1994), 73-87.
Von Bertalanffy L. (1950). The theory of open systems in physics and biology', Science, 111, 2872 (1950) 23-29.
Wahlstrom K. & Quirchmayr G. (2008). A Privacy-Enhancing Architecture for Databases. Journal of Research and Practice in Information Technology 40, 3 (August 2008) 151-162, at http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.454.3815&rep=rep1&type=pdf
Walsham G. (1995). Interpretive Case Studies in IS Research: Nature and Method. European Journal of Information Systems 4, 2 (May 1995) 74-81.
Whelan, A (2020). ‘Ask for More Time’: Big Data Chronopolitics in the Australian Welfare Bureaucracy. Critical sociology, vol. 46, no. 6, pp. 867–880.
White, S. (2021). Authorisation and accountability of automated government decisions under Australian Administrative Law. AIAL Forum, no. 102, pp. 84–96.
Whiteford P. (2021). Debt by design: The anatomy of a social policy fiasco – Or was it something worse? Aust. J of Public Admin 80,2 (June 2021) 340-360, at https://onlinelibrary.wiley.com/doi/epdf/10.1111/1467-8500.12479
Whiteford P. (2022). For the poorest 20% of Australian households, social security payments provide more than 70% of their income. John Menadue's Public Policy Journal, 20 May 2022, at https://johnmenadue.com/social-security/
Wong K. (2022). Robodebt scheme told to ‘cease and desist. AAP, 4 November 2022, at https://www.aap.com.au/news/debt-collectors-to-front-royal-commission/
Wright, A. & Ng, Y-F. (2022). Services Australia’s Single Touch Payroll Program: The enduring legacy of Robodebt, or a fundamentally different system?. Public Law Review (North Ryde, N.S.W.), vol. 33, no. 2, pp. 127–142.
Yin R.K. (2017). Case Study Research and Applications: Design and Methods. 6th edition, Sage, 2017.
Zwass V. (2010). Co-creation: Toward a taxonomy and an integrated research perspective. International Journal of Electronic Commerce 15,1 (2010) 11-48.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Roger Clarke, Katina Michael, Roba Abbas
This work is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License.
AJIS publishes open-access articles distributed under the terms of a Creative Commons Non-Commercial and Attribution License which permits non-commercial use, distribution, and reproduction in any medium, provided the original author and AJIS are credited. All other rights including granting permissions beyond those in the above license remain the property of the author(s).
