Publications

  • Publications
  • A Legal Framework for Artificial Intelligence Fairness Reporting

A Legal Framework for Artificial Intelligence Fairness Reporting

Year of Publication: 2022
Month of Publication: 11
Author(s): Ernest Lim and Yap Jia Qing
Research Area(s): Information Technology and the Law
Journal Name: The Cambridge Law Journal
Volume Number: 81
Issue Number: 3
Abstract:

Clear understanding of artificial intelligence (AI) usage risks and how they are being addressed is needed, which require proper and adequate corporate disclosure. We advance a legal framework for AI Fairness Reporting to which companies can and should adhere on a comply-or-explain basis. We analyse the sources of unfairness arising from different aspects of AI models and the disparities in the performance of machine learning systems. We evaluate how the machine learning literature has sought to address the problem of unfairness through the use of different fairness metrics. We then put forward a nuanced and viable framework for AI Fairness Reporting comprising: (1) disclosure of all machine learning models usage; (2) disclosure of fairness metrics used and the ensuing trade-offs; (3) disclosure of de-biasing methods used; and (d) release of datasets for public inspection or for third-party audit. We then apply this reporting framework to two case studies.