ΑΙhub.org
 

Bug bounties for algorithmic harms? – a report from the Algorithmic Justice League

by
09 February 2022



share this:

bug bountiesImage from the report “Bug bounties for algorithmic harms?” Credit: AJL.

Researchers from the Algorithmic Justice League (AJL) have released a report which takes a detailed look at bug bounty programmes (BBPs) and how these could be used to address various kinds of socio-technical problems, including algorithmic harm.

BBPs are mechanisms that incentivize hackers to identify and report cybersecurity vulnerabilities. Hundreds of companies and organizations regularly use BBPs to buy security flaws from hackers. Now, BBPs have been adopted to address a wider spectrum of socio-technical harms and risks beyond security bugs.

However, as report authors Josh Kenway, Camille François, Sasha Costanza-Chock, Inioluwa Deborah Raji, and Joy Buolamwini note, the conditions under which BBPs might constitute appropriate mechanisms for addressing socio-technical concerns remain relatively unexamined.

To compile their report the authors held interviews with BBP experts and practitioners, they reviewed the existing literature, and they analysed historical and present-day approaches to vulnerability disclosure. There were three main lines of enquiry for the team. They considered how BBPs might be used to:

  • Foster and nurture participation and community among researchers
  • Shape field development by fostering the development of resources and methods
  • Drive transparency and accountability across the industry

The five key takeaways from the report are as follows:

  1. Prepare to include socio-technical concerns. Only a few companies/organisations have expanded their current programs to include socio-technical issues, and no clear best-practices have emerged. The report provides recommendations for how to shape BBPs for algorithmic harm discovery and mitigation.
  2. Look across the lifecycle. Bug bounties are just one tool for enhancing cybersecurity. Likewise, BBPs for algorithmic harm will need to be accompanied by other mechanisms in order to assess and act on reports of such harms.
  3. Nurture the community of practice. There is a sense of community within bug bounty platforms with organisations and members sharing educational materials, resources and tools. The authors caution against approaches that exclude those from fields outside of computer science
  4. Intentionally develop a diverse, inclusive community. Successfully deploying BBPs for algorithmic harms will require serious effort to recruit and retain diverse communities of researchers and community advocates, and to ensure fair compensation for work.
  5. Foster and protect participatory, adversarial research, and guarantee some form of public disclosure. Greater protection for third-party algorithmic harms research is needed.

You can find the full pdf version of the report here. This includes more background information, findings and recommendations pertaining to the five key takeaways, interviews with experts, and a case study of Twitter’s recent bias bounty pilot.

Report citation

Kenway, Josh, Camille François, Sasha Costanza-Chock, Inioluwa Deborah Raji, and Joy Buolamwini. Bug Bounties For Algorithmic Harms? Lessons from Cybersecurity Vulnerability Disclosure for Algorithmic Harms Discovery, Disclosure, and Redress. Washington, DC: Algorithmic Justice League. January 2022. Available at https://ajl.org/bugs.




Lucy Smith , Managing Editor for AIhub.
Lucy Smith , Managing Editor for AIhub.




            AIhub is supported by:


Related posts :



Should I use offline RL or imitation learning?

In this blog post, we aim to understand if, when and why offline RL is a better approach for tackling a variety of sequential decision-making problems.
17 May 2022, by

Watch the sessions from AI UK

The recordings of the sessions from the AI UK conference are now available for all to watch.
16 May 2022, by

Launch of a new standard for AI security in Singapore

The standard aims to guide AI practitioners in dealing with malicious attacks on AI systems.

Using deep learning to predict physical interactions of protein complexes

A computational tool developed to predict the structure of protein complexes is providing new insights into the biomolecular mechanisms of their function.
podcast

New voices in AI: human-AI collaboration, with Nicolo' Brandizzi

We talk to Nicolo' Brandizzi about his work on human-AI collaboration.
11 May 2022, by

ACM SIGAI Industry Award 2022 nominations

Find out how you can make a nomination for the ACM SIGAI Industry Award - deadline 31 May 2022.
10 May 2022, by





©2021 - Association for the Understanding of Artificial Intelligence


 












©2021 - ROBOTS Association