ΑΙhub.org
 

#ICML2022 Test of Time award announced


by
20 July 2022



share this:
winners' medal

The International Conference on Machine Learning (ICML) Test of Time award is given to a paper from ICML ten years ago that has had significant impact. This year the award goes to:

Poisoning Attacks against Support Vector Machines
Battista Biggio, Blaine Nelson and Pavel Laskov

The paper investigates adversarial machine learning and, specifically, poisoning attacks on support vector machines (SVMs). The awards committee noted that this paper is one of the earliest and most impactful papers on the theme of poisoning attacks, which are now widely studied by the community. The authors use a gradient ascent strategy in which the gradient is computed based on properties of the SVM’s optimal solution. The method can be kernelized, thereby not needing explicit feature representation. The committee judged that this paper initiated thorough investigation of the problem and inspired significant subsequent work.

The abstract of the paper:
We investigate a family of poisoning attacks against Support Vector Machines (SVM). Such attacks inject specially crafted training data that increases the SVM’s test error. Central to the motivation for these attacks is the fact that most learning algorithms assume that their training data comes from a natural or well-behaved distribution. However, this assumption does not generally hold in security-sensitive settings. As we demonstrate, an intelligent adversary can, to some extent, predict the change of the SVM’s decision function due to malicious input and use this ability to construct malicious data. The proposed attack uses a gradient ascent strategy in which the gradient is computed based on properties of the SVM’s optimal solution. This method can be kernelized and enables the attack to be constructed in the input space even for non-linear kernels. We experimentally demonstrate that our gradient ascent procedure reliably identifies good local maxima of the non-convex validation error surface, which significantly increases the classifier’s test error.

You can read the paper in full here.

In a special award session, first author Battista Biggio gave a plenary talk describing the research, and subsequent developments. In the early days of this research field (around 2006-2010) work on poisoning attacks focussed on simple models and concerned security-related applications, such as spam filtering and network intrusion detection. The challenge that the authors set themselves with this work was to find out if these attacks were possible against a more complex classifier, and something closer to the state-of-the-art. They decided to study SVMs because they were theoretically grounded and quite popular at the time. Their strategy was to find an optimal attack point (to inject the “poisoned” samples) that maximised the classification error.

Battista also spoke about some of the work that has followed in this space, including adversarial examples for deep neural networks, machine learning security, and different types of attacks against machine learning models.

You can watch Battista’s original talk on this paper, at ICML 2012.

There were also two Test of Time honourable mentions:

  • Building high-level features using large scale unsupervised learning
    Quoc Le, Marc’Aurelio Ranzato, Rajat Monga, Matthieu Devin, Kai Chen, Greg Corrado, Jeff Dean, Andrew Ng
    Read the paper here.
  • On causal and anticausal learning
    Bernhard Schölkopf, Dominik Janzing, Jonas Peters, Eleni Sgouritsa, Kun Zhang, Joris Mooij
    Read the paper here.


tags: ,


Lucy Smith is Senior Managing Editor for AIhub.
Lucy Smith is Senior Managing Editor for AIhub.




            AIhub is supported by:


Related posts :



Interview with Eden Hartman: Investigating social choice problems

  24 Apr 2025
Find out more about research presented at AAAI 2025.

The Machine Ethics podcast: Co-design with Pinar Guvenc

This episode, Ben chats to Pinar Guvenc about co-design, whether AI ready for society and society is ready for AI, what design is, co-creation with AI as a stakeholder, bias in design, small language models, and more.

Why AI can’t take over creative writing

  22 Apr 2025
A large language model tries to generate what a random person who had produced the previous text would produce.

Interview with Amina Mević: Machine learning applied to semiconductor manufacturing

  17 Apr 2025
Find out how Amina is using machine learning to develop an explainable multi-output virtual metrology system.

Images of AI – between fiction and function

“The currently pervasive images of AI make us look somewhere, at the cost of somewhere else.”

Grace Wahba awarded the 2025 International Prize in Statistics

  16 Apr 2025
Her contributions laid the foundation for modern statistical techniques that power machine learning algorithms such as gradient boosting and neural networks.

Repurposing protein folding models for generation with latent diffusion

  14 Apr 2025
The awarding of the 2024 Nobel Prize to AlphaFold2 marks an important moment of recognition for the of AI role in biology. What comes next after protein folding?




AIhub is supported by:






©2024 - Association for the Understanding of Artificial Intelligence


 












©2021 - ROBOTS Association