MixMatch
Mixmatch: A holistic approach to semi-supervised learning. Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled data to mitigate the reliance on large labeled datasets. In this work, we unify the current dominant approaches for semi-supervised learning to produce a new algorithm, MixMatch, that works by guessing low-entropy labels for data-augmented unlabeled examples and mixing labeled and unlabeled data using MixUp. We show that MixMatch obtains state-of-the-art results by a large margin across many datasets and labeled data amounts. For example, on CIFAR-10 with 250 labels, we reduce error rate by a factor of 4 (from 38% to 11%) and by a factor of 2 on STL-10. We also demonstrate how MixMatch can help achieve a dramatically better accuracy-privacy trade-off for differential privacy. Finally, we perform an ablation study to tease apart which components of MixMatch are most important for its success.
Keywords for this software
References in zbMATH (referenced in 6 articles )
Showing results 1 to 6 of 6.
Sorted by year (- Lang, Rongling; Fan, Ya; Liu, Guoliang; Liu, Guodong: Analysis of unlabeled lung sound samples using semi-supervised convolutional neural networks (2021)
- Liang, Jiye; Cui, Junbiao; Wang, Jie; Wei, Wei: Graph-based semi-supervised learning via improving the quality of the graph dynamically (2021)
- Wang, Kun; Sun, WaiChing; Du, Qiang: A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks (2021)
- Ahfock, Daniel; McLachlan, Geoffrey J.: An apparent paradox: a classifier based on a partially classified sample may have smaller expected error rate than that if the sample were completely classified (2020)
- Kihyuk Sohn, David Berthelot, Chun-Liang Li, Zizhao Zhang, Nicholas Carlini, Ekin D. Cubuk, Alex Kurakin, Han Zhang, Colin Raffel: FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence (2020) arXiv
- van Engelen, Jesper E.; Hoos, Holger H.: A survey on semi-supervised learning (2020)