Search: onr:"swepub:oai:lup.lub.lu.se:876fdff9-0b5a-4717-9c7b-25f73e93d612" >
Benchopt : Reproduc...
Benchopt : Reproducible, efficient and collaborative optimization benchmarks
-
- Moreau, Thomas (author)
- University of Paris-Saclay
-
- Massias, Mathurin (author)
- University of Lyon
-
- Gramfort, Alexandre (author)
- University of Paris-Saclay
-
show more...
-
- Ablin, Pierre (author)
- Paris Dauphine University
-
- Bannier, Pierre Antoine (author)
- University of Paris-Saclay
-
- Charlier, Benjamin (author)
- University of Montpellier
-
- Dagréou, Mathieu (author)
- University of Paris-Saclay
-
- la Tour, Tom Dupré (author)
- University of California, Berkeley
-
- Durif, Ghislain (author)
- University of Montpellier
-
- Dantas, Cassio F. (author)
- University of Montpellier
-
- Klopfenstein, Quentin (author)
- University of Luxembourg
-
- Larsson, Johan (author)
- Lund University,Lunds universitet,Statistiska institutionen,Ekonomihögskolan,Department of Statistics,Lund University School of Economics and Management, LUSEM
-
- Lai, En (author)
- University of Paris-Saclay
-
- Lefort, Tanguy (author)
- The French National Centre for Scientific Research (CNRS)
-
- Malézieux, Benoit (author)
- University of Paris-Saclay
-
- Moufad, Badr (author)
- Ecole Normale Superieure de Lyon
-
- Nguyen, Binh T. (author)
- Télécom Paris
-
- Rakotomamonjy, Alain (author)
- Criteo AI Lab
-
- Ramzi, Zaccharie (author)
- Centre d'Ecologie Fonctionnelle et Evolutive (CEFE)
-
- Salmon, Joseph (author)
- The French National Centre for Scientific Research (CNRS),Institut Universitaire de France
-
- Vaiter, Samuel (author)
- The French National Centre for Scientific Research (CNRS),University of Côte d'Azur
-
Koyejo, S. (editor)
-
Mohamed, S. (editor)
-
Agarwal, A. (editor)
-
Belgrave, D. (editor)
-
Cho, K. (editor)
-
Oh, A. (editor)
-
show less...
-
(creator_code:org_t)
- 2022
- 2022
- English.
-
In: Advances in Neural Information Processing Systems 35 - 36th Conference on Neural Information Processing Systems, NeurIPS 2022. - 1049-5258. - 9781713871088 ; 35, s. 25404-25421
- Related links:
-
https://lup.lub.lu.s...
Abstract
Subject headings
Close
- Numerical validation is at the core of machine learning research as it allows to assess the actual impact of new methods, and to confirm the agreement between theory and practice. Yet, the rapid development of the field poses several challenges: researchers are confronted with a profusion of methods to compare, limited transparency and consensus on best practices, as well as tedious re-implementation work. As a result, validation is often very partial, which can lead to wrong conclusions that slow down the progress of research. We propose Benchopt, a collaborative framework to automate, reproduce and publish optimization benchmarks in machine learning across programming languages and hardware architectures. Benchopt simplifies benchmarking for the community by providing an off-the-shelf tool for running, sharing and extending experiments. To demonstrate its broad usability, we showcase benchmarks on three standard learning tasks: ℓ2-regularized logistic regression, Lasso, and ResNet18 training for image classification. These benchmarks highlight key practical findings that give a more nuanced view of the state-of-the-art for these problems, showing that for practical evaluation, the devil is in the details. We hope that Benchopt will foster collaborative work in the community hence improving the reproducibility of research findings.
Subject headings
- NATURVETENSKAP -- Matematik -- Sannolikhetsteori och statistik (hsv//swe)
- NATURAL SCIENCES -- Mathematics -- Probability Theory and Statistics (hsv//eng)
Keyword
- Logistic regression
- Machine learning
Publication and Content Type
- kon (subject category)
- ref (subject category)
Find in a library
To the university's database
- By the author/editor
-
Moreau, Thomas
-
Massias, Mathuri ...
-
Gramfort, Alexan ...
-
Ablin, Pierre
-
Bannier, Pierre ...
-
Charlier, Benjam ...
-
show more...
-
Dagréou, Mathieu
-
la Tour, Tom Dup ...
-
Durif, Ghislain
-
Dantas, Cassio F ...
-
Klopfenstein, Qu ...
-
Larsson, Johan
-
Lai, En
-
Lefort, Tanguy
-
Malézieux, Benoi ...
-
Moufad, Badr
-
Nguyen, Binh T.
-
Rakotomamonjy, A ...
-
Ramzi, Zaccharie
-
Salmon, Joseph
-
Vaiter, Samuel
-
Koyejo, S.
-
Mohamed, S.
-
Agarwal, A.
-
Belgrave, D.
-
Cho, K.
-
Oh, A.
-
show less...
- About the subject
-
- NATURAL SCIENCES
-
NATURAL SCIENCES
-
and Mathematics
-
and Probability Theo ...
- Articles in the publication
-
Advances in Neur ...
- By the university
-
Lund University