Search: onr:"swepub:oai:DiVA.org:kth-323022" >
Neural Greedy Pursu...
Neural Greedy Pursuit for Feature Selection
-
- Das, Sandipan (author)
- KTH,Teknisk informationsvetenskap
-
- Javid, Alireza M. (author)
- KTH,Teknisk informationsvetenskap
-
- Borpatra Gohain, Prakash (author)
- KTH,Teknisk informationsvetenskap
-
show more...
-
- Eldar, Yonina C. (author)
- Weizmann Inst Sci, Math & Comp Sci, Rehovot, Israel.
-
- Chatterjee, Saikat (author)
- KTH,Teknisk informationsvetenskap
-
show less...
-
(creator_code:org_t)
- Institute of Electrical and Electronics Engineers (IEEE), 2022
- 2022
- English.
-
In: 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN). - : Institute of Electrical and Electronics Engineers (IEEE).
- Related links:
-
https://urn.kb.se/re...
-
show more...
-
https://doi.org/10.1...
-
show less...
Abstract
Subject headings
Close
- We propose a greedy algorithm to select N important features among P input features for a non-linear prediction problem. The features are selected one by one sequentially, in an iterative loss minimization procedure. We use neural networks as predictors in the algorithm to compute the loss and hence, we refer to our method as neural greedy pursuit (NGP). NGP is efficient in selecting N features when N << P, and it provides a notion of feature importance in a descending order following the sequential selection procedure. We experimentally show that NGP provides better performance than several feature selection methods such as DeepLIFT and Drop-one-out loss. In addition, we experimentally show a phase transition behavior in which perfect selection of all N features without false positives is possible when the training data size exceeds a threshold.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
Keyword
- Feature selection
- Deep learning
Publication and Content Type
- ref (subject category)
- kon (subject category)
To the university's database