Sökning: WFRF:(Nowaczyk Sławomir 1978 ) >
Evolving intelligence : Overcoming challenges for Evolutionary Deep Learning
-
- Altarabichi, Mohammed Ghaith, 1981- (författare)
- Högskolan i Halmstad,Akademin för informationsteknologi
-
- Nowaczyk, Sławomir, Professor, 1978- (preses)
- Högskolan i Halmstad,Akademin för informationsteknologi
-
- Pashami, Sepideh, Associate Professor, 1985- (preses)
- Högskolan i Halmstad,Akademin för informationsteknologi
-
visa fler...
-
- Sheikholharam Mashhadi, Peyman, Senior Lecturer, 1982- (preses)
- Högskolan i Halmstad,Akademin för informationsteknologi
-
- Lavesson, Niklas, Professor, 1985- (opponent)
- Blekinge Institute of Technology, Karlskrona, Sweden
-
visa färre...
-
(creator_code:org_t)
- ISBN 9789189587311
- Halmstad : Halmstad University Press, 2024
- Engelska 32 s.
-
Serie: Halmstad University Dissertations ; 109
- Relaterad länk:
-
https://hh.diva-port... (primary) (Raw object)
-
visa fler...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- Deep Learning (DL) has achieved remarkable results in both academic and industrial fields over the last few years. However, DL models are often hard to design and require proper selection of features and tuning of hyper-parameters to achieve high performance. These selections are tedious for human experts and require substantial time and resources. A difficulty that encouraged a growing number of researchers to use Evolutionary Computation (EC) algorithms to optimize Deep Neural Networks (DNN); a research branch called Evolutionary Deep Learning (EDL).This thesis is a two-fold exploration within the domains of EDL, and more broadly Evolutionary Machine Learning (EML). The first goal is to makeEDL/EML algorithms more practical by reducing the high computational costassociated with EC methods. In particular, we have proposed methods to alleviate the computation burden using approximate models. We show that surrogate-models can speed up EC methods by three times without compromising the quality of the final solutions. Our surrogate-assisted approach allows EC methods to scale better for both, expensive learning algorithms and large datasets with over 100K instances. Our second objective is to leverage EC methods for advancing our understanding of Deep Neural Network (DNN) design. We identify a knowledge gap in DL algorithms and introduce an EC algorithm precisely designed to optimize this uncharted aspect of DL design. Our analytical focus revolves around revealing avant-garde concepts and acquiring novel insights. In our study of randomness techniques in DNN, we offer insights into the design and training of more robust and generalizable neural networks. We also propose, in another study, a novel survival regression loss function discovered based on evolutionary search.
Ämnesord
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Datorsystem (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Computer Systems (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Signalbehandling (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Signal Processing (hsv//eng)
Nyckelord
- neural networks
- evolutionary deep learning
- evolutionary machine learning
- feature selection
- hyperparameter optimization
- evolutionary computation
- particle swarm optimization
- genetic algorithm
Publikations- och innehållstyp
- vet (ämneskategori)
- dok (ämneskategori)