SwePub
Sök i SwePub databas

  Utökad sökning

Träfflista för sökning "WFRF:(Stork J) srt2:(2020-2023)"

Sökning: WFRF:(Stork J) > (2020-2023)

  • Resultat 1-8 av 8
Sortera/gruppera träfflistan
   
NumreringReferensOmslagsbildHitta
1.
  •  
2.
  •  
3.
  •  
4.
  •  
5.
  •  
6.
  • Isac, Arnekvist, et al. (författare)
  • The effect of Target Normalization and Momentum on Dying ReLU
  • 2020
  • Ingår i: The 32nd annual workshop of the Swedish Artificial Intelligence Society (SAIS).
  • Konferensbidrag (refereegranskat)abstract
    • Optimizing parameters with momentum, normalizing data values, and using rectified linear units (ReLUs) are popular choices in neural network (NN) regression. Although ReLUs are popular, they can collapse to a constant function and" die", effectively removing their contribution from the model. While some mitigations are known, the underlying reasons of ReLUs dying during optimization are currently poorly understood. In this paper, we consider the effects of target normalization and momentum on dying ReLUs. We find empirically that unit variance targets are well motivated and that ReLUs die more easily, when target variance approaches zero. To further investigate this matter, we analyze a discrete-time linear autonomous system, and show theoretically how this relates to a model with a single ReLU and how common properties can result in dying ReLU. We also analyze the gradients of a single-ReLU model to identify saddle points and regions corresponding to dying ReLU and how parameters evolve into these regions when momentum is used. Finally, we show empirically that this problem persist, and is aggravated, for deeper models including residual networks.
  •  
7.
  •  
8.
  • Paolini, Lucia, et al. (författare)
  • Large-scale production of extracellular vesicles: Report on the “massivEVs” ISEV workshop
  • 2022
  • Ingår i: Journal of Extracellular Biology. - : Wiley. - 2768-2811. ; 1:10
  • Tidskriftsartikel (refereegranskat)abstract
    • Extracellular vesicles (EVs) large-scale production is a crucial point for the translation of EVs from discovery to application of EV-based products. In October 2021, the International Society for Extracellular Vesicles (ISEV), along with support by the FET-OPEN projects, “The Extracellular Vesicle Foundry” (evFOUNDRY) and “Extracellular vesicles from a natural source for tailor-made nanomaterials” (VES4US), organized a workshop entitled “massivEVs” to discuss the potential challenges for translation of EV-based products. This report gives an overview of the topics discussed during “massivEVs”, the most important points raised, and the points of consensus reached after discussion among academia and industry representatives. Overall, the review of the existing EV manufacturing, upscaling challenges and directions for their resolution highlighted in the workshop painted an optimistic future for the expanding EV field.
  •  
Skapa referenser, mejla, bekava och länka
  • Resultat 1-8 av 8

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.

 
pil uppåt Stäng

Kopiera och spara länken för att återkomma till aktuell vy