Sökning: id:"swepub:oai:DiVA.org:kth-324937" >
Neuromorphic Vision...
Neuromorphic Vision-Based Fall Localization in Event Streams with Temporal-Spatial Attention Weighted Network
-
- Chen, G. (författare)
- School of Automotive Studies and School of Electronic and Information Engineering, Tongji University, Shanghai, China
-
- Qu, S. (författare)
- School of Automotive Studies and School of Electronic and Information Engineering, Tongji University, Shanghai, China
-
- Li, Z. (författare)
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China; Department of Automation, University of Science and Technology of China, Hefei, China
-
visa fler...
-
- Zhu, H. (författare)
- School of Automotive Studies and School of Electronic and Information Engineering, Tongji University, Shanghai, China
-
- Dong, J. (författare)
- School of Automotive Studies and School of Electronic and Information Engineering, Tongji University, Shanghai, China
-
- Liu, M. (författare)
- Author image of Min Liu Min Liu Institute of Neuroinformatics, University of Zurich, Zürich, Switzerland; Department of Information Technology and Electrical Engineering, ETH Zurich, Zürich, Switzerland
-
- Conradt, Jörg (författare)
- KTH,Beräkningsvetenskap och beräkningsteknik (CST)
-
visa färre...
-
(creator_code:org_t)
- Institute of Electrical and Electronics Engineers (IEEE), 2022
- 2022
- Engelska.
-
Ingår i: IEEE Transactions on Cybernetics. - : Institute of Electrical and Electronics Engineers (IEEE). - 2168-2267 .- 2168-2275. ; 52:9, s. 9251-9262
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- Falling down is a serious problem for health and has become one of the major etiologies of accidental death for the elderly living alone. In recent years, many efforts have been paid to fall recognition based on wearable sensors or standard vision sensors. However, the prior methods have the risk of privacy leaks, and almost all these methods are based on video clips, which cannot localize where the falls occurred in long videos. For these reasons, in this article, the bioinspired vision sensor-based falls temporal localization framework is proposed. The bioinspired vision sensors, such as dynamic and active-pixel vision sensor (DAVIS) camera applied in this work responds to pixels' brightness change, and each pixel works independently and asynchronously compared to the standard vision sensors. This property makes it have a very high dynamic range and privacy preserving. First, to better represent event data, compared with the typical constant temporal window mechanism, an adaptive temporal window conversion mechanism is developed. The temporal localization framework follows a proven proposal and classification paradigm. Second, for the high-efficient and recall proposal generation, different from the traditional sliding window scheme, the event temporal density as the actionness score is set and the 1D-watershed algorithm to generate proposals is applied. In addition, we combine the temporal and spatial attention mechanism with our feature extraction network to temporally model the falls. Finally, to evaluate the performance of our framework, 30 volunteers are recruited to join the simulated fall experiments. According to the results of experiments, our framework can realize precise falls temporal localization and achieve the state-of-the-art performance.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datorseende och robotik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Vision and Robotics (hsv//eng)
Nyckelord
- Bioinspired vision
- falls temporal localization
- privacy-preserving
- Cameras
- Computer vision
- Dynamics
- Extraction
- Feature extraction
- Privacy-preserving techniques
- Wearable sensors
- Bio-inspired vision
- Fall temporal localization
- Features extraction
- Location awareness
- Older adults
- Privacy preserving
- Proposal
- Spatial attention
- Temporal localization
- Vision sensors
- Pixels
- aged
- algorithm
- falling
- human
- prevention and control
- Accidental Falls
- Algorithms
- Humans
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas