Sökning: WFRF:(Mårtensson Karl) >
Reinforcement Learn...
Reinforcement Learning Based Approach for Flip Attack Detection
-
- Liu, Hanxiao (författare)
- KTH,Skolan för elektroteknik och datavetenskap (EECS),School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore
-
- Li, Yuchao (författare)
- KTH,Reglerteknik
-
- Mårtensson, Jonas, 1976- (författare)
- KTH,Reglerteknik
-
visa fler...
-
Xie, Lihua (författare)
-
- Johansson, Karl H., 1967- (författare)
- KTH,Reglerteknik
-
visa färre...
-
(creator_code:org_t)
- Institute of Electrical and Electronics Engineers Inc. 2020
- 2020
- Engelska.
-
Ingår i: Proceedings of the IEEE Conference on Decision and Control. - : Institute of Electrical and Electronics Engineers Inc.. ; , s. 3212-3217
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- This paper addresses the detection problem of flip attacks to sensor network systems where the attacker flips the distribution of manipulated sensor measurements of a binary state. The detector decides to continue taking observations or to stop based on the sensor measurements, and the goal is to have the flip attack recognized as fast as possible while trying to avoid terminating the measurements when no attack is present. The detection problem can be modeled as a partially observable Markov decision process (POMDP) by assuming an attack probability, with the dynamics of the hidden states of the POMDP characterized by a stochastic shortest path (SSP) problem. The optimal policy of the SSP solely depends on the transition costs and is independent of the assumed attack possibility. By using a fixed-length window and suitable feature function of the measurements, a Markov decision process (MDP) is used to approximate the behavior of the POMDP. The optimal solution of the approximated MDP can then be solved by any standard reinforcement learning methods. Numerical evaluations demonstrates the effectiveness of the method.
Ämnesord
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Reglerteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Control Engineering (hsv//eng)
Nyckelord
- Learning systems
- Markov processes
- Numerical methods
- Sensor networks
- Stochastic systems
- Detection problems
- Markov Decision Processes
- Optimal solutions
- Partially observable Markov decision process
- Reinforcement learning method
- Sensor measurements
- Sensor network systems
- Stochastic shortest paths
- Reinforcement learning
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)