Quantum error correction for the toric code using deep reinforcement learning

Andreasson, PhilipGothenburg University,Göteborgs universitet,Institutionen för fysik (GU),Department of Physics (GU) (author)

2019-09-02
Verein zur Forderung des Open Access Publizierens in den Quantenwissenschaften,2019

We implement a quantum error correction algorithm for bit-flip errors on the topological toric code using deep reinforcement learning. An action-value Q-function encodes the discounted value of moving a defect to a neighboring site on the square grid (the action) depending on the full set of defects on the torus (the syndrome or state). The Q-function is represented by a deep convolutional neural network. Using the translational invariance on the torus allows for viewing each defect from a central perspective which significantly simplifies the state space representation independently of the number of defect pairs. The training is done using experience replay, where data from the algorithm being played out is stored and used for mini-batch upgrade of the Q-network. We find performance which is close to, and for small error rates asymptotically equivalent to, that achieved by the Minimum Weight Perfect Matching algorithm for code distances up to d=7. Our results show that it is possible for a self-trained agent without supervision or support algorithms to find a decoding scheme that performs on par with hand-made algorithms, opening up for future machine engineered decoders for more general error models and error correcting codes.

Johansson, JoelGothenburg University,Göteborgs universitet,Institutionen för fysik (GU),Department of Physics (GU) (author)
Liljestrand, SimonGothenburg University,Göteborgs universitet,Institutionen för fysik (GU),Department of Physics (GU) (author)
Granath, Mats,1972Gothenburg University,Göteborgs universitet,Institutionen för fysik (GU),Department of Physics (GU)(Swepub:gu)xgranm (author)
Göteborgs universitetInstitutionen för fysik (GU) (creator_code:org_t)

In:Quantum: Verein zur Forderung des Open Access Publizierens in den Quantenwissenschaften32521-327X

By the author/editor: Andreasson, Phil ...; Johansson, Joel; Liljestrand, Sim ...; Granath, Mats, 1 ...

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Physical Science ...; and Condensed Matter ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.