In reinforcement learning, an agent interacts with its environment to act according to a policy in accordance with the observation state; these are executed based on a class of neural networks. In the interaction between states and actions, the series of decision sequences are often described...