With the advent of the era of artificial intelligence, deep reinforcement learning has achieved unprecedented success in high-dimensional and large-scale artificial intelligence tasks. However, the insecurity and instability of the DRL algorithm have an important impact on its performance. The Soft Actor-Critic algorithm uses advanced functions to update the policy and value network to alleviate some of these problems. However, SAC still has some problems. In order to reduce the error caused by the overestimation of SAC, we propose a new (...) SAC algorithm called Averaged-SAC. By averaging the previously learned action-state estimates, it reduces the overestimation problem of soft Q-learning, thereby contributing to a more stable training process and improving performance. We evaluate the performance of Averaged-SAC through some games in the MuJoCo environment. The experimental results show that the Averaged-SAC algorithm effectively improves the performance of the SAC algorithm and the stability of the training process. (shrink)

ObjectiveTo explore the relations among perceived stress, fatigue, sleepiness, and the pathway of their effects on the ambulatory arterial stiffness index among medical staff.MethodsThis cross-sectional study was conducted at a tertiary hospital in Wuhan, China. Perceived stress, fatigue, and sleepiness were measured using the perceived stress scale, Fatigue assessment scale, and Epworth Sleepiness Scale, respectively. AASI was obtained from 24-h ambulatory blood pressure monitoring. Path analysis was used to clarify the relations among the PSS, FAS, and ESS scores, and their (...) relations to AASI values.ResultsA total of 153 participants were included herein. The PSS and FAS correlated with the ESS, and the PSS correlated with the FAS. In addition, the ESS correlated with the AASI. According to the path analysis results, the PSS and FAS had no direct effect on the AASI, but did have an indirect effect on this index by influencing the ESS.ConclusionSleepiness was a mediator of the effects of perceived stress and fatigue on AASI. (shrink)