근골격 모델과 참조 모션을 이용한 이족보행 강화학습

Reinforcement Learning of Bipedal Walking with Musculoskeletal Models and Reference Motions

초록

In this paper, we introduce a method to obtain high-quality results at a low cost for simulating musculoskeletal characters based on data from the reference motion through motion capture on two-legged walking through reinforcement learning. We reset the motion data of the reference motion to allow the character model to perform, and then train the corresponding motion to be learned through reinforcement learning. We combine motion imitation of the reference model with minimal metabolic energy for the muscles to learn to allow the musculoskeletal model to perform two-legged walking in the desired direction. In this way, the musculoskeletal model can learn at a lower cost than conventional manually designed controllers and perform high-quality bipedal walking.

키워드

musculoskeletal modeltwo-legged walkingmetabolic energymotion imitationreinforcement learning근골격 모델이족보행메타볼릭 에너지모션 모방강화학습
제목
근골격 모델과 참조 모션을 이용한 이족보행 강화학습
제목 (타언어)
Reinforcement Learning of Bipedal Walking with Musculoskeletal Models and Reference Motions
저자
전지웅권태수
DOI
10.15701/kcgs.2022.29.1.23
발행일
2023-03
저널명
한국컴퓨터그래픽스학회논문지
29
1
페이지
23 ~ 29