Model-free Reinforcement Learning-based Locomotion for Bipedal Robot

Honghao Liao

VsisLab, Shandong University, China

202214818@mail.sdu.edu.cn

Project Duration: 2023.03 - 2023.12

Project Introduction

In this project, we developed a series of locomotion controllers for the bipedal robot XR4 in Mujoco using model-free reinforcement learning. These locomotion controllers enable XR4 to walk and run on different terrains, as well as demonstrate agile football dribbling skills.

Demonstrations

Step in Place

Demonstration of basic locomotion ability of a bipedal robot - stepping in place.

Walk in Different Terrains

Demonstrations of neural network locomotion policy that can adapt to different terrains. The forward walking speed of the bipedal robot is set to a fixed 1 m/s.

walk forward in hill field terrain.
walk forward in pyraimd terrain.
walk forward in step stone terrain.

Run

Demonstrations of natural forward running ability.

run forward at 2m/s.
run forward at 3m/s.

Football Dribble

Demonstrations of a continuous football dribbling task combining locomotion ability and simple object interaction.

agile football dribble video 1.
agile football dribble video 2.