2015
DOI: 10.1109/tsmc.2015.2418321
|View full text |Cite
|
Sign up to set email alerts
|

Learning to Adjust and Refine Gait Patterns for a Biped Robot

Abstract: In this paper, a reinforced learning method for biped walking is proposed, where the robot learns to appropriately modulate an observed walking pattern. The biped robot was equipped with two Q-learning mechanisms. First, the robot learns a policy to adjust a defective walking pattern, gait-by-gait, into a more stable one. To avoid the complexity of adjusting too many joints of a humanoid robot and to speed up the learning process, the dimensionality of the action space was reduced. In turn, the other learning … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
2

Citation Types

0
12
0

Year Published

2016
2016
2023
2023

Publication Types

Select...
8

Relationship

1
7

Authors

Journals

citations
Cited by 28 publications
(12 citation statements)
references
References 16 publications
0
12
0
Order By: Relevance
“…Nowadays, intelligent robot application areas expand into every walk of life such as the biped robots, [1][2][3] unmanned aerial vehicles, [4][5][6] mobile robots, 7 and so on. Among them, the researches on mobile robots always play an important role complying with their better stability.…”
Section: Introductionmentioning
confidence: 99%
“…Nowadays, intelligent robot application areas expand into every walk of life such as the biped robots, [1][2][3] unmanned aerial vehicles, [4][5][6] mobile robots, 7 and so on. Among them, the researches on mobile robots always play an important role complying with their better stability.…”
Section: Introductionmentioning
confidence: 99%
“…The concept of stability, which defines the type of walking, is divided into two categories, as follows: Static stability: the projection of the COM onto the walking plane must always lie within the support polygon. Thus, the COM is always vertically aligned to the area of the robot's stance foot, and is calculated by: pxCOM=1Mtruei=1Nmmixi,2em pyCOM=1Mtruei=1Nmmiyi,2em pzCOM=1Mtruei=1Nmmizi.2em Dynamic stability: The ZMP must always lie within the area of the stance foot, and its coordinates can be calculated as, considering support at pz =0: pxZMP=pxCOMprefix−truepx¨COMpzCOMtruepz¨COM+g,2em …”
Section: Case Study Of the Proposed Control Designmentioning
confidence: 99%
“…Strategies based on dynamically stable walking allow the projection of the COM to be outside the support polygon if the ZMP lies within the support area. Thus, dynamic stability might be less restrictive for trajectory generation …”
Section: Case Study Of the Proposed Control Designmentioning
confidence: 99%
“…The angle at each joint can be calculated and rotated to simulate the straightforward gait pattern. Furthermore, some studies were developed to adjust the poses [26] of the humanoid robot in order to speed up the learning process. The robot poses are formed by a set of gait patterns to avoid the complex adjustment of multiple joints and to further implement the straightforward gait pattern.…”
Section: Introductionmentioning
confidence: 99%