A visual path-following learning approach for industrial robots using DRL

Maldonado-Ramirez, Alan; Rios‐Cabrera, Reyes; López-Juárez, Ismael

doi:10.1016/j.rcim.2021.102130

Cited by 31 publications

(10 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similarly, using techniques such as Machine-to-Machine (M-2-M) and intelligent robots as applications from the KUKA company. Robot-based KUKA system technology for machine tool automation is used, among other things, for the loading and unloading of machines and supports elements of Industries 4.0 [47]. In the KUKA's site in Augsburg, work 7 robots, which is a typical production environment at an international machine manufacturer [48].…”

Section: Applications Of Fourth Industrial Revolutionmentioning

confidence: 99%

Industry 4.0 and Its Implications: Concept, Opportunities, and Future Directions

Abdelmajied¹

2022

Supply Chain - Recent Advances and New Perspectives in the Industry 4.0 Era

View full text Add to dashboard Cite

This chapter aims to analyze the Industry 4.0 framework, identify the definition and drivers of the Industry 4.0 paradigm, discuss its potential effect, and determine obstacles of the Industry 4.0. For the research methodology, a critical literature review is performed, we relied on the recent studies related to industry 4.0. Findings – This study concluded that Industry 4.0 describes a future production system’s vision; it is an inevitable revolution and radical change, covering a wide range of innovative technologies, and all sectors. Industry 4.0 brings significant advantages to organizations, including real-time data analysis, increased visibility, autonomous monitoring, enhanced productivity, and competitiveness. The key features of Industry 4.0 are collaboration and integration of schemes, both horizontal and vertical. Innovation performs an essential role in organizations, sectors, countries. Industry 4.0 has enormous potential effect in many areas, and its application will have an impact across transforming the work environment. Industry 4.0 leads to potentials in three dimensions of sustainability. The KUKA corporation is an application for industry 4.0, for instance, smart factories, M-2-M, intelligent robots, etc., these technologies help industry 4.0 to separate rapidly. In contrast, there are some barriers, to implementing Industry 4.0 for example financial constraints, technical competency, organizational restraints.

show abstract

Section: Applications Of Fourth Industrial Revolutionmentioning

confidence: 99%

Industry 4.0 and Its Implications: Concept, Opportunities, and Future Directions

Abdelmajied¹

2022

Supply Chain - Recent Advances and New Perspectives in the Industry 4.0 Era

View full text Add to dashboard Cite

show abstract

“…Reference [10] experimentally investigated the 34 influence of different relative plate lengths and spacing of 35 twin-plate breakwater when encountering incident waves 36 with different wave heights. Reference [15] carried out 37 an experiment about some characteristics on the inter-38 action between the submerged plate and regular waves, 39 which proved that submerged plate is of greater wave dissipation performance than a submerged rectangular step.…”

Section: Introductionmentioning

confidence: 99%

“…In a relatively short period of time, DRL has grown considerably, from which many methods and tricks are proposed [32], [33], [34]. Moreover, the appearance of AlphaGo [35] caused the craze about DRL, after which DRL has been applied to solve specific tasks with great efficiency such as traffic control [36], [37], robot control [38], [39], Unmanned Aerial Vehicle (UAV) trajectory planning [40], [41], etc.…”

Section: Introductionmentioning

confidence: 99%

A Model Coupling CFD and DRL: Investigation on Wave Dissipation by Actively Controlled Flat Plate

et al. 2022

View full text Add to dashboard Cite

In order to protect structures along the offshore and off the coast, breakwaters are commonly applied to reduce the influence of waves. Flat plate breakwater is studied frequently due to its great performance near the water surface, however, traditional passive methods such as fixed and floating flat plate breakwaters usually fail to give full play of effective wave dissipation when encountering variable unknown incoming waves. Therefore, this paper develops an interdisciplinary model coupling computational fluid dynamics (CFD) and deep reinforcement learning (DRL) to study the wave dissipation of a submerged movable flat plate breakwater against regular waves. An in-house numerical wave tank (NWT) is built to simulate the fluid-structure interaction between the plate and regular waves. The fluid domain in NWT is regarded as environment while the flat plate breakwater is agent. In addition, the wave dissipation strategy is learned by the artificial neural network (ANN) through the continuous wave-plate interaction. It is excited to find that the coupling model is able to learn the control strategies automatically and exhibits good adaptability to the changes of environment. 13 14 INDEX TERMS Wave dissipation, deep reinforcement learning, flat plate breakwater, active controlling, CFD and DRL. culated, of which the results showed that a suitable geo-49 metrical porosity of the upper plate leads to a low level of 50 uplift wave forces on both plates. Reference [17] investi-51 gated the flow field passing over a submerged horizontal 52 flat plate by means of a free surface potential flow model, 53 a form discretized by the Boundary Element Method (BEM), 54 from which the wave dissipation mechanism of a plate-55 type breakwater and the influence of plate thickness, length 56 and submergence was concluded. Reference [18] presented 57 an integrated CFD+CSM approach to fully simulate the 58 hydroelastic interaction between nonlinear ocean waves and 59 a deformable SHPB device, making two major contributions: 60 (a) the research work demonstrated a valid computer-aided 61 approach that can perform hydroelastic offshore and coastal 62 designs; (b) the researching work demonstrated a hydroelastic 63 design methodology for breakwaters for the first time and 64 showed that the deformation of the structure has a significant 65 effect on the wave-damping performance. References [19] 66 and [20] conducted an experiment to research the wave dissi-67 pation performance of a twin-plate considering various wave 68 conditions. References [21] and [22] investigated the interac-69 tion between freak waves based on numerically investigating 70 the interaction characteristics of horizontal deck structures 71 and freak waves, which revealed the corresponding phenom-72 ena, wave loads, and structural response. Reference [23] 73 further studied the interaction between Peregrine breather-74 based freak waves and twin-plate breakwaters, including the 75 characteristics of interaction phenomena, transmitted wave 76 surface, wave loads, and st...

show abstract

“…With the continuous development of manufacturing industry, online measurement technology has been widely used in various industrial fields, which mainly includes three-dimensional shape measurement, machining trajectory guidance and quality detection [1][2][3] . Among them, the flexible measurement system with industrial robot as the moving carrier and a variety of sensors as the detection device has the advantages of non-contact, high efficiency and high precision, which can better meet a variety of online measurement needs in the industrial field [4][5][6] .…”

Section: Introductionmentioning

confidence: 99%