The pavement inspection task, which mainly includes crack and garbage detection, is essential and carried out frequently. The human-based or dedicated system approach for inspection can be easily carried out by integrating with the pavement sweeping machines. This work proposes a deep learning-based pavement inspection framework for self-reconfigurable robot named Panthera. Semantic segmentation framework SegNet was adopted to segment the pavement region from other objects. Deep Convolutional Neural Network (DCNN) based object detection is used to detect and localize pavement defects and garbage. Furthermore, Mobile Mapping System (MMS) was adopted for the geotagging of the defects. The proposed system was implemented and tested with the Panthera robot having NVIDIA GPU cards. The experimental results showed that the proposed technique identifies the pavement defects and litters or garbage detection with high accuracy. The experimental results on the crack and garbage detection are presented. It is found that the proposed technique is suitable for deployment in real-time for garbage detection and, eventually, sweeping or cleaning tasks.
Routine cleaning the pavement is an essential requirement to maintain a sustainable environment for social life. The different width and type of pavements raise the challenges for autonomous vehicles with fixed shape to operate effectively. In this paper, we introduce the vision based reconfiguration of self-reconfigurable pavement sweeping robot called Panthera, which can adjust its frame width to ease the cleaning tasks to become friendly with different pavement geometry. The expansion and compression operations of the Panthera width are implemented by rotating one high torque motor connecting with the lead screw rod to change the opening angle of linkage hinges. The Panthera cleaning and locomotion operations are synchronized with changing the robot width according to the output of detected pavement width. To this end, the segmented pavement leveraged on the masked based deep convolutional neural network (DCNN) is used as input for the proposed closed-loop feedback control method, enabling the robot to adjust the requirement of changing the width during locomotion accurately. The proposed PID scheme takes into account the robot kinematic design with the flexibility of width changing modes. The experiments were carried out in real environments demonstrated the autonomous reconfiguration robot width with various locomotion scenarios on pavements of varying width.
Regular washing of public pavements is necessary to ensure that the public environment is sanitary for social activities. This is a challenge for autonomous cleaning robots, as they must adapt to the environment with varying pavement widths while avoiding pedestrians. A self-reconfigurable pavement sweeping robot, named Panthera, has the mechanisms to perform reconfiguration in width to enable smooth cleaning operations, and it changes its behavior based on environment dynamics of moving pedestrians and changing pavement widths. Reconfiguration in the robot’s width is possible, due to the scissor mechanism at the core of the robot’s body, which is driven by a lead screw motor. Panthera will perform locomotion and reconfiguration based on perception sensors feedback control proposed while using an Red Green Blue-D (RGB-D) camera. The proposed control scheme involves publishing robot kinematic parameters for reconfiguration during locomotion. Experiments were conducted in outdoor pavements to demonstrate the autonomous reconfiguration during locomotion to avoid pedestrians while complying with varying pavements widths in a real-world scenario.
The design of cleaning and maintenance (CaM) robots is generally limited by their fixed morphologies, resulting in limited functions and modes of operation. Contrary to fixed shape robots, the design of reconfigurable robots presents unique challenges in designing their system, subsystems, and functionalities with the scope for innovative operational scenarios and achieving high performance in multiple modalities without compromise. This paper proposes a heuristic framework using three layers, namely input, formulation, and output layer, for designing reconfigurable robots with the aid of established transformation principles including expand/collapse, expose/cover, and fuse/divide observed in several products, services, and systems. We apply this heuristic framework approach to the novel design of a pavement CaM robotic system and subsystems, namely, i) Varying footprint, ii) Transmission, iii) Outer skin or cover iv) Storage bin, v) Surface cleaning, and vi) Vacuum/suction and blowing. The advances in the design method using the heuristic approach are demonstrated by developing an innovative reconfigurable design for CaM task. Kinematic analysis and control architecture enabling the unique locomotion behavior and gaits, namely, a) static reconfiguration and b) reconfiguration while locomotion, supported by the control architecture. Experiments were conducted and outcomes are discussed along with the failure mode analysis to support the design robustness and limitations through the observations made from the development to testing phase over one year. A detailed video demonstrating the design capabilities is linked.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2025 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.