CAD-based 3D objects recognition in monocular images for mobile augmented reality

Han, Pengfei; Zhao, Gang

doi:10.1016/j.cag.2015.05.021

Cited by 26 publications

(11 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The proper development of the user interface for AR solutions, including speech recognition features, has been addressed by Ajanki et and Caruso et al (2015). Finally, the development of MAR solutions has been discussed by Biocca et al (2007), Mourtzis et al (2013), Verbelen et al (2014), Han and Zhao (2015), and Kim and Lee (2016).…”

Section: Technical Papersmentioning

confidence: 99%

“…Visualization issues have been dealt with by Klein and Murray (2010), who proposed a method to model the artifacts produced by a small low-cost camera and add these effects to an ideal pinhole image produced by conventional rendering methods. Sensors (i.e., typically "inertial sensors" of mobile devices) are used in AR environment to estimate the position, inclination, or movement of an object; they have been used to this end by Chandaria et al (2007) and Han and Zhao (2015). An HMD is a display device, worn on the head or as part of a helmet, with one or two small displays; an exhaustive examination of display systems (including HMDs) suitable for adoption in AR environments has been made by Weng et al (2012).…”

Section: Technical Papersmentioning

confidence: 99%

See 1 more Smart Citation

Augmented reality technology in the manufacturing industry: A review of the last decade

2019

View full text Add to dashboard Cite

The aim of this article is to analyze and review the scientific literature relating to the application of Augmented Reality (AR) technology in industry. AR technology is becoming increasingly diffuse, due to the ease of application development and the widespread use of hardware devices (mainly smartphones and tablets) able to support its adoption. Today, a growing number of applications based on AR solutions are being developed for industrial purposes. Although these applications are often little more than experimental prototypes, AR technology is proving highly flexible and is showing great potential in numerous areas (e.g., maintenance, training/learning, assembly or product design) and in industrial sectors (e.g., the automotive, aircraft or manufacturing industries). It is expected that AR systems will become even more widespread in the near future.The purpose of this review is to classify the literature on AR published from 2006 to early 2017, to identify the main areas and sectors where AR is currently deployed, describe the technological solutions adopted, as well as the main benefits achievable with this kind of technology.ARTICLE HISTORY

show abstract

Section: Technical Papersmentioning

confidence: 99%

Section: Technical Papersmentioning

confidence: 99%

Augmented reality technology in the manufacturing industry: A review of the last decade

2019

View full text Add to dashboard Cite

show abstract

“…Fig. 6 We use the line L c determined by the origin and the centroid in camera coordinate system to roughly locate the target object and the depth information is roughly estimated since the area of an object's projection is inverse relational to the squared value of depth [7] We use this color-based mask to estimate an approximate translation. First, we find all contours from the binary mask image as shown in Fig.…”

Section: Approximate Translationmentioning

confidence: 99%

Line-based initialization method for mobile augmented reality in aircraft assembly

Han

Zhao

2016

Vis Comput

Self Cite

View full text Add to dashboard Cite

A fast line-based initialization method for mobile augmented reality in aircraft assembly is proposed in this paper. The challenge of recognition and pose estimation of aircraft structural parts in monocular images on mobile devices is mainly addressed. Rather than local feature points, straight lines are extracted and utilized here since they are more suitable for aircraft structural parts, which usually have a solid color and lack textures to generate invariant descriptors. The geometric relationship between 3D world lines and their projections on the camera image are built to estimate the relative 6-DOF pose including rotation and translation, respectively. The inertial sensors of mobile devices are used to provide partial rotation information directly, and the rest is obtained through a voting process. To shrink the search space and, therefore, improve the speed and robustness of initialization, a color-based ROI mask and a vertical lines extraction method are proposed. To determine the translation, the color mask is first used to roughly approximate the real pose and then a possible-correspondence map of lines is built by parallelism alignment combined with the rotation already obtained. This paper describes the details of our method and also shows its effectiveness with experiments. Moreover, the proposed method is especially suitable for but not limited to the aircraft assembly field.

show abstract

“…Figure 7. The edge-based camera tracking mechanism and process presented in [30,50], the differences in edge features between the artifact tracking target and the rock mass tracking target, and the proposed methods to overcome these gaps.…”

Section: Edge-based Ar Tracking Of Rock Mass Targetmentioning

confidence: 99%

Augmented Reality Mapping of Rock Mass Discontinuities and Rockfall Susceptibility Based on Unmanned Aerial Vehicle Photogrammetry

et al. 2019

View full text Add to dashboard Cite

In rockfall hazard management, the investigation and detection of potential rockfall source areas on rock cliffs by remote-sensing-based susceptibility analysis are of primary importance. However, when the rockfall analysis results are used as feedback to the fieldwork, the irregular slope surface morphology makes it difficult to objectively locate the risk zones of hazard maps on the real slopes, and the problem of straightforward on-site visualization of rockfall susceptibility remains a research gap. This paper presents some of the pioneering studies on the augmented reality (AR) mapping of geospatial information from cyberspace within 2D screens to the physical world for on-site visualization, which directly recognizes the rock mass and superimposes corresponding rock discontinuities and rockfall susceptibility onto the real slopes. A novel method of edge-based tracking of the rock mass target for mobile AR is proposed, where the model edges extracted from unmanned aerial vehicle (UAV) structure-from-motion (SfM) 3D reconstructions are aligned with the corresponding actual rock mass to estimate the camera pose accurately. Specifically, the visually prominent edges of dominant structural planes were first explored and discovered to be a robust visual feature of rock mass for AR tracking. The novel approaches of visual-geometric synthetic image (VGSI) and prominent structural plane (Pro-SP) were developed to extract structural planes with identified prominent edges as 3D template models which could provide a pose estimation reference. An experiment verified that the proposed Pro-SP template model could effectively improve the edge tracking performance and quality, and this approach was relatively robust to the changes of sunlight conditions. A case study was carried out on a typical roadcut cliff in the Mentougou District of Beijing, China. The results validate the scalability of the proposed mobile AR strategy, which is applicable and suitable for cliff-scale fieldwork. The results also demonstrate the feasibility, efficiency, and significance of the geoinformation AR mapping methodology for on-site zoning and locating of potential rockfalls, and providing relevant guidance for subsequent detailed site investigation.

show abstract

CAD-based 3D objects recognition in monocular images for mobile augmented reality

Cited by 26 publications

References 25 publications

Augmented reality technology in the manufacturing industry: A review of the last decade

Augmented reality technology in the manufacturing industry: A review of the last decade

Line-based initialization method for mobile augmented reality in aircraft assembly

Augmented Reality Mapping of Rock Mass Discontinuities and Rockfall Susceptibility Based on Unmanned Aerial Vehicle Photogrammetry

Contact Info

Product

Resources

About