Rendering algorithms for aberrated human vision simulation

Csoba, István; Kunkli, Roland

doi:10.1186/s42492-023-00132-9

Cited by 3 publications

(2 citation statements)

References 103 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although XR has many uses in industries like entertainment and education, its multiple uses in biomedicine open up revolutionary possibilities for both basic science and healthcare [ 47 – 50 ]. The authors in [ 51 ] concentrate on the process of turning biomedical findings into virtual things.…”

Section: Vr and Ar In Medical Educationmentioning

confidence: 99%

Virtual and augmented reality in biomedical engineering

Taghian,

Abo-Zahhad,

Sayed

et al. 2023

BioMed Eng OnLine

View full text Add to dashboard Cite

Background In the future, extended reality technology will be widely used. People will be led to utilize virtual reality (VR) and augmented reality (AR) technologies in their daily lives, hobbies, numerous types of entertainment, and employment. Medical augmented reality has evolved with applications ranging from medical education to picture-guided surgery. Moreover, a bulk of research is focused on clinical applications, with the majority of research devoted to surgery or intervention, followed by rehabilitation and treatment applications. Numerous studies have also looked into the use of augmented reality in medical education and training. Methods Using the databases Semantic Scholar, Web of Science, Scopus, IEEE Xplore, and ScienceDirect, a scoping review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria. To find other articles, a manual search was also carried out in Google Scholar. This study presents studies carried out over the previous 14 years (from 2009 to 2023) in detail. We classify this area of study into the following categories: (1) AR and VR in surgery, which is presented in the following subsections: subsection A: MR in neurosurgery; subsection B: spine surgery; subsection C: oral and maxillofacial surgery; and subsection D: AR-enhanced human-robot interaction; (2) AR and VR in medical education presented in the following subsections; subsection A: medical training; subsection B: schools and curriculum; subsection C: XR in Biomedicine; (3) AR and VR for rehabilitation presented in the following subsections; subsection A: stroke rehabilitation during COVID-19; subsection B: cancer and VR, and (4) Millimeter-wave and MIMO systems for AR and VR. Results In total, 77 publications were selected based on the inclusion criteria. Four distinct AR and/or VR applications groups could be differentiated: AR and VR in surgery (N = 21), VR and AR in Medical Education (N = 30), AR and VR for Rehabilitation (N = 15), and Millimeter-Wave and MIMO Systems for AR and VR (N = 7), where N is number of cited studies. We found that the majority of research is devoted to medical training and education, with surgical or interventional applications coming in second. The research is mostly focused on rehabilitation, therapy, and clinical applications. Moreover, the application of XR in MIMO has been the subject of numerous research. Conclusion Examples of these diverse fields of applications are displayed in this review as follows: (1) augmented reality and virtual reality in surgery; (2) augmented reality and virtual reality in medical education; (3) augmented reality and virtual reality for rehabilitation; and (4) millimeter-wave and MIMO systems for augmented reality and virtual reality.

show abstract

Section: Vr and Ar In Medical Educationmentioning

confidence: 99%

Virtual and augmented reality in biomedical engineering

Taghian,

Abo-Zahhad,

Sayed

et al. 2023

BioMed Eng OnLine

View full text Add to dashboard Cite

show abstract

“…Several computer imaging techniques exist that simulate a critical property of human vision namely imperfection resulting from highly effective wave front aberration that vary from person to person. In addition to existing vision simulation techniques, there are many new challenges in rendering algorithms to simulate aberrant human vision [28]. An exact solution for connecting visualization with conscious geometric interpretation is computer-enhanced descriptive geometry (CeDG), a modern scientific approach to solving and creating computer modelling of three-dimensional (3D) geometric systems through descriptive geometry procedures.…”

Section: Introductionmentioning

confidence: 99%

Challenges of Engineering Applications of Descriptive Geometry

Balajti

2023

Symmetry

View full text Add to dashboard Cite

Descriptive geometry has indispensable applications in many engineering activities. A summary of these is provided in the first chapter of this paper, preceded by a brief introduction into the methods of representation and mathematical recognition related to our research area, such as projection perpendicular to a single plane, projection images created by perpendicular projection onto two mutually perpendicular image planes, but placed on one plane, including the research of curves and movements, visual representation and perception relying on a mathematical approach, and studies on toothed driving pairs and tool geometry in order to place the development presented here among them. As a result of the continuous variability of the technological environment according to various optimization aspects, the engineering activities must also be continuously adapted to the changes, for which an appropriate approach and formulation are required from the practitioners of descriptive geometry, and can even lead to improvement in the field of descriptive geometry. The imaging procedures are always based on the methods and theorems of descriptive geometry. Our aim was to examine the spatial variation in the wear of the tool edge and the machining of the components of toothed drive pairs using two cameras. Resolving contradictions in spatial geometry reconstruction research is a constant challenge, to which a possible answer in many cases is the searching for the right projection direction, and positioning cameras appropriately. A special method of enumerating the possible infinite viewpoints for the reconstruction of tool surface edge curves is presented in the second part of this paper. In the case of the monitoring the shape geometry, taking into account the interchangeability of the projection directions, i.e., the property of symmetry, all images made from two perpendicular directions were taken into account. The procedure for determining the correct directions in a mathematically exact way is also presented through examples. A new criterion was formulated for the tested tooth edge of the hob to take into account the shading of the tooth next to it. The analysis and some of the results of the Monge mapping, suitable for the solution of a mechanical engineering task to be solved in a specific technical environment, namely defining the conditions for camera placements that ensure reconstructibility are also presented. Taking physical shadowing into account, conclusions can be drawn about the degree of distortion of the machined surface from the spatial deformation of the edge curve of the tool reconstructed with correctly positioned cameras.

show abstract

Fast rendering of central and peripheral human visual aberrations across the entire visual field with interactive personalization

Csoba,

Kunkli

2023

Vis Comput

View full text Add to dashboard Cite

With the recent progress made in areas such as head-mounted displays and vision-correcting devices, there is a growing interest in fast and personalized algorithms for simulating aberrated human vision. Existing vision-simulating approaches are generally hindered by the lack of personalization, computational cost of rendering, and limited types of supported aberrations. This paper presents a fast vision simulation method with interactive personalization capabilities for simulating arbitrary central and peripheral aberrations of the human eye. First, we describe a novel, neural network-based solution for efficiently estimating the physical structure of the simulated eye and calculating the necessary Zernike aberration coefficients for computing the point-spread functions with varying pupil sizes, focus distances, and incidence angles. Our new approach operates in the sub-second regime and produces highly accurate outputs, facilitating the interactive personalization of vision simulation. Next, we present an improved PSF interpolation method for an existing tiled PSF splatting algorithm for rendering. The proposed algorithm significantly improves the computational performance and memory efficiency of the previous approach, allowing the simulation of peripheral vision with arbitrary visual aberrations in low-latency applications. Following the description of our new techniques, we evaluate their performance characteristics and simulation accuracies on several different eye conditions and test scenarios and compare our results to several previous vision simulation algorithms.

show abstract

Rendering algorithms for aberrated human vision simulation

Cited by 3 publications

References 103 publications

Virtual and augmented reality in biomedical engineering

Virtual and augmented reality in biomedical engineering

Challenges of Engineering Applications of Descriptive Geometry

Fast rendering of central and peripheral human visual aberrations across the entire visual field with interactive personalization

Contact Info

Product

Resources

About