Flexible modeling of next-generation displays using a differentiable toolkit

Akşit, Kaan; Kavaklı, Koray

doi:10.1117/12.2649243

Practical Holography XXXVII: Displays, Materials, and Applications 2023

DOI: 10.1117/12.2649243

|View full text |Cite

Flexible modeling of next-generation displays using a differentiable toolkit

Kaan Akşit¹,

Koray Kavaklı²

Abstract: We introduce an open-source toolkit for simulating optics and visual perception. The toolkit offers differentiable functions that ease the optimization process in design. In addition, this toolkit supports applications spanning from calculating holograms for holographic displays to foveation in computer graphics. We believe this toolkit offers a gateway to remove overheads in scientific research related to next-generation displays.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Speckle-free holography with a diffraction-aware global perceptual model

Wei,

Chen,

Zhou

et al. 2024

Photon. Res.

View full text Add to dashboard Cite

Computer-generated holography (CGH) based on neural networks has been actively investigated in recent years, and convolutional neural networks (CNNs) are frequently adopted. A convolutional kernel captures local dependencies between neighboring pixels. However, in CGH, each pixel on the hologram influences all the image pixels on the observation plane, thus requiring a network capable of learning long-distance dependencies. To tackle this problem, we propose a CGH model called Holomer. Its single-layer perceptual field is 43 times larger than that of a widely used 3×3 convolutional kernel, thanks to the embedding-based feature dimensionality reduction and multi-head sliding-window self-attention mechanisms. In addition, we propose a metric to measure the networks’ learning ability of the inverse diffraction process. In the simulation, our method demonstrated noteworthy performance on the DIV2K dataset at a resolution of 1920×1024, achieving a PSNR and an SSIM of 35.59 dB and 0.93, respectively. The optical experiments reveal that our results have excellent image details and no observable background speckle noise. This work paves the path of high-quality hologram generation.

show abstract

Speckle-free holography with a diffraction-aware global perceptual model

Wei,

Chen,

Zhou

et al. 2024

Photon. Res.

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Flexible modeling of next-generation displays using a differentiable toolkit

Cited by 1 publication

References 11 publications

Speckle-free holography with a diffraction-aware global perceptual model

Speckle-free holography with a diffraction-aware global perceptual model

Contact Info

Product

Resources

About