JSPatcher, a Visual Programming Environment for Building High-Performance Web Audio Applications

Ren, Shihong; Pottier, Laurent; Buffa, Francesca M.; Yu, Yang

doi:10.17743/jaes.2022.0056

Cited by 3 publications

(3 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Experimental results show that the tool can be used with other JavaScript language built-ins, Web APIs, etc. to create interactive programs and artworks that can be shared online [20]. Nicole Johnson-Glauch et al in order to explore how students can utilize representational features, proposed a synthesis of the results of two previous studies Method.…”

Section: Related Workmentioning

confidence: 99%

Spatial Display Model of Oil Painting Art Based on Digital Vision Design

Yang,

Yue

2024

IJACSA

View full text Add to dashboard Cite

Oil painting, owing to its unique expressive approach, holds infinite charm in classical artistic creation, yet introduces complexities in terms of manual maintenance. In pursuit of digital spatial visualization of oil painting art, this study employs a stereo matching algorithm and Efficient large-scale stereo matching, focusing on aspects like disparity maps and pixel contrasts. Furthermore, enhancements in the algorithm involve the incorporation of the cross-arms strategy for image registration and the selection of auxiliary point sets to optimize the handling of image features. Results indicate that the proposed model, evaluated on the Middlebury dataset, achieves high accuracy, recall rates, and F1 scores, measuring 97.2%, 95.0%, and 97.5% respectively, surpassing the DecStereo algorithm by 3.4%, 8.2%, and 5.7%. When tested on the Photo2monet oil painting dataset, the proposed model achieves peak signal-to-noise ratio and average structural similarity index values of 16.781 and 0.833 respectively. This suggests that the proposed model excels in digital visual representation of oil paintings, exhibiting higher image precision, stronger stereo matching capabilities, and superior spatial display performance.

show abstract

Section: Related Workmentioning

confidence: 99%

Spatial Display Model of Oil Painting Art Based on Digital Vision Design

Yang,

Yue

2024

IJACSA

View full text Add to dashboard Cite

show abstract

“…[2] Based on this context, our work aims to use Web technologies to transform smart devices into a brain-controlled music box. Our previous researches focused on web-based DSP techniques, sound design systems, visual programming languages for real-time audio processing and interactive music [8,9,11], and led to the design and implementation of a "patcher" web application named JSPatcher [10], a high-level visual language similar to the one of Max/MSP [4,5], that enables users to visually, interactively, construct audio graphs using the Web Audio API. For this new project, we also rely on JSPatcher.…”

Section: About the Workmentioning

confidence: 99%

Reflex-in: Generate Music on the Web with Real-time Brain Wave

Ren

Buffa

Pottier

et al. 2023

Companion Proceedings of the ACM Web Conference 2023

Self Cite

View full text Add to dashboard Cite

show abstract

“…In response to the issue of building user interface systems, Ren S et al studied that in this environment, users can use an aWeb browser to process domain specific languages (such as FAUST or Gen) with audio for graphical design and operation of digital signal processor algorithms. These algorithms were executed in a dedicated high priority thread called AudioWorklet [14]. Although the above visual programming techniques can convert images into code, their accuracy is difficult to guarantee, and their conversion performance is poor when faced with more complex code.…”

Section: Introductionmentioning

confidence: 99%

Automatic Code Generation for Android Applications Based on Improved Pix2code

Zou,

2024

JAIT

View full text Add to dashboard Cite

With the expansion of the Internet market, the traditional software development method has been difficult to meet the market demand due to the problems of long development cycle, tedious work and difficult system maintenance. Therefore, to improve software development efficiency, this study uses residual networks and bidirectional long short-term memory networks to improve the Pix2code model. The experiment results show that after improving the visual module of the Pix2code model using residual networks, the accuracy of the training set improves from 0.92 to 0.96, and the convergence time is shortened from 3 hours to 2 hours. After using a bidirectional long short-term memory network to improve the language module and decoding layer, the accuracy and convergence speed of the model have also been improved. The accuracy of the training set grew from 0.88 to 0.92, and the convergence time was shortened by 0.5 hours. However, models improved by bidirectional long short-term memory networks might exhibit over-fitting, and thus this study uses Dropout and Xavier normal distribution to improve the memory network. The results validate that the training set accuracy of the optimized bidirectional long short-term memory network remains around 0.92, but the accuracy of the test set has improved to a maximum of 85%. Dropout and Xavier normal distributions can effectively improve the over-fitting problem of bidirectional long short-term memory networks. Although they can also decrease the model’s stability, their gain is higher. The training and testing accuracy of the Pix2code improved by residual network and bidirectional long short-term memory network are 0.95 and 0.82, respectively, while the code generation accuracy of the original Pix2code is only 0.77. The above data indicates that the improved Pix2code model has improved the accuracy and stability of code automatic generation.

show abstract

JSPatcher, a Visual Programming Environment for Building High-Performance Web Audio Applications

Cited by 3 publications

References 7 publications

Spatial Display Model of Oil Painting Art Based on Digital Vision Design

Spatial Display Model of Oil Painting Art Based on Digital Vision Design

Reflex-in: Generate Music on the Web with Real-time Brain Wave

Automatic Code Generation for Android Applications Based on Improved Pix2code

Contact Info

Product

Resources

About