Sketch2Domino: Interactive Chain Reaction Design and Guidance

Peng, Yichen; Mishima, Yuki; Igarashi, Yamato; Miyauchi, Ryoma; Okawa, Masahiro; Xie, Haoran; Miyata, Kazunori

doi:10.1109/nicoint50878.2020.00013

Cited by 12 publications

(7 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Sketches are a high-level abstract visual representation without great visual detail. By analyzing the intent behind a user's freehand sketch, sketchbased interaction allows users intuitive access to various applications such as image retrieval [2,7,8], image editing [9][10][11][12], simulation control [13], block arrangement [14], and 3D modeling [15][16][17]. Among sketch-based systems, freehand portrait sketching is difficult for ordinary users due to the required drawing skills and capabilities, which are inaccessible to novices (e.g., with poor drawing skills).…”

Section: Sketch-based Applicationsmentioning

confidence: 99%

DualFace: Two-stage drawing guidance for freehand portrait sketching

et al. 2021

Self Cite

View full text Add to dashboard Cite

Special skills are required in portrait painting, such as imagining geometric structures and facial detail for final portrait designs. This makes it a difficult task for users, especially novices without prior artistic training, to draw freehand portraits with high-quality details. In this paper, we propose dualFace, a portrait drawing interface to assist users with different levels of drawing skills to complete recognizable and authentic face sketches. Inspired by traditional artist workflows for portrait drawing, dualFace gives two-stages of drawing assistance to provide global and local visual guidance. The former helps users draw contour lines for portraits (i.e., geometric structure), and the latter helps users draw details of facial parts, which conform to the user-drawn contour lines. In the global guidance stage, the user draws several contour lines, and dualFace then searches for several relevant images from an internal database and displays the suggested face contour lines on the background of the canvas. In the local guidance stage, we synthesize detailed portrait images with a deep generative model from user-drawn contour lines, and then use the synthesized results as detailed drawing guidance. We conducted a user study to verify the effectiveness of dualFace, which confirms that dualFace significantly helps users to produce a detailed portrait sketch.

show abstract

Section: Sketch-based Applicationsmentioning

confidence: 99%

DualFace: Two-stage drawing guidance for freehand portrait sketching

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…However, these proposed systems were designed for automatic machine control where the user guidance was absent such task instruction. To solve this issue, Sketch2Domino proposed a sketch-based guidance system for domino toppling production [17]. Sketch2Bento proposed the guide system for ingredient arrangement of designing lunch boxes [24].…”

Section: Sketch-based Guidancementioning

confidence: 99%

“…To support designing a complex chain reaction such as domino blocks, we implemented a sketch-based instruction system for the domino placement according to the user customized sketch in this case study [17]. The prototype system applied interactive projection-mapping technology to guide users to places the System Overview As shown in Figure 6, users can draw the sketch for the intention design of the domino arrangement.…”

Section: Domino Arrangementmentioning

confidence: 99%

SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches

Xie¹,

Peng²,

Wang³

2021

Preprint

Self Cite

View full text Add to dashboard Cite

In this work, we propose an interactive general instruction framework SketchMeHow to guidance the common users to complete the daily tasks in real-time. In contrast to the conventional augmented reality-based instruction systems, the proposed framework utilizes the user sketches as system inputs to acquire the users' production intentions from the drawing interfaces. Given the user sketches, the designated task instruction can be analyzed based on the subtask division and spatial localization for each task. The projector-camera system is adopted in the projection guidance to the end-users with the spatial augmented reality technology. To verify the proposed framework, we conducted two case studies of domino arrangement and bento production. From our user studies, the proposed systems can help novice users complete the tasks efficiently with user satisfaction. We believe the proposed SketchMeHow can broaden the research topics in sketch-based real-world applications in human-computer interaction 1 .

show abstract

“…It realizes to transfer a virtual user interface into real space. Many studies have focused on developing HCI based on Augmented Reality(AR) [5][6] [7]. Other research has worked on situation sharing and communication support in a distributed environment, using SAR and virtual reality (VR) technology [8][9] and to visualize the working environment constantly, thus facilitating remote communication [10].…”

Section: Related Workmentioning

confidence: 99%

SpatialViewer: A Remote Work Sharing Tool that Considers Intimacy Among Workers

Makioka

Kobayashi

et al. 2021

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Due to the influence of the new coronavirus disease , teleworking has been expanding rapidly. Although existing interactive remote working systems are convenient, they do not allow users to adjust their spatial distance to team members at will, and they ignore the discomfort caused by different levels of intimacy. To solve this issue, we propose a telework support system using spatial augmented reality technology. This system calibrates the space in which videos are projected with real space and adjusts the spatial distance between users by changing the position of projections. Users can switch the projection position of the video using hand-wave gestures. We also synchronize audio according to distance to further emphasize the sense of space within the remote interaction: the distance between projection position and user is inversely proportional to the audio volume. We conducted a telework experiment and a questionnaire survey to evaluate our system. The results show that the system enables users to adjust distance according to intimacy and thus improve the users' comfort 1 .

show abstract

Sketch2Domino: Interactive Chain Reaction Design and Guidance

Cited by 12 publications

References 15 publications

DualFace: Two-stage drawing guidance for freehand portrait sketching

DualFace: Two-stage drawing guidance for freehand portrait sketching

SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches

SpatialViewer: A Remote Work Sharing Tool that Considers Intimacy Among Workers

Contact Info

Product

Resources

About