A Novel Lip Synchronization Approach for Games and Virtual Environments

Abstract

This paper presents an algorithm for the offline generation of lip-sync animation. It redefines visemes as sets of constraints on the facial articulators such as lips, jaw, tongue. The algorithm was comparatively evaluated with 30 healthy participants by presenting a set of phrases delivered verbally by a virtual character. Each phrase was presented in two versions: once with the traditional lip-sync method, and once with our method. Results confirm that the suggested solution produces more natural animation than standard keyframe interpolation techniques.

Optimists at Heart: Why Do We Research Game AI? (Extended Version)

“…Papers often frame the problems they are trying to solve as being costly for game developers, sometimes described in terms of hours spent solving a problem, sometimes in terms of the cost in hardware to solve or create something. For example, [26] explains that traditional approaches to lip-synching in game development are 'time-consuming and expensive', thus motivating a need for better approaches to automating this task.…”

“…Although we briefly reference it above, note here that we are not distinguishing the target domain. Some papers explicitly mention applications to the games industry [26] while other papers are interested in applications to broad AI and simply use games as a platform for this [10]. We consider work seeking to make a process more efficient to be under the Cost category for the purposes of this paper.…”

Synchronizing Controlled Logistics Terminals between Simulated and Visualized Production Lines Using An ASTAK Method

“…In this article, the Controlled Logistics Terminals (hereinafter referred to as CLT) in a simulated production line of an unmanned factories are used as an example for the experiment of an ASTAK method. Through the three steps of animation simplification, timing alignment, and keyframe synchronization, the consistency in the movements of the CLT between these two production lines has been achieved [17][18][19][20][21][22][23] The contributions to this paper are listed as follows:…”