Exergaming, the use of activity, exercise, and information in video games, has been a growing field for the promotion of wellness and for preventing and treating obesity. Realistic exergaming requires movements that are adapted from detailed, fine-grain motions. An appropriate, active exergame requires a user-centric design, allowing for accurate motion recognition as well as a real-time responsiveness, often balancing accuracy with latency. This paper presents a framework for such an exergaming system, specializing on human interaction. This system includes a method for dynamically altering the algorithm to analyze the trade-off between classification accuracy and real-time responsiveness, allowing for a unique, tailored, interactive experience.