Evaluating 3D User Interaction in VR

We proposed an EEG-based experiment framework that evaluates the performance of 3D interaction techniques in VR. Our lab environment integrates HTC VIVE, Leap Motion, and a 64-channel Compumedic EEG cap. The aims of our research are to 1) establish a continuous and objective measurement for the level of presence in VR, 2) induce design principles for content creation in VR, and 3) building a closed-loop VR + EEG platform that dynamically adjusts content presentation based on users’ cognition states.

Game Evaluation with Physiological Data

We developed an integrated game evaluation system that combines the game play screens, video recording of the game tester and multiple physiological data streams, including electrocardiogram (ECG), electromyography (EMG), and skin conductance. The system fuses these data stream into a performance metric and provide a continuous multi-modal feedback to the game developers for evaluating their game experience.

Eye Tracking for Online Learning Evaluation

This project explored using an eye-tracker to evaluate the efficiency of online learning. Based on the eye movement pattern, we found that students with high-achievement tend to focus on important regions of the given graph or description while students with lower degree of understanding exhibit a more unfocused eye movement patterns.

EEG and Mathematical Problem Solving

This fundamental science project explores brain dynamics associated with mathematical problem solving. The result shows the novel finding that longer solution times were linked to the magnitude of spectral modulation. Additionally, the length of solution times was associated with increasingly asymmetric broadband activities along the fronto-parietal axis.

Back to Top