Cardboard Controller: A Cost-Effective Method to Support Complex Interactions in Mobile VR.

In desktop applications 3D input devices are mostly operated by the non-dominant hand to control 3D viewpoint navigation, while selection and geometry manipulations are handled by the dominant hand using the regular 2D mouse. This asymmetric bi-manual interface is an alternative to commonly used keyboard and mouse input, where the non-dominant hand assists the dominant hand with keystroke input to toggle modes. Our first study compared the keyboard and mouse interface to bi-manual interfaces using the 3D input devices SpaceTraveller and Globefish in a coarse spatial orientation task requiring egocentric and exocentric viewpoint navigation. The different interface configurations performed similarly with respect to task completion times, but the bi-manual techniques resulted in significantly less errors. This result is likely to be due to better workload balancing between the two hands allowing the user to focus on a single task for each hand. Our second study focused on a bi-manual 3D point selection task, which required the selection of small targets and good depth perception. The Globefish interface employing position control for rotations performed significantly better than the SpaceTraveller interface for this task.

Objective: The aim of this study is to investigate how well eye movement times in visual target selection tasks by an eye input device follows the typical Fitts" Law and to compare vertical and horizontal eye movement times.BR Background: Typically manual pointing provides excellent fit to the Fitts" Law model. However, when an eye input device is used for the visual target selection tasks, there were some debates on whether the eye movement times in can be described by the Fitts" Law. More empirical studies should be added to resolve these debates. This study is an empirical study for resolving this debate. On the other hand, many researchers reported the direction of movement in typical manual pointing has some effects on the movement times. The other question in this study is whether the direction of eye movement also affects the eye movement times.BR Method: A cursor movement times in visual target selection tasks by both input devices were collected. The layout of visual targets was set up by two types. Cursor starting position for vertical movement times were in the top of the monitor and visual targets were located in the bottom, while cursor starting positions for horizontal movement times were in the right of the monitor and visual targets were located in the left.BR Results: Although eye movement time was described by the Fitts" Law, the error rate was high and correlation was relatively low (R² = 0.80 for horizontal movements and R² = 0.66 for vertical movements), compared to those of manual movement. According to the movement direction, manual movement times were not significantly different, but eye movement times were significantly different.BR Conclusion: Eye movement times in the selection of visual targets by an eye-gaze input device could be described and predicted by the Fitts" Law. Eye movement times were significantly different according to the direction of eye movement.BR Application: The results of this study might help to understand eye movement times in visual target selection tasks by the eye input devices.

With the advancement of computer techniques, a greater emphasis has been placed on intuitive human-computer interactions (HCIs). Virtual Reality systems can offer a novel way for users to interact with the objects in the computer generated environment (the so called Virtual Environment, VE). Through VR technology, we have the ability to replace the traditional input device, such as keyboard and mouse, with other modes such as speech and gesture. In our research project, we use a CyberGlove, developed by Virtual Technology Inc., as an input device to develop a desktop CAD modeling system for conceptual designers. We elaborate the limitations of the Dataglove and use gestures to support intuitive human-computer interface. To develop this gesture interface, we emphasize that conceptual designers are allowed full-freedom to use different kinds of gestures to conduct various geometric shape operations instead of depending solely on keyboard and 2D mouse. The designers can indicate objects or directions simply by pointing with the hand, and manipulate the position and orientation of an object by grasping and turning. The “virtual tools” can be used for shaping, cutting, and joining objects. We employ the 3D GUIs for enhancing the gesture interface. In the VE, the 3D menu and “virtual hand” float over the objects rather than being part of the scene. Various 3D cursors can be used to select menu or manipulate the object.

For those minimally invasive surgery where conventional surgical instruments cannot reach the surgical site due to their straight structure and rigidity, concentric tube continuum robots are a promising technology because of their small size (comparable to a needle) and maneuverability. These flexible, compliant manipulators can easily access hard to reach anatomical structures, e.g. by turning around corners. By teleoperating the robot the surgeon stays in direct control at any time. In this paper, three off-the-shelf input devices are considered for teleoperation of a concentric tube continuum robot: a 3D mouse, a gamepad, and a 3 degrees of freedom haptic input device. Three tasks which mimic relevant surgical maneuvers are performed by 12 subjects using each input device: reaching specific locations, picking and placing objects from one location to another, and approaching the surgical site through a restricted pathway. We present quantitative results (task completion time, accuracy, etc.), a statistical analysis, and empirical results (questionnaires). Overall, the performance of subjects using the 3D mouse was superior to the performance using the other input devices. The subjective ranking of the 3D mouse by the subjects confirms this result.

The most time-consuming part of character animation is 3D character posing. Posing using a mouse is a slow and tedious task that involves sequences of selecting on-screen control handles and manipulating the handles to adjust character parameters, such as joint rotations and end effector positions. Thus, various 3D user interfaces have been proposed to make animating easier, but they typically provide less accuracy. The proposed interface combines a mouse with the Leap Motion device to provide 3D input. A usability study showed that users preferred the Leap Motion over a mouse as a 3D gestural input device. The Leap Motion drastically decreased the number of required operations and the task completion time, especially for novice users.

Arm fatigue is an important factor affecting user experience in Virtual Reality (VR). In this work, we have proposed ProxyHand and StickHand, virtual hand techniques to address this issue. Using ProxyHand or StickHand, users can flexibly adjust the 3D-spatial offset between the physical hand and its virtual representation. This will allow users to keep their arms in a comfortable posture (vertically down) even when they have to manipulate objects in locations that require lifting of arms using the default interaction method. Proposed ProxyHand and StickHand have a similar Underlying concept that is to introduce a 3D-spatial offset between the physical hand and its virtual representation in VR. However, they respond differently to the user’s hand movements because of different working mechanisms. Question arises whether the 3D-spatial offset will negatively impact the hand control ability as the directness of interaction is being violated. To investigate this, we conducted user studies where users were asked to perform object translation, rotation and hybrid tasks. ProxyHand and StickHand are used in combination in some scenarios to maximize positive impact on the user experience in VR. This raises the question to find the best possible combination of these virtual hands to reduce arm fatigue. Firstly, for this purpose, we combined both virtual hands by manually allowing users to switch between ProxyHand and StickHand. Secondly, we used machine learning to automatically switch between both the virtual hands. Results showed that introduction of a 3D-spatial offset largely reduced the arm fatigue while offering equal performance to the default interaction method for all these tasks; translation, rotation and hybrid task. Users preferred using ProxyHand and StickHand to interact in the VR environment for longer periods of time.

We present two studies to assess which physical factors influence 3D object movement tasks with various input devices. Since past research has shown that a mouse with suitable mapping techniques can serve as a good input device for some 3D object movement tasks, we also evaluate which characteristics of the mouse sustain its success. Our first study evaluates the effect of a supporting surface across orientation of input device movement and display orientation. A 3D tracking device was used in all conditions for consistency. The results of this study are inconclusive; no significant differences were found between the factors examined. The results of a second study show that the mouse outperforms the tracker for speed in all instances. The presence of support also improved accuracy when tracker movement is limited to 2D operation. A 3DOF movement mode performed worst overall.

We investigate silent speech as a hands-free selection method in eye-gaze pointing. We first propose a stripped-down image-based model that can recognize a small number of silent commands almost as fast as state-of-the-art speech recognition models. We then compare it with other hands-free selection methods (dwell, speech) in a Fitts' law study. Results revealed that speech and silent speech are comparable in throughput and selection time, but the latter is significantly more accurate than the other methods. A follow-up study revealed that target selection around the center of a display is significantly faster and more accurate, while around the top corners and the bottom are slower and error prone. We then present a method for selecting menu items with eye-gaze and silent speech. A study revealed that it significantly reduces task completion time and error rate.

Due to the emergence of mobile 3D and VR devices, multi-view 3D videos are expected to play increasingly important roles shortly. Compared with traditional single-view videos, it is envisaged that a multi-view 3D video requires a larger storage space. Nevertheless, efficient caching of multi-view 3D videos in a proxy has not been explored in the literature. In this paper, therefore, we first observe that the storage space can be effectively reduced by leveraging Depth Image Based Rendering (DIBR) in multi-view 3D. We then formulate a new cache replacement problem, named View Selection and Cache Operation (VSCO), and find the optimal policy based on Markov Decision Process. Also, we devise an efficient and effective algorithm to solve the problem. Simulation results manifest that the proposed algorithm can significantly improve the cache hit rate and reduce the total cost compared with the previous renowned cache replacement algorithms.

In order to improve the authenticity of human-computer interaction in the virtual scene, the data glove is used. Aimed at this sensor input device for the characteristic of multiple-joints, the collection and calibration method of original data are discussed. By analyzing the movement characteristics of human hand, mapping from human hand to virtual hand is accomplished. By embedding OSG in MFC, with the intersect vector method and map projection method, invoking the 3D ship engine room and interactive effect of people roaming in the scene are reached. And at last, by using the data glove, the interventional manipulation of virtual objects in the virtual scene is implemented.

It is speculated that virtual environments (VE) might be used as a training tool in brain injury rehabilitation. The rehabilitation process often involves practicing so-called instrumental activities of daily living (IADL), such as shopping, cooking, and using a telephone. If a brain injury patient is to practice such activities in a VE, the patient must be able to navigate the viewpoint and interact with virtual objects in an understandable way. People with brain injury may be less tolerant to a poor interface and a VE might therefore become unusable due to, for example, an unsuitable input device. In this paper we present two studies aimed to do initial usability testing of VE interaction methods on people without experience of 3D computer graphics. In the first study four navigation input device configurations were compared: the IntelliKeys keyboard and the Microsoft Sidewinder joystick, both programmed with two and three degrees of freedom (DOF). The purpose of the second study was to evaluate a method for interaction with objects, and to find a sufficiently usable input device for this purpose. The keyboard was found to be more suitable for navigation tasks in which the user wants to give the viewpoint a more advantageous position and orientation for carrying out a specific task. No big differences could be found between two and three DOFs. The method for interaction with objects was found to work sufficiently well. No difference in performance could be found between mouse and touch screen, but some evidence was found that they affect the usability of the VE interface in different ways.

Virtual hand or pointer metaphors are among the key approaches for target selection in immersive environments. However, targeting moving objects is complicated by factors including target speed, direction, and depth, such that a basic implementation of these techniques might fail to optimize user performance. We present results of two empirical studies comparing characteristics of virtual hand and pointer metaphors for moving target acquisition. Through a first study, we examine the impact of depth on users’ performance when targets move beyond and within arms’ reach. We find that movement in depth has a great impact on both metaphors. In a follow-up study, we design a reach-bounded Go-Go (rbGo-Go) technique to address challenges of virtual hand and compare it to Ray-Casting. We find that target width and speed are significant determinants of user performance and we highlight the pros and cons for each of the techniques in the given context. Our results inform the UI design for immersive selection of moving targets.

This paper presents the design and execution of a comparative experimental between-participant study with 42 participants. We investigated depth perception comparing a 2D display with a glasses-free 3D autostereoscopic display in detail and conducted a follow-up study with the new 3D zSpace technology including a stylus as input device. This work comprises the design of a tympanoplastic training scenario used as the study's real world task. Participants had to position a prosthesis implant to reconstruct the ossicular chain and thus a patient's hearing ability. The study revealed an overwhelming support of the 3D autostereoscopic display compared to a 2D display regarding depth judgment, task completion time and the number of required scene and prosthesis interactions.

Computer graphics hardware supporting real-time interactive 3D animation has the potential to support effective user interfaces by enabling virtual 3D workspaces. However, this potential requires development of viewpoint movement techniques that support rapid and controlled movement through workspaces. Rapid movement through large distances avoids wasted work time; controlled movement near target objects allows the user to examine and interact with objects in the workspace. Current techniques for viewpoint movement typically use high velocities to cover distances rapidly, but high velocities are hard to control near objects. This paper describes a new technique for targeted viewpoint movement that solves this problem. The key idea is to have the user indicate a point of interest (target) on a 3D object and use the distance to this target to move the viewpoint logarithmically, by moving the same relative percentage of distance to the target on every animation cycle. the result is rapid motion over distances that slows as the viewpoint approaches the target object. The technique can be used with 2D and multidimensional input devices. We also extend the technique to move objects in the workspace.

This paper examines a new technique for the visualization of and the interaction with trees, objects frequently used to convey hierarchical relationships in biological data. Motivated by the quality of 2D tree interaction, we adapt the planar tree-of-life metaphor to a virtual, semi-immersive 3D environment. A 3D environment extends the utility of this metaphor by allowing the user to view an entire data set in a single screen. Interrogation of the tree is implemented using 3D input devices. This real-time interrogation of the tree itself provides a quick means by which to qualitatively analyse the hierarchical data. In this paper, we describe the techniques underlying the implementation of such an environment. We conclude by considering the utility of tree metaphors as a basis for the representation of highly dimensional data sets. Arbor3D (source code, a binary executable for SGI IRIX 6.4, Perl parsers, and sample Newick data files) are available via the Internet (http://xian.tamu.edu/Arbor3D/). Arbor3D can be displayed in "CAVE simulator" mode on an SGI workstation screen, or as an interactive virtual environment on a projection workbench. druths@rice.edu; echen@cs.rice.edu; leland@xian.tamu.edu