The influence of input device characteristics on spatial perception in desktop-based 3D applications

Article Free Access Share on ToolStone: effective use of the physical manipulation vocabularies of input devices Authors: Jun Rekimoto Interaction Laboratory, Sony Computer Science Laboratories, Inc., 3-14-13 Higashigotanda, Shinagawa-ku, Tokyo 141-0022 Japan Interaction Laboratory, Sony Computer Science Laboratories, Inc., 3-14-13 Higashigotanda, Shinagawa-ku, Tokyo 141-0022 JapanView Profile , Eduardo Sciammarella Interaction Laboratory, Sony Computer Science Laboratories, Inc., 3-14-13 Higashigotanda, Shinagawa-ku, Tokyo 141-0022 Japan Interaction Laboratory, Sony Computer Science Laboratories, Inc., 3-14-13 Higashigotanda, Shinagawa-ku, Tokyo 141-0022 JapanView Profile Authors Info & Claims UIST '00: Proceedings of the 13th annual ACM symposium on User interface software and technologyNovember 2000 Pages 109–117https://doi.org/10.1145/354401.354421Online:01 November 2000Publication History 51citation1,479DownloadsMetricsTotal Citations51Total Downloads1,479Last 12 Months29Last 6 weeks2 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my Alerts New Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF

In a stable bimanual trajectory tracing task with interlimb spatial and temporal synchrony, blocking the visual information from one hand may alter the performance of either hand. In this paper, we investigate the effect of visual information on motor behaviour of dominant and non-dominant hands during a bimanual task, with a focus on motor lateralization theory's anticipation for a more pronounced distortion on one hand due to visual information withdrawal. To address this question, four bimanual circle tracing experiments were designed with two rehabilitation robotic arms with real time visual feedback. Two experiments were conducted under the free-visual condition whereas the visual feedback from one hand was blocked for the other two. The in-depth analysis of the metrics extracted from 685 circles, drawn by 6 participants, revealed that non-dominant hand, when visible, generally performs worse than the dominant hand, for instance it exhibits less circularity. In their invisible modes, the performance of the dominant and non-dominant hands displayed inconsistent difference across the participants. Moreover, both hands showed a higher pace when partial visual information was available. Our findings using this robotic framework as a systematic tool on developing new paradigms are discussed.

Internal models for bi-manual tasks

The between-hand interference during bimanual tasks is a consequence of the connection between the neural controllers of movement. Previous studies showed the existence of an asymmetric between-hand interference (caused by neural crosstalk) when different kinematics plans were to be executed by each hand or when only one was visually guided and received perturbed visual feedback. Here, in continuous bimanual circle drawing tasks, we investigated if the central nervous system (CNS) can benefit from visual composite feedback, i.e., a weighted sum of hands' positions presented for the visually-guided hand, to control the non-visible hand. Our results demonstrated improvement in the non-visible non-dominant hand (NDH) performance in the presence of the composite feedback. When NDH was visually guided, the dominant hand's (DH) performance during asymmetric drawing deteriorated, while its performance during symmetric drawing improved. This indicates that the CNS's ability to leverage composite feedback, which can be the result of decoding the non-visible hand positional information from the composite feedback, is task-dependent and can be asymmetric. Also, the non-visible hand's performance degraded when DH or NDH was visually guided with amplified error feedback. The results of the amplified feedback condition do not strongly support the asymmetry of the interference during asymmetric circle drawing. Comparing muscle activations in the asymmetric experiment, we concluded that the observed kinematic differences were not due to alternation in muscle co-contractions.

Although the level of handedness in humans varies cross-culturally, humans are generally described as right-handed, which has been considered a uniquely human trait. Recently, captive chimpanzees (Pan troglodytes) have been shown to exhibit right-hand preference when performing bimanual but not unimanual tasks. Less clear is whether this pattern also occurs in wild chimpanzees and other African apes. Using videos (N = 49) of six wild western gorillas (Gorilla gorilla gorilla) feeding on termites at the Mondika Research Center (Republic of Congo), we tested whether they exhibit hand preference when performing unimanual, i.e., reaching for termite mound pieces; bimanual, i.e., “termite tapping”: rhythmically shaking a piece of termite mound with the dominant hand and collecting the termites in the other hand tasks; or hand transfer prior to bimanual tasks, i.e., transferring a piece of termite mound from one hand to the other. All individuals exhibited exclusive hand preference when performing the bimanual tasks, with five of six gorillas preferring the right hand. Conversely, most individuals did not show any manual preference during the unimanual task. In addition, hand preference during hand transfer revealed clear hand dominance of similar strength and direction of those shown for the bimanual task, suggesting that this measure is as sensitive as the bimanual task itself. Thus, we propose “termite feeding” as a novel task to be considered in future hand-preference studies in wild western gorillas. Our results are in concordance with those for chimpanzees and captive gorillas showing hemispheric specialization for bimanual actions in apes.

This paper examines a new technique for the visualization of and the interaction with trees, objects frequently used to convey hierarchical relationships in biological data. Motivated by the quality of 2D tree interaction, we adapt the planar tree-of-life metaphor to a virtual, semi-immersive 3D environment. A 3D environment extends the utility of this metaphor by allowing the user to view an entire data set in a single screen. Interrogation of the tree is implemented using 3D input devices. This real-time interrogation of the tree itself provides a quick means by which to qualitatively analyse the hierarchical data. In this paper, we describe the techniques underlying the implementation of such an environment. We conclude by considering the utility of tree metaphors as a basis for the representation of highly dimensional data sets. Arbor3D (source code, a binary executable for SGI IRIX 6.4, Perl parsers, and sample Newick data files) are available via the Internet (http://xian.tamu.edu/Arbor3D/). Arbor3D can be displayed in "CAVE simulator" mode on an SGI workstation screen, or as an interactive virtual environment on a projection workbench. druths@rice.edu; echen@cs.rice.edu; leland@xian.tamu.edu

We present a new interactive modeling technique based on the notion of sculpting a solid material. A sculpting tool is controlled by a 3D input device and the material is represented by voxel data; the tool acts by modifying the values in the voxel array, much as a paint program's paintbrush modifies bitmap values. The voxel data is converted to a polygonal surface using a marching-cubes algorithm; since the modifications to the voxel data are local, we accelerate this computation by an incremental algorithm and accelerate the display by using a special data structure for determining which polygons must be redrawn in a particular screen region. We provide a variety of tools: one that cuts away material, one that adds material, a sandpaper tool, a heat gun, etc. The technique provides an intuitive direct interaction, as if the user were working with clay or wax. The models created are free-form and may have complex topology; however, they are not precise, so the technique is appropriate for modeling a boulder or a tooth but not for modeling a crankshaft.

Conventional interactive 3D tree modeling systems are generally based on 2D input devices, and it's not convenient to generate desired 3D tree shape from 2D inputs due to the complexity of 3D tree structures. In this paper, we present a system for modeling trees interactively using a 3D gesture-based VR platform. The system contains a head-mounted display (HMD) and a 6-DOF motion controller for interaction. We propose an improved procedural modeling method to generate trees faster for VR platform. Using the 6-DOF motion controller, users can manipulate tree structures by a set of 3D interactive operations, including geometric editing using 3D gestures, sketching, brushing and silhouette-guided growth. Our interactions are more flexible and convenient than using traditional 2D input devices, e.g., we allow the user to simultaneously rotate and translate parts of a tree using a 3D gesture.

Tablets and smartphones are now increasingly common and the interfaces are predominantly touch-based and often multi-touch. More and more schools are testing them with their students in the hope of bringing educational benefits. With this new type of device, new interactions become possible. Many studies have been done on the manipulation of 3D objects with 2D input devices, but we are only at the beginning of studies that link the needs of pedagogy with the possibilities of these new types of interactions. FINGERS© ((Find INteractions for Geometry learNERS) )is an application for learning spatial geometry. It is intended for pupils aged 9 to 12. The interactions have been designed with the teachers. Some interactions are specific to 3D geometry (translations 3 DOF, rotations, nets, combinations of cubes, etc) and others are general like naming or multi-selection. Many gesture grammars offer a set of interactions to select an object or a group of objects. Multi-taps or lassoing around an area are commonly adopted interactions. The execution of geometry exercises requires the construction of other interactions such as multi-criteria selection. The real question is how to introduce a parameter into the tactile selection. This seemingly simple interaction is in fact complex to implement. One of the problems is often the large amount of information displayed on the screen. The amount of information displayed does not allow the use of conventional selection modes. The difficulties encountered are, for example, that objects can hide, their size is too small, their number is too large. This selection could be based on physical similarity (cube, cylinder, pyramid, sphere, etc.), similarity of colour, orientation in space, etc. For example, how to select all red cubes, how to select all green objects, how to select all cylinders. The real question is how to define a grammar of tactile gestures that allows parameter selection. After presenting the limitations of current solutions, we present the solutions developed in FINGERS©. We explain how they allow a simple and intuitive "multi-criteria" selection by using physical or colorometric characteristics of objects. We present examples from the implementation of this selection mode in the FINGERS software.

Article Virtual world modeler Share on Authors: Elton K. H. Tsang Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong KongView Profile , Hanqiu Sun Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong KongView Profile , Mark Green Department of Computer Science, University of Alberta, Canada Department of Computer Science, University of Alberta, CanadaView Profile Authors Info & Claims VRST '98: Proceedings of the ACM symposium on Virtual reality software and technologyNovember 1998 Pages 179–186https://doi.org/10.1145/293701.293734Online:02 November 1998Publication History 3citation432DownloadsMetricsTotal Citations3Total Downloads432Last 12 Months4Last 6 weeks0 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access

The ability to specify nonplanar 3D curves is of fundamental importance in 3D modeling and animation systems. Effective techniques for specifying such curves using 2D input devices are desirable, but existing methods typically require the user to edit the curve from several viewpoints. We present a novel method for specifying 3D curves with 2D input from a single viewpoint. The user rst draws the curve as it appears from the current viewpoint, and then draws its shadow on the oor plane. The system correlates the curve with its shadow to compute the curve's 3D shape. This method is more natural than existing methods in that it leverages skills that many artists and designers have developed from work with pencil and paper.

Content creation for computer graphics applications is a very timeconsuming process that requires skilled personnel. Many people find the manipulation of 3D object with 2D input devices non-intuitive and difficult. We present a system, which restricts the motion of objects in a 3D scene with constraints. In this publication we discuss an experiment that compares two different 3D manipulation interfaces via 2D input devices. The results show clearly that the new constraint-based interface performs significantly better than previous work.KeywordsUser TestInput DeviceObject ManipulationScene GraphTarget SceneThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

There has been a considerable effort to provide sensory feedback for myoelectric prostheses. Among the solutions provided in the literature, sensory substitution is an easy and cost-effective way to provide feedback through different sensory modalities at different locations on the body. In this study, we evaluate the effect of sensory substitution of force and position feedback on a two-degree-of-freedom dynamic finger flexion task. For this purpose, a new methodology and an experimental setup are developed. The experimental methodology is based on the "strength-dexterity test", working on the principle of buckling of compression springs. The experimental setup comprises a haptic interface, an input device, a force sensor, two vibration feedback tactors, and a virtual environment. A psychophysical test is conducted where subjects interact with a virtual spring with the index finger of their dominant hand through the haptic interface, the input device, or the force sensor in either isotonic or isometric mode. Three feedback conditions are tested: no sensory substitution, modality-matched sensory substitution, and modality-mismatched sensory substitution (through vibration). Sensory substitution feedback is provided on the subject's contralateral arm. Results show that sensory substitution of force and position does not have a significant contribution to subjects' performance in the proposed dynamic task.

There is a growing movement toward designing more natural user interfaces that take advantage of an individual's experiential knowledge of speech and handwriting interaction. One disadvantage of these natural interfaces is that the system may not always interpret the user input accurately. No study has attempted to determine what impact these accuracy rates have on the user's acceptance or preference of a particular application. Given that handwriting and speech have a lower input accuracy rate than keyboard input, are there certain applications that individuals would prefer not to use with either a speech or handwriting input device?

We performed several experiments using a Personal Digital Assistant (PDA) as an input device in the non-dominant hand along with a mouse in the dominant hand. A PDA is a small hand-held palm-size computer like a 3Com Palm Pilot or a Windows CE device. These are becoming widely available and are easily connected to a PC. Results of our experiments indicate that people can accurately and quickly select among a small numbers of buttons on the PDA using the left hand without looking, and that, as predicted, performance does decrease as the number of buttons increases. Homing times to move both hands between the keyboard and devices are only about 10% to 15% slower than times to move a single hand to the mouse, suggesting that acquiring two devices does not cause a large penalty. In an application task, we found that scrolling web pages using buttons or a scroller on the PDA matched the speed of using a mouse with a conventional scroll bar, and beat the best two-handed times reported in an earlier experiment. These results will help make two-handed interactions with computers more widely available and more effective.