A situated computing framework for mobile and ubiquitous multimedia access using small screen and composite devices

Today, the average consumer is comfortable browsing a web site using a desktop, laptop or kiosk computer. However, this is changing a rapid rate as more and more consumers access the same web content using a small screen device such as a mobile phone or personal digital assistant (PDA). Regardless of the consumers’ expertise with the mobile device, the experience is becoming frustrating as they try to navigate their way through web content that has been designed for a large screen; a design that results in cumbersome layout, slow-loading images and ‘off-screen’ navigation points when viewed on a small screen device. The result is dissatisfaction on part of the consumer, and possible loss of revenue for an e-business enterprise. The main objective of this paper is to highlight several techniques and technologies that are currently available that can assist in displaying ‘user-friendly’ web pages regardless of the screen size of the device.

Small screen appliances, such as cellular phones or Personal Digital Assistants (PDAs), enjoy enormous popularity as is evidenced by the tremendous commercial success. One focus of the ubiquitous research community is the potential utility of this class of devices beyond that of a basic organizer or communication device. The pocket-sized requirement imposes constraints upon the computational power and user interface of these small screen devices. This paper describes the Composite Device Computing Environment (CDCE) that offers a framework for supporting nomadic users with small screen devices for the retrieval of rich contents and the access of diverse services. CDCE provides a communication network infrastructure for seeking, unifying and exploiting any surrounding devices as a means to overcome the small screen client constraints. This paper describes the architecture and reports the current status of the ongoing realization of CDCE.

In this study we focused on the social representations of digital teaching among Higher Education agents, considering their reported experience (more or less diversified) and type of access (mobile devices or not, large-screen devices or small screen-devices). The context of the study was a public Higher Education institution in the North of Portugal in which the Moodle was adopted years-ago to support learning activities. The participants were 36 teachers (39% males, 61% females), aged between 25 and 55 years-old, and 144 freshmen students (20% males, 80% females), aged between 18 and 57 years-old, enrolled in different programs in the area of Health care. They answered to a questionnaire that consisted of: free association tasks around stimuli such as digital teaching and Moodle; a semantic differentiation scale on the attitudes towards Moodle; multiple choice questions about the levels of use and type of access to the platform; and demographic questions, including age and sex. A content-analysis of the qualitative data was conducted, using a macro developed in Excel. Words evoked by the participants were reduced to their most common form and phases rewritten to their common theme. Words and themes were then grouped under overarching categories. A descriptive analysis of the quantitative data was also performed. Results revealed that whereas for the teachers the semantic field of digital teaching consisted of the categories accessibility (47%), evolution (42%), and distance (39%); for the students it consisted of technology (97%), evolution (59%), and easiness (37%). The Moodle was seen as a kind of repository by the majority of the students (89%). Such image is shared by less than one half of teachers (36%) and it was more common among those who declared to use more functionalities of the learning management system (LMS). It is worth mentioning that almost one half of students associated the Moodle with knowledge (49%). Errors and the dependency on the Internet were pointed out as the main constrains of the LMS, while accessibility and easiness of use were the main advantages. With respect to access, the portable computer was the device most used by both teachers and students (90%). Desktops were used by more than 80% of teachers and by less than 20% of students, while the reverse picture was found in the access by mobile phone (around 20% of teachers and around 70% of students). This study provides interesting clues about the relation between the social position of the agents and their representations. The social representations seem to be more homogeneous among students than among teachers, suggesting that there is a relation with practices. The fact that the image of the Moodle as a repository is more present among the teachers who reported having used more functionalities of the Moodle is somewhat counter-intuitive and urges for more studies. It is also very suggestive that the agents use different anchors to represent digital teaching: distance in the case of the teachers and technology in the case of the students, though they converge in seeing it as a sign of evolution. Although mobile access seems to be more frequent among students, big screen devices are more used than small screen devices. These results do not support the idea of a screen-device gap among the participants, but should nevertheless open a discussion about what kind of affordances are being explored in digital teaching.

This study proposes a submenu window as a navigation aid for mobile Internet access on a cellular phone. The submenu window presents child-level menu items along with their upper-level menu. The effectiveness of the submenu window was investigated in an experiment. The factors manipulated in the experiment include the types of submenu window, age of participants, and timing of presenting the submenu. Task completion time, number of button clicks, and subjective preference were measured while the participants were performing target search tasks. The results showed that they preferred the separate submenu window. The best performance was obtained when the submenu immediately followed the selection of its parent menu. In addition, the participants in their 20s found a target menu item with fewer button clicks than did the teenagers. The separate submenu window with no delay was recommended in terms of both performance and subjective preference. The design guidelines for submenu windows on a small-screen device are also provided. The results of this study are expected to be applicable to menu-driven interfaces of many small-screen devices such as digital cameras and personal digital assistants.

PurposeThe purpose of this paper is to carry out a survey in order to better understand the nature of handheld mobile computing use by academic library users and to determine whether there is a significant demand for using the library services with these small screen devices.Design/methodology/approachA survey is created to measure whether people want to access an OPAC with a small screen. Additionally, through open‐ended questions, the survey attempts to gain a broader understanding of handheld mobile computing's impact on, and implications for, the services provided by academic libraries.FindingsA total of 58.4 percent of respondents who own a web‐enabled handheld device indicate that they would use small screen devices, such as PDAs or web‐enabled cell phones to search a library OPAC.Originality/valueThe increasing prevalence of handheld mobile computing devices such as PDAs and web‐enabled cell phones warrants investigation as to its impact on libraries. This study examines an academic library user population and the potential demand for using the library's catalog with handheld mobile computing devices

In recent years, small screen devices have seen widespread increase in their acceptance and use. Combining mobility with their increased technological advances many such devices can now be considered mobile information terminals. However, user interactions with small screen devices remain a challenge due to the inherent limited display capabilities. These challenges are particularly evident for tasks, such as information seeking. In this paper we assess the effectiveness of using hierarchical-query biased summaries as a means of supporting the results of an information search conducted on a small screen device, a PDA. We present the results of an experiment focused on measuring users’ perception of relevance of displayed documents, in the form of automatically generated summaries of increasing length, in response to a simulated submitted query. The aim is to study experimentally how users’ perception of relevance varies depending on the length of summary, in relation to the characteristics of the PDA interface on which the content is presented. Experimental results suggest that hierarchical query-biased summaries are useful and assist users in making relevance judgments.

In this paper, we illustrate the use of space-time trade-offs for information presentation on small screens. We propose the use of Rapid Serial Visual Presentation (RSVP) to provide a rich set of navigational information for Web browsing. The principle of RSVP browsing is applied to the development of a Web browser for small screen devices, the RSVP browser. The results of an experiment in which Web browsing with the RSVP browser is compared with that of a typical WAP browser suggests that RSVP browsing may indeed offer alternative to other forms of Web browsing on small screen devices.

A great deal of research has been done focusing on font, text size, and background colors for use with PowerPoint and on Web pages; but no research has been done to aid in the development of PowerPoint presentations for use on small screen devices such as the iPod.In this study, the researcher developed a PowerPoint that tested font size and clarity, text color against background, as well as clarity of images and graphs and found that much of what works in a quality PowerPoint presentation for computer screens does not work for small screens. This paper presents the result of this study and suggests some guidelines that can be used to create video podcasts that can be viewed in a variety of settings; thereby making the video podcast a useful extension of the classroom PowerPoint.

Design of text entry on small screen devices, e.g. smartwatches, faces two related challenges: trading off a reasonably sized keyboard area against space to display the entered text and the concern over fat fingers. This paper investigates tap accuracy and revisits layered interfaces to explore a novel layered text entry method. A two part user study identifies preferred typing and reading tilt angles and then investigates variants of a tilting layered keyboard against a standard layout. We show good typing speed (29 wpm) and very high accuracy on the standard layout - contradicting fears of fat-fingers limiting watch text-entry. User feedback is positive towards tilting interaction and we identify ∼14° tilt as a comfortable typing angle. However, layering resulted in slightly slower and more erroneous entry. The paper contributes new data on tilt angles and key offsets for smartwatch text entry and supporting evidence for the suitability of QWERTY on smartwatches.

Online graphics recognition has become the key problem for pen-based user interface on small screen devices, such as PDA and Tablet PC. In this paper, a novel constraint-based approach to online graphics recognition is proposed. The key idea of our approach is that when the user is drawing a graphic object, the system can extract the constraints between primitives and basic shapes from the object and use these constraints to retrieve similar graphic objects from the database at run time. The user can then choose the standard object from the ranked list of results to replace his sketches before he finishes drawing all strokes of the object. For this purpose, we summarize three types of primitives and several types of basic shapes as the basic components of a graphic object. We also define a set of constraints between primitives and basic shapes to represent their structural relations. The algorithms for online constraint extraction and graphics recognition are also presented. Experimental results show that our approach is efficient for online graphics recognition and effective for improving the user’s productivity.

ABSTRACTZooming is a basic operation that many digital maps support for exploring them interactively. Especially for maps on small screen devices, this is a helpful operation to uncover the user's region of interest possibly hidden by labels, e.g. points of interest represented by icons. However, by scaling the map larger the user loses the context. As a consequent the user might need to repeatedly zoom in and out to explore the map step by step.We present an approach that reduces the necessity of zooming by providing the user with the possibility of displacing the labels of a circular focus region. To that end, we utilize techniques from focus+context maps implementing the displacement of the labels by fish-eye projections. The visual association between labels and their point features is established by connecting lines aggregated to bundles. Our approach particularly guarantees that labels move smoothly when the user continuously shifts the focus region, which reduces distracting flickering effects while exploring the map by panning the map view. Further, when the user stops moving the focus region, mathematical programming is applied to optimize positions of the displaced labels. In an evaluation on real-world data and synthetically generated data, we show that our approach substantially increases the legibility of both the focus region and the displaced labels.

Semantic information is necessary for Semantic Web processing and is useful to Web adaptation services such as personalization of users' browsing activities on small screen devices. However, semantic information is always implicitly encoded in most existing HTML documents. This paper describes a page segmentation method to parse Web pages into rectangular segments containing some semantic information, namely blocks. Existing page segmentation techniques are mainly built on HTML DOM structure or purely vision based, not accurate enough either in visual presentation or in semantic sense. Our approach is automatic, and based on a refined typing system which tightly couples type analysis with indispensable visual cues to generate blocks into the tree structure, aiming to achieve high degree of coherence in both semantic and visual views. Experimental results show better accuracy and completeness of our method over existing ones.

ABSTRACTBandwidth is still a limiting factor for the Quality of Service (QoS) of mobile communication applications. In particular, for Voice over IP the QoS is not yet as good as for common, well-engineered, public-switched telephone networks. Multisensory communication has been identified as a possibility to moderate this limitation. One of the strengths of mobile video technology lies in its combination of visual and auditory modalities. However, one of the most salient features of mobile video applications is its small screen size. To test the potential of multimodal synergy for mobile devices, we assessed to what extent small screens affect multimodal synergy. This potential was assessed in an experiment with 54 participants, who conducted a standardised video-listening test for three talking-heads videos with a signal-to-noise ratio of –9 dB. The videos were presented on three different screen sizes, whilst keeping the video and auditory signals equal. Compared to a ground truth based on 359 participants, intelligibility was found to be significantly higher when using a large screen than when using a small screen. This indicates that mobile video technology has the potential for a significant multimodal synergy to which screen size is a substantial constraint. To optimally benefit from their multimodal potential, we offer suggestions on how to increase the effective screen size for small screen (e.g. mobile) devices and applications through elaborating the most relevant (visual) features. We conclude that knowledge about human sensory processing can alleviate the identified constraint and maximise the potential QoS of mobile video technology.

The mobile phone industry has experienced an explosive growth in recent years. Mobile phone subscriber numbers have passed the 1.6 billion mark at the end of 2004. The emerging markets such as China, India, and Brazil contribute this growth. In China, the number of mobile subscribers has already surpassed the number of fixed landline phone subscribers. In Korea, the number of mobile phone Internet subscribers is 34.53 million people or 72% of the population in June 2004 (APEC, 2005). Mobile e-commerce (m-commerce) makes business mobility a reality. Mobile users can access the Internet at anytime and anywhere with ubiquitous, inexpensive computing infrastructure. Mobile wireless services are ranging from mobile phone networks to wireless local area networks. The service provided by mobile phone systems has achieved huge success. Mobile phone users originate from all walks of life and include almost all age groups—from teenagers to retired people. It creates a new method of personal communication without location constraints. As telecommunication technologies are converging at fast speed. We will study mobile phone and personal digital assistant (PDA) related to mobile and wireless telecommunication. Hence, m-commerce is defined as electronic commerce carried out in handheld devices such as mobile phone and PDA through mobile and wireless telecommunication networks.

User experience with web browsing on small screens: Experimental investigations of mobile-page interface design and homepage design for news websites