A Study on Different User Interfaces for Teaching Virtual Borders to Mobile Robots

This paper presents a distributed, multi-user virtual reality testbed for a mobile robot. The main components of the testbed include user interface, networking, simulation and robot control. The user interface is implemented as a combination of a virtual environment and a standard graphical user interface (GUI). The virtual environment is developed using the Virtual Reality Modeling Language (VRML) and it corresponds to the laboratory environment where the robot is placed and tested. The standard GUI is implemented using Java Programming language. The World Wide Web (WWW) browser is used to integrate the virtual environment (embedded VRML) and the standard GUI (Java applet) in a single user interface. Users can access a dedicated WWW server and download the user interface. Networking component (communication among users and robots) is implemented using the Distributed Interactive Simulation (DIS) protocol. The existing robot development system has been utilized to provide simulation capabilities. A separate stand-alone Java application has been developed to communicate and control the robot using a wireless Ethernet link. In addition to user's direct control, control algorithms (e.g. fuzzy logic based) can be used to replace the user. A Nomad200 mobile robot has been used for initial measurements and evaluations of the testbed.

The design of user interfaces (UIs) for assistive robot systems can be improved through the use of a set of design guidelines presented in this article. As an example, the article presents two different UI designs for an assistive manipulation robot system. We explore the design considerations from these two contrasting UIs. The first is referred to as the graphical user interface (GUI), which the user operates entirely through a touchscreen as a representation of the state of the art. The second is a type of novel UI referred to as the tangible user interface (TUI). The TUI makes use of devices in the real world, such as laser pointers and a projector–camera system that enables augmented reality. Each of these interfaces is designed to allow the system to be operated by an untrained user in an open environment such as a grocery store. Our goal is for these guidelines to aid researchers in the design of human–robot interaction for assistive robot systems, particularly when designing multiple interaction methods for direct comparison.

User interfaces represent a major part in software products. Generally, it is difficult to document the content and the structure of the user interface. However, there is a need to save and preserve the overall state and structure of the user interface for later communication and modifications in requirements, design and implementation. The Graphical User Interface (GUI) storage format should be universal and can be transferred from one application to another (such as XML). GUI states are usually defined as the overall combination of properties of all the components or widgets of the GUI This paper suggests an alternative back end representation of user interfaces and their state from their original format within the applications. The user interface model is transformed to a schema saved in an XML file. The schema structure represents the user interface state. This state considers only the structure of the user interface and ignores controls' specific properties. XML format is widely used and accepted by many applications. It is the infrastructure language for web pages and database management systems. User interface documentation is useful for future evaluation and comparison, useful for stakeholders' communication. It is also for some GUI testing activities such as regression testing where we trigger testing if there is a change in the user interface.

AI (Artificial Intelligence) and GUI (Graphical User Interface) are the two most cutting-edge technologies. These technologies individually can make a comprehensive change in industries and alter economic and social interactions and connections. In general, Now-a-days AI is integrated with human technology and used in some wide range of sectors like healthcare, finance to education, banking, manufacturing, transportation, etc. GUI is used in gaming, designing, AR (Augmented reality) and VR (Virtual reality), media, smart home devices, etc., Integration of Artificial Intelligence and Graphical User Interface is beneficial for both users and app developers. The convergence of AI and GUI gives dynamic applications like Data Visualization, Insights, Smart assistants, Adaptions, Navigations, and Predictive analytics. This integration will increase the ease of access for new information to users. Now we are facing some general problems based on these technologies like Adaptive User Interfaces, Automated user interface testing, AI-Enhanced data visualization, Intelligent GUI Design Assistance, Real-Time Emotion Recognition for GUI Adaptation, etc., User interfaces are often designed with a one-size-fits-all approach, which does not account for individual user preferences and abilities. Designing perceptive and attractive GUIs requires significant space and time. This chapter focus on how can we develop a UI (User Interface) with base of AI which can be capable of solving the above obstacles and gives the simple objectives and technical solutions. By this integration we can execute some future projects like AI-Enhanced Customer Support Portals, Adaptive Gaming Interfaces, Interactive Financial Management Systems, and more.

Implementation of a Chatbot System using AI and NLP

Mobility for graphical user interfaces (GUIs) is a challenging problem, as different GUIs need to be constructed for different device capabilities and changing context, preferences and users’ locations. GUI developers frequently create multiple user interface versions for different devices. The solution lies in using a single, abstract, user interface description that is used later to automatically generate user interfaces for different devices. Various techniques are proposed to adapt GUIs from an abstract specification to a concrete interface. Design-time techniques have the possibility of creating better performing GUIs but, in contrast to run-time techniques, lack flexibility and mobility. Run-time techniques’ mobility and autonomy can be significantly improved by using mobile agent technology and an indirect GUI generation paradigm. Using indirect generation enables analysis of computer-human interaction and application of artificial intelligence techniques to be made at run-time, increasing GUIs’ performance and usability.

As we all know that, SLAM (Simultaneous Localization and Mapping) are vital for mobile robot. This paper presents a method of map building using interactive GUI (Graphical User Interface) for an indoor service mobile robot because of the uncertainty of the sensors. What's more, the operator can modify the map compared with the real-time video from the web camera of the mobile robot. In the proposed system, EKF (Extended Kalman Filter) was used to improve the precision of self-localization of the mobile robot. This paper also introduces the architecture of the proposed system and gives some experimental results.

For educational purposes there is a need to teach electrical and computer engineering students the basics of the design of state machines using programmable logic devices, and for students interested in mobile robots to teach them the basics of mobile robots' behaviors. At the same time one of the topics of interest in the mobile robot's community is how to generate their new behaviors, using state machines, automatically. This paper discusses how to create mobile robots' behaviors using genetic algorithms (GAs), implementing them in programmable logic devices (FPGAs) and how these behaviors can be programmed by students in a mobile robotics course. The behaviors are encoded as algorithm state machines and using feed-forward artificial neural networks (ANN). In the state-machine approach, each individual's chromosome represents, given a set of inputs coming from the sensors and the current state, both the next state and the outputs that control the robot's movements. In the ANN approach, whose weights are found also with GAs, a pipeline architecture was built to perform it, each pipeline executes a layer of the ANN, thus once the pipeline is full the execution speed of the ANN is one sensors' clock cycle. We evaluate the behaviors generated by the GA according to a fitness function that grades their performance for avoiding obstacles. The inputs to such a robot are infrared sensors to detect obstacles, the outputs are the velocities of its wheels. Our objectives are first, to prove that GAs are a good option as a method for finding behaviors for mobile robots' navigation, and second, that these behaviors can be implemented in an efficient way in FPGAs. We tested both behaviors in a small mobile robot, that is build in an electrical engineering course that teaches how to build mobile robots.

This research project investigates the connections between user identity, product emotion and interface design. It investigates whether mobile communication devices can better reflect user identity and lifestyle through the provision of a customizable Graphical user interface (GUI) that users can actively manipulate. The study proposes a user and design-driven interaction process whereby users can easily personalize the interface of their devices to reflect their idiosyncratic needs and preferences, the designed interface making interaction more individually useful, meaningful and empowering. The project extends the scope of end user customization beyond basic cosmetic changes to the physical appearance of the GUI to the modification of the actual process of interaction. The research focuses on the capacity to employ the user interface to support more intimate and flexible patterns of use that foster personal identification and emotional investment with devices, as against those that are preordained, device-driven and technologically deterministic.

Localization of an autonomous mobile robot has always been a topic of interest in Robotics community. The constraints of working under different environments are constantly a challenge in designing an efficient localization system. We propose a localization algorithm for a mobile robot, which will be used for home security. The objective is to perform indoor localization efficiently and keeping the cost as low as possible so as to make it commercializable. Here, we introduce an approach based on recognizing a pattern generated by laser pointers on the wall, which is captured by an infrared camera. The image of this pattern is used to locate the position of a robot in the room. The problem of working under black ceiling has been overcomed because the projection is on the wall and is moving which also increases the range of operation. As the pattern is unique, the interference of strong sunlight has also been fixed to some extent. Experimental results show that the proposed approach is effective in real environment and opens new doors for future research.

XML Based Graphical User Interface Editor and Runtime Parser for ISO 11783 Machine Automation Systems

Mobile applications use Accessibility Services to assist users with disabilities (UWDs) in using Graphical User Interface (GUI)-based apps. However, such mobile assistive technologies are not fully secure as these can obtain data from the GUI objects, enhance this data for UWDs and transmit it to a server, thereby potentially exposing sensitive data to the external world. SEAPHISH (SEcuring Accessibility using PHISHing) is a platform aimed towards protecting against such an attack by providing defense by deception. This platform generates a phishing app i.e. an app similar to the original app installed on the user’s smartphone by extracting GUI elements and properties from the original app. A simulation for SEAPHISH can help determine the situations when an attack against a particular app can be performed with a high degree of probability. But performing effective simulations requires a fundamental understanding of the properties of GUI layouts of apps at large. This thesis aims at providing a framework that analyzes GUI layouts and their transitions using a large base of approximately three million Android apps. Various state-of-the-art tools that use different strategies in traversing layouts are explored. We created a framework where the tool Backstage performs static analysis and another tool AndroidRipper performs dynamic analysis of the layouts to help build a GUI model of the app. Using these models, we investigate the layouts of Android apps by collecting statistics on various GUI elements and screens. This investigation enhances SEAPHISH with statistically significant real-world constraints thereby providing defense against malwares and reducing the security vulnerabilities faced by UWDs.

Visual and aural are two most important channels of information processing. While most of the interaction with computers have been designed around the visual channel, there are circumstances where voice based man-machine interaction becomes preferable, and in some cases, necessary, given that voice based interaction comes naturally to humans and can be used by illiterate people easily.

The contemporary theory of metaphor defines the metaphor as a major and indispensable part of our ordinary, conventional way of conceptualizing the world and it asserts that the metaphors are used to define our relationship with the physical environment and to create a context of communication. The metaphors are the core idioms of the contemporary graphical user interface (GUI) and have an important role in helping users interact with computer systems. The desktop metaphor began with the first GUI Xerox Star and was popularized by the Lisa of Apple Macintosh. Realizing the physical-office metaphor and reflecting the familiar world of the potential users by using icons of file, folder and trashcan, the metaphor-based GUIs made it relatively easy for all to use the computer productively. Nowadays almost all of the software industry is based on the desktop metaphor paradigm. However, besides the researchers that favor the use of metaphors in the development of the system image by accentuating their assistance to learning, there are also other researchers, who reject the metaphor-based design approach in GUIs by referring to their limitations. Considering these discussions and various approaches, this study aims to make an outline of the historical development of metaphor-based GUIs; to determine the current state of metaphor within GUI design by brief examples and finally to identify future prospects and research themes. The study claims that metaphor still remains to be an inevitable part of the GUI to communicate it with the users and despite its potential limitations -rather than rejecting the metaphor totally- it seems better-to try compatible and supplementary solutions like visual formalism.

Improving object-oriented user interfaces with constraints