Photogrammetry: Dwelling amongst the Artefacts

The text is created from 3D scans of Virginia Woolf’s writing hut and garden located in the house where she lived from 1918 until her death in 1941: Monk’s House in Rodmell, East Sussex. The scans capture the garden in ways that appear both substantial and yet ethereal, tracing contours that explore the physical textures of the site while using movement to allude to the cadences and syntax of the text. The film has been developed using Woolf’s 1931 experimental novel ‘The Waves’ as a narrative armature. The ‘camera’ moves through the garden, mapping out different perspectives with a steady pace and rhythm, tracing dreamlike vectors as if motivated by the desire-lines of Woolf’s restless characters. After a sequence that implies confusion and disorientation, the final tracking shot returns us to the hut, as a voice previously buried and scrambled in the soundtrack reads a particularly poignant section of the novel. Author Biographies Nic Clear, Professor of Architecture & Dean of School of Arts and Humanities, University of Huddersfield Professor Nic Clear is a qualified architect, writer and curator. He is Professor of Architecture and Dean of the School of Arts and Humanities at the University of Huddersfield. He was a Professor of Architecture and Head of the Department of Architecture and Landscape at the University of Greenwich, having previously taught at the Bartlett School of Architecture for over 20 years. In 2015, he was the Inaugural Professor for Research in Visionary Cities at the Institute of Fine Arts in Vienna, and has taught in the UK, Europe, the US and Canada. Hyun Jun Park, Course Director Postgraduate Architecture, Leeds Beckett University Hyun Jun Park is a practitioner, writer, curator, fellow of the Royal Society of Arts and Course Director for Postgraduate Architecture at the Leeds School of Architecture, Leeds Beckett University. Prior to this, he was Course Leader for the Master of Architecture at the University of Huddersfield and taught postgraduate M.Arch design studio at the University of Greenwich. Before he came to the UK, he was an associate architect at SAMOO Architects & Engineers (SAMSUNG Corp), Seoul, Korea. He was awarded M.Arch by the Bartlett School of Architecture and finished his BA and first master’s degree at Hongik University, Seoul, Korea.Clear + ParkClear+Park use 3D laser scanning to create multidisciplinary works that operate across architecture, installation, and media arts. Clear+Park use 3D scanning to capture spaces and create spatial representations and narratives that engage with, and respond to specific site histories and spatial practices. Through their research Clear+Park explore ways in which architects and artists can reproduce, develop, manipulate, and represent spaces using advanced digital technology in ways that engage with non-specialist audiences.

There is context-related temporal and spatial information in video. How to make better use of these information is the key to improving the accuracy and speed of video object detection. The method of processing spatial and temporal information through 3D convolution is better than that of processing spatial information first and then processing time dimension information. There are two reasons for this assertion. One is that the 3D convolution can process spatial information and temporal information at the same time which will not divide them into two parts in feature extraction. The other is that the human visual derivation mechanism needs to memorize multi frames and process a video as a whole. After the training test on NFS dataset, it is verified that 3D convolution has stronger ability to extract temporal and spatial information. In addition, this paper also proposes a downward sampling method by connecting the low-resolution layer and the high-resolution layer, which can effectively improve the FPN model and enrich its high-level feature representation. After training and testing with different number of downward sample modules on MOT16 dataset, the improvement of model performance by down-sampling module is verified. Finally, this paper combines the downward sample module with the 3D network, and obtains the best test results on the NFS dataset.

In the context of automotive driving assistance, this paper describes a generic (i.e. applicable to both vehicle interior and exterior scenes) vision based approach for scene content analysis. It makes use of temporal and spatial information from a stereoscopic sequence of images to localize objects and estimate their position and motion. The proposed method is divided into three steps. First, image features are selected, tracked and reconstructed in the 3D world space. Second, a clustering step is processed in the 5D space made of the positions and 2D motions parameters. The last step is devoted to clusters interpretation: it is out of the scope of the paper, however orientations are given to illustrate the capabilities of the proposed approach. The paper is organized as follows: first, the use of temporal and spatial information from a stereoscopic sequence is investigated. A state of the art of existing methods is presented. Then, a generic approach for object segmentation is proposed. Lastly, experimental results are presented.

Modern industrial plants generally consist of multiple manufacturing units, and the local correlation within each unit can be used to effectively alleviate the effect of spurious correlation and meticulously reflect the operation status of the process system. Therefore, the local correlation, which is called spatial information here, should also be taken into consideration when developing the monitoring model. In this study, a cascaded monitoring network (MoniNet) method is proposed to develop the monitoring model with concurrent analytics of temporal and spatial information. By implementing convolutional operation to each variable, the temporal information that reveals dynamic correlation of process data and spatial information that reflects local characteristics within individual operation unit can be extracted simultaneously. For each convolutional feature, a submodel is developed and then all the submodels are integrated to generate a final monitoring model. Based on the developed model, the operation status of the newly collected sample can be identified by comparing the calculated statistics with their corresponding control limits. Similar to the convolutional neural network (CNN), the MoniNet can also expand its receptive field and capture deeper information by adding more convolutional layers. Besides, the filter selection and submodel development in MoniNet can be replaced to generalize the proposed network to many existing monitoring strategies. The performance of the proposed method is validated using two real industrial processes. The illustration results show that the proposed method can effectively detect process anomalies by concurrent analytics of temporal and spatial information.

Home Network-Attached Storage (NAS) provides an easy way for data sharing and backup among multiple consumer electronic devices in home networks. Because of large capacity and cost effectiveness, disks are widely adopted in home NAS devices. In addition, data writes are common for many home NAS devices since these devices are usually used for data storage and backup. A writeback policy selects which dirty buffers are to be flushed to the disk, which is critical to the system performance under write-intensive workloads. In this paper, an intelligent writeback policy for home NAS called TESA is proposed. In contrast to most existing writeback policies, TESA considers both temporal and spatial information of the dirty buffers to improve the writeback performance. Considering the temporal information helps to reduce the frequency of writing back recently used dirty buffers, and hence leads to reduced write traffic. Considering the spatial information causes a reduction in the overall seek time and rotation delay of the dirty buffer writeback. The TESA writeback policy was implemented on a NAS evaluation board running Linux kernel. The performance results shows that TESA yields a significant performance improvement (i.e., up to 33.1%) over the original writeback policy of Linux. Moreover, TESA outperforms the policy that considers only the temporal information of the dirty buffers by up to 21.0%, and it also has up to 10.9% performance improvement over a previous policy that considers both the temporal and spatial information.

Most of the existing hyperspectral image change detection methods based on deep learning utilize convolutional neural networks (CNN), recurrent neural networks (RNN), and long-short-term memory (LSTM). However, CNNs primarily focus on extracting spatial information from hyperspectral images, thereby failing to fully utilize channel and temporal information. In this paper, we propose a network called STSTNet that can jointly extract spatial, spectral, and temporal feature information. To achieve a richer feature representation space, we employ a spatial attention module to extract spatial feature information from feature maps, and a spectral transformer encoder structure to extract abundant spectral sequence information. Specifically, we design two temporal information extraction structures after each spatial information extraction structure or spectral information extraction structure to capture correlations and interactions within the hyperspectral images. Extensive experiments have been conducted on three hyperspectral datasets, and the experimental results demonstrate the network’s excellent performance.

Episodic memory involves the processing of spatial and temporal aspects of personal experiences. The lateral entorhinal cortex (LEC) plays an essential role in subserving memory. However, the mechanisms by which LEC integrates spatial and temporal information remain elusive. Here, we recorded LEC neurons while male rats performed one-dimensional tasks. Many LEC cells displayed spatial firing fields and demonstrated selectivity for traveling directions. Furthermore, some LEC neurons changed the firing rates of their spatial rate maps during a session (rate remapping). Importantly, this temporal modulation was consistent across sessions, even when the spatial environment was altered. Notably, the strength of temporal modulation was greater in LEC compared to other brain regions, such as the medial entorhinal cortex, CA1, and CA3. Thus, we demonstrate spatial rate mapping in LEC neurons, which may serve as a coding mechanism for temporal context, and allow for flexible multiplexing of spatial and temporal information.

The Acquisition and Long-Term Retention of Temporal, Spatial, and Item Information

The present work explores an interactive model of spatial and temporal information in map memory. In four experiments, participants learned a map with temporal and spatial information confounded or unconfounded. Attentional and representational levels of information were made apparent through tasks that tap spatial, temporal, or other information. Learning criteria emphasizing sequential order or location imposed differential weighting of the information types in memory. Results indicate that map memory is spatial, but also interacts with the order in which map locations are encountered. Findings show flexibility in allocating attention and information indexing of location and sequential order information in map learning.

Natural language is rich and varied, but also highly structured. The rules of grammar are a primary source of linguistic regularity, but there are many other factors that govern patterns of language use. Language models attempt to capture linguistic regularities, typically by modeling the statistics of word use, thereby folding in some aspects of grammar and style. Spoken language is an important and interesting subset of natural language that is temporally and spatially grounded. While time and space may directly contribute to a speaker’s choice of words, they may also serve as indicators for communicative intent or other contextual and situational factors. To investigate the value of spatial and temporal information, we build a series of language models using a large, naturalistic corpus of spatially and temporally coded speech collected from a home environment. We incorporate this extralinguistic information by building spatiotemporal word classifiers that are mixed with traditional unigram and bigram models. Our evaluation shows that both perplexity and word error rate can be significantly improved by incorporating this information in a simple framework. The underlying principles of this work could be applied in a wide range of scenarios in which temporal or spatial information is available. Index Terms: language modeling, multimodal, spatial, temporal, context

Spatial and temporal saliency based four-stream network with multi-task learning for action recognition

The analysis of a multitemporal sequence of images of a given site makes it possible to exploit temporal information in addition to spectral and spatial information, and therefore represents a way to improve the accuracy with respect to the non-contextual single-time classification. The proposed contextual multitemporal classification scheme consists of two stages of multilayer perceptron (MLP) neural networks for each single-time image of the multitemporal sequence. The first stage is a one-hidden layer MLP whose ro/spl circ/le is to estimate, for each pixel, the single-time posterior probability of each class, given the feature vector. These probability estimates represent spectral information; in addition, they are utilized to generate a non-contextual classification map. The neighboring class labels of a given pixel in the non-contextual classification map are exploited to extract spatial information, while temporal information is deduced from the non-contextual maps produced by the remaining single-time images in the multitemporal sequence. Spatial and temporal contextual information together with spectral information serve as inputs for the second stage network of the classification scheme where the fusion takes place. As the network configuration can influence the classification performances, three MLP-based configurations are investigated. Experimental results on a multitemporal data set consisting of two multisensor (Landsat TM and ERS-1 SAR) images are presented. The performances of the proposed methods are discussed and compared with those obtained by a reference classifier based on the Markov random fields fusion approach in terms of classification accuracy. The results show that the proposed fusion approach based on neural networks may represent an interesting solution to the problem of multitemporal contextual fusion.

This paper proposes a novel algorithm for automatically and quickly extracting the external edge of the moving object. The algorithm uses both spatial and temporal information, which is abundant in image sequences and has not usually been efficiently used in conventional algorithm. Especially most attention of this algorithm is paid for the moving object external-edges. This orientation is designed to deal with the overlap of moving objects in successive frames. After the temporal segmentation the external edge of moving object is detected. Differing from current algorithms the fusing way of the temporal and spatial information has been progressed. Here the algorithm only uses spatial information of the temporal external edge to refine the edge points for getting the accurate boundary. This method will greatly decrease the compute and achieve the fast process in the real-time system. Though the simulation, this algorithm can get perfect result.

Spatial and temporal information are two major feature dimensions of human movements. How these two types of information are represented in working memory—whether as integrated units or as individual features—influences how much information might be retained and how the retained information might be manipulated. In this study, we investigated how spatial (path/trajectory) and temporal (speed/rhythm) information of complex whole-body movements are represented in working memory under a more ecologically valid condition wherein the spatiotemporal continuity of movement sequences was considered. We found that the spatial and temporal information are not automatically integrated but share the storage capacity and compete for a common pool of cognitive resources. The finding rejects the strong form of object-based representation and supports the partial independence of spatial and temporal processing. Nevertheless, we also found that contextual factors, such as the way movements are organized and displayed, can further modulate the level of object-based representation and spatiotemporal integration.

With the rapid development of mobile computing and Web services, a huge amount of data with spatial and temporal information have been collected everyday by smart mobile terminals, in which an object is described by its spatial information and temporal information. Motivated by the significance of spatio-temporal range search and the lack of efficient search algorithm, in this paper, we study the problem of spatio-temporal range search (STRS), a novel index structure is proposed, called HOC-Tree, which is based on Hilbert curve and OC-Tree, and takes both spatial and temporal information into consideration. Based on HOC-Tree, we develop an efficient algorithm to solve the problem of spatio-temporal range search. Comprehensive experiments on real and synthetic data demonstrate that our method is more efficient than the state-of-the-art technique.