Investigating memory for faces based on emotional contextual information.

Monkeys Recall and Reproduce Simple Shapes from Memory

Objective:Recent findings suggest that diminished processing of positive contextual information about others during interactions may contribute to social impairment in the schizophrenia spectrum. This could be due to general social context processing deficits or specific biases against positive information. We studied the impact of positive and negative social contextual information during social interactions using functional neuroimaging and probed whether these neural mechanisms were associated with real-life social functioning in schizophrenia spectrum disorders.Methods:Patients with a schizophrenia spectrum disorder (N = 23) and controls disorder (N = 25) played three multi-round trust games during functional magnetic resonance imaging scanning, with no, positive and negative information about the counterpart’s trustworthiness, while all counterparts were programmed to behave trustworthy. The main outcome variable was the height of the shared amount in the trust game, i.e. investment, representing an indication of trust. The first investment in the game was considered to be basic trust, since no behavioural feedback was given yet. We performed region-of-interest analyses and examined the association with real-life social functioning using the experience sampling method.Results:Social contextual information had no effect on patients’ first investments, whereas controls made the lowest investment after negative and the highest investments after positive contextual information was provided. Over trials, patients decreased investments, suggesting reduced social reward learning, whereas controls increased investments in response to behavioural feedback in the negative context. Patients engaged the dorsolateral prefrontal cortex less than controls during context presentation and showed reduced activity within the caudate during repayments. In patients, lower investments were associated with more time spent alone and social exclusion and lower caudate activation was marginally significantly associated with higher perceived social exclusion.Conclusion:The failure to adapt trust to positive and negative social contexts suggests that patients have a general insensitivity to prior social information, indicating top-down processing impairments. In addition, patients show reduced sensitivity to social reward, i.e. bottom-up processing deficits. Moreover, lower trust and lower neural activation were related to lower real-life social functioning. Together, these findings indicate that improving trust and social interactions in schizophrenia spectrum needs a multi-faceted approach that targets both mechanisms.

This study tested first whether 240 undergraduate students share high consensual agreement in their selection of faces and voices which fit criminal and non‐criminal ‘occupations’ second, whether there are significant relationships between trait impressions and voice characteristics for persons selected as exemplars of criminals and non‐criminals; and third, whether categorization of targets into ‘good guys’ and ‘bad guys’ influences recognition memory. Subjects' selections of exemplars of criminals and non‐criminals from video recordings of the face and voice, or face‐only, or voice‐only of 15 white men were done with high confidence in a significantly non‐random manner. Significant correlations were found between trait impressions and vocal characteristics in all three presentation modes which differentiated good guys from bad guys. Recognition memory for target voices was significantly inferior to the recognition of face and voice targets, and face‐only targets. Recognition confidence scores were significantly higher for good guys over bad guys, especially in the voice‐only condition. The results were discussed in terms of the probability that stereotyping of faces and voices can influence decision‐making in the legal process.

Neural activity associated with episodic memory for emotional context

The approach taken in the present investigation was to examine reactions to positive and negative employer information by eliciting online (i.e., moment-to-moment) reactions in a simulated computer-based job fair. Reactions to positive and negative information commonly reveal a negatively biased asymmetry. Positively biased asymmetries have been documented in the psychological literature, but they are rare. This article shows evidence for such asymmetry in reactions to realistic information in this simulated recruitment context. The intensity of reactions to positive information was greater than the intensity of reactions to negative information on the same attribute. Findings are discussed in relation to research on temporal discounting in vocational preference.

Previous research has shown a source memory advantage for faces presented in negative contexts. As yet it remains unclear whether participants remember the specific type of context in which the faces were presented or whether they can only remember that the face was associated with negative valence. In the present study, participants saw faces together with descriptions of two different types of negative behaviour and neutral behaviour. In Experiment 1, we examined whether the participants were able to discriminate between two types of other-relevant negative context information (cheating and disgusting behaviour) in a source memory test. In Experiment 2, we assessed source memory for other-relevant negative (threatening) context information (other-aggressive behaviour) and self-relevant negative context information (self-aggressive behaviour). A multinomial source memory model was used to separately assess partial source memory for the negative valence of the behaviour and specific source memory for the particular type of negative context the face was associated with. In Experiment 1, source memory was specific for the particular type of negative context presented (i.e., cheating or disgusting behaviour). Experiment 2 showed that source memory for other-relevant negative information was more specific than source memory for self-relevant information. Thus, emotional source memory may vary in specificity depending on the degree to which the negative emotional context is perceived as threatening.

The hypothesis that elderly individuals are less likely than young adults to connect target and contextual information was tested. Young and elderly adults were presented with a number of slides, each of which contained a word superimposed in the center of a background picture of a landscape or cityscape. Half of the subjects were told to remember the words and half were told to remember the word-and-background pairs. All subjects were then tested for their recognition memory of the word-and-background pairs. The results indicate that elderly adults have greater difficulty than young adults remembering the connections between words and background pictures but that this occurs whether the pictures are target information or contextual information. Therefore, the results of this study provide no support for the notion that elderly adults have a specific contextual encoding deficit.

The context reinstatement effect refers to the enhanced memory performance found when the context information paired with a target item at study is re-presented at test. Here we investigated the consequences of the way that context information is processed in such a setting that gives rise to its beneficial effect on item recognition memory. Specifically, we assessed whether reinstating context in a recognition test facilitates subsequent memory for this context, beyond the facilitation conferred by presentation of the same context with a different study item. Reinstating the study context at test led to better accuracy in two-alternative forced choice recognition for target faces than did re-pairing those faces with another context encountered during the study phase. The advantage for reinstated over re-paired conditions occurred for both within-subjects (Exp. 1) and between-subjects (Exp. 2) manipulations. Critically, in a subsequent recognition test for the contexts themselves, contexts that had previously served in the reinstated condition were recognized better than contexts that had previously served in the re-paired context condition. This constitutes the first demonstration of continuous effects of context reinstatement on memory for context.

Context-aware computing has become an essential component of modern wearable technology, enabling devices to sense, interpret, and respond to users’ environments and affective states. By integrating contextual intelligence, smart systems can adapt their own behavior to better align with user needs, enhancing efficiency, personalization, and user experience. A critical aspect of context awareness is the ability to recognize a user’s internal state, particularly emotions, which influence decision-making, communication, and overall well-being. While emotion recognition is traditionally approached through multimodal sensing—using cameras, microphones, or physiological sensors such as Electroencephalography (EEG), Electrocardiography (ECG), and Electro-dermal Activity (EDA)—these methods often require multiple sensors, leading to challenges related to power consumption, complexity, and privacy. The demand for a more efficient and unobtrusive approach to emotion and context recognition has driven research toward minimal-sensor solutions that can extract meaningful affective and contextual information with reduced hardware requirements. Restricting sensing sources of contextual information by using only limited number of sensors might come at the expense of constraining the ultimate goal of context-awareness. Such expense can be mitigated by “doing more with less” i.e. delving into the opportunities of using a single sensor for multiple purposes. What is desirable is a minimal-sensor solution capable of capturing both motion and physiological signals for both robust emotion recognition and additional context estimation. Among wearable sensors, chest-worn Inertial Measurement Units (IMUs) stand out as promising candidates for comprehensive context estimation, as they are well-positioned to capture motion patterns, and physiological vibrations, being the subtle cardio-respiratory signals. This raises the question of whether a single chest-worn IMU could serve as a minimal yet effective sensor for simultaneously estimating both emotional and contextual information, offering a practical alternative to traditional multi-sensor approaches. To address the challenge of using chest-worn IMU for multiple context sensing, I investigated the potential of using Seismocardiography (SCG) and Accelerometry-Derived Respiration (ADR) to estimate emotional states. First, I explored the existing capabilities of chest-worn IMUs in capturing cardio-respiratory vibrations and motion data, which I used as a knowledge base for embedding such IMUs in context sensing. Data plays a crucial role in this problem, therefore I developed a flexible software interface, ColEmo, to facilitate the scalable collection of emotion-related data and introduced a novel dataset, EmoWear, integrating physiological and motion data for emotion recognition and context awareness. Then, I examined the feasibility of using SCG for emotion recognition, comparing its performance with traditional physiological signals and evaluating its effectiveness as a single-sensor solution. This thesis presents a detailed analysis of the potential of chest-worn IMUs for emotion and context recognition. It reports on the design and validation of a SCG-based wearable system, the development and characteristics of the EmoWear dataset, and the implementation of the ColEmo platform for emotion data collection. The research also examines machine learning techniques applied to the SCG and ADR signals, assessing their effectiveness in estimating emotional states. My findings indicate that SCG-based emotion recognition achieves performance comparable to conventional physiological counterparts, demonstrating the feasibility of using a single IMU sensor for affective computing. The publicly-available EmoWear dataset provides a valuable resource for future research, highlighting the potential of combining motion and physiological data for enhanced context awareness. Additionally, the ColEmo software interface, which I published open-source, proves to be an effective tool for multi-modal emotion data collection, facilitating further advancements in wearable emotion recognition. The results pave the way for a minimal-sensor approach for context information estimation that can significantly reduce system complexity while maintaining high performance. These findings confirm that chest-worn IMUs present an opportunity to further improve emotion recognition in addition to the motion-based context information estimation. My research highlights the need for standardized methodologies in affective computing and demonstrates the viability of motion-based physiological sensing for emotion estimation. By using a single chest-worn IMU, this work presents an alternative to multi-sensor systems, reducing power consumption, and privacy concerns while maintaining robust performance. Future research should focus on refining IMU-based emotion recognition using deep learning techniques and larger datasets to enhance classification accuracy. Further validation in real-world settings is necessary to assess the practical applicability of the proposed system. The EmoWear dataset should be explored for additional context-awareness applications, such as activity recognition and stress monitoring, to maximize its utility. The ColEmo platform offers opportunities for expansion beyond emotion recognition, including cognitive load estimation, stress monitoring, and human-computer interaction. This research moves wearable technology forward by using fewer sensors, helping make affective computing more efficient, versatile, and respectful of privacy.

The impact of post-learning sleep vs. wakefulness on recognition memory for faces with different facial expressions

Youths’ processing of emotion information: Responses to chronic and video-based laboratory stress

Electrophysiological correlates of proactive interference in the ‘Recent Probes’ verbal working memory task

Recently, numerous studies have investigated the neurocognitive mechanism of learning words in isolation or in semantic contexts. However, emotion as an important influencing factor on novel word learning has not been fully considered in the previous studies. In addition, the effects of emotion on word learning and the underlying neural mechanism have not been systematically investigated. Sixteen participants were trained to learn novel concrete or abstract words under negative, neutral, and positive contextual emotions over 3 days; then, fMRI scanning was done during the testing sessions on day 1 and day 3. We compared the brain activations in day 1 and day 3 to investigate the role of contextual emotions in learning different types of words and the corresponding neural plasticity changes. Behaviorally, the performance of the words learned in the negative context was lower than those in the neutral and positive contexts, which indicated that contextual emotions had a significant impact on novel word learning. Correspondingly, the functional plasticity changes of the right angular gyrus (AG), bilateral insula, and anterior cingulate cortex (ACC) induced by word learning were modulated by the contextual emotions. The insula also was sensitive to the concreteness of the learned words. More importantly, the functional plasticity changes of the left inferior frontal gyrus (left IFG) and left fusiform gyrus (left FG) were interactively influenced by the contextual emotions and concreteness, suggesting that the contextual emotional information had a discriminable effect on different types of words in the neural mechanism level. These results demonstrate that emotional information in contexts is inevitably involved in word learning. The role of contextual emotions in brain plasticity for learning is discussed.

Context Effects and the use of Relational Information in Recognition Memory

Findings reported in the memory literature suggest that the emotional components of an encoding episode can be dissociated from nonemotional memory. In particular, it has been found that the previous association with threatening events can be retrieved in aversive conditioning even in the absence of item identification. In the present study, we test whether emotional source memory can be independent of item recognition. Participants saw pictures of snakes paired with threatening and nonthreatening context information (poisonousness or nonpoisonousness). In the source memory test, participants were required to remember whether a snake was associated with poisonousness or nonpoisonousness. A simple extension of a well-established multinomial source monitoring model was used to measure source memory for unrecognized items. By using this model, it was possible to assess directly whether participants were able to associate a previously seen snake with poisonousness or nonpoisonousness even if the snake itself was not recognized as having been presented during the experiment. In 3 experiments, emotional source memory was only found for recognized items. While source memory for recognized items differed between emotional and nonemotional information, source memory for unrecognized items was equally absent for emotional and nonemotional information. We conclude that emotional context information is bound to item representations and cannot be retrieved in the absence of item recognition. (PsycINFO Database Record