Perceptual Organization

In 1912, Max Wertheimer published his paper on phi motion, widely recognized as the start of Gestalt psychology. Because of its continued relevance in modern psychology, this centennial anniversary is an excellent opportunity to take stock of what Gestalt psychology has offered and how it has changed since its inception. We first introduce the key findings and ideas in the Berlin school of Gestalt psychology, and then briefly sketch its development, rise, and fall. Next, we discuss its empirical and conceptual problems, and indicate how they are addressed in contemporary research on perceptual grouping and figure-ground organization. In particular, we review the principles of grouping, both classical (e.g., proximity, similarity, common fate, good continuation, closure, symmetry, parallelism) and new (e.g., synchrony, common region, element and uniform connectedness), and their role in contour integration and completion. We then review classic and new image-based principles of figure-ground organization, how it is influenced by past experience and attention, and how it relates to shape and depth perception. After an integrated review of the neural mechanisms involved in contour grouping, border ownership, and figure-ground perception, we conclude by evaluating what modern vision science has offered compared to traditional Gestalt psychology, whether we can speak of a Gestalt revival, and where the remaining limitations and challenges lie. A better integration of this research tradition with the rest of vision science requires further progress regarding the conceptual and theoretical foundations of the Gestalt approach, which is the focus of a second review article.

This chapter provides an overview of some fundamental issues in perceptual organization. The Gestalt psychologists hypothesized that perceptual experience stood in an isomorphic relationship with brain processes. The role of the phenomenologist in guiding the research of the experimental psychologist is comparable to the role of the experimental psychologist in guiding the research of the physiological psychologist: Their relationship should be thought of not as antagonistic but rather as complementary. In order to explain curious interactions in perceptual fields, the Gestalt psychologists postulated a physiological model in which perceived form corresponded to the shape of electrical fields in the brain. Perceptual organization also includes the representation of relationships among the various objects in the perceptual world, including spatial relationships such as support, occlusion, and the like in the visual modality and analogous relationships in the other modalities. An important aspect of perceptual organization is the processing of relational information from the sensory input.

Perceptual organization remains one of the very few established theories on the human visual system. It underpinned many pre-deep seminal works on segmentation and detection, yet research has seen a rapid decline since the preferential shift to learning deep models. Of the limited attempts, most aimed at interpreting complex visual scenes using perceptual organizational rules. This has however been proven to be sub-optimal, since models were unable to effectively capture the visual complexity in real-world imagery. In this paper, we rejuvenate the study of perceptual organization, by advocating two positional changes: (i) we examine purposefully generated synthetic data, instead of complex real imagery, and (ii) we ask machines to synthesize novel perceptually-valid patterns, instead of explaining existing data. Our overall answer lies with the introduction of a novel visual challenge – the challenge of perceptual question answering (PQA). Upon observing example perceptual question-answer pairs, the goal for PQA is to solve similar questions by generating answers entirely from scratch (see Figure 1). Our first contribution is therefore the first dataset of perceptual question-answer pairs, each generated specifically for a particular Gestalt principle. We then borrow insights from human psychology to design an agent that casts perceptual organization as a self-attention problem, where a proposed grid-to-grid mapping network directly generates answer patterns from scratch. Experiments show our agent to outperform a selection of naive and strong baselines. A human study however indicates that ours uses astronomically more data to learn when compared to an average human, necessitating future research (with or without our dataset).

Perceptual organization (PO) deficits have long been considered a hallmark of schizophrenia (SZ), reflecting disruptions in the integration of visual information. This systematic review critically evaluates the behavioral evidence for PO impairments in SZ and individuals with high schizotypal traits, focusing on three key mid-level processes: contour integration, perceptual grouping, and figure-ground segmentation. Forty-four studies were included, identified through a systematic search and evaluated for bias using the QUADAS-2 tool. Findings reveal robust and replicable deficits in contour integration among individuals with SZ, especially in those with disorganization symptoms, suggesting impaired lateral interactions in early visual areas. Perceptual grouping deficits were also prominent but appeared more sensitive to cognitive load and stimulus complexity, consistent with top-down integration failures. Figure-ground segmentation impairments were less consistently reported and often dependent on task demands, emerging more clearly under challenging conditions. In schizotypy, evidence of PO deficits was more variable. Some studies identified subtle impairments in contour integration and grouping, particularly under high attentional load or in individuals with disorganized traits, while others reported intact performance. The heterogeneity of methods across studies, particularly differences in stimulus type, complexity, and grouping cues, was a major limiting factor for cross-study comparisons. Findings from this review support a dimensional view of PO deficits, where specific symptom clusters, rather than diagnosis alone, predict perceptual dysfunction. PO impairments, particularly in contour integration, may serve as sensitive cognitive markers for early detection and targeted intervention in SZ-spectrum disorders.

The processes of perceptual organization and social categorization share the goal of simplifying and structuring the world, though they have traditionally been studied within separate branches of psychology. Drawing on embodied cognition, this perspective suggests that both processes stem from bodily experiences. Early sensorimotor experiences, such as being held in proximity or rocked in synchrony, may have shaped the principles of perceptual organization and provide the foundations for social categorization. To integrate these domains, a triadic embodied model is proposed, linking bodily experience, perceptual organization, and social categorization as dynamically interacting vertices. The model allows bidirectional influences, whereby each element can prime and reinforce the others, and may also involve activation of metaphorical concepts. It further explains how cultural context can bias these interconnections. The model situates social categorization along a continuum of representational depth, from shallow symbolic tagging to deep embodied simulation. While prior work has demonstrated dyadic links between bodily experience, perceptual organization, and social categorization, the present article explicitly integrates these domains in a unified model, offering new directions for understanding how people structure their physical and social world.

Perceptual organization in task performance

How do we perceptually and cognitively organize incoming stimulation? A century ago, Gestalt psychologists posited the law of Prägnanz: psychological organization will always be as 'good' as possible given the prevailing conditions. To make the Prägnanz law a useful statement, it needs to be specified further (a) what a 'good' psychological organization entails, (b) how the Prägnanz tendency can be realized, and (c) which conditions need to be taken into account. Although the Gestalt school did provide answers to these questions, modern-day mentions of Prägnanz or good Gestalt often lack these clarifications. The concept of Prägnanz has been (mis)understood in many different ways, and by looking back on the rich history of the concept, we will attempt to present a more fine-grained view and promote a renewed understanding of the central role of Prägnanz in visual perception and beyond. We review Gestalt psychology's answers to the questions listed above, and also discuss the four main uses of the Prägnanz concept in more detail: (a) a Prägnanz tendency in each organizational process, (b) Prägnanz as a property of a Gestalt, (c) Prägnanz steps as internal reference points, and (d) Prägnanz in relation to aesthetic appreciation. As a key takeaway, Prägnanz is a multifaceted Gestalt psychological concept indicating the "goodness" of an experienced organization. Both the removal of unnecessary details and the emphasis on characteristic features of the overall organization compared to a reference organization can contribute to the emergence of a 'better' Gestalt. The stimulus constellation is not the only factor in determining the goodness of an organization, also the stimulus' interaction with an individual in a specific spatial and temporal context plays a role. Taking the ideas on Prägnanz as a generative framework and keeping the original Gestalt psychological context in mind, future research on perceptual organization can improve our understanding of the principles underlying psychological organization by further specifying how different organizational principles interact in concrete situations. Public significance statement: This paper reviews what a 'good' psychological organization entails, and how the incoming stimulation is clarified in human perception to achieve the best possible psychological organization. The review debunks common misconceptions on the meaning of "goodness" and synthesizes the most important perspectives and developments on "goodness" from its conception until now.

Distortions in memory for maps

In our complex acoustic environment, we are confronted with a mixture of sounds produced by several simultaneous sources. However, we rarely perceive these sounds as incomprehensible noise. Our brain uses perceptual organization processes to independently follow the emission of each sound source over time. If the acoustic properties exploited in these processes are well-established, the neurophysiological mechanisms involved in auditory scene analysis remain unclear and have recently raised more interest. Here, we review the studies investigating these mechanisms using electrophysiological recordings from the cochlear nucleus to the auditory cortex, in animals and humans. Their findings reveal that basic mechanisms such as frequency selectivity, forward suppression and multi-second habituation shape the automatic brain responses to sounds in a way that can account for several important characteristics of perceptual organization of both simultaneous and successive sounds. One challenging question remains unresolved: how are the resulting activity patterns integrated to yield the corresponding conscious percepts?

The Psychology of Perceptual Organization: A Transformational Approach

The processing and perception of visual stimuli are greatly dependent on the context in which those stimuli are presented. While this is not always (and indeed is probably not supposed to be) evident when viewing real-world scenes, the abundance of contextual effects is revealed for example by the vast number of different visual illusions. Context can profoundly change the way the visual system processes single visual stimuli. In contrast masking, surround suppression, and crowding, distracting stimuli impair the observer's ability to detect, identify, and make other judgements about visual stimuli. These perceptual phenomena presumably reflect the operation of neural mechanisms that adjust the operating range of the visual system according to the prevailing conditions, or act to reduce responses to redundant stimulus features. This work first investigates the relationship between masking, which is caused by stimuli that are spatially superimposed on a target stimulus, and surround suppression, which is caused by spatially displaced stimuli. This was done using a temporal masking paradigm and measuring the time-courses of masking and surround suppression. The results reveal how the effects of these suppressive interactions are delicately dependent on stimulus timing and suggest that surround suppression acts extremely fast, having an effect on the early part of the neural response. Finally, contextual effects such as surround suppression and crowding are often considered to be automatic processes that occur over fixed areas in the visual field. The final part of this work shows how changing the spatial layout, and consequently the perceptual organization, of the stimuli can dramatically reduce surround suppression and crowding effects, even in conditions where the current models would predict strong effects. Surround suppression and crowding seem to operate only within perceptually homogeneous areas, while stimuli that are perceptually separate, the ones that stand out, are not affected.

We perceive structure through a process of perceptual organization. Here we report a new perceptual organization phenomenon-the facilitation of visual grouping by global curvature. Observers viewed patterns that they perceived as organized into collections of curves. The patterns were perceptually ambiguous such that the perceived orientation of the patterns varied from trial to trial. When patterns were sufficiently dense and proximity was equated for the predominant perceptual alternatives, observers tended to perceive the organization with the greatest curvature. This effect is tantamount to visual grouping by maximal curvature and thus demonstrates an unprecedented effect of global structure on perceptual organization. We account for this result with a model that predicts the perceived organization of a pattern as function of its nonaccidentality, which we define as the probability that it could have occurred by chance. Our findings demonstrate a novel relationship between the geometry of a pattern and the visual salience of global structure.

Point clouds with ever-increasing volume are regular data in 3D city modelling, in which building reconstruction is a significant part. The photogrammetric point cloud, generated from UAS (Unmanned Aerial System) imagery, is a novel type of data in building reconstruction. Its positive characteristics, alongside its challenging qualities, provoke discussions on this theme of research. In this paper, patch-wise detection of the points of window frames on facades and roofs are undertaken using this kind of data. A density-based multi-scale filter is devised in the feature space of normal vectors to globally handle the matter of high volume of data and to detect edges. Color information is employed for the downsized data to remove the inner clutter of the building. Perceptual organization directs the approach via grouping and the Gestalt principles, to segment the filtered point cloud and to later detect window patches. The evaluation of the approach displays a completeness of 95% and 92%, respectively, as well as a correctness of 95% and 96%, respectively, for the detection of rectangular and partially curved window frames in two big heterogeneous cluttered datasets. Moreover, most intrusions and protrusions cannot mislead the window detection approach. Several doors with glass parts and a number of parallel parts of the scaffolding are mistaken as windows when using the large-scale object detection approach due to their similar patterns with window frames. Sensitivity analysis of the input parameters demonstrates that the filter functionality depends on the radius of density calculation in the feature space. Furthermore, successfully employing the Gestalt principles in the detection of window frames is influenced by the width determination of window partitioning.

In the previous chapter, I specified perceptual organization as an autonomous process that enables us to perceive scenes as structured wholes consisting of objects arranged in space. Because any scene can be interpreted in numerous ways, it is amazing not only that the visual system usually has a clear preference for only one interpretation, but also that this interpretation usually is sufficiently veridical to guide us through the world. Indeed, it is true that visual illusions show that what we see is not always what we look at, but a fair degree of veridicality seems necessary — otherwise, our visual system would probably not have survived during evolution. In this chapter, expanding on van der Helm (2000), I assess what degree of veridicality vision might achieve by aiming at simplicity. To this end, I elaborate on three related issues, which I next introduce briefly. S implicity versus likelihood . The main issue is whether the perceptual organization process is guided by the likelihood principle (von Helmholtz, 1909/1962) or by the simplicity principle (Hochberg & McAlister, 1953). Both principles take this process as a form of unconscious inference yielding interpretations which persons subjectively believe are most likely to be true. The question, however, is what drives this unconscious inference, and as I indicate next, the two principles differ fundamentally in this respect. The likelihood principle, on the one hand, aims explicitly at a high degree of veridicality in the external world.

In this journal, Palmer and Rock (1994) articulated a principle of perceptual organization calleduniform connectedness (UC); and they contended that previous investigators of perception had failed to realize the need for this organizing principle. The authors outlined a theory of perceptual organization that "places the principle of UC at center stage" (p. 38) in that UC was assigned the two privileged roles of (1) forming the fundamental units for later perceptual processes, and (2) yielding the postconstancy regions that correspond to environmental surfaces. In this commentary, I argue that the proposed theory entails a serial ordering of perceptual processes that is inconsistent with current evidence regarding figure-ground organization, stereo fusion, and object recogntion. In addition, I point out that Kurt Koffka (1935) recognized the need for a principle of unit formation similar to the one proposed by Palmer and Rock.