發展使用MPEG-Layer-3 的神經信號壓縮器之初期研究

Developing electrophysiological recordings of brain neuronal activity and their analysis provide a basis for exploring the structure of brain function and nervous system investigation. The recorded signals are typically a combination of spikes and noise. High amounts of background noise and possibility of electric signaling recording from several neurons adjacent to the recording site have led scientists to develop neuronal signal processing tools such as spike sorting to facilitate brain data analysis. Spike sorting plays a pivotal role in understanding the electrophysiological activity of neuronal networks. This process prepares recorded data for interpretations of neurons interactions and understanding the overall structure of brain functions. Spike sorting consists of three steps: spike detection, feature extraction, and spike clustering. There are several methods to implement each of spike sorting steps. This paper provides a systematic comparison of various spike sorting sub-techniques applied to real extracellularly recorded data from a rat brain basolateral amygdala. An efficient sorted data resulted from careful choice of spike sorting sub-methods leads to better interpretation of the brain structures connectivity under different conditions, which is a very sensitive concept in diagnosis and treatment of neurological disorders. Here, spike detection is performed by appropriate choice of threshold level via three different approaches. Feature extraction is done through PCA and Kernel PCA methods, which Kernel PCA outperforms. We have applied four different algorithms for spike clustering including K-means, Fuzzy C-means, Bayesian and Fuzzy maximum likelihood estimation. As one requirement of most clustering algorithms, optimal number of clusters is achieved through validity indices for each method. Finally, the sorting results are evaluated using inter-spike interval histograms.

In this research, we study the effect of feature selection in the spike detection and sorting accuracy. We introduce a new feature representation for neural spikes from multichannel recordings. The features selection plays a significant role in analyzing the response of brain neurons. The more precise selection of features leads to a more accurate spike sorting, which can group spikes more precisely into clusters based on the similarity of spikes. Proper spike sorting will enable the association between spikes and neurons. Different with other threshold-based methods, the cepstrum of spike signals is employed in our method to select the candidates of spike features. To choose the best features among different candidates, the Kolmogorov-Smirnov (KS) test is utilized. Then, we rely on the super paramagnetic method to cluster the neural spikes based on KS features. Simulation results demonstrate that the proposed method not only achieve more accurate clustering results but also reduce computational burden, which implies that it can be applied into real-time spike analysis.

Unsupervised spike sorting, a vital processing step in real-time brain-implantable microsystems, is faced with the prominent challenge of managing nonstationarity in neural signals. In long-term recordings, spike waveforms gradually change and new source neurons are likely to become activated. Adaptive spike sorters combined with on-implant training units effectively process the nonstationary signals at the cost of high hardware resource utilization. On the other hand, static approaches, while being hardware-friendly, are subjected to decreased processing performance in such recordings where the neural signal characteristics gradually change. To strike a balance between the hardware cost and processing performance, this study proposes a hardware-efficient novelty-aware spike sorting approach that is capable of dealing with both variated spike waveforms and spike waveforms generated from new source neurons. Its improved hardware efficiency compared to adaptive ones and capability of dealing with nonstationary signals make it attractive for implantable applications. The proposed novelty-aware spike sorting especially would be a good fit for brain-computer interfaces where long-term, real-time interaction with the brain is required, and the available on-implant hardware resources are limited. Our unsupervised spike sorting benefits from a novelty detection process to deal with neural signal variations. It tracks the spike features so that in case of detecting an unexpected change (novelty detection) both on and off-implant parameters are updated to preserve the performance in new state. To make the proposed approach agile enough to be suitable for brain implants, the on-implant computations are reduced while the computational burden is realized off-implant. The performance of our proposed approach is evaluated using both synthetic and real datasets. The results demonstrate that, in the mean, it is capable of detecting 94.31% of novel spikes (wave-drifted or emerged spikes) with a classification accuracy (CA) of 96.31%. Moreover, an FPGA prototype of the on-implant circuit is implemented and tested. It is shown that in comparison to the OSORT algorithm, a pivotal spike sorting method, our spike sorting provides a higher CA at significantly lower hardware resources. The proposed circuit is also implemented in a 180-nm standard CMOS process, achieving a power consumption of 1.78[Formula: see text][Formula: see text] per channel and a chip area of 0.07[Formula: see text]mm2 per channel.

Spike sorting is a fundamental process for decoding neural activity, involving preprocessing, spike detection, feature extraction, clustering, and validation. However, conventional spike sorting methods are highly fragmented, labor-intensive, and heavily reliant on expert manual curation, limiting their scalability and reproducibility. This challenge has become more pressing with advances in neural recording technology, such as high-density Neuropixels for large-scale neural recording or flexible electrodes for long-term stable recording over months to years. The volume and complexity of these datasets make manual curation infeasible, requiring an automated and scalable solution. Here, we introduce SpikeAgent, a multimodal large language model (LLM)-based AI agent that automates and standardizes the entire spike sorting pipeline. Unlike traditional approaches, SpikeAgent integrates multiple LLM backends, coding functions, and established algorithms, autonomously performing spike sorting with reasoning-based decision-making and real-time interaction with intermediate results. It generates interpretable reports, providing transparent justifications for each sorting decision, enhancing transparency and reliability. We benchmarked SpikeAgent against human experts across various neural recording technology, demonstrating its versatility and ability to achieve curation consistency that are equal to, or even higher than human experts. It also drastically reduces the expertise barrier and accelerates the curation and validation time by orders of magnitude. Moreover, it enables automated interpretability of the neural spiking data, which cannot be achieved by any conventional methods. SpikeAgent presents a paradigm shift in processing signals for neuroscience and brain-computer interfaces, while laying the ground for AI agent-augmented science across various domains.

Spike sorting, i.e., the separation of the firing activity of different neurons from extracellular measurements, is a crucial but often error-prone step in the analysis of neuronal responses. Usually, three different problems have to be solved: the detection of spikes in the extracellular recordings, the estimation of the number of neurons and their prototypical (template) spike waveforms, and the assignment of individual spikes to those putative neurons. If the template spike waveforms are known, template matching can be used to solve the detection and classification problem. Here, we show that for the colored Gaussian noise case the optimal template matching is given by a form of linear filtering, which can be derived via linear discriminant analysis. This provides a Bayesian interpretation for the well-known matched filter output. Moreover, with this approach it is possible to compute a spike detection threshold analytically. The method can be implemented by a linear filter bank derived from the templates, and can be used for online spike sorting of multielectrode recordings. It may also be applicable to detection and classification problems of transient signals in general. Its application significantly decreases the error rate on two publicly available spike-sorting benchmark data sets in comparison to state-of-the-art template matching procedures. Finally, we explore the possibility to resolve overlapping spikes using the template matching outputs and show that they can be resolved with high accuracy.

A spike detection system has been developed using a pattern-recognition technique. The waves are processed by a 16-bit microcomputer, and only the waves that satisfy certain statistical conditions are detected as a spike. A normalized method is used to take care of fluctuations over time of amplitude, period, duration, etc. The accuracy of spike detection is 96%. >

The perceptual deadband (PD) data reduction scheme allows for a significant reduction of network load in real-time haptic communication scenarios. Aiming to ascertain how the optimum PD data reduction parameter k is best determined, an experiment was conducted in which a possible interaction of PD data reduction and visual feedback on haptic feedback quality and task performance was investigated. The results show that when haptic feedback is complemented with visual feedback, haptic data reduction affects haptic feedback quality at a lower data reduction rate than it affects task performance. When visual feedback is missing, however, this effect is reversed. These results imply that the perception of haptic feedback quality is markedly influenced by visual sensory input as well as task requirements; hence, it is recommended to consider feedback quality and task performance in the optimization of PD reduction before such schemes may be applied to industrial telepresence and teleaction systems.

Neural spike sorting is used to classify neural spike signals based on neuron type and so is an essential step in decoding brain signals. Because of its computational complexity, spike sorting is generally carried out offline or, at least, using a transmitted signal. In contrast, in-brain spike sorting would reduce the data that needs to be transmitted by orders of magnitude with a corresponding reduction in transmission power. This would enable real-time wireless neural recordings. In this paper, we design and characterize a hardware prototype for in-brain spike sorting. Our design is able to reduce the wireless transmission power by a factor of over 200 over direct transmission. Also, compared with the current state-of-the-art, our design increases the sorting accuracy from 75% to 93% while remaining within hard constraints for power, power density, and real-time processing.

A simple method for efficient spike detection in multiunit recordings

Event Abstract Back to Event Optimizing Spike-Sorting Yield through Selection of Optimal Recording Sites in High-density Microelectrode Arrays Jan Müller1*, Felix Franke2, Michele Fiscella1, Urs Frey3, Douglas Bakkum1 and Andreas Hierlemann1 1 ETH Zurich, Department of Biosystems Science and Engineering, Switzerland 2 ETH Zürich, Department of Biosystems Science and Engineering, Switzerland 3 Riken, Quantitative Biology Center, Japan Motivation Recently, various high-density microelectrode arrays (HDMEA) were developed for in-vitro and in-vivo applications. Some of these arrays feature hundreds to thousands of electrodes, from which a subset can be selected for recording at one time [1-4]. Our goal here is to simultaneously extract the activity of a maximum number of identifiable neurons from such recordings. Careful choice of recording electrodes is required, when the number of recorded neurons exceeds the number of available recording channels. When analyzing data from networks of neurons, one is typically interested in the exact relative timing of the occurrence of action potentials in different neurons. Here, we consider the assignment of recorded action potentials to individual neurons a classification problem. Therefore, we propose a metric relying on linear discriminant analysis (LDA) to compute the expected classification error for a given electrode arrangement. Moreover, we propose an algorithm to automatically find optimal electrode configurations. Material and Methods HDMEA: To demonstrate the feasibility of our method, we used a recently developed HDMEA featuring 26,400 Pt microelectrodes, arranged in a grid-like configuration with a center-to-center pitch of 17.5 μm [3]. 1024 of these electrodes can be selected for simultaneous recording by means of low-noise amplifiers (2.4 μV rms in the action potential signal band 300 Hz–10 kHz). Algorithm: The extent to which action potentials from two neurons can be clearly distinguished depends on their multi-electrode waveforms. The best separation can be achieved if information from all electrodes is available. However, only a subset of all available electrodes can be used for recording at the same time. Our method starts out by successively recording through blocks of all 26,400 electrodes, spike sorting each of the recordings, and building templates for each neuron (Step 1). Using the templates from all neurons and linear discriminant analysis [5], we compute the expected spike sorting error (ESSE) using all electrodes. We then compute for each electrode the ESSE under the assumption that the corresponding electrode would not be used for recording (Step 2). Electrodes, the removal of which increases the ESSE by the least amount will then be discarded (Step 3). Step 2 and 3 are iterated until the desired number of electrodes, i.e., the number of available readout channels is reached. Results We recorded from a patch of hamster retina for ten minutes per electrode. Based on this data, action potential templates were computed, and the algorithm has been applied to identify the optimal recording electrodes. The classification error decays exponentially upon increasing the number of used electrodes. Discussion/Conclusion We have presented a framework to assess the quality of a particular recording scenario. The framework quantifies the error probability for discriminating between all a-priori known templates for all present neurons. The algorithm was applied to recordings from a retina performed with a recently developed HDMEA. Our approach is related to earlier work [6]. However, by relying on linear discriminant analysis, we make - in a Bayesian sense - optimal use of the available recording resources. [1] Lopez, Carolina M., et al. "A 966-electrode neural probe with 384 configurable channels in 0.13μm SOI CMOS", ISSCC (2016), 392-393. [2] Viswam, Vijay, et al. "Multi-Functional Microelectrode Array System featuring 59’760 Electrodes, 2048 Electrophysiology Channels, Impedance and Neurotransmitter Measurement Units", ISSCC (2016), 394-396. [3] Ballini, Marco, et al. "A 1024-Channel CMOS microelectrode array with 26,400 electrodes for recording and stimulation of electrogenic cells in vitro." Solid-State Circuits, IEEE Journal of 49.11 (2014): 2705-2719. [4] Seidl, Karsten, et al. "CMOS-based high-density silicon microprobe arrays for electronic depth control in intracortical neural recording" Microelectromechanical Systems, Journal of, 20(6):1439– 1448, 2011. [5] Franke, Felix, et al. "Bayes Optimal Template Matching for Spike Sorting – Combining Fisher Discriminant Analysis with Optimal Filtering, " J. Comput. Neurosci., vol. 38, no. 3, pp. 439–459, 2015. [6] Vysotska, Olga, "Automatic channel selection and neural signal estimation across channels of neural probes", International Conference on Intelligent Robots and Systems (2014), 1453–1459. Keywords: Retina, CMOS, Spike-sorting, high-density microelectrode array (HDMEA) Conference: MEA Meeting 2016 | 10th International Meeting on Substrate-Integrated Electrode Arrays, Reutlingen, Germany, 28 Jun - 1 Jul, 2016. Presentation Type: Poster Presentation Topic: MEA Meeting 2016 Citation: Müller J, Franke F, Fiscella M, Frey U, Bakkum D and Hierlemann A (2016). Optimizing Spike-Sorting Yield through Selection of Optimal Recording Sites in High-density Microelectrode Arrays. Front. Neurosci. Conference Abstract: MEA Meeting 2016 | 10th International Meeting on Substrate-Integrated Electrode Arrays. doi: 10.3389/conf.fnins.2016.93.00122 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 22 Jun 2016; Published Online: 24 Jun 2016. * Correspondence: Dr. Jan Müller, ETH Zurich, Department of Biosystems Science and Engineering, Basel, Switzerland, jan.mueller@bsse.ethz.ch Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Jan Müller Felix Franke Michele Fiscella Urs Frey Douglas Bakkum Andreas Hierlemann Google Jan Müller Felix Franke Michele Fiscella Urs Frey Douglas Bakkum Andreas Hierlemann Google Scholar Jan Müller Felix Franke Michele Fiscella Urs Frey Douglas Bakkum Andreas Hierlemann PubMed Jan Müller Felix Franke Michele Fiscella Urs Frey Douglas Bakkum Andreas Hierlemann Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.

In a resource-constrained Wireless Sensor Networks (WSNs), the optimization of the sampling and the transmission rates of each individual node is a crucial issue. A high volume of redundant data transmitted through the network will result in collisions, data loss, and energy dissipation. This paper proposes a novel data reduction scheme that exploits the spatial-temporal correlation among sensor data in order to determine the optimal sampling strategy for the deployed sensor nodes. This strategy reduces the overall sampling/transmission rates while preserving the quality of the data. Moreover, a back-end reconstruction algorithm is deployed on the workstation (Sink). This algorithm can reproduce the data that have not been sampled by finding the spatial and temporal correlation among the reported data set, and filling the “non-sampled” parts with predictions. We have used real sensor data of a network that was deployed at the Grand-St-Bernard pass located between Switzerland and Italy. We tested our approach using the previously mentioned data-set and compared it to a recent adaptive sampling based data reduction approach. The obtained results show that our proposed method consumes up to 60% less energy and can handle non-stationary data more effectively.

Biofouling and corrosion of heat exchanger surfaces in Ocean Thermal Energy Conversion (OTEC) systems may be controlling factors in the potential success of the OTEC concept. Very little is known about the nature and behavior of marine fouling films at sites potentially suitable for OTEC power plants. To facilitate the acquisition of needed data, a biofouling measurement device developed by Professor J. G. Fetkovich and his associates at Carnegie-Mellon University (CMU) has been mass produced for use by several organizations in experiments at a variety of ocean sites. The CMU device is designed to detect small changes in thermal resistance associated with the formation of marine microfouling films. An account of the work performed at the Pacific Northwest Laboratory (PNL) to develop a computerized uncertainty analysis for estimating experimental uncertainties of results obtained with the CMU biofouling measurement device and data reduction scheme is presented. The analysis program was written as a subroutine to the CMU data reduction code and provides an alternative to the CMU procedure for estimating experimental errors. The PNL code was used to analyze sample data sets taken at Keahole Point, Hawaii; St. Croix, the Virgin Islands; and at a site in the Gulf of Mexico. The uncertainties of the experimental results were found to vary considerably with the conditions under which the data were taken. For example, uncertainties of fouling factors (where fouling factor is defined as the thermal resistance of the biofouling layer) estimated from data taken on a submerged buoy at Keahole Point, Hawaii were found to be consistently within 0.00006 hr-ft/sup 2/-/sup 0/F/Btu, while corresponding values for data taken on a tugboat in the Gulf of Mexico ranged up to 0.0010 hr-ft/sup 2/-/sup 0/F/Btu. Reasons for these differences are discussed.

Advances in neuronal probe technology to record brain activity have posed a significant challenge in performing necessary processing and analysis of the recorded data. To be able to infer meaningful conclusions from the recorded signals through these probes, sophisticated signal processing and analysis tools are required. This paper presents a MATLAB-based novel tool, 'SigMate', capable of performing various processing and analysis incorporating the available standard tools and our in-house custom tools. The present features include, data display (2D and 3D), baseline correction, stimulus artifact removal, noise characterization, file operations (file splitter, file concatenator, and file column rearranger), latency estimation, determination of cortical layer activation order, spike detection, spike sorting, and are gradually growing. This tool has been tested extensively for the recordings using the standard micropipettes as well as implantable neural probes based on EOSFETs (Electrolyte-Oxide-Semiconductor Field Effect Transistors) and will be made available to the community shortly.

Unsupervised automatic online spike sorting using reward-based online clustering

Brain-machines - also termed neural prostheses, could potentially increase substantially the quality of life for people suffering from motor disorders or even brain palsy. In this paper we investigate the non-stationary continuous decoding problem associated to the rat’s hand position. To this aim, intracortical data (also named ECoG for electrocorticogram) are processed in successive stages: spike detection, spike sorting, and intention extraction from the firing rate signal.