Beyond frames: A contextual deep learning approach for classroom action understanding

Software was developed in Python for the digital processing of object images before their detection using the You Only Look Once (YOLO) artificial neural network. Detection was carried out on object images, specifically vehicles and other road users. The preprocessing of images was performed through histogram equalization and local contrast enhancement. The original images were read from video cameras or graphic files. Image detection was performed using the medium-sized YOLO convolutional neural network model, YOLOv8m. As a result of detection, the studied objects, particularly cars, were highlighted with rectangular bounding boxes. To evaluate the accuracy of object detection, several metrics (parameters) were used: Precision, Recall, Intersection over Union (IoU), F1, and Average Precision (AP). The YOLO network was pre-trained on the Common Objects in Context dataset. The YOLO neural network returns the object recognition confidence, the coordinates of its center (x, y) on the image, and its width and height (w, h). The detected objects are marked with rectangular bounding boxes. The positioning of objects in the images was manually performed using the Roboflow tool, which allows for accurate spatial positioning of each object. The study of the impact of image preprocessing on the accuracy of object detection by the YOLO network was conducted using a typical traffic scene image. After histogram equalization, the histogram becomes more symmetrical and uniform, improving the visual quality of both dark and bright areas. This led to improved object detection accuracy across almost all metrics. The increase in detection accuracy by the IoU parameter is 0.169. The summary improvement in detection accuracy by the IoU, F1, AP parameters is 0.502. It was shown that after image preprocessing, detection accuracy increased, and all vehicles were correctly detected. The developed software can be used in various computer vision systems as well as in Internet of Things systems for remote monitoring and control.

Lesion segmentation in dermoscopic images significantly enhances the diagnostic performance of AI-based classification models. However, conventional methods often require pixel-level annotations, which are resource-intensive and prone to errors caused by external artifacts, such as hair and skin markings. We propose a hybrid framework called SAM-enhanced YOLO, which integrates the Segment Anything Model (SAM) with You Only Look Once (YOLO) for precise pixel-level segmentation. This method combines YOLO's efficient lesion localization with SAM's advanced zero-shot segmentation capabilities. To further validate the framework, we compared it against traditional methods, including GrabCut and Otsu's thresholding, as well as SAM used without YOLO (SAM-only). For SAM-only, lesion segmentation was initialized at the image center to simulate a typical dermoscopic imaging setup. SAM-enhanced YOLO demonstrated superior segmentation performance, achieving an Intersection over Union (IoU) of 0.738 and an F1-score (the harmonic mean of precision and recall) of 0.833, compared to 0.578 and 0.683 with SAM-only, respectively. This represents a 28% improvement in IoU and a 22% improvement in F1-score compared to SAM-only. The results were consistent across lesion shapes and contrast conditions, with SAM-enhanced YOLO exhibiting the lowest variability and highest robustness among the evaluated methods. By reducing the need for pixel-level annotations and outperforming both standalone SAM and traditional methods, SAM-enhanced YOLO provides a scalable and resource-efficient solution for dermoscopic lesion segmentation. This framework holds significant potential for improving diagnostic workflows in clinical and resource-limited settings.

Accurately obtaining accurate information about the future traffic flow of all roads in the transportation network is essential for traffic management and control applications. In order to address the challenges of acquiring dynamic global spatial correlations between transportation links and modeling time dependencies in multi-step prediction, we propose a spatial linear transformer and temporal convolution network (SLTTCN). The model is using spatial linear transformers to aggregate the spatial information of the traffic flow, and bidirectional temporal convolution network to capture the temporal dependency of the traffic flow. The spatial linear transformer effectively reduces the complexity of data calculation and storage while capturing spatial dependence, and the time convolutional network with bidirectional and gate fusion mechanisms avoids the problems of gradient vanishing and high computational cost caused by long time intervals during model training. We conducted extensive experiments using two publicly available large-scale traffic data sets and compared SLTTCN with other baselines. Numerical results show that SLTTCN achieves the best predictive performance in various error measurements. We also performed attention visualization analysis on the spatial linear transformer, verifying its effectiveness in capturing dynamic global spatial dependency.

The main core purpose of artificial emotional intelligence is to recognize human emotions. Technologies such as facial, semantic, or brainwave recognition applications have been widely proposed. However, the abovementioned recognition techniques for emotional features require a large number of training samples to obtain high accuracy. Human behaviour pattern can be trained and recognized by the continuous movement of the Spatial Temporal Graph Convolution Network (ST-GCN). However, this technology does not distinguish between the speed of delicate emotions, and the speed of human behaviour and delicate changes of emotions cannot be effectively distinguished. This research paper proposes Spatial Temporal Variation Convolutional Network training for human emotion recognition, using skeleton detection technology to calculate the degree of skeleton point change between consecutive actions and using the nearest neighbour algorithm to classify speed levels and train the ST-GCN recognition model to obtain the emotional state. Application of the speed change recognition ability of the Spatial Temporal Variation Graph Convolution Network (STV-GCN) to artificial emotional intelligence calculation makes it possible to efficiently recognize the delicate actions of happy, sad, fear, and angry in human behaviour. The STV-GCN technology proposed in this paper is compared with ST-GCN and can effectively improve the recognition accuracy by more than 50%.

Efficient identification of key nodes is crucial to optimizing detector deployment and enhancing traffic monitoring in intelligent transportation systems. However, existing approaches often struggle to adapt to dynamic traffic variations, leading to suboptimal coverage and increased deployment costs. We propose bidirectional temporal convolutional graph attention networks (BTC-GATs) to address these limitations. This novel framework integrates bidirectional attention mechanisms to capture upstream and downstream dependencies, temporal convolutional networks for multiscale feature extraction, and graph attention networks for spatial information aggregation. BTC-GATs incorporates adaptive temporal modeling to capture nonlinear traffic dynamics, gradient-based variation analysis to quantify node influence, and a ranking mechanism that fuses attention coefficients with topological attributes to further enhance robustness and interoperability. In addition, a key node coverage study is conducted to examine the trade-off between accuracy and deployment efficiency. Extensive experiments on the California Highway PeMS04 dataset demonstrate that BTC-GATs outperforms benchmark methods in key node identification, offering superior accuracy and stability. Further analysis confirms its robustness under varying traffic conditions and initialization settings, highlighting its potential as a scalable, adaptive, and cost-effective solution for intelligent traffic monitoring. By facilitating efficient sensor placement, BTC-GATs contributes to improved data collection and congestion management in large-scale transportation networks.

Data in time series format, such as biological signals from medical sensors or machine signals from sensors in industrial environments are rich sources of information that can give crucial insights on the present and future condition of a person or machine. The task of predicting future values of time series has been initially approached with simple machine learning methods, and lately with deep learning. Two models that have shown good performance in this task are the temporal convolutional network and the attention module. However, despite the promising results of deep learning methods, their black-box nature makes them unsuitable for real-world applications where the predictions need to be explainable in order to be trusted. In this paper we propose an architecture comprised of a temporal convolutional network with an attention mechanism that makes predictions while presenting the timesteps of the input that were most influential for future outputs. We apply it on two datasets and we show that we gain interpretability without degrading the accuracy compared to the original temporal convolutional models. We then go one step further and we combine our configuration with various machine learning methods on top, creating a pipeline that achieves interpretability both across timesteps and input features. We use it to forecast a different variable from one of the above datasets and we study how the accuracy is affected compared to the original black-box approach.

YOLO-YCbCr based smoke segmentation method for fire detection was proposed in this study to enhance smoke segmentation performance with reduction in computational cost. The proposed method consists of the deep learning object detection model, You Only Look Once (YOLO), and the color space-based segmentation model, rule-based YCbCr. YOLO is used to detect smoke objects in the input fire images through bounding boxes. The images in the bounding boxes are characterized based on YCbCr color space and the proposed YCbCr rules derived by considering smoke image characteristics segment smoke region. In order to evaluate the smoke segmentation performance, six different fire incident video data were used. The mean intersection over union (IoU) value of the proposed method was improved by approximately 31.3% and 24.5% respectively when compared to the reference models: YOLO-RGB model and YOLO-CIELAB model. It was found that YOLO significantly reduced the erroneous smoke segmentation and YCbCr rules derived from the smoke color features were effective in the smoke segmentation.

The you-only-look-once (YOLO) v2 object detector uses a single stage object detection network. YOLO v2 is faster than other two-stage deep learning object detectors, such as regions with convolutional neural networks (Faster R-CNNs).The YOLO v2 model runs a deep learning CNN on an input image to produce network predictions. The object detector decodes the predictions and generates bounding boxes YOLO v2 uses anchor boxes to detect classes of objects in an image. For more details, see Anchor Boxes for Object Detection. The YOLO v2 predicts these three attributes for each anchor box: Intersection over union (IoU) — Predicts the objectness score of each anchor box. Anchor box offsets — Refine the anchor box position. Class probability — Predicts the class label assigned to each anchor box. The figure shows predefined anchor boxes (the dotted lines) at each location in a feature map and the refined location after offsets are applied. Matched boxes with a class are in color. You can design a custom YOLO v2 model layer by layer. The model starts with a feature extractor network, which can be initialized from a pretrained CNN or trained from scratch. The detection subnetwork contains a series of Conv, Batch norm, and ReLu layers, followed by the transform and output layers, yolov2TransformLayer and yolov2OutputLayer objects, respectively.yolov2TransformLayertransforms the raw CNN output into a form required to produce object detections.yolov2OutputLayerdefines the anchor box parameters and implements the loss function used to train the detect.

Accurate load forecasting is essential for ensuring safe, stable, and economical operation of energy internet. Temporal convolutional networks (TCNs) have demonstrated superior performance, when compared to recurrent neural network models, since their introduction in electrical load forecasting. However, the current TCN‐based models are unable to obtain a large receptive field and strong long‐time feature extraction capability owing to the specific kernel size of the 1D convolution structure. This paper proposes a temporal inception convolutional network based on multi‐head attention (TICN‐Att) for ultra‐short‐term load prediction. By introducing an inception structure into the TCN, the proposed model can extract multi‐dimensional information from the input features, through the multiple hidden convolutional kernels of different scales, without stacking layers depth‐wise. Simultaneously, by introducing a multi‐head attention mechanism, the TICN‐Att model has a long time‐dependent extraction capability, similar to that of the long short‐term memory network models. The generalization and validity of the model are tested using the global energy forecasting competition (GEFCOM2014) dataset, electrical load data of a city in Jiangsu (China), and PJM power system dataset. The experimental results demonstrated that the proposed model has the best prediction effect, compared to the other state‐of‐the‐art models.

A novel structural deformation prediction method based on graph convolutional network during shield tunnel construction

Transient muscle movements influence the temporal structure of myoelectric signal patterns, often leading to unstable prediction behavior from movement-pattern classification methods. We show that temporal convolutional network sequential models leverage the myoelectric signal's history to discover contextual temporal features that aid in correctly predicting movement intentions, especially during interclass transitions. We demonstrate myoelectric classification using temporal convolutional networks to effect 3 simultaneous hand and wrist degrees-of-freedom in an experiment involving nine human-subjects. Temporal convolutional networks yield significant (p<;0.001) performance improvements over other state-of-the-art methods in terms of both classification accuracy and stability.

Abstract. The present work proposes a prediction model of significant wave height (SWH) and average wave period (APD) based on variational mode decomposition (VMD), temporal convolutional networks (TCNs), and long short-term memory (LSTM) networks. The wave sequence features were obtained using VMD technology based on the wave data from the National Data Buoy Center. Then the SWH and APD prediction models were established using TCNs, LSTM, and Bayesian hyperparameter optimization. The VMD–TCN–LSTM model was compared with the VMD–LSTM (without TCN cells) and LSTM (without VMD and TCN cells) models. The VMD–TCN–LSTM model has significant superiority and shows robustness and generality in different buoy prediction experiments. In the 3 h wave forecasts, VMD primarily improved the model performance, while the TCN had less of an influence. In the 12, 24, and 48 h wave forecasts, both VMD and TCNs improved the model performance. The contribution of the TCN to the improvement of the prediction result determination coefficient gradually increased as the forecasting length increased. In the 48 h SWH forecasts, the VMD and TCN improved the determination coefficient by 132.5 % and 36.8 %, respectively. In the 48 h APD forecasts, the VMD and TCN improved the determination coefficient by 119.7 % and 40.9 %, respectively.

Veg-W2TCN: A parallel hybrid forecasting framework for non-stationary time series using wavelet and temporal convolution network model

Lubricating oil degradation directly impacts friction coefficient, wear rate, and lubrication regime transitions, making precise health quantification essential for predictive tribological maintenance. However, conventional evaluation methods fail to capture subtle tribological changes preceding lubrication failure, often oversimplifying complex multi-parameter relationships critical to friction and wear performance. To address this challenge, this study proposes Seasonal–Trend decomposition using Loess, a Factor Attention Network, a Temporal Convolutional Network, and an Informer with Long Short-Term Memory Variational Autoencoder (SFTI-LVAE) framework for continuous tribological health assessment of diesel engine lubricants. The approach integrates Seasonal–Trend decomposition using Loess (STL) for trend–seasonal separation, a Factor Attention Network (FAN) for multidimensional feature fusion, and a Temporal Convolutional Network (TCN)-enhanced Informer for capturing long-term tribological dependencies. By combining Long Short-Term Memory (LSTM) temporal modeling with Variational Autoencoder (VAE) reconstruction, the method quantifies lubricant health through reconstruction error, establishing a direct correlation between data deviation and tribological performance degradation. Additionally, permutation importance-based feature evaluation and parameter contribution quantification techniques enable deep mechanistic analysis and fault source tracing of lubricant health degradation. Experimental validation using multi-sensor monitoring data demonstrates that SFTI-LVAE achieves a 96.67% fault detection accuracy with zero false alarms, providing early warning 6.47 h before lubrication failure. Unlike traditional anomaly detection methods that only classify conditions as abnormal or normal, the proposed continuous health index reveals gradual tribological degradation processes, capturing subtle viscosity–temperature relationships and wear particle evolution indicating early lubrication regime transitions. The health index correlates strongly with tribological performance indicators, enabling a transition from reactive maintenance to predictive tribological management, providing an innovative solution for equipment health evaluation in the digital tribology era.

In this paper we propose a novel set of techniques for real-time Multi-Target Multi-Camera (MTMC) tracking of vehicles in congested, low speed environments, such as those of drive-thru scenarios, where metrics such as the number of vehicles, time of stay, and interactions between vehicles and staff are needed and must be highly accurate. Traditional methods of tracking based on Intersection over Union (IoU) and basic appearance features produce fragmented trajectories of misidentifications under these conditions. Furthermore, detectors, such as YOLO (You Only Look Once) architectures, exhibit different types of errors due to vehicle proximity, lane changes, and occlusions. Our methodology introduces a new tracker algorithm, Multi-Object Tracker based on Corner Displacement (MTCD), that improves the robustness against bounding box deformations by analysing corner displacement patterns and several other factors involved. The proposed solution was validated on real-world drive-thru footage, outperforming standard IoU-based trackers like Nvidia Discriminative Correlation Filter (NvDCF) tracker. By maintaining accurate cross-camera trajectories, our framework enables the extraction of critical operational metrics, including vehicle dwell times and person–vehicle interaction patterns, which are essential for optimizing service efficiency. This study tackles persistent tracking challenges in constrained environments, showcasing practical applications for real-world surveillance and logistics systems where precision is critical. The findings underscore the benefits of incorporating geometric resilience and delayed decision-making into MTMC architectures. Furthermore, our approach offers the advantage of seamless integration with existing camera infrastructure, eliminating the need for new deployments.