Improvement Optical Character Recognition for Structured Documents using Generative Adversarial Networks

An internet of things (IoT) is an exclusive method, were its impact on the enactments of human life is very trendy. This research on library control system operates on the basis of IoT and optical character recognition (OCR) algorithm rules and its training. A closed-circuit television (CCTV) watched mechanism is created to control the book issuing and returning phenomenon via tag studying system in the library. In this proposed work text file is converted into an audio file. This audio file is being played and the contents of the book can be heard via the headset. This unique function of the OCR helps blind people. Now a days OCR widely focused in machine processes such as machine transformation, text to speech extraction and text data mining. It utilized in various area of research in artificial intelligence, computer vision and pattern recognition. Using OCR to scan the damaged book in the library converted into pdf format the book gets new life and sharing the contents to multiple readers. In this paper aims to implement IoT based library management system to maintaining books in digital format.

Lack of handwriting automatization in childhood can cause difficulties within and outside the school context. Therefore, the objective quantification of the handwriting performance is key. A Smart Ink Pen (SIP) used on paper demonstrated its validity in characterizing primary school children's handwriting process, although missing information on the handwriting product. To overcome this limitation, a trace reconstruction algorithm was developed, based on the force and IMU signals measured by the SIP. A total of 353 words "uno", written in cursive from the BVSCO-3 battery by 50 Italian students of the 5th grade of primary school, was reconstructed. The quality of the reconstructions was validated through an Optical Character Recognition (OCR) algorithm (Google Vision), using the scans of the actual traces as a reference. The character recognition rates were 81.02% and 59.49%, the character error rates 21.48% and 47.65%, for scans and reconstructions, respectively. A deeper analysis revealed that 15% of the reconstructions were read in the opposite direction by the OCR algorithm, likely due to a non sufficient sampling rate for the last portion of the words. A characterization of the differences between the good, bad and opposite reconstructions allowed to identify some directions of improvement. An increase of the SIP sampling rate, a better modeling of the thickness of the trace, a finer estimation of the relative distance between the IMU sensor and the tip and the reconstruction of the tip trajectory during in-air movements could improve the trace reconstruction algorithm. In addition, the possibility to leverage transfer learning approaches on the OCR algorithm using the reconstructed traces for additional training could further improve the performances in terms of character recognition rate. However, the preliminary results obtained are promising and highlight the possibility of reconstructing handwriting traces while maintaining the naturalness of the gesture.Clinical relevance- This contribution establishes the possibility of reconstructing handwritten traces from the kinematic and force signals recorded by an ecological sensorized ink pen.

Conditional Generative Adversarial Network (GAN) is a GAN that generates data with the desired condition from the latent vector. The auxiliary classifier GAN is the most used among the variations of conditional GANs. In this study, we explain the problem of auxiliary classifier GAN and propose conditional activation GAN that can replace auxiliary classifier GAN to reduce the number of hyperparameters and improve training speed. The loss function of conditional activation GAN is defined as the sum of the loss of each GAN created for each condition. Since each GAN shares all hidden layers, the GANs can be considered as a single GAN and it does not increase the amount of computation much. Also, in order to prevent ignorance of conditions in the discriminator of conditional GANs with batch normalization, we propose a mixed batch training, in which each batch for discriminator is always configured to have the same ratio of real data and generated data so that each batch always has the similar condition distribution

Load validity discrimination for telescopic boom of rock drilling jumbo

Since the COVID-19 pandemic, numerous jobs have become necessary, including the storing and sharing of printed material across computers. One simple way to save data from printed papers to a computer system is to scan them first and then save them as images. However, it would be quite challenging to extract or query text or other information from these photo files to reuse this information. As a result, a method for automatically retrieving and storing information, particularly text, from picture files is required. Optical character recognition (OCR) is an ongoing research topic that aims to create a computer system capable of extracting and processing text from images. To accomplish successful automation, certain significant problems must be identified and addressed. The font properties of characters in paper documents, as well as image quality, are only a few of the latest problems. Characters may not be recognized correctly by the computer system because of many complexities. So, in this study, authors look into OCR in four different contexts and apply them to get our results. However, every OCR is further followed by these two steps. First, a comprehensive explanation of the challenges that may develop during the OCR phases is provided. The key phases of an OCR system are then executed, including pre-processing, segmentation, normalization, feature extraction, classification, and post-processing. It can be used with deep learning software to provide OCR data which is very useful for robotic and AI applications.

From real–time tumor classification to operative outcome prediction, applications of machine learning to neurosurgery are powerful. However, the translation of many of these applications are restricted by the lack of “big data” in neurosurgery. Important restrictions in patient privacy and sharing of imaging data reduce the diversity of the datasets used to train resulting models and therefore limit generalizability. Synthetic learning is a recent development in machine learning that generates synthetic data from real data and uses the synthetic data to train downstream models while preserving patient privacy. Such an approach has yet to be successfully demonstrated in the spine surgery domain. Spine radiographs were collected from the VinDR–SpineXR dataset, with 1470 labeled as abnormal and 2303 labeled as normal. A conditional generative adversarial network (GAN) was trained on the radiographs to generate a spine radiograph and normal/abnormal label. A modified conditional GAN (SpineGAN) was trained on the same task. A convolutional neural network (CNN) was trained using the real data to label abnormal radiographs. A CNN was trained to label abnormal radiographs using synthetic images from the GAN and in a separate experiment from SpineGAN. Using the real radiographs, an AUC of 0.856 was achieved in abnormality classification. Training on synthetic data generated by the standard GAN (AUC of 0.814) and synthetic data generated by our SpineGAN (AUC of 0.830) resulted in similar classifier performance. SpineGAN generated images with higher FID and lower precision scores, but with higher recall and increased performance when used for synthetic learning. The successful application of synthetic learning was demonstrated in the spine surgery domain for the classification of spine radiographs as abnormal or normal. A modified domain–relevant GAN is introduced for the generation of spine images, evidencing the importance of domain–relevant generation techniques in synthetic learning. Synthetic learning can allow neurosurgery to use larger and more diverse patient imaging sets to train more generalizable algorithms with greater patient privacy.

Due to the real working conditions, the collected mechanical fault datasets are actually limited and always highly imbalanced, which restricts the diagnosis accuracy and stability. To solve these problems, we present an imbalanced fault diagnosis method based on the generative model of conditional-deep convolutional generative adversarial network (C-DCGAN) and provide a study in detail. Deep convolutional generative adversarial network (DCGAN), based on traditional generative adversarial networks (GAN), introduces convolutional neural network into the training for unsupervised learning to improve the effect of generative networks. Conditional generative adversarial network (CGAN) is a conditional model obtained through introducing conditional extension into GAN. C-DCGAN is a combination of DCGAN and CGAN. In C-DCGAN, based on the feature extraction ability of convolutional networks, through the structural optimization, conditional auxiliary generative samples are used as augmented data and applied in machine fault diagnosis. Two datasets (Bearing dataset and Planetary gear box dataset) are carried out to validate. The simulation experiments showed that the improved performance is mainly due to the generated signals from C-DCGAN to balance the dataset. The proposed method can deal with imbalanced fault classification problem much more effectively. This model could improve the accuracy of fault diagnosis and the generalization ability of the classifier in the case of small samples and display better fault diagnosis performance.

A conditional variational autoencoding generative adversarial networks with self-modulation for rolling bearing fault diagnosis

This article explores the application of Generative Adversarial Networks (GANs) in improving subsurface rock analysis. GANs generate realistic images of rock features, enhancing the accuracy and efficiency of estimating rock properties. The objective is to advance the field of subsurface rock analysis, offering insights into the potential of GAN techniques. The article reviews recent developments in data-driven rock reconstruction technology, specifically focusing on GANs. It highlights GANs’ ability to generate and estimate rock features like porosity and permeability. These GAN methods are complemented by discriminators to select or reject features, making them integral to the reconstruction model. The article provides a framework for engineers and researchers to effectively utilize these techniques for rock reconstruction, offering an assessment of their strengths and limitations. Digital rock reconstruction, aided by GANs, has promising implications for site selection and recovery. GANs enhance image resolution, improving the field of view and dynamism of parameters in rock analysis. However, GANs heavily rely on high-quality data, which poses a limitation. To address this, conditional GANs have been proposed. The article comprehensively reviews the latest developments in GAN methods for digital rock reconstruction, offering valuable insights for engineers and researchers using GANs for accurate subsurface rock analysis. It also proposes ways to enhance these methods and advance the field. The novelty of this article lies in its exploration of Generative Adversarial Networks (GANs) in the context of subsurface rock analysis. It emphasizes the potential of GAN techniques to generate realistic rock images and estimate properties like porosity and permeability. Additionally, the article discusses the integration of GANs into the digital rock concept, highlighting their role in improving predictive models and supporting decision-making in the oil and gas industry's resource extraction and production strategies.

Bangla handwritten character recognition is known to be one of the most classical problem in the field of machine learning. In order to solve a machine learning problem one must thing is dataset. The more varied data a model sees the better it learns. Generative adversarial networks (GANs) are a group of neural networks that are used in unsupervised machine learning. It helps to resolve many difficult operations such as image generation from description, transforming low resolution image into high resolution, retrieving image contents given a small pattern etc. GAN's have many other promising applications in machine learning. There are many variations available for GAN. One of the variation of GAN is Conditional Generative Adversarial Networks(cGAN). This kind of GAN is used for generating a specific type of image. In this work we have used cGAN for generating Class Based Character Generation. This work can help researchers to generate handwritten characters to enhance the perfomance of deep learning models. We have trained this model to generate 50 Basic Bangla Characters, 10 Bangla Numerals and 24 Compound characters.

Raster images contain regions such as plot segments, log headers, depth track etc. which provide valuable information about well logs. The automatic extraction of these regions from raster documents is necessary for well log digitization which can further open-up numerous possibilities of processing the well log data such as well log prediction and correlation. As the first step towards raster digitization, in this work, we address the raster segmentation task to automatically extract important raster regions such as plot segment, depth track, and log headers. Next, we propose to identify the number of well logs recorded in the raster. Further, we aim to extract depth information using Optical Character Recognition (OCR) in the extracted depth track region given by the raster segmentation. Specifically, we propose a novel two stage Deep Learning (DL)-based approach using conditional Generative Adversarial Network (c-GAN) for raster image segmentation where for each raster image we detect plot segments, log headers, and depth track regions. The raster image segmentation is carried out using a DL-based image-to-image translation strategy. In the image-to-image translation, input raster image is processed to get an output segmentation mask. In the next step of raster digitization, we identify different well logs by processing the log header region extracted in the raster segmentation step. We propose a faster RCNN-based model to delineate each log header instance from the log header section of a raster image. In the third step, for depth values extraction, we use the depth track region extracted by the above raster segmentation model. We use OCR to extract the depth values in the depth track image. Output from the OCR can be noisy due to inferior quality raster images. The OCR output is denoised to obtain accurate depth values at each point in the depth track region. We evaluate the proposed raster segmentation and well log instance detection model on a test dataset of variety of raster images with varying quality. We achieve an excellent mean intersection over union (mIoU) of 85.6% in the case of raster segmentation. The above results are due to the novel approach of raster segmentation using c-GAN, and data augmentation strategy used to create large data using limited training data of raster images. Similarly, we achieve mIoU of 91.82% in the log header instance detection task. Furthermore, denoising module for depth values extraction delivers robust performance in automatic extraction of depth values. We measure the performance of the depth track extraction module in terms of ability to correctly identify the extreme values (start and end) in the depth track. Our method attains an outstanding 90.5% accuracy addressing OCR failure modes (due to noisy raster images).

Regular sampled seismic data is important for seismic data processing. However, seismic data is often missing due to natural or economic reasons. Especially, when encountering big obstacles, the seismic data will be missing in big gaps, which is more difficult to be reconstructed. Conditional generative adversarial networks (cGANs) are deep-learning models learning the characteristics of the seismic data to reconstruct the missing data. In this paper, we use a conditional Wasserstein generative adversarial network (cWGAN) to interpolate the missing seismic data in big gaps. We use the Wasserstein loss function to train the network and use a gradient penalty in the WGAN (cWGAN-GP) to enforce the Lipschitz constraint. We use a pre-stack seismic dataset to assess the performance. The interpolated results and the calculated recovered signal-to-noise ratios indicate that the cWGAN-GP can recover the missing seismic traces in portions or the entire regions, and the cWGAN-GP based interpolation is more accurate than the cGAN.

This project is intended to gift the ability of expression to the speech deprived by building a module that extracts thoughts from the human brain and presents it to the outside world as a digital image. This novel approach reconstructs same images of different colours from the EEG brain waves. Standalone datasets are being used to train the model which is obtained by using Enobio8 headset. EEG signals are acquired by providing six different shapes of three unique colors as the visual stimuli. After processing these signals EEG features are extracted using a convolutional Neural Network (CNN). The extracted features alongside noise are passed as an input to conditional Deep Convolutional Generative Adversarial Networks (cDCGANs) and conditional Generative Adversarial Networks (cGANs) which reconstruct the visual stimuli corresponding to the EEG data. The results obtained by the same are noted and analysed. The paper explicitly compares the working and performance of cGAN and cDCGAN models.

A tropical cyclone intensity prediction model using conditional generative adversarial network

ObjectiveMeibomian gland dysfunction (MGD) is a primary cause of dry eye disease. Analysis of MGD, its severity, shapes and variation in the acini of the meibomian glands (MGs) is receiving...