Hardware-efficient large-scale reconfigurable optical neural network (ONN) using complex media

Event Abstract Back to Event Logarithmic Hybrid Optical Neural Network-type systems: towards digital-optical cognitive models of robust object recognition Ioannis Kypraios1* 1 Oxford University, Centre for Innovation & Enterprise, APEM Computing Lab, United Kingdom Abstract - By combining the complex logarithmic r-theta mapping of a space-variant imaging sensor [1, 2] with the hybrid digital-optical neural network filter together with a window unit multiple objects of the same class or of different classes can robustly be recognized. The resulted logarithmic r-theta mapping for hybrid digital-optical neural network system or briefly referred to as logarithmic hybrid optical neural network system is shown to exhibit with a single pass over the input data simultaneously in-plane rotation, out-of-plane rotation, scale, log r-θ map translation and shift invariance, and good clutter tolerance by recognizing correctly the different objects within the cluttered scenes. Here, we study the biologically-inspired knowledge learning and knowledge representation [3] achieved by the logarithmic hybrid optical neural network-type of object recognition systems (see Fig. 1 and Fig. 2). We investigate the effects that altering the knowledge representation can have on the problem’s learned knowledge and the problem solving process, in overall. Further, we study the logarithmic unconstrained-, logarithmic constrained-, and logarithmic modified-hybrid optical neural network systems architectures’ designs [4, 5]. We show how the logarithmic unconstrained-hybrid optical neural network object recognition system applies an unconstrained representation of the problem’s knowledge to maximize the search of solutions, how the logarithmic constrained-hybrid optical neural network object recognition system uses a constrained representation of the problem’s knowledge to guide the search towards certain solutions over others in the multidimensional search space, and how the logarithmic modified-hybrid optical neural network object recognition system uses memory-like masks to recall certain solutions over others in the multidimensional search space. Fig. 1. (a) Simplified human retina and visual cortex model used for description purposes only; (b) A digital-optical computational model for the cognitive interaction between the retina and the human visual cortex with the general logarithmic hybrid optical neural network architercture. Fig. 2. Biologically-inspired knowledge learning and knowledge representation with the logarithmic hybrid optical neural network-type of object recognition systems. Figure 1 Figure 2 References [1] C. F. R. Weiman, “Video compression via log-polar mapping”, Real-Time Image Processing II, SPIE Symposium on OE/Aerospace Sensing, Vol. 1295, 266-277 (1990) [2] C. G. Ho et al., “Sensor geometry and sampling methods for space-variant image processing”, Pattern Analysis and Applications, Vol. 5, 369-384 (2002) [3] I. Lee, and B. Portier, "An empirical study of knowledge representation and learning within conceptual spaces for intelligent agents", 6th IEEE/ACIS International Conference Computer and Information Science, 463-468, Melbourne, Australia (2007) [4] I. Kypraios et al., “Fully invariant complex Logarithmic r- map for the Hybrid Optical Neural Network filter for object recognition within cluttered scenes”, 50th Anniversary International Symposium ELMAR 2008, IEEE Region 8/IEEE Croatia Section/EURASIP, Zadar-Croatia, Vol. 1, 141-146 (2008) [5] I. Kypraios et al., “Logarithmic r-θ mapping for hybrid optical neural network filter for object recogntion within cluttered scenes”, Recent Advances in Multimedia Signal Processing and Communications, SCI231, Springer-Verlag Berlin Heidelberg, 91-120 (2009) Keywords: digital-optical, cognitive, object recognition, Robust and Adaptive Systems, Knowledge representation, learning and memory Conference: Neuroinformatics 2013, Stockholm, Sweden, 27 Aug - 29 Aug, 2013. Presentation Type: Poster Topic: Neuromorphic engineering Citation: Kypraios I (2013). Logarithmic Hybrid Optical Neural Network-type systems: towards digital-optical cognitive models of robust object recognition. Front. Neuroinform. Conference Abstract: Neuroinformatics 2013. doi: 10.3389/conf.fninf.2013.09.00066 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 09 Apr 2013; Published Online: 11 Jul 2013. * Correspondence: Dr. Ioannis Kypraios, Oxford University, Centre for Innovation & Enterprise, APEM Computing Lab, Begbroke, Oxfordshire, OX5 1PF, United Kingdom, ioanniskyp@yahoo.com Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Ioannis Kypraios Google Ioannis Kypraios Google Scholar Ioannis Kypraios PubMed Ioannis Kypraios Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.

The switching and routing is essential for an advanced and reconfigurable optical network, and great efforts have been done for traditional single-mode system. We propose and demonstrate an on-chip switch compatible with mode-division multiplexing system. By controlling the induced phase difference, the functionalities of dynamically routing data channels can be achieved. The proposed switch is experimentally demonstrated with low insertion loss of ~1 dB and high extinction ratio of ~20 dB over the C-band for OFF-ON switchover. For further demonstration, the non-return-to-zero on-off keying signals at 10 Gb/s carried on the two spatial modes are successfully processed. Open and clear eye diagrams can be observed and the bit error rate measurements indicate a good data routing performance.

In this paper, we discuss TCP (transport control protocol data transfers over a reconfigurable optical network. We find the throughput to be diminished by false detection of congestion by TCP congestion control and avoidance mechanisms.

A novel configuration of an optical lateral inhibitory neural network using a two-dimensional internal-light-coupled optical device (ILCOD) array is proposed. It is experimentally certified with a test ILCOD structured with seven units in a two-dimensional hexagonal arrangement that the optical coupling between the units causes turn-off of the light emission of the unit in a specific position, which results in lateral inhibitory action of a neural network.

The growing computational demands of artificial intelligence motivate the development of optical neural networks (ONNs), while their practical deployment remains constrained by optimization complexity and limited adaptability. We propose a mutual learning knowledge distillation framework for optical diffractive neural networks (ODNNs), synergizing photonic computing with adaptive training strategies. Our architecture enables bidirectional knowledge transfer between parameter-efficient optical student networks and electrical ResNet teachers, leveraging both labeled data and probabilistic guidance. The validation on Fashion-MNIST and Kuzushiji-MNIST demonstrates classification accuracy improvements of 5.9% and 13.88%, respectively, over conventional ODNNs training. In addition, we further developed the photonic to photonic mutual learning computational paradigm, in which an optical network with 0.98 × 106 parameters can bootstrap compact photonic classifiers with 0.19 × 106 parameters, achieving an accuracy of 79.5% on MNIST and yielding an absolute improvement of 9% relative to the noncooperative baseline. Even though the all-optical mutual learning paradigm still has a gap of about 19% with the state-of-the-art ODNNs, the number of parameters of the guided student networks is smaller than the state-of-the-art networks by several or even dozens of times. These results establish a paradigm for overcoming fundamental limitations in ONN optimization, paving the way for a new era in which ONNs can solve large-scale practical problems through photonic–electronic and photonic–photonic co-design.

Optoelectronic realization of adaptive filters and equalizers using fiber optic tapped delay lines and spatial light modulators has been discussed recently. We describe the design of a single layer fiber optic Adaline neural network which can be used as a bit pattern classifier. In our realization we employ as few electronic devices as possible and use optical computation to utilize the advantages of optics in processing speed, parallelism, and interconnection. The new optical neural network described in this paper is designed for optical processing of guided lightwave signals, not electronic signals. We analyzed the convergence or learning characteristics of the optically implemented Adaline in the presence of errors in the hardware, and we studied methods for improving the convergence rate of the Adaline.© (1993) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only.

In recent years, with the expansion of information, artificial intelligence technology has been developed and used in various fields. Among them, optical neural network provides a new type of special neural network accelerator chip solution, which has the advantages of high speed, high bandwidth, and low power consumption. In this paper, we construct an optical neural network based on Mach–Zehnder interferometer. The experimental results on the image classification of MNIST handwritten digitals show that the optical neural network has high accuracy, fast convergence and good scalability.

Artificial intelligence has prevailed in all trades and professions due to the assistance of big data resources, advanced algorithms, and high-performance electronic hardware. However, conventional computing hardware is inefficient at implementing complex tasks, in large part because the memory and processor in its computing architecture are separated, performing insufficiently in computing speed and energy consumption. In recent years, optical neural networks (ONNs) have made a range of research progress in optical computing due to advantages such as sub-nanosecond latency, low heat dissipation, and high parallelism. ONNs are in prospect to provide support regarding computing speed and energy consumption for the further development of artificial intelligence with a novel computing paradigm. Herein, we first introduce the design method and principle of ONNs based on various optical elements. Then, we successively review the non-integrated ONNs consisting of volume optical components and the integrated ONNs composed of on-chip components. Finally, we summarize and discuss the computational density, nonlinearity, scalability, and practical applications of ONNs, and comment on the challenges and perspectives of the ONNs in the future development trends.

Hardware implementation of artificial neural networks facilitates real-time parallel processing of massive data sets. Optical neural networks offer low-volume 3D connectivity together with large bandwidth and minimal heat production in contrast to electronic implementation. Here, we present a conceptual design for in-fiber optical neural networks. Neurons and synapses are realized as individual silica cores in a multi-core fiber. Optical signals are transferred transversely between cores by means of optical coupling. Pump driven amplification in erbium-doped cores mimics synaptic interactions. We simulated three-layered feed-forward neural networks and explored their capabilities. Simulations suggest that networks can differentiate between given inputs depending on specific configurations of amplification; this implies classification and learning capabilities. Finally, we tested experimentally our basic neuronal elements using fibers, couplers, and amplifiers, and demonstrated that this configuration implements a neuron-like function. Therefore, devices similar to our proposed multi-core fiber could potentially serve as building blocks for future large-scale small-volume optical artificial neural networks.

We describe an optical learning three-layer neural network that uses a back-propagation algorithm for human face recognition. Learning is performed by two-dimensional optical means for handling images without scanning and pixeling, because a face recognition problem needs a large-scale network. The two-dimensional input image is treated directly without vectorizing so that a recognition process of an unknown facial image is executed in real-time. We demonstrate training and recognition of three human faces using an experimental system.

While numerous artificial neural network (ANN) models have been electronically implemented and simulated by conventional computers, optical technology provides a far superior mechanism for the implementation of large-scale ANNs. The properties of light make it an ideal carrier of data signals. With optics, very large and high speed neural network architectures are possible. Because light is a predictable phenomenon, it can be described mathematically and its behavior can be simulated by conventional computers. A hologram is in essence a capture of the light field at a particular moment in time and space. Later, the hologram can be used to reconstruct the three dimensional light field carrying optical data. This makes a hologram an ideal medium for capturing, storing, and transmitting data in optical computers, such as optical neural networks (ONNs). Holograms can be created using conventional methods, but they can also be computer generated. In this paper, we will present an overview of optical neural networks, with emphasis on the holographic neural networks. We will take a look at the mathematical basis of holography in terms of the Fresnel Zone Plate and how it can be utilized in making computer generated holograms (CGHs). Finally, we will present various methods of CGH implementation in a two layer holographic ONN.

One of the pressing issues for optical neural networks (ONNs) is the performance degradation introduced by parameter uncertainties in practical optical components. Hereby, we propose a novel two-step ex situ training scheme to configure phase shifts in a Mach–Zehnder-interferometer-based feedforward ONN, where a stochastic gradient descent algorithm followed by a genetic algorithm considering four types of practical imprecisions is employed. By doing so, the learning process features fast convergence and high computational efficiency, and the trained ONN is robust to varying degrees and types of imprecisions. We investigate the effectiveness of our scheme by using practical machine learning tasks including Iris and MNIST classifications, showing more than 23% accuracy improvement after training and accuracy (90.8% in an imprecise ONN with three hidden layers and 224 tunable thermal-optic phase shifters) comparable to the ideal one (92.0%).

Optical neural networks (ONNs) herald a new era in information and communication technologies and have implemented various intelligent applications. In an ONN, the activation function (AF) is a crucial component determining the network performances and on-chip AF devices are still in development. Here, we first demonstrate on-chip reconfigurable AF devices with phase activation fulfilled by dual-functional graphene/silicon (Gra/Si) heterojunctions. With optical modulation and detection in one device, time delays are shorter, energy consumption is lower, reconfigurability is higher and the device footprint is smaller than other on-chip AF strategies. The experimental modulation voltage (power) of our Gra/Si heterojunction achieves as low as 1 V (0.5 mW), superior to many pure silicon counterparts. In the photodetection aspect, a high responsivity of over 200 mA/W is realized. Special nonlinear functions generated are fed into a complex-valued ONN to challenge handwritten letters and image recognition tasks, showing improved accuracy and potential of high-efficient, all-component-integration on-chip ONN. Our results offer new insights for on-chip ONN devices and pave the way to high-performance integrated optoelectronic computing circuits.

Optical neural networks are considered a promising alternative for mitigating the computational bottlenecks and energy constraints of electronic neural networks. However, their widespread adoption is limited by the absence of efficient optical nonlinear activation units. In this work, we leverage the mature optical component Mach–Zehnder interferometer (MZI) used for constructing optical neural networks and integrate magneto-optical (MO) functional materials into its waveguide arms, achieving a magnetically tunable optical nonlinear activation function. Utilizing finite element simulation software COMSOL Multiphysics, we established a model of the MZI modulator with MO material and optimized the critical structural parameters, such as the radius of the S-bend waveguide, the coupling length of the directional coupler, and the length of the MO waveguide. By adjusting the magnetic field intensity applied to the MO waveguide, the phase difference between the two interfering arms of the MZI can be precisely controlled, thereby enabling the output light intensity to demonstrate the traits of an optical nonlinear activation function. The utilization of MO modulation for achieving optical nonlinear activation function represents a significant advancement over electro-optical and thermo-optical techniques. This method boasts a faster response speed and superior modulation efficiency, coupled with seamless integration and tunability. It holds significant application value in the optical neural networks capable of managing high-speed data processing tasks.

The MONET project ended in November 1999. Over the five year duration of this project, many significant advances were made in optical networking architectures, components, subsystems, systems, and network demonstrations. In this paper, we report on the major accomplishment of the last year of the MONET project, which was the completion and operation of a transparent, reconfigurable optical network in Washington, DC. This paper describes the network and summarizes experimental results achieved in the first months of operation.