Despite various optical realizations of convolutional neural networks (CNNs), optical implementation of nonlinear activation functions and pooling operations are still challenging problems. In this regard, this paper proposes an optical saturable absorption nonlinearity and its atomic-level model, as well as two various optical pooling operations, namely optical average pooling and optical motion pooling, by means of 4f optical correlators. Proposing these optical building blocks not only speed up the neural networks due to negligible optical processing latency, but also facilitate the concatenation of optical convolutional layers with no optoelectrical conversions in-between, as the significant bottlenecks of implementing photonic CNNs. Furthermore, the proposed optical motion pooling layer increases the translation invariance property of CNNs, avoiding the inclusion of all corresponding translated images for the training procedure, and hence, increases the training speed of the neural network. The classification accuracy of the proposed optical convolutional layer is evaluated as the first layer of a customized version of AlexNet architecture, named as OP-AlexNet, for classification of Kaggle Cats and Dog challenge, CIFAR-10, and MNIST datasets, as 83.76%, 72.82%, and 99.25%, respectively, by using optical average pooling.
This paper proposes a novel topology for optical Network on Chip (NoC) architectures with the key advantages of regularity, vertex symmetry, scalability to large scale networks, constant node degree, and simplicity. Moreover, we propose a minimal deterministic routing algorithm for the proposed topology which leads to small and simple photonic routers. Built upon our novel network topology, we present a scalable all-optical NoC, referred to as 2D-HERT, which offers passive routing of optical data streams based on their wavelengths. Utilizing wavelength routing method along with Wavelength Division Multiplexing technique, our proposed optical NoC eliminates the need for electrical resource reservation. We compare performance of the proposed architecture against electrical NoCs and alternative all-optical onchip architectures under various synthetic traffic patterns. Averaging through different traffic patterns, achieves average perpacket power reduction of 53%, 45%, and 95% over optical crossbar, λ-router, and electrical Torus, respectively.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.