Novel Analog Implementation of a Hyperbolic Tangent Neuron in Artificial Neural Networks

Document Type

Article

Publication Date

11-1-2021

Abstract

Recently, enormous datasets have made power dissipation and area usage lie at the heart of designs for artificial neural networks (ANNs). Considering the significant role of activation functions in neurons and the growth of hardware-based neural networks like memristive neural networks, this work proposes a novel design for a hyperbolic tangent activation function (Tanh) to be used in memristive-based neuromorphic architectures. The purpose of implementing a CMOS-based design for Tanh is to decrease power dissipation and area usage. This design also increases the overall speed of computation in ANNs, while keeping the accuracy in an acceptable range. The proposed design is one of the first analog designs for the hyperbolic tangent and its performance is analyzed by using two well-known datsets, including the Modified National Institute of Standards and Technology (MNIST) and Fashion-MNIST. The direct implementation of the proposed design for Tanh is proposed and investigated via software and hardware modeling.

Identifier

85096824253 (Scopus)

Publication Title

IEEE Transactions on Industrial Electronics

External Full Text Location

https://doi.org/10.1109/TIE.2020.3034856

e-ISSN

15579948

ISSN

02780046

First Page

10856

Last Page

10867

Issue

11

Volume

68

Grant

2013DFM10100

Fund Ref

International Science and Technology Cooperation Programme

This document is currently not available here.

Share

COinS