A Combined Activation Function for Learning Performance Improvement of CNN Image Classification

Guangliang Pan, Jun Li, Fei Lin, Tingting Sun, Yulin Sun

2019

Abstract

With the rise of artificial intelligence, it has unlimited possibilities for machines to replace human work. Aiming at how to improve the learning performance of convolutional neural network (CNN) image classification by changing the activation function, a combined Tanh-relu activation function is proposed based on the single Sigmoid, Tanh and Relu activation functions. Based on CNN-LeNet-5, the size of the convolution kernel and sampling window is changed and the number of layers of the convolutional neural network is reduced. At the same time, the network structure of the LeNet-5 model is improved. On the Mnist handwritten digital dataset, the combined Tanh-relu activation function was compared with a single activation function. The experimental results show that the CNN model with combined Tanh-relu activation function has faster accuracy fitting speed and higher accuracy, improves the convergence speed of loss and enhances the convergence performance of CNN model.

Paper Citation

in Harvard Style

Pan G., Li J., Lin F., Sun T. and Sun Y. (2019). A Combined Activation Function for Learning Performance Improvement of CNN Image Classification.In Proceedings of 5th International Conference on Vehicle, Mechanical and Electrical Engineering - Volume 1: ICVMEE, ISBN 978-989-758-412-1, pages 360-366. DOI: 10.5220/0008851103600366

in Bibtex Style

@conference{icvmee19,
author={Guangliang Pan and Jun Li and Fei Lin and Tingting Sun and Yulin Sun},
title={A Combined Activation Function for Learning Performance Improvement of CNN Image Classification},
booktitle={Proceedings of 5th International Conference on Vehicle, Mechanical and Electrical Engineering - Volume 1: ICVMEE,},
year={2019},
pages={360-366},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008851103600366},
isbn={978-989-758-412-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of 5th International Conference on Vehicle, Mechanical and Electrical Engineering - Volume 1: ICVMEE,
TI - A Combined Activation Function for Learning Performance Improvement of CNN Image Classification
SN - 978-989-758-412-1
AU - Pan G.
AU - Li J.
AU - Lin F.
AU - Sun T.
AU - Sun Y.
PY - 2019
SP - 360
EP - 366
DO - 10.5220/0008851103600366