A Note on the Hwang-Kim’s Universal Activation Function

In this talk we give some notes on Universal activation function UA(t) proposed from Seung-Yeon Hwang and Leong-Joon Kim (Computers, Materials and Continua 75:2, 2022). First of all, we will note that this new activation function is, in a certain sense, a ”superposition” of activation functions suggested by Jun (Mathematics 7:3, 2019) and Vasileva and Kyurkchiev (Int. J. Differ. Equ. and Appl. 21:1, 2022). This fact is missing in the work of Hwang and Kim. Our main goal is to investigate the smooth approximation to UA(t) using Gaussian error function. The theoretical results are important in elucidating the intrinsic properties of this new universal activation function. We present simple dynamic programming module for graphical representation of smooth approximation of UA(t) developed by CAS Wolfram Mathematica.