Prof.  Loc  Nguyen
Loc Nguyen’s Academic Network,  Vietnam

Title: Is matrix neural network the alternative of convolutional neural network?

Abstract:

Currently, deep learning is the most important and popular methodology in artificial intelligence (AI) and artificial neural network (ANN) is the foundation of deep learning. The main drawback of ANN is the boom problem of a huge number of parametric weights when ANN in deep learning establishes a large number of hidden layers. The excellent solution for image processing within context of deep learning is convolutional neural network (CNN) equipped filtering kernel. Another solution of the boom problem is that large parametric weight vector is organized as matrix, which leads to a so-called matrix neural network (MNN). Computation cost of MNN is decreased significantly in comparison with ANN but it is necessary to test the main hypothesis “whether MNN is the alternative of CNN”. Moreover, transformer which is the new trend in AI and deep learning, which aims to improve/replace traditional ANN by self-supervised learning, in which attention is the significant mechanism of self-supervised learning. Therefore, the implicit deep meanings of attention and filtering kernel are similar, which represents feature of data, which does not go beyond parametric weights too. In general, the research has two goals: 1) explaining and implementing ANN, CNN, and transformer (attention) and 2) applying analysis of variance (ANOVA) into evaluating the effectiveness of ANN, CNN, and transformer (attention) within context of image classification. The ultimate result is that it is not asserted that MNN is the alternative of CNN but MNN can be an optional choice for implementing ANN instead of focusing on the unique CNN solution. Moreover, the incorporation of MNN and attention in implementing transformer produces a compromising solution of high performance and computational cost

Biography:

Loc Nguyen is an independent scholar from 2017. He holds Master degree in Computer Science from University of Science, Vietnam in 2005. He holds PhD degree in Computer Science and Education at Ho Chi Minh University of Science in 2009. His PhD dissertation was honored by World Engineering Education Forum (WEEF) and awarded by Standard Scientific Research and Essays as excellent PhD dissertation in 2014. He holds Postdoctoral degree in Computer Science from 2013, certified by Institute for Systems and Technologies of Information, Control and Communication (INSTICC) by 2015. Now he is interested in poetry, computer science, statistics, mathematics, education, and medicine. He serves as reviewer, editor, speaker, and lecturer in a wide range of international journals and conferences from 2014. He is volunteer of Statistics Without Borders from 2015. He was granted as Mathematician by London Mathematical Society for Postdoctoral research in Mathematics from 2016. He is awarded as Professor by Scientific Advances and Science Publishing Group from 2016. He was awarded Doctorate of Statistical Medicine by Ho Chi Minh City Society for Reproductive Medicine (HOSREM) from 2016. He was awarded and glorified as contributive scientist by International Cross-cultural Exchange and Professional Development-Thailand (ICEPD-Thailand) from 2021 and by Eudoxia Research University USA (ERU) and Eudoxia Research Centre India (ERC) from 2022. He has published 104 papers and preprints in journals, books, conference proceedings, and preprint services. He is author of 6 scientific books. He is author and creator of 10 scientific and technological products