Development of transformer is a far progressive step in the long journeys of both generative artificial intelligence (GenAI) and statistical translation machine (STM) with support of deep neural network (DNN), in which STM can be known as interesting result of GenAI because of encoder-decoder mechanism for sequence generation built in transformer. But why is transformer being preeminent in GenAI and STM? Firstly, transformer has a so-called self-attention mechanism that discovers contextual meaning of every token in sequence, which contributes to reduce ambiguousness. Secondly, transformer does not concern ordering of tokens in sequence, which allows to train transformer from many parts of sequences in parallel. Thirdly, the third reason which is result of the two previous reasons is that transformer can be trained from large corpus with high accuracy as well as highly computational performance. Moreover, transformer is implemented by DNN which is one of important and effective approaches in artificial intelligence (AI) in recent time. Although transformer is preeminent because of its good consistency, it is not easily understandable. Therefore, this technical report aims to describe transformer with explanations which are as easily understandable as possible.

Loc Nguyen is an independent scholar from 2017. He holds Master degree in Computer Science from University of Science, Vietnam in 2005. He holds PhD degree in Computer Science and Education at Ho Chi Minh University of Science in 2009. His PhD dissertation was honored by World Engineering Education Forum (WEEF) and awarded by Standard Scientific Research and Essays as excellent PhD dissertation in 2014. He holds Postdoctoral degree in Computer Science from 2013, certified by Institute for Systems and Technologies of Information, Control and Communication (INSTICC) by 2015. Now he is interested in poetry, computer science, statistics, mathematics, education, and medicine. He serves as reviewer, editor, speaker, and lecturer in a wide range of international journals and conferences from 2014. He is volunteer of Statistics Without Borders from 2015. He was granted as Mathematician by London Mathematical Society for Postdoctoral research in Mathematics from 2016. He is awarded as Professor by Scientific Advances and Science Publishing Group from 2016. He was awarded Doctorate of Statistical Medicine by Ho Chi Minh City Society for Reproductive Medicine (HOSREM) from 2016. He was awarded and glorified as contributive scientist by International Cross-cultural Exchange and Professional Development-Thailand (ICEPD-Thailand) from 2021 and by Eudoxia Research University USA (ERU) and Eudoxia Research Centre India (ERC) from 2022. He has published 98 papers and preprints in journals, books, conference proceedings, and preprint services. He is author of 5 scientific books. He is author and creator of 9 scientific and technological products.