Transformer

A transformer is a type of neural network architecture used for the transduction or transformation of input sequences into output sequences during deep learning applications, such as natural language processing (NLP) and computer vision (CV).