What are transformers?
Transformers transform inputs into outputs. It is really that simple.
For example, say that you wanted to translate text from one language to another. A transformer would transform the input sequence (the first language) into an output sequence (the second language).