Unraveling the Mystery: Transformers

17:45 - 18:30


The word Transformer has become popular due to the appearance of different AI-based apps such as DALL·E 2, IMAGE, ChatGPT or Bard. These systems use Transformer-type deep neural networks that allow them to extract information from the context of the input words by using attention and self-attention techniques to generate the result. In this talk, I will describe what a Transformer is, how it works, how we can build or reuse one to build our NLP or Computer Vision systems and see how they fit into the architectures of the new cognitive systems that seem to be revolutionizing the world of AI.


Moisés Martínez

Moisés Martínez