Published on March 23, 2023

Learn Transformers

The Transformer architecture reimplemented to be easy to understand

By William Guimont-Martin • 1 minute read •

Computer Sciences
Deep Learning
Transformers

Here’s a small library I made to explain the Transformer architecture in PyTorch: willGuimont/transformers. The code is heavily commented and should be easy to follow.

This repository also contains some popular transformer-based models, such as Vision Transformer.

This was made while developping new practical exercises for GLO-7030 at Université Laval.