This is a Pytorch implementation of the transformer architecture from the Attention Is All You Need paper. We use the transformer model for a translation task.

Code along with Umar Jamil's tutorial