CSSE 313: Day 23

Outline

• Transformers cont'd
• Streams, MLP, positional encodings, concept of contextualized embeddings
• Discussion of Attention paper

Resources

• Slides for Transformers
• Slides for Attention paper
• Attention is all you need paper