teaching_llm_applications
Masked language modelling vs. Generative models
Representation models
- BERT
Generative models
-
Decoder only
-
GPT-1
-
masked self attention and decoder only
-
Differences between the two kinds of models
Image credit Jay Alammar deeplearning.ai