Overview

Linguistics

1. Word Vectors
2. Dependency Parsing
3. Linguistics Insights
4. Coreference Resolution
5. Constituency Parsing

Architectures

1. RNNs
2. Language Models
3. Transformers
   1. Pretraning
   2. Prompting
   3. RLHF
4. ConvNets + Tree Recursive Neural Networks

Applications

1. NLG
2. QA
3. CodeGen
4. Multimodal DL

Interpretability

1. Interpretability