A survey of language models (arXiv:2303.18223) | Kaggle | Page 1

https://arxiv.org/abs/2303.18223

I've been citing figures from this paper since it came out and figured the occasion of launching Kaggle's Discord #1130529466230247444 forum was a good time to actually read it more deeply. Of course it's inevitably going to become a tiny bit stale due to the release of Llama v2 which I'm sure will mark another wave of innovation, but it's definitely still a great survey paper if you're looking to understand the technical evolution of LLMs.

Curious for takeaways from others who've read!

arXiv.org

A Survey of Large Language Models

Language is essentially a complex, intricate system of human expressions
governed by grammatical rules. It poses a significant challenge to develop
capable AI algorithms for comprehending and grasping a language. As a major
approach, language modeling has been widely studied for language understanding
and generation in the past two decades, evol...

#A survey of language models (arXiv:2303.18223)