#I learned in other forums that Vedal once posted teaching pictures. Does anyone know?
1 messages · Page 1 of 1 (latest)
I learned in the Chinese forum that Vedal posted a picture,through pictures, we can know how to make Neuro
Sorry, because I use Google translated, English is not very accurate
I don’t remember him posting anything like that but here’s a clip https://youtu.be/fatAMpWM2sQ?si=o-7f0vppq-SdM-Cu
The Twitch streamer Vedal has created an AI called Neuro-Sama and at the end of the subathon they built a language model from scratch while following this tutorial from Andrej Karpathy: https://www.youtube.com/watch?v=kCc8FmEb1nY
To watch Neuro&Vedal live: https://www.twitch.tv/vedal987
Here’s the video he was watching https://youtu.be/kCc8FmEb1nY?si=CE8KW41KMo83Nrf-
We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connections to ChatGPT, which has taken the world by storm. We watch GitHub Copilot, itself a GPT, help us write a GPT (meta :D!) . I recommend people watch the earlier makemore videos to get comfortable...
