This can be big. Google unveils the successor to the Transformer architecture
"We present a new neural long term memory module that learns to memorize historical context and helps an attention to attend to the current context while utilizing long past information. We show that