I’m starting a weekly blog where I (metaphorically) cut open the putative black box architecture of the transformer! 🤖
Part 1: Are transformers that different from convolutional networks? 🤔
neuroailab.github.io/transfo…
#Neuroscience #NeuroAI #Vision
Companion blog to my recent preprint out with @dyamins on “The transformer as a candidate canonical cortical microcircuit”
biorxiv.org/content/10.64898…
2
184
In neuroscience, a canonical microcircuit is thought to subserve all cortical computation. In AI, neural networks universally subserve intelligent behavior. Is there convergence between computational motifs in natural and artificial intelligence? Work with @dyamins 🧠🤖
Read the preprint at biorxiv.org/content/10.64898… :)

