~hackernews | Bookmarks (2)

clear filters

Short-term Hebbian learning can implement transformer-like attention

plos.org

Open Access Peer-reviewed Transformers have revolutionized machine learning models of language and vision, but their connection...
Open Access Peer-reviewed Transformers have revolutionized machine learning models of language and vision, but their connection with neuroscience remains tenuous. Built from attention layers, they require a mass comparison of queries and keys that is difficult to perform using traditional neural circuits. Here, we s...

action potentials axons machine learning neuronal dendrites neurons
1
How newly discovered brain cells have made us rethink the human mind

newscientist.com

brain neurons
2