SyNAPSE

A circuit board with a 4×4 array of SyNAPSE-developed chips. Each chip has one million electronic “neurons” and 256 million electronic synapses between neurons. Built on 28nm process technology, the 5.4 billion transistor chip has one of the highest transistor counts of any chip ever produced as of 2014.

SyNAPSE is a DARPA program that aims to develop electronic neuromorphic machine technology, an attempt to build a new kind of cognitive computer with form, function, and architecture similar to the mammalian brain. Such artificial brains would be used in robots whose intelligence would scale with the size of the neural system in terms of the total number of neurons and synapses and their connectivity.

SyNAPSE is a backronym standing for Systems of Neuromorphic Adaptive Plastic Scalable Electronics. The name alludes to synapses, the junctions between biological neurons. The program is being undertaken by HRL Laboratories (HRL), Hewlett-Packard, and IBM Research. In November 2008, IBM and its collaborators were awarded $4.9 million in funding from DARPA while HRL and its collaborators were awarded $5.9 million in funding from DARPA. For the next phase of the project, DARPA added $16.1 million more to the IBM effort while HRL received an additional $10.7 million. In 2011, DARPA added $21 million more to the IBM project. and an additional $17.9 million to the HRL project. The SyNAPSE team for IBM is led by Dharmendra Modha, manager of IBM's cognitive computing initiative. The SyNAPSE team for HRL is led by Narayan Srinivasa, manager of HRL's Center for Neural and Emergent Systems.

The initial phase of the SyNAPSE program developed nanometer scale electronic synaptic components capable of adapting the connection strength between two neurons in a manner analogous to that seen in biological systems (Hebbian learning), and simulated the utility of these synaptic components in core microcircuits that support the overall system architecture.

Continuing efforts will focus on hardware development through the stages of microcircuit development, fabrication process development, single chip system development, and multi-chip system development. In support of these hardware developments, the program seeks to develop increasingly capable architecture and design tools, very large-scale computer simulations of the neuromorphic electronic systems to inform the designers and validate the hardware prior to fabrication, and virtual environments for training and testing the simulated and hardware neuromorphic systems.

Published product highlights

• clockless operation (event-driven), consumes 70 mW during real-time operation, power density of 20 mW/cm²
• manufactured in Samsung's 28 nm process technology, 5.4 billion transistors
• one million neurons and 256 million synapses networked into 4096 neurosynaptic cores by a 2D array, all programmable
• each core module integrates memory, computation, and communication, and operates in an event-driven, parallel, and fault-tolerant fashion

Participants

The following people and institutions are participating in the DARPA SyNAPSE program:

IBM team, led by Dharmendra Modha

• Stanford University: Brian A. Wandell, H.-S. Philip Wong
• Cornell University: Rajit Manohar
• Columbia University Medical Center: Stefano Fusi
• University of Wisconsin–Madison: Giulio Tononi
• University of California, Merced: Christopher Kello
• iniLabs GmbH: Tobi Delbruck
• IBM Research: Rajagopal Ananthanarayanan, Leland Chang, Daniel Friedman, Christoph Hagleitner, Bulent Kurdi, Chung Lam, Paul Maglio, Dharmendra Modha, Stuart Parkin, Bipin Rajendran, Raghavendra Singh

HRL Team led by Narayan Srinivasa

• HRL Laboratories: Narayan Srinivasa, Jose Cruz-Albrecht, Dana Wheeler, Tahir Hussain, Sri Satyanarayana, Tim Derosier, Youngkwan Cho, Corey Thibeault, Michael O' Brien, Michael Yung, Karl Dockendorf, Vincent De Sapio, Qin Jiang, Suhas Chelian
• Boston University: Massimiliano Versace, Stephen Grossberg, Gail Carpenter, Yongqiang Cao, Praveen Pilly
• Neurosciences Institute: Gerald Edelman, Einar Gall, Jason Fleischer
• University of Michigan: Wei Lu
• Georgia Institute of Technology: Jennifer Hasler
• University of California, Irvine: Jeff Krichmar
• George Mason University: Giorgio Ascoli, Alexei Samsonovich
• Portland State University: Christof Teuscher
• Stanford University: Mark Schnitzer
• Set Corporation: Chris Long

See also

• TrueNorth – IBM chip (introduced mid 2014) boasts of 1 million neurons and 256 million synapses (computing sense); 5.4 billion transistors and 4,096 neurosynaptic cores (hardware).
• Computational RAM is another approach bypassing the von Neumann bottleneck

External links

• Systems of Neuromorphic Adaptive Plastic Scalable Electronics
• Neuromorphonics Lab, Boston University
• Center for Neural and Emergent Systems Homepage
• HRL Labs Homepage