Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Machine Complexity
e.g. Gates; Memory; Neurons; Synapses Power; Size
Neuromorphic Machines
Objective
Develop electronic, neuromorphic machine technology that scales to biological level.
Human Cortex Simulated Human Cortex
Program Objective
simple
complex
[log]
Environmental Complexity
e.g. Input Combinatorics
15 Watts I Liter
The SyNAPSE program seeks to break the programmable machine paradigm and define a new path for creating useful, intelligent machines
Approved for Public Release, Distribution Unlimited 3
DARPA SyNAPSE Increased component density Increased component function Defect tolerant Neuromorphic information, learning, cognition, understanding architecture Path to biologically competitive intelligence
<<60 years
The SyNAPSE program seeks to extend the development of modern electronics into a new revolutionary new era using a similar paradigm.
Approved for Public Release, Distribution Unlimited 4
Inspiration
Biological-Scale Neuromorphic Electronic Devices
Human NeoCortex Neuromorphic Electronics 1010 intersection/cm2 in crossbar arrays w/ 100 nm pitch ~5x108 transistors/cm2 in state of the art CMOS
~1010
~106
synapses/cm2
Neurons/cm2
Conclusion: Gross statistics of biological neural systems might be realized in modern electronics.
Approved for Public Release, Distribution Unlimited 5
The electronic synapse performs computation, memory, and adaptation in a neuromorphic system. Computation occurs in the electron current (i=v*g) injected through the synapse conductance g between neurons in response to (spike) voltage v. Memory occurs as a slowly changing electrophysical property that modifies g. Neuromorphic adaptation (aka plasticity) occurs as g changes in response to the same voltages used for computation.
Approved for Public Release, Distribution Unlimited
Post-synaptic Neuron
tpre
tpost
time
Pre-synaptic Neuron
% change in synaptic conductance
t+
0
t-
0 t = (tpre tpost)
Neurons encode information as spikes and communicate to other neurons in both both forward (axonic) and backward (dendritic) directions. The time-relation between forward and backward spikes arriving at a synapse determines if the synaptic connection should be increased or decreased. Connection strength increases (decreases) whenever forward spikes are causally (acausually) correlated to backward spikes.
Spike processing
Spike time encoding Spike time dependent plasticity
Connectivity
Hardwired Addressed / programmable On-chip / off chip
Rebuilding the current computer architecture from scratch is outside the scope of this solicitation
11
(Image removed)
Train and evaluate machine intelligence across capabilities found in mammalian species (106 range of brain size) Virtual environment for the evolution of intelligent machines Fill long-standing need for authoritative machine intelligence evaluation
Approved for Public Release, Distribution Unlimited 12
Features
Identification/classification of spatiotemporal objects in animation or video Multi-dimensional complexity variability Core task of all cognitive systems Quantitative measures of complexity Objective measures of performance Easily scaled Human interaction Abstract cognition Interaction in complex, dynamic environments. Comparison to small animal studies Exercises all levels of cognition Most difficult to score and scale
Cognitive Area
(Image removed)
(Image removed)
(Image removed)
13
Disciplinary Gap Neuroscience Neuroinformatics Neurophysiology Neuroanatomy Neural models Neural simulation Animal models
(Image removed)
VLSI CMOS Device Design Analog-Digital Asynchronous Sub-threshold neuromorphic Fabrication Test Packaging
15
Program Approach
System (SyNAPSE) Top-down (simulation)
Model
Make
Networks (e.g. cortical column) Biological Scale Machine Intelligence Circuits (e.g. center-surround)
Measure
Architecture
Components (e.g. synapse / neuron) Bottom-up (devices)
Hardware
Materials (e.g. memristors)
Simulation
Environment Attack the problem bottom-up and topdown and force disciplinary integration with a common set of objectives. Sponsor a suite of complementary capabilities to build, train, and evaluate devices.
16
Program Components
Hardware will likely include CMOS devices, novel synaptic components, and combinations of hard-wired and programmable/virtual connectivity and will support critical information processing techniques like spike time encoding and spike time dependent plasticity. Architectures will support critical structures and functions observed in biological systems such as connectivity, hierarchical organization, core component circuitry, competitive self-organization, and modulatory/reinforcement systems. Large scale digital simulations of circuits and systems will be used to prove component and whole system functionality and to inform overall system development in advance of neuromorphic hardware implementation. Environments will be evolving virtual platforms for the training, evaluation and benchmarking of intelligent machines
Approved for Public Release, Distribution Unlimited 17
Program Outline
Phase 0 Phase 1 Phase 2 Phase 3 Phase 4
~106 neuron single chip implementation Mouse level ~108 neuron design for simulation and hardware layout
Hardware
Mouse level benchmark (~ 106 neuron) Add Audition, Proprioception and Survival All mammal complexity
Environment
Sustain
19
22
23
24
26
Describe an approach to developing electronic neuronal processing units (neurons) consistent with (1), (2) and (3).
Describe an electronic coding, communication and synaptic update scheme consistent with (1), (2), and (3).
Describe a plan of computer simulation/emulation to enable the near real-time simulation of neuromorphic systems up to 108 neurons and 1012 synapses.
Describe a plan to obtain and import descriptions of neural systems from neuro-biological databases (as appropriate). Describe key technical challenges and approaches to achieving these goals and any other items in the critical path.
Approved for Public Release, Distribution Unlimited
27
Describe a means to scale the complexity of these tasks over the entire range of mammalian intelligence (~106 range in brain size). Describe a capability for hosting the environment including hardware, software and system support. Describe an interface for interacting with the environment.
Approved for Public Release, Distribution Unlimited 28
Proposal Evaluation
30
Evaluation Criteria
1) 2) 3) 4) Ability to Meet Go/No-Go Metrics Scientific and Technical Merit Value to Defense Management Approach and Proposers Capabilities and Related Experience 5) Cost and Schedule Realism.
31
32
Value to Defense
Proposers must demonstrate the longterm potential of successful research to radically change military capability or improve national security with a clear statement of the goals of their program, and a quantitative comparison with existing technology as appropriate.
34
The proposed team has the expertise to manage the cost and schedule.
Similar efforts completed/ongoing by the proposer in this area are fully described including identification of other Government sponsors.
Approved for Public Release, Distribution Unlimited 35
The proposers abilities to aggressively pursue performance metrics in the shortest timeframe and to accurately account for that timeframe will be evaluated, as well as proposers ability to understand, identify, and mitigate any potential risk in schedule
Approved for Public Release, Distribution Unlimited 36
Administrative Items
37
38
Proposal Format
Proposals must consist of two volumes-technical and cost. Technical- Maximum of 55 pages including references, tables, and charts. Please do not include separate articles or CDs as these will not be used in the review process. Cost-contains a cover sheet, detailed cost break down, and supporting cost and pricing information.
For detailed description of proposal format see the BAA at http://www.darpa.mil/baa/BAA08-28.html
39
Coherent integration and management of multidisciplinary research organizations is required. Structure proposals to reduce risk early and to give the government flexibility in task/phase funding
40
Teaming Website
http://www.sainc.com/SyNAPSETeaming/index.asp
A teaming website has been created to facilitate the organization of teams to address all program component areas.
Approved for Public Release, Distribution Unlimited 41
Discussion
Please submit questions by noon so that they may be answered during the FAQ segment of the workshop.
42