WO2007002790A3 - Neural modeling and brain-based devices using special purpose processor - Google Patents

Neural modeling and brain-based devices using special purpose processor Download PDF

Info

Publication number
WO2007002790A3
WO2007002790A3 PCT/US2006/025264 US2006025264W WO2007002790A3 WO 2007002790 A3 WO2007002790 A3 WO 2007002790A3 US 2006025264 W US2006025264 W US 2006025264W WO 2007002790 A3 WO2007002790 A3 WO 2007002790A3
Authority
WO
WIPO (PCT)
Prior art keywords
special purpose
purpose processor
brain
based devices
neural
Prior art date
Application number
PCT/US2006/025264
Other languages
French (fr)
Other versions
WO2007002790A2 (en
Inventor
James A Snook
Donald B Hutson
Jeffrey L Krichmar
Original Assignee
Neurosciences Res Found
James A Snook
Donald B Hutson
Jeffrey L Krichmar
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Neurosciences Res Found, James A Snook, Donald B Hutson, Jeffrey L Krichmar filed Critical Neurosciences Res Found
Priority to JP2008519538A priority Critical patent/JP2009508182A/en
Priority to EP06785790A priority patent/EP1902358A4/en
Publication of WO2007002790A2 publication Critical patent/WO2007002790A2/en
Publication of WO2007002790A3 publication Critical patent/WO2007002790A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks

Abstract

A special purpose processor (SPP) can use a Field Programmable Gate Array (FPGA) or similar programmable device to model a large number of neural elements. The FPGAs can have multiple cores doing presynaptic, postsynaptic, and plasticity calculations in parallel. Each core can implement multiple neural elements of the neural model.
PCT/US2006/025264 2005-06-28 2006-06-28 Neural modeling and brain-based devices using special purpose processor WO2007002790A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2008519538A JP2009508182A (en) 2005-06-28 2006-06-28 Neural modeling and brain-based devices using special purpose processors
EP06785790A EP1902358A4 (en) 2005-06-28 2006-06-28 Neural modeling and brain-based devices using special purpose processor

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US69453205P 2005-06-28 2005-06-28
US60/694,532 2005-06-28
US11/426,881 US7533071B2 (en) 2005-06-28 2006-06-27 Neural modeling and brain-based devices using special purpose processor
US11/426,881 2006-06-27

Publications (2)

Publication Number Publication Date
WO2007002790A2 WO2007002790A2 (en) 2007-01-04
WO2007002790A3 true WO2007002790A3 (en) 2009-05-07

Family

ID=37596030

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/025264 WO2007002790A2 (en) 2005-06-28 2006-06-28 Neural modeling and brain-based devices using special purpose processor

Country Status (4)

Country Link
US (3) US7533071B2 (en)
EP (1) EP1902358A4 (en)
JP (1) JP2009508182A (en)
WO (1) WO2007002790A2 (en)

Families Citing this family (71)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7272681B2 (en) * 2005-08-05 2007-09-18 Raytheon Company System having parallel data processors which generate redundant effector date to detect errors
US7765029B2 (en) * 2005-09-13 2010-07-27 Neurosciences Research Foundation, Inc. Hybrid control device
US8150629B2 (en) * 2005-11-10 2012-04-03 In Silico Biosciences Method and apparatus for computer modeling of the interaction between and among cortical and subcortical areas in the human brain for the purpose of predicting the effect of drugs in psychiatric and cognitive diseases
CA2653513C (en) 2006-05-25 2015-03-31 Elminda Ltd. Neuropsychological spatiotemporal pattern recognition
US7647590B2 (en) * 2006-08-31 2010-01-12 International Business Machines Corporation Parallel computing system using coordinator and master nodes for load balancing and distributing work
WO2009069135A2 (en) * 2007-11-29 2009-06-04 Elminda Ltd. System and method for neural modeling of neurophysiological data
JP4577422B2 (en) * 2008-07-14 2010-11-10 ソニー株式会社 Information processing system and information processing method, robot control system and control method, and computer program
US8156264B2 (en) * 2009-04-03 2012-04-10 Analog Devices, Inc. Digital output sensor FIFO buffer with single port memory
KR20130111956A (en) * 2010-05-19 2013-10-11 더 리전트 오브 더 유니버시티 오브 캘리포니아 Neural processing unit
US8676734B2 (en) * 2010-07-07 2014-03-18 Qualcomm, Incorporated Methods and systems for replaceable synaptic weight storage in neuro-processors
US8515885B2 (en) 2010-10-29 2013-08-20 International Business Machines Corporation Neuromorphic and synaptronic spiking neural network with synaptic weights learned using simulation
US8892487B2 (en) 2010-12-30 2014-11-18 International Business Machines Corporation Electronic synapses for reinforcement learning
US8909576B2 (en) * 2011-09-16 2014-12-09 International Business Machines Corporation Neuromorphic event-driven neural computing architecture in a scalable neural network
US8996430B2 (en) 2012-01-27 2015-03-31 International Business Machines Corporation Hierarchical scalable neuromorphic synaptronic system for synaptic and structural plasticity
US8977583B2 (en) 2012-03-29 2015-03-10 International Business Machines Corporation Synaptic, dendritic, somatic, and axonal plasticity in a network of neural cores using a plastic multi-stage crossbar switching
US8868477B2 (en) 2012-03-29 2014-10-21 International Business Machines Coproration Multi-compartment neurons with neural cores
US9082078B2 (en) 2012-07-27 2015-07-14 The Intellisis Corporation Neural processing engine and architecture using the same
US9159020B2 (en) 2012-09-14 2015-10-13 International Business Machines Corporation Multiplexing physical neurons to optimize power and area
US9165244B2 (en) * 2012-10-12 2015-10-20 Ecole Polytechnique Federale De Lausanne (Epfl) Structural to functional synaptic conversion
US9020867B2 (en) 2012-11-06 2015-04-28 International Business Machines Corporation Cortical simulator for object-oriented simulation of a neural network
US8990130B2 (en) 2012-11-21 2015-03-24 International Business Machines Corporation Consolidating multiple neurosynaptic cores into one memory
US9185057B2 (en) 2012-12-05 2015-11-10 The Intellisis Corporation Smart memory
US9239984B2 (en) 2012-12-21 2016-01-19 International Business Machines Corporation Time-division multiplexed neurosynaptic module with implicit memory addressing for implementing a neural network
US9373073B2 (en) 2012-12-21 2016-06-21 International Business Machines Corporation Time-division multiplexed neurosynaptic module with implicit memory addressing for implementing a universal substrate of adaptation
US10248675B2 (en) 2013-10-16 2019-04-02 University Of Tennessee Research Foundation Method and apparatus for providing real-time monitoring of an artifical neural network
US20150242741A1 (en) * 2014-02-21 2015-08-27 Qualcomm Incorporated In situ neural network co-processing
US10552734B2 (en) 2014-02-21 2020-02-04 Qualcomm Incorporated Dynamic spatial target selection
US9542645B2 (en) * 2014-03-27 2017-01-10 Qualcomm Incorporated Plastic synapse management
US9852006B2 (en) 2014-03-28 2017-12-26 International Business Machines Corporation Consolidating multiple neurosynaptic core circuits into one reconfigurable memory block maintaining neuronal information for the core circuits
US20150324691A1 (en) * 2014-05-07 2015-11-12 Seagate Technology Llc Neural network connections using nonvolatile memory devices
US10817785B2 (en) * 2014-08-09 2020-10-27 Fred Narcross Brain emulator support system
US10679120B2 (en) * 2014-11-10 2020-06-09 International Business Machines Corporation Power driven synaptic network synthesis
EP3035249B1 (en) * 2014-12-19 2019-11-27 Intel Corporation Method and apparatus for distributed and cooperative computation in artificial neural networks
US9552327B2 (en) 2015-01-29 2017-01-24 Knuedge Incorporated Memory controller for a network on a chip device
US10061531B2 (en) 2015-01-29 2018-08-28 Knuedge Incorporated Uniform system wide addressing for a computing system
US9886193B2 (en) 2015-05-15 2018-02-06 International Business Machines Corporation Architecture and implementation of cortical system, and fabricating an architecture using 3D wafer scale integration
CN105182794A (en) * 2015-08-12 2015-12-23 天津大学 FPGA-based closed-loop electrophysiological experiment platform
CN105845001B (en) * 2015-11-09 2019-02-22 天津大学 Multiple electrode array Simulation Experimental Platform based on FPGA
WO2017151926A1 (en) 2016-03-03 2017-09-08 Google Inc. Deep machine learning methods and apparatus for robotic grasping
CN111230871B (en) * 2016-03-03 2023-04-07 谷歌有限责任公司 Deep machine learning method and device for robot gripping
US10027583B2 (en) 2016-03-22 2018-07-17 Knuedge Incorporated Chained packet sequences in a network on a chip architecture
US10635968B2 (en) 2016-03-24 2020-04-28 Intel Corporation Technologies for memory management of neural networks with sparse connectivity
US10346049B2 (en) 2016-04-29 2019-07-09 Friday Harbor Llc Distributed contiguous reads in a network on a chip architecture
CN106125730B (en) * 2016-07-10 2019-04-30 北京工业大学 A kind of robot navigation's map constructing method based on mouse cerebral hippocampal spatial cell
US11663450B2 (en) 2017-02-28 2023-05-30 Microsoft Technology Licensing, Llc Neural network processing with chained instructions
US11615297B2 (en) 2017-04-04 2023-03-28 Hailo Technologies Ltd. Structured weight based sparsity in an artificial neural network compiler
US11238334B2 (en) 2017-04-04 2022-02-01 Hailo Technologies Ltd. System and method of input alignment for efficient vector operations in an artificial neural network
US10387298B2 (en) 2017-04-04 2019-08-20 Hailo Technologies Ltd Artificial neural network incorporating emphasis and focus techniques
US11544545B2 (en) 2017-04-04 2023-01-03 Hailo Technologies Ltd. Structured activation based sparsity in an artificial neural network
US11551028B2 (en) 2017-04-04 2023-01-10 Hailo Technologies Ltd. Structured weight based sparsity in an artificial neural network
CN107704922B (en) * 2017-04-19 2020-12-08 赛灵思公司 Artificial neural network processing device
CN107679620B (en) * 2017-04-19 2020-05-26 赛灵思公司 Artificial neural network processing device
CN107679621B (en) 2017-04-19 2020-12-08 赛灵思公司 Artificial neural network processing device
US10671349B2 (en) 2017-07-24 2020-06-02 Tesla, Inc. Accelerated mathematical engine
US11409692B2 (en) 2017-07-24 2022-08-09 Tesla, Inc. Vector computational unit
US11157441B2 (en) 2017-07-24 2021-10-26 Tesla, Inc. Computational array microprocessor system using non-consecutive data formatting
US11157287B2 (en) 2017-07-24 2021-10-26 Tesla, Inc. Computational array microprocessor system with variable latency memory access
US11893393B2 (en) 2017-07-24 2024-02-06 Tesla, Inc. Computational array microprocessor system with hardware arbiter managing memory requests
JP6953229B2 (en) * 2017-08-10 2021-10-27 株式会社半導体エネルギー研究所 Semiconductor device
US10803379B2 (en) 2017-12-12 2020-10-13 Amazon Technologies, Inc. Multi-memory on-chip computational network
US10846621B2 (en) * 2017-12-12 2020-11-24 Amazon Technologies, Inc. Fast context switching for computational networks
US11561791B2 (en) 2018-02-01 2023-01-24 Tesla, Inc. Vector computational unit receiving data elements in parallel from a last row of a computational array
US11803741B2 (en) 2018-02-14 2023-10-31 Syntiant Offline detector
US10948957B1 (en) * 2019-09-26 2021-03-16 Apple Inc. Adaptive on-chip digital power estimator
KR20210052702A (en) * 2019-10-30 2021-05-11 삼성전자주식회사 Neural Processing Unit and Electronic Device Including the Same
RU2739340C1 (en) * 2019-11-14 2020-12-23 Федеральное государственное бюджетное учреждение науки Институт физиологии им. И.П. Павлова Российской академии наук (ИФ РАН) Method for neuromorphic data processing and device for implementation thereof
US11221929B1 (en) 2020-09-29 2022-01-11 Hailo Technologies Ltd. Data stream fault detection mechanism in an artificial neural network processor
US11811421B2 (en) 2020-09-29 2023-11-07 Hailo Technologies Ltd. Weights safety mechanism in an artificial neural network processor
US11237894B1 (en) 2020-09-29 2022-02-01 Hailo Technologies Ltd. Layer control unit instruction addressing safety mechanism in an artificial neural network processor
US11874900B2 (en) 2020-09-29 2024-01-16 Hailo Technologies Ltd. Cluster interlayer safety mechanism in an artificial neural network processor
US11263077B1 (en) 2020-09-29 2022-03-01 Hailo Technologies Ltd. Neural network intermediate results safety mechanism in an artificial neural network processor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4095367A (en) * 1976-06-09 1978-06-20 Takara Co., Ltd. Articulated robot assembly
US5164826A (en) * 1991-08-19 1992-11-17 Westinghouse Electric Corp. Method and apparatus for visual inspection of the internal structure of apparatus through internal passages
US20030033032A1 (en) * 2001-07-02 2003-02-13 Lind Michael A. Application specific intelligent microsensors

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06259585A (en) * 1993-03-10 1994-09-16 Toyota Central Res & Dev Lab Inc Neural network device
US5491650A (en) 1993-04-19 1996-02-13 California Institute Of Technology High precision computing with charge domain devices and a pseudo-spectral method therefor
US5781702A (en) 1995-06-07 1998-07-14 Univ South Western Hybrid chip-set architecture for artificial neural network system
EP0850405A2 (en) 1995-09-19 1998-07-01 Morphometrix Technologies Inc. A neural network assisted multi-spectral segmentation system
JPH09319724A (en) * 1996-05-31 1997-12-12 Noritz Corp Inference device
DE69609613D1 (en) * 1996-10-01 2000-09-07 Finmeccanica Spa Programmed neuron module
DE19718224A1 (en) * 1997-04-30 1997-11-27 Harald Dipl Phys Wuest Digital neural network processor for consumer goods, games, telecommunications or medical equipment or vehicle
JP2000061153A (en) * 1998-08-21 2000-02-29 Bandai Co Ltd Toy device
US20040015079A1 (en) * 1999-06-22 2004-01-22 Teratech Corporation Ultrasound probe with integrated electronics
US6882992B1 (en) * 1999-09-02 2005-04-19 Paul J. Werbos Neural networks for intelligent control
EP1089221A3 (en) 1999-09-29 2007-05-02 Lucent Technologies Inc. Spike-based hybrid computation
JP4427860B2 (en) * 2000-03-24 2010-03-10 株式会社デンソー VEHICLE CONTROL DEVICE AND RECORDING MEDIUM
JP2002187082A (en) * 2000-10-11 2002-07-02 Sony Corp System and method for controlling robot
US6553300B2 (en) 2001-07-16 2003-04-22 Deere & Company Harvester with intelligent hybrid control system
EP1563348A2 (en) 2002-08-21 2005-08-17 Neal E. Solomon Systems, methods and apparatus for organizing groups of self-configurable mobile robotic agents in a multi-robotic system
WO2004033159A1 (en) 2002-10-11 2004-04-22 Fujitsu Limited Robot control algorithm construction device, robot control algorithm construction program, robot control device, robot control program, and robot
JP4587738B2 (en) 2003-08-25 2010-11-24 ソニー株式会社 Robot apparatus and robot posture control method
US7519879B2 (en) * 2004-04-26 2009-04-14 Agilent Technologies, Inc. Apparatus and method for dynamic in-circuit probing of field programmable gate arrays
US7240160B1 (en) * 2004-06-30 2007-07-03 Sun Microsystems, Inc. Multiple-core processor with flexible cache directory scheme
US7430643B2 (en) * 2004-12-30 2008-09-30 Sun Microsystems, Inc. Multiple contexts for efficient use of translation lookaside buffer

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4095367A (en) * 1976-06-09 1978-06-20 Takara Co., Ltd. Articulated robot assembly
US5164826A (en) * 1991-08-19 1992-11-17 Westinghouse Electric Corp. Method and apparatus for visual inspection of the internal structure of apparatus through internal passages
US20030033032A1 (en) * 2001-07-02 2003-02-13 Lind Michael A. Application specific intelligent microsensors

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"IEEE Proceedings of the Fourth International Conference on Microelectronics for Neural Networks and Fuzzy Systems. 26-28 September 1994", article HALGAMUGE ET AL.: "Fuzzy Interpretable Dynamically Developing Neural Networks with FPGA Based Implementation.", pages: 226 - 234, XP010222657 *
MILLER, W.T.: "III. Real-time Neural Network Control of a Biped Walking Robot.", IEEE CONTROL SYSTEMS MAGAZINE., vol. 14, no. 1, February 1994 (1994-02-01), pages 41 - 48, XP008125042 *
See also references of EP1902358A4 *

Also Published As

Publication number Publication date
US7533071B2 (en) 2009-05-12
EP1902358A4 (en) 2010-06-02
US20070094481A1 (en) 2007-04-26
US20090240642A1 (en) 2009-09-24
EP1902358A2 (en) 2008-03-26
WO2007002790A2 (en) 2007-01-04
JP2009508182A (en) 2009-02-26
US20120323832A1 (en) 2012-12-20
US8126828B2 (en) 2012-02-28

Similar Documents

Publication Publication Date Title
WO2007002790A3 (en) Neural modeling and brain-based devices using special purpose processor
WO2007002731A3 (en) Addressing scheme for neural modeling and brain-based devices using special purpose processor
WO2013192490A3 (en) Training and operating industrial robots
WO2011008591A3 (en) Tubular valve system and method
WO2011123392A3 (en) Unitized engine nacelle structure
BRPI0820971A2 (en) PROTECTIVE LAYER FOR PLANTS AND TREES, THEIR PRODUCTION AND THEIR USE
BRPI0810746A2 (en) FUEL CELL DEVICES AND SYSTEMS AND THEIR PRODUCTION AND USE METHODS.
DK3397009T3 (en) Methods and devices in a communication network
EP2023277A4 (en) Neural network learning device, method, and program
DK1981853T3 (en) Substituted imidazoles and their use as pesticides
WO2012014082A3 (en) Artificial intelligence and methods for relating herbal ingredients with illnesses in traditional chinese medicine
MY187594A (en) Tetradecahedron toy block
WO2013022975A3 (en) Creature construction toy
DE602006013554D1 (en) Endoscope device and communication method used in the device
NO20070781L (en) Well actuator tools and methods for use in a well
WO2008048831A3 (en) Flexible object simulator
WO2009058982A3 (en) Modular robot with a plurality of agents
DE502007004947D1 (en) Bus interface unit for intermediate switching into a two-wire current loop as well as transducers, positioners and analog input and output modules with such a bus interface unit
BRPI1006920A2 (en) reactive dyes, their preparation and their use
ECSP14005917A (en) PREPARATIONS INCLUDING AMORPHOUS EMODEPSIDE
WO2010087805A3 (en) Insult resistant plants and methods of producing and using the same
TW200642276A (en) Fan out buffer and method therefor
USD815296S1 (en) Tissue cell block
BRPI0906433A2 (en) cyclic indole-3-carboxamides, their preparation and their use as a pharmaceutical
DE602005025113D1 (en) INTRAVAGINAL DEVICE WITH LIQUID TRANSPORT PLATES AND MANUFACTURING METHOD

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
ENP Entry into the national phase

Ref document number: 2008519538

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2006785790

Country of ref document: EP