arxiv: v1 [cs.ne] 2 Nov 2016

Transcription

1 Deep counter networks for asynchronous event-based processng arxv: v1 [cs.ne] 2 Nov 216 Jonathan Bnas, Gacomo Indver, and Mchael Pfeffer Insttute of Neuronformatcs Unversty of Zurch and ETH Zurch, Swtzerland jbnas@n.ethz.ch November 3, 216 Abstract Despte ther advantages n terms of computatonal resources, latency, and power consumpton, event-based mplementatons of neural networks have not been able to acheve the same performance fgures as ther equvalent state-of-the-art deep network models. We propose counter neurons as mnmal spkng neuron models whch only requre addton and comparson operatons, thus avodng costly multplcatons. We show how nference carred out n deep counter networks converges to the same accuracy levels as are acheved wth state-of-the-art conventonal networks. As ther event-based style of computaton leads to reduced latency and sparse updates, counter networks are deally suted for effcent compact and low-power hardware mplementaton. We present theory and tranng methods for counter networks, and demonstrate on the mnst benchmark that counter networks converge quckly, both n terms of tme and number of operatons requred, to state-of-the-art classfcaton accuracy. 1 Introducton Despte the remarkable success of deep neural networks [14] n areas such as computer vson [13, 7] or speech recognton [8], bologcal neural systems clearly outshne ther artfcal counterparts n terms of compactness, speed and energy consumpton. One putatve reason for such effcency may le n the way sgnals are represented and transmtted n anmal brans: data s transmtted sparsely and asynchronously, n small packets by means of spkes. Ths s n stark contrast wth the frame-based approach of classcal neural networks, whch always compute the complete output of one layer synchronously, before passng t on to the next layer. Indeed, spke-based processng allows for more effcent utlzaton of communcaton channels and computng resources, and can lead to speedups n processng [17]. These advantages have sparked nterest n dedcated spkng neural network electronc devces based on such event-drven 1

2 processng schemes [16, 11]. Achevng the same accuracy as state-of-the-art deep learnng models wth event-based updates has remaned challengng, but recently a number of methods have been proposed whch convert a prevously traned conventonal analog neural network (ANN) nto a spkng one [1, 5, 9, 6]. The prncple of such converson technques s to approxmate the contnuous-valued actvatons of ANN unts by the spke rates of event-based neurons. Although successful on several classcal benchmark tasks, all these methods suffer from approxmaton errors, and typcally requre a multtude of spkes to represent a sngle contnuous value, thereby losng some of the advantages of event-based computaton. In ths work, we propose a set of mnmalstc event-based asynchronous neural network models, whch process nput data streams contnuously as they arrve, and whch are formally equvalent to conventonal frame-based models. Ths class of models can be used to buld hghly effcent event-based processng systems, potentally n conjuncton wth event-based sensors [4, 18]. The resultng systems process the stream of ncomng data n real tme, and yeld frst predctons of the output typcally already after a few data packets have been receved, and well before the full nput pattern has been presented to the network. Here we demonstrate how the computaton carred out by counter networks exactly reproduces the computaton done n the conventonal frame-based network. Ths allows mantanng the hgh accuracy of deep neural networks, but does so wth a power and resource effcent representaton and communcaton scheme. Specfcally we show how, as a consequence of the event-drven style of processng, the resultng networks do not requre computatonally expensve multplcaton operatons. We ntally demonstrate the prncple for networks wth bnary actvatons, and then extend the model to non-bnary actvatons. The performance of our novel models s evaluated on the mnst dataset. The numercal results ndcate that counter networks requre fewer operatons than prevous approaches to process a gven nput, whle enablng state-of-the-art classfcaton accuracy. 2 Counter neural networks Multplcatons are the most expensve operatons when usng conventonal neural networks for nference on dgtal hardware. It s therefore desrable to reduce the number of requred multplcatons to a mnmum. In ths secton, we ntroduce an event-based neuron model, whch only makes use of addton operatons, counter varables, and smple comparsons, all of whch can be mplemented very effcently n smple dgtal electronc crcuts. 2.1 Multplcaton-free networks Prevous work has shown how frame-based neural networks can be mplemented usng addtons only, by ether restrctng all weghts to bnary (or ternary) values [1, 15, 3], or by usng bnary actvatons [2]. The bnary varable (weght 2

3 or actvaton) then represents an ndcator functon, and all neural actvatons can be computed by smply addng up the selected weghts or actvatons. To ntroduce our event-based model n ts most basc form, we frst nvestgate the case where neurons have bnary actvatons, such that the output of all neurons y (k) n layer k s gven by ( y (k) = σ W (k) y (k 1) θ (k)), (1) where W s the weght matrx, θ are threshold values correspondng to bas terms, and { 1, f x >, σ(x) = (2), otherwse. Thus, the output of a neuron s 1 f ts net nput s greater than ts threshold value θ and otherwse. Whle ths model does not pose any constrants on the weghts and thresholds, we use low precson nteger values n all experments to keep the computatonal cost low and allow for hghly effcent dgtal mplementatons. We consder here mult-layer networks traned through stochastc gradent descent usng the backpropagaton algorthm [19]. Snce the error gradent s zero almost everywhere n the dscrete network gven by eqs. (1) and (2), we replace the bnarzaton functon σ by a logstc sgmod functon σ n the backward pass, σ(x) = exp ( λx), (3) where λ s a scalng factor. Furthermore, durng tranng, we keep copes of the hgh-resoluton weghts and actvatons, and use them to compute the gradent n the backward pass, as proposed by [3, 2]. In addton to the actvatons and network parameters, the nputs to the network are bnarzed by scalng them to le n the range [, 1] and roundng them to the nearest nteger. 2.2 Lossless event-based mplementaton through counter neurons The multplcaton-free network proposed above can drectly be turned nto an asynchronous event-based neural network by turnng every unt of the ANN nto a counter neuron, whch we descrbe below. The weghts and bases obtaned through the tranng procedure above can be used n the event-based network wthout further converson. Each counter neuron s defned by an nternal counter varable c, whch s updated whenever the neuron receves postve or negatve nputs n the form of bnary events (or spkes). The neuron operaton s llustrated n fg. 1 and s descrbed by alg. 1. A counter neuron essentally counts, or adds up, all the nputs t receves. Whenever ths sum crosses the threshold θ, a bnary event ±1 s emtted. The value of the event depends on the drecton n whch 3

4 Input 2-2 Counter state c θ Output 1-1 Tme Fgure 1: Illustraton of the basc counter neuron model. The nternal counter varable c s ntalzed at the negatve threshold level θ and accumulates nputs provded through events at dscrete tme steps. Whenever the counter changes ts sgn,.e. when the accumulated nput becomes greater or smaller than the threshold level θ, an event s emtted. The event s postve (+1) f the sgn changes from negatve to postve, and negatve ( 1) otherwse. the threshold was crossed,.e. a postve event s emtted when the threshold s crossed from below, and a negatve event when c falls below the threshold. Whenever neuron j emts an event the quantty ±w j s provded as nput to neuron of the next layer, wth the sgn determned by the output of neuron j. Thus, the neurons themselves do not contnuously provde output sgnals, whch makes nformaton transmsson and computaton n the network very sparse. The nput to the network s also provded n event-based form as a stream of bnary events (or spkes),.e. the network at dscrete ponts n tme receves a lst of ndces of one or more pxels, ndcatng that these pxels are actve. Specfcally, a bnary nput mage (or other data) s streamed to the network pxel-by-pxel n an asynchronous manner, whereby the order and exact tmng of the pxels does not matter. In the followng we wll show analytcally that an event-based network based on counter neurons produces exactly the same output as ts frame-based counterpart. Proof of the equvalence. To prove the equvalence of the frame-based and the event-based model we have to show that the outputs of ndvdual neurons are the same n both settngs. In the followng, we assume θ k > k wthout loss of generalty. Let an event-based network be ntalzed at tme t =, such that all c k () = θ k. Wthn the tme nterval [, T ], neuron of layer m n the event-based network receves a sequence of N nputs, (w (m) j 1 s 1,..., w (m) j N s N ) from a set of source neurons j 1,..., j N at tmes t 1,..., t N, where s k s the sgn of 4

5 ntalze: c θ whenever neuron receves an nput event np = sgn j w j from a neuron j or a sum of smultaneous nput events np = j J sgn jw j from a set of neurons J do c c c + np c prev f emt +1 end c prev f emt 1 end end c prev and c > then > and c then Algorthm 1: Basc counter neuron mplementaton. the kth event, and t k T, k. It follows from alg. 1 that the value of the counter varable c (m) at tme T s c (m) (T ) = c (m) (t N ) = k=1,...,n w(m) j k s k θ (m), (4) as t smply sums up the nputs. The sgn of c (m) mght change several tmes durng the presentaton of the nput, and trgger the emsson of a postve or negatve event at every zero-crossng. Snce c (m) s ntalzed at θ (m) <, there (t N )) sgn changes n total, where n s a non-negatve nteger, are 2n + σ(c (m) and thus the total nput communcated to neuron k of the next layer s σ ( c (m) (t N ) ) w (m+1) k = σ ( N k=1 w(m) j k s k θ (m) ) w (m+1) k =: ŷ (m) w (m+1) k, (5) as the 2n sgn changes cancel out. On the other hand, recursvely applyng eq. (5) leads to ( ) ( ) ŷ (m) = σ j w(m) j σ(c (m 1) j (t N )) θ (m) = σ j w(m) j ŷ (m 1) j θ (m). (6) Snce ŷ () k = y() k for the nput layer, the equvalence must also hold for all hgher layers, accordng to eq. (6). Wth the noton of equvalence, t s clear that the event-based network, f confgured wth the parameters obtaned for the frame-based network, s able to exactly reproduce the output of the latter. Unlke n prevous work [1, 5], the resultng event-based network s guaranteed to provde the same result as the deal frame-based mplementaton. Thereby, the respectve output value can be obtaned by addng up the events emtted by the output layer. Techncally, 5

6 Layer 3 Layer 2 Layer Correct output Input event Fgure 2: Example run of the event-based system. A sngle nput pattern of the mnst test set s presented over tme (one pxel per tmestep) to a traned counter network. Postve events are dsplayed n black, negatve events n red. The correct output (class 3) for ths nput pattern can be read out long before the whole nput has been presented. Shaded regons ndcate that the output of the network s correct durng these perods,.e. only the output neuron for class 3 has produced more postve than negatve output spkes. the equvalence holds only n the case where the full stream of nput events has been presented to the network, and propagated through all layers. In practce, however, a few nput events are often enough to actvate the rght neurons and produce the correct output long before the full set of nput events has been presented. As a consequence, on average far fewer operatons than n the frame-based model are requred to compute the correct output (see fg. 2 for an example). 2.3 Extenson to non-bnary nputs The constrant that the nput patterns are bnary, and each nput unt ether produces an event or not, can be safely relaxed to nteger-valued nputs wthout further modfcatons of the model. The framework thus supports fner graned nput scales, whch s mportant e.g. for nput mages usng multple gray-levels or RGB values to encode dfferent colors. The smple modfcaton s that each ndvdual nput unt produces over tme a number of events that corresponds to the encoded nteger value. Whle such nteger-valued nputs would requre 6

7 ntalze: z ; c θ whenever there s an nput event np = sgn j w j from a neuron j or a sum of smultaneous nput events np = j J sgn jw j from a set of neurons J do c c + np whle c λ do emt +1 c c λ z z + 1 end whle z > and c < do emt 1 c c + λ z z 1 end end Algorthm 2: Extended counter neuron mplementaton based on the dscretzed ReLU actvaton. The parameter θ represents the neuron s threshold. The scalng factor λ allows adjustng the step sze at whch the neuron emts events,.e. how much more nput s requred to trgger the next event. multplcaton n the frame-based network wth non-bnary (or non-ternary) weghts, the event-based network remans free of multplcaton operatons, as the nstantaneous output of any nput unt s stll bnary. 2.4 Extended counter neuron network wth non-bnary actvatons Usng bnary outputs for neurons mght be a dsadvantage, because due to the the lmted output bandwdth of ndvdual neurons t mght be necessary to use more neurons n hdden layers to obtan the same accuracy as a non-bnary network. The counter network model can easly be extended to non-bnary actvatons, wthout requrng multplcaton n the event-based mplementaton. In order to tran a network based on neurons featurng multple, dscrete levels of actvaton, we use a dscretzed verson of the ReLU actvaton functon durng tranng: ( ) x + ɛ f(x) = ρ, (7) λ 7

8 Input 2-2 Counter state 4 2 λ c z Output 1-1 Tme Fgure 3: Illustraton of the extended counter neuron model. The nternal counter varable c accumulates nput events at dscrete tme steps. Whenever the varable crosses the threshold level λ, a postve event (+1) s emtted and the second counter varable z s ncremented by 1. On the other hand, f z > and c becomes negatve, a negatve event ( 1) s emtted and z s decremented. Whenever an event s emtted, c wraps around to stay n the range (, λ]. Note that we assumed θ = for ths llustraton. where ɛ 1 s a small, postve constant, λ Z + s a scalng factor, and ρ s the typcal ReLU half-wave rectfcaton, { x, f x >, ρ(x) = (8), otherwse. As n the bnary case, the dscrete actvaton s used durng tranng n the forward pass, and a contnuous approxmaton n the backward pass. Specfcally, f can be approxmated by a shfted and scaled ReLU, f(x) = ρ ( x λ 1 2 ), (9) n the backward pass. The learned parameters can then agan be drectly transferred to confgure a network of event-based neurons wthout further converson of weghts or bases. The dynamcs of ths network are llustrated n fg. 3, and descrbed n alg. 2. The equvalence of the frame-based and the event-based mplementaton can be proven smlarly to the bnary case. A sketch of the proof s outlned below: Proof of the equvalence. From alg. 2 t can be seen that after a neuron has processed a number of nput events, ts nternal varable z has the value ρ( (x 8

9 θ + ɛ)/λ ), where x s the accumulated nput provded over tme. On the other hand, the value of z changes only when an event s emtted, and ts value corresponds to the number of postve events emtted, mnus the number of negatve events emtted. Thus, the accumulated output communcated by the neuron corresponds precsely to z, and thereby to the output of the frame-based model gven by eq. (7), snce x corresponds to the total nput provded by neurons from the prevous layer, x = j w jy j. The dscretzed ReLU offers a wder range of values than the bnary actvaton, and therefore allows for a more fne-graned response, thereby facltatng tranng. On the other hand, usng non-bnary outputs mght lead to larger output delays compared to the bnary case, as the traned neurons mght now requre a multtude of events from ndvdual neurons to arrve at the correct output. 3 Results Varous networks were traned on the mnst dataset of handwrtten dgts to demonstrate compettve classfcaton accuracy. In partcular, we evaluated fully connected networks (FCNs) of three hdden layers ( ) and fve hdden layers ( ) to nvestgate how the depth of the network affects the processng speed and effcency. In addton we traned convolutonal networks (CNNs) wth two (784-12c5-12c7-1) and four (784-12c3-12c5-12c7-12c9-1) hdden layers. The network dmensons were chosen such that the number of parameters remans roughly the same n the shallower and deeper networks ( 2.8 mo. parameters for the FCNs, and 5k for the CNNs.) 3.1 Tranng detals The networks were traned through stochastc gradent descent usng the Adam method [12]. The gradents for the backward pass were computed usng the contnuous approxmatons descrbed by eqs. (3) and (9). All parameters were restrcted to 8-bt nteger precson n the forward pass, and floatng pont representatons were used only n the backward pass, as suggested by [3, 2]. The bases θ were restrcted to non-negatve values through an addtonal constrant n the objectve functon, otherwse categorcal cross-entropy was used as the loss functon. The learnng rate was set to.1 for the CNNs and to.5 for the FCNs. The mnst dataset was splt nto a tranng set of 5 samples, a valdaton set of 1 samples, and a test set of 1 samples, and a batch sze of 2 samples was used durng tranng. The networks were traned untl a classfcaton error of 1.5% on the valdaton set was obtaned. The low-precson parameters were then drectly used n an event-based network of equvalent archtecture. 9

10 # Input patterns Input pattern length (events) 1 Input patterns classfed (%) 5 basc: extended: 3 hdden 5 hdden 3 hdden 5 hdden basc: extended: 2 conv 4 conv 2 conv 4 conv kops. trggered by sngle nput event Input events provded FCN Input events provded CNN Fgure 4: Performance of the basc and extended counter neuron models. The top panel shows the dstrbuton of nput pattern lengths (event count or actve pxels) of the mnst test set. The mddle panels show the fracton of classfed patterns (classfed here means that the output s the same as that of the correspondng frame-based network) as a functon of the number of nput events presented to the network for the dfferent archtectures that were tested (mean over mnst test set; left: FCNs; rght: CNNs). The arrows mark the postons where the 99 % threshold s crossed. The bottom panels show the number of addton operatons trggered n the networks by an ndvdual nput event over the course of the nput presentaton (mean over mnst test set). 3.2 Fast and effcent classfcaton The man advantage of event-based deep networks s that outputs can be obtaned fast and effcently. We quantfy ths n Fgure 4, where the processng speed s measured as the tme taken to produce the same output as the frame-based model, and effcency s quantfed as the number of addton operatons requred to compute the output. For ths analyss, ndvdual pxels of the nput mage are 1

11 1 Input patterns classfed (%) 5 basc: ext.: 3 h 5 h 3 h 5 h basc: ext.: 2 c 4 c 2 c 4 c 1 2 Operatons requred (mo.) 1 2 Operatons requred (mo.) Fgure 5: Effcency of the basc and extended counter neuron models. The dagram shows the average number of operatons requred by dfferent archtectures to classfy a certan fracton of test set examples. The arrows mark the postons where the 99 % threshold s crossed. The color and lne style correspond to the ones used n fg. 4. provded to the network one by one n random order. In the systems based on the basc counter network model wth bnary neurons, the majorty of events s emtted at the begnnng of the nput data presentaton, wth actvty gradually declnng n the course of the presentaton. Ths reflects the fact that counter neurons cannot emt two events of the same sgn n a row, leadng to quck saturaton n the output. The opposte s the case for the extended counter neuron based on the dscretzed ReLU, where actvty gradually ramps up. Overall, ths allows the extended model to produce the desred output wth fewer operatons than the basc model, as can be seen n fg. 5. The acheved effcency s beyond what had been possble wth prevous converson-based methods: our method acheves classfcaton of mnst at <5k events (CNN based on the extended neuron model), whle the best reported result of a converson-based network, to our knowledge, s >1 mo. events [17]. Despte the dfferent network archtectures, the behavor of FCNs and CNNs s qualtatvely smlar, wth the man dfferences beng due to the neuron model. In general, deeper networks seem to requre a greater number of operatons than shallower networks to acheve equvalent results. 4 Dscusson The two presented counter neuron models allow effcent event-based mplementatons of deep neural network archtectures. Whle prevous methods constructed deep spkng networks by convertng parameters and approxmatng actvatons wth frng rates, the output of our model s provably equvalent to ts frame-based counterpart. Tranng s done n the frame-based doman, where state-of-the-art neural network optmzaton methods can be exploted. The dscrete nature of counter networks allows hardware-frendly dgtal mplementatons, and makes them very sutable to process data from event-based sensors [18]. The resultng 11

12 systems dffer from tradtonal neural networks n the sense that unts are updated depth frst, rather than breadth frst, meanng that any neuron can fre when ts threshold s crossed, nstead of watng for all neurons n prevous layers to be updated, as n conventonal neural networks. Ths allows processng of nput data as they arrve, rather than watng for a whole frame to be transferred to the nput layer. Ths can sgnfcantly speed up processng n dgtal applcatons. Compared to other deep spkng neural networks based on parameter converson [17], counter networks requre fewer operatons to process nput mages, even n our non-optmzed settng. We expect that addng further constrants to enforce sparsty or reduce neuron actvatons can make counter networks even more effcent. Further research s requred to nvestgate the applcablty of the counter neuron model n recurrent networks. Fnally, event-based systems are appealng because they allow for purely local, event-based weght update rules, such as spke-tmng dependent plastcty (STDP). Prelmnary results ndcate that STDP-based tranng of counter networks s possble, whch not only would allow effcent nference but also tranng of deep event-based networks. Acknowledgements The research was supported by the Swss Natonal Scence Foundaton Grant and the European Unon ERC Grant References [1] Yongqang Cao, Yang Chen, and Deepak Khosla. Spkng deep convolutonal neural networks for energy-effcent object recognton. Internatonal Journal of Computer Vson, 113(1):54 66, 215. [2] Mattheu Courbaraux and Yoshua Bengo. BnaryNet: Tranng deep neural networks wth weghts and actvatons constraned to +1 or -1. arxv preprnt arxv: , 216. [3] Mattheu Courbaraux, Yoshua Bengo, and Jean-Perre Davd. BnaryConnect: Tranng deep neural networks wth bnary weghts durng propagatons. In Advances n Neural Informaton Processng Systems, pages , 215. [4] Tob Delbrück, Bernabe Lnares-Barranco, Eugeno Culurcello, and Chrstoph Posch. Actvty-drven, event-based vson sensors. In Proceedngs of 21 IEEE Internatonal Symposum on Crcuts and Systems, pages IEEE, 21. [5] Peter U Dehl, Danel Nel, Jonathan Bnas, Matthew Cook, Shh-Ch Lu, and Mchael Pfeffer. Fast-classfyng, hgh-accuracy spkng deep networks through weght and threshold balancng. In 215 Internatonal Jont Conference on Neural Networks (IJCNN). IEEE, 215. [6] Steven K. Esser, Paul A. Merolla, John V. Arthur, Andrew S. Cassdy, Rathnakumar Appuswamy, Alexander Andreopoulos, Davd J. Berg, Jeffrey L. McKnstry, Tmothy Melano, Davs R. Barch, Carmelo d Nolfo, Pallab Datta, Arnon Amr, Bran Taba, Myron D. Flckner, and Dharmendra S. Modha. Convolutonal networks for fast, energy-effcent neuromorphc computng. Proceedngs of the Natonal Academy of Scences,

13 [7] Kamng He, Xangyu Zhang, Shaoqng Ren, and Jan Sun. Delvng deep nto rectfers: Surpassng human-level performance on ImageNet classfcaton. In Proceedngs of the IEEE Internatonal Conference on Computer Vson, pages , 215. [8] Geoffrey E Hnton, L Deng, Dong Yu, George E Dahl, Abdel-Rahman Mohamed, Navdeep Jatly, Andrew Senor, Vncent Vanhoucke, Patrck Nguyen, Tara N Sanath, et al. Deep neural networks for acoustc modelng n speech recognton: The shared vews of four research groups. IEEE Sgnal Processng Magazne, 29(6):82 97, 212. [9] Erc Hunsberger and Chrs Elasmth. Spkng deep networks wth LIF neurons. arxv preprnt arxv: , 215. [1] Kyuyeon Hwang and Wonyong Sung. Fxed-pont feedforward deep neural network desgn usng weghts +1,, and -1. In 214 IEEE Workshop on Sgnal Processng Systems (SPS), pages 1 6. IEEE, 214. [11] Gacomo Indver, Federco Corrad, and Nng Qao. Neuromorphc archtectures for spkng deep neural networks. In 215 IEEE Internatonal Electron Devces Meetng (IEDM). IEEE, 215. [12] Dederk Kngma and Jmmy Ba. Adam: A method for stochastc optmzaton. arxv preprnt arxv: , 214. [13] Alex Krzhevsky, Ilya Sutskever, and Geoffrey E Hnton. Imagenet classfcaton wth deep convolutonal neural networks. In Advances n neural nformaton processng systems, pages , 212. [14] Yann LeCun, Yoshua Bengo, and Geoffrey E Hnton. Deep learnng. Nature, 521(7553): , 215. [15] Zhouhan Ln, Mattheu Courbaraux, Roland Memsevc, and Yoshua Bengo. Neural networks wth few multplcatons. arxv preprnt arxv:151.39, 215. [16] Paul A Merolla, John V Arthur, Rodrgo Alvarez-Icaza, Andrew S Cassdy, Jun Sawada, Flpp Akopyan, Bryan L Jackson, Nabl Imam, Chen Guo, Yutaka Nakamura, et al. A mllon spkng-neuron ntegrated crcut wth a scalable communcaton network and nterface. Scence, 345(6197): , 214. [17] Danel Nel, Mchael Pfeffer, and Shh-Ch Lu. Learnng to be effcent: algorthms for tranng low-latency, low-compute deep spkng neural networks. In Proceedngs of the 31st Annual ACM Symposum on Appled Computng, pages ACM, 216. [18] Chrstoph Posch, Teresa Serrano-Gotarredona, Bernabe Lnares-Barranco, and Tob Delbruck. Retnomorphc event-based vson sensors: bonspred cameras wth spkng output. Proceedngs of the IEEE, 12(1): , 214. [19] D E Rumelhart, G E Hnton, and R J Wllams. Learnng representatons by back-propagatng errors. Nature, 323: , [2] Evangelos Stromatas, Danel Nel, Mchael Pfeffer, Francesco Gallupp, Steve B Furber, and Shh-Ch Lu. Robustness of spkng deep belef networks to nose and reduced bt precson of neuro-nspred hardware platforms. Fronters n neuroscence, 9,