= g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output...

28

Transcript of = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output...

Page 1: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

����������� ����� �������������� ������� ���!���#"$���&%'(���*)���+, - ��%����*.��"/'01%32 4 ,657, �98����;:� ���<�>=

?A@3BDCFEHGJI K!LMEHNPOHQRLME

SUTWVYX[ZP\[]_^a`�bdc�]UX[^9e�f�g;hjik`YZkl[m[ZP]_^9nkoqprmMst^Roqc#uwvxcH]_^yprprbzik^ycH]|{�}�~_]_^ys�~a�z��^yl[bz]_^yl���}���pz}�c[^a�Zkc[l���^ao�l�ok`U^y~UVam!��\[`U^yprbrs�brc[ZP`U}[�

Page 2: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

� � ��� ����

� � � ���� ������� � ������ ��� � ����� � ��� � �"!� �#�%$ �&� '(�*) + , �-�������.�"! $ �/� �0 + 1 + 23�54 ���765�������

8%9;:=<?>A@CBD<FE�GIHKJMLNGCODPRQTSVUXWYH[ZYSVJXO�J\G^]YU_Q;HK`aQTU_]Rb^cIL=Q\HK]Y`dQ\]eQ\GIS�QTGIS=]YU_fg]DhR`IS=cIUTODia`^S=QkjF]YU\lmJHK`nQTGISFLV]Y`aQ\SpoqQ�]DhCJ_cIPrSVU_ZqHsJ\SVb3isStODU_`IHK`IW^u.vqHKwxPIiKSyPrSVU\L=SVP^Q\U\]Y`^JVzYw{c^isQTHsi|OtfYS=UMP}S=U\LVS=P^QTU_]Y`IJ=zUTO~bIH|ODiM�CO~J\HKJ�h�cI`ILpQTHs]Y`�`ISpQkj�]YU_lmJVz�Q\GIS��CO~LNlqP^U\]YPCO~WaO~QTHs]Y`�O~iKWY]YU_HsQ\GIw�zIOD`Ib�]DQ\GISVUeQT]YP^HKLVJODU_Snb^HKJ\L=cIJ\J_SVb�u�E�GISnPIU\]D�IiKS=w�]Dh.]AZDSVU��IQ\Q\HK`IWxOD`Ib�WYS=`ISVU\ODiKHs�tO~Q\HK]Y`�j�G^HKLNG�HsJ�]Dh;SVwxHK`IS=`mQPIU\ODL=Q\HKLtO~iFHsw�Pr]YU_QTOD`IL=S�HsJ�SVwxPIGCO~J\HK�=SVb�u���iKi�Q\GISV]YU_S=Q\HKLtO~iFL=]Y`ILVS=P^QTJ3O~U\S�HsiKiscIJ_Q\UTO~Q\SVb��af� �M�.����ODPIP^iKS=Q\J�j�GIHKLNG�QTGISgU_StODbIS=U�LtOD`�bI]?j�`IiK]YODb�h�U_]Yw���^�k�����m�D�D�a�¡ � ¢ �£¥¤\�r¦�§k£¥¨V�©�~ª�«a¬}��­~«q�

®3¯?® °M±%²�³y´�µ·¶·¸�²�¹=´�±º ZYS=U�QTGIS»i|ODJ�Q�Qkj�S=`mQkf�fYSVODU\Jd`^SVcIU\ODi;`^S=QkjF]YU\lmJdGCOtZDS�h�]YcI`Ib�QTGIS=HKU�j¼Otf�HK`aQT]�`mcIw�S=U\]Yc^JODPIP^iKHKLVO~QTHs]Y`IJ�UTO~`IWYHK`^Wxh�U_]Yw½LNGCODUTO~L=QTS=UdU\S=LV]YWD`IHsQ\HK]Y`�zCP^i|OD`aQd]DP^QTHsw�Hs�tO~Q\HK]Y`�zqQT]��I`COD`IL=H|ODiPIU_SVbIHsL=QTHs]Y`�¾RJ\SVS¿S~u¥W^u�ÀÂÁAÃÄu º h�QTS=`�Q\GIS�Q\SVU\w�Å¥`^SVcIU\ODi�`ISpQkj�]DU\l©ÅCHKJ¼c^J\SVb�HsJ�O{UTO~Q\GISVU��IU\]aO~bJ\S=`IJ\S�j�GIHsLNG�WYU_]YcIPIJ�Q\]YWYSpQTGIS=U�bIHsÆ}SVU_SV`aQyhÇODw�HsiKHsSVJM]Dh�ODiKWY]DU\HsQ\GIwxJ.OD`^bxwxS=Q\GI]qbIJVu º `ÈQTG^S�IHs]YiK]YWDHKLtO~iDSV`^b{]DhIQ\GISFJ_P}S=L=Q\U\cIw�zDQTG^S�Q\SVU\wÉ`IS=cIUTO~iq`^S=QkjF]YU\lnHKJXcIJ\S=b�QT]¢bISVJ_LVU_HK�rS�wx]RbIS=iKJ]Dh�L=]Yw�P^c^QNO~Q\HK]Y`ÊHK`�J\Hs`IWYiKSx`IS=cIU\]Y`^J{]YU»j�G^]YiKS�ODU\SVODJ�]~h�QTGIS��IUTODHs`�u�Ëk`�QTGISxh�]YiKis]?j�HK`IWjFS�h�]qLVcIJ3]Y`ÌODU_Q\Hs�CL=H|ODiF`ISVcIU\ODi�`IS=QkjF]YU_lruÍE�G^SVU\S�O~QxiKSVODJ_Q3QTG^U\SVS�bIH[Æ�S=U\SV`aQ�LViKODJ\J_SVJx]DhODisWY]YU\H[QTGIwxJ�w�Otf��rS�bIHKJ�QTHs`IWYcIHsJ\GIS=b���J_cIP}S=U_ZqHKJ_SVb�zFcI`IJ_cIP}S=U_ZqHKJ_SVb�z¼OD`Ib7U\S=HK`^h�]YU_LVS=w�S=`mQiKSVODU\`^HK`IWIu.E�GIHKJ�LNGCODPRQTSVU�h�]qLVcIJ_SVJ�SpoRLViscIJ\H[ZYS=isfÎ]Y`�QTG^SnJ_cIPrSVU_ZqHsJ\SVb�iKSVODU\`IHs`IWÈPCODU\ODbIHsWYw�u

®3¯ÐÏ Ñδx³�Ò Ó�ÔÍÕ-Ö¿¶·³�´x±·×��U�QTH[�CLVHKODi�`IS=cIUTODi/`^S=QkjF]YU\lmJ¢ODU\Sg�CODJ_SVb�]Y`�O3U\O~QTG^SVU�J\Hsw�PIisSdwx]RbIS=i�]Dh.Ox`^SVcIU_]Y`�uFØ�]YJ�Q`IS=cIU\]Y`^JÈGCOtZYS%QTG^U\SVSÎPIODU_Q\JV��O�bISV`^bIU\H[QTS�j�GIHsLNG LV]YisiKS=L=QTJ»HK`IP^c^QTJ�h�U_]YwÙ]DQTGIS=U�`IS=cIU\]D`IJ

Ú

Page 3: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

x i = g(Σj wijx j − ϑ )

dendrite

synapse electrode spike train

output

summationof inputs

threshold(nonlinearity)

transmissionof output

rate

T

axonsoma

xg(.)

j

x iwij

pulsesT

i

������� Ú u Ú �;�*J\HK`^WYiKSeODU�QTHs�ILVH|O~iI`ISVc^U\]Y`�u�Ëk`^PIc^Q�ZDO~iKcIS=J���ODU_S�J\cIwxw�S=b�j�H[QTG3j�S=HKWYGaQTJ� �� OD`Ib�PCODJ_J\S=b�QTG^U\]YcIWDG�OÈ`I]Y`^iKHK`^StODU�h�c^`IL=Q\HK]Y`������  �� ����Ðu�Ç]DUgh�U_]Yw OD`ÊSpoqQ\SVU\`IODiyJ_QTHsw{cIiscIJ��о.OÎJ\]Dw�OÎj�GIHKLNGÊPrSVU_h�]DU\wxJ»O~`�Hsw�Pr]YU_QTOD`aQ¿`I]Y`^iKHK`^StODUPIU_]RL=SVJ\J_HK`IWnJ_Q\SVP�¾m�C`CO~iKisf{OD`xO oR]Y`�zqO¿LtOD�^iKSp� iKHslDS¼j�HKU_S�ODiK]D`IWdj�GIHKLNG3QTG^Se]Dc^QTPIcRQFJ_HKWY`IODiIHKJQTU\OD`IJ_w�H[Q\QTS=b�QT]�]DQTGIS=U¼`IS=cIU\]Y`^J¼h�cIU_Q\GISVU¼b^]Aj�`%Q\GISdPIU_]RL=SVJ_J\HK`^WÈLNGCODHK`�u�E�GISdLV]D`I`ISVLpQTHs]Y`J\H[QTS%�rS=QkjFSVS=` Qkj�]·`IS=cIU\]D`IJÈHKJ»LtODisiKSVb�O�J_fq`CO~PIJ\S~uÊE�G^S%J\HsWY`CODi�]Dh�wx]YJ_Q�U\StO~iF`IS=cIU\]D`IJLV]D`IJ\HsJ_QTJ�]DhXJ_PIHKl~SVJVzCJ_GI]YU�Q�PIcIiKJ_SVJ�]DhXS=iKSVLpQTU_HKLtO~i�ODLpQTHsZqH[QkfYu�Ëk`�ODU�QTHs�ILVH|O~i}`IS=cIUTO~i�`IS=QkjF]YU_lqJ=zQTG^SÈJ\PIHslDSVJnODU_SÈU\S=PIi|ODL=SVb��af·OÎLV]D`mQ\HK`mcI]Yc^JdZDO~U\H|O~�IiKS��nj�GIHsLNG�jFS3w�Otf�QTGIHs`Il�]~h�O~JgOQTS=w�Pr]YU\ODiKi[f%OtZYS=UTODWDSVb�PIcIiKJ_S������ �puE�GIS»h�]YU_w�O~i/`ISVcIU_]Y`·wx]RbIS=i/bISVJ_LVU_HK�rSVJ�Q\GIS»h�]YisiK]?j�HK`^WxP^U\]qLVSVJ_J\Hs`IW%J_Q\SVPIJ!�#".HsWIu Ú u Ú �puE�GIS�U\O~QTS=J$��]DhgO~iKi�`IS=cIU\]Y`^J�j�GIHsLNG J\S=`IbÍJ\HsWY`CODisJ3Q\]�`IS=cIU\]D` ��O~U\S�jFSVHsWYGaQTS=bÌj�HsQ\G

PCODU\ODwxS=QTS=U\J¢ �� u&%�S�w�O?f�Q\GIHK`Il�]Dh.QTGIS=J\S�jFSVHsWYGaQTJ¿ODJ¢bISVJ_LVU_HK�IHs`IW�QTG^S�S('xLVODL=f�]Dh�QTG^SLV]D`I`ISVLpQTHs]Y`�h�U_]Yw*)�QT]n�\u.� jFSVHsWYGaQ�HsJyQ\GISVU_S=h�]YU_S¢J_]YwxS=QTHsw�S=J�LtODisiKS=b,+¥J_fq`CODPRQTHKLeS('xLVODL=frÅ[uE�GISn]Yc^Q\PIc^Q&�-�X]Dh.`^SVcIU_]Y`��yHsJ�O3`^]Y`IiKHs`IStO~U�QTU\OD`IJ_h�]DU\w"]DhXQTG^SnJ_cIwxw�S=b�Hs`IPIc^QVz

�-�/.0�213546�7 S  �� ��98;:<�>=? £ � Ú u Ú �j�GIS=U\S�¬�HsJ�Q\GISg`mcIw{�rSVUe]Dh�Hs`IPIc^Q�isHK`IS=JeL=]Y`aZYS=U\WYHs`IW�]D`mQ\]�`^SVcIU_]Y`���OD`Ib@:·HKJeOÈh�]YU\w�ODiQTG^U\SVJ_GI]Yisb�PCODU\ODwxS=QTS=UVu&A/S=Q¢cIJ¢bIS=�C`^S»QTG^SnQ\]DQNODiMHs`IPIc^Q¢ODJ��@. � 4�7 S  �� -��8;:<�ku�E�G^SJ\Hsw�P^iKSVJ�Q3LNGI]YHsLVS�]DhdO�`I]Y`^iKHK`^StODU_HsQkf�jF]YcIisb �rS�O�Q\GIU\S=J\GI]DiKb7h�cI`IL=Q\HK]Y`��B���Ä�<�C. Ú h�]YU�@D0E3OD`^b��=SVU\]x]DQ\GISVU�j�HKJ\S~uF%�Sgw�O?f�j�U\H[QTSdQTG^HKJ�HK`%Q\GIS¿h�]YU\w

���Ä�<�F.0GH�¡��� � Ú u ÁI�j�GIS=U\Sgj�SnGCOtZYSncIJ\S=b�Q\GISgbIS=�I`IHsQ\HK]Y`�]DhXQTGIS�JeStOtZqHKJ\HsbISgJ_Q\SVP�h�cI`IL=Q\HK]Y`�u

Page 4: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

Ø�]YU\SgWYS=`ISVU\ODiKi[fYzqj�SnLV]Yc^iKb�U\S=PIi|ODL=S¿QTGISgJ_Q\U\HsL=Q�QTG^U\SVJ_GI]Yisb��af�O +¥J\]Dh�QVÅIQTGIU_SVJ\G^]YiKb���¡���F. ÚÁ À Ú � QTOD`IG �Ä����Ãa£ � Ú u�� �

E�GISgOD�r]?ZYS¿LNGI]DHKLVS¿HsJ�wx]DQTH[Z~O~QTS=b%�af�QTG^S�hÇODL=Q�QTGCO~Q�QTGISd]Dc^QTPIcRQ�]DhXO{`ISVc^U\]Y`�HKJ�QkfqPIHKLVODiKiLVis]YJ\S{Q\]Î�VS=U\]�Hsh�Q\GISVU_SÈHKJd`I]�Hs`IPIc^QgO QgODiKiX]YU¿H[h�QTGISÈHs`IPIc^Q¿HsJdHK`^GIHK�IH[QT]YU�fYu¿E�GISÈ]Dc^QTPIcRQUTO QTS�ODP^PIU\]aO~LNGISVJyO�w�O oRHKw�cIw ZDO~iKcIS ��j�GIHsLNGÈLtOD`È�rS¼`I]YU_w�O~iKHK�=SVbgQT]¿cI`^HsQkf �XH[hCQTGIS¼Hs`IPIc^QHKJ¢J_Q\U\]Y`IW^u %�S�w�Otf�c^J\SÈ�@. �  �� �8 :���HK` � Ú u�� �ÐueE�G^S�Z~ODiKcISn]Dh�:���bISpQTS=U\wxHK`IS=J¢QTG^SQTU\OD`IJ_HsQTHs]Y`nU\SVWDHKwxS�h�U_]Yw iK]?j QT]¢GIHKWDG�]Yc^Q\PIc^QVu "C]YU;OD`{HK`^PIc^Q �  �� <��. :��^Q\GIS�]Dc^QTPIcRQHKJ�SÐo^ODL=Q\isfÎGCO~ishXQTGISgw�O oRHKw{cIw�uvR]YwxS=QTHsw�S=JFH[Q�HsJ¼ODisJ\]»cIJ\Sph�cIi}Q\]{LV]Y`^J\HKb^SVU¼`IS=cIU\]D`IJ�j�HsQ\GÎO�isHK`ISVODU�QTUTO~`IJ_h�S=U�h�cI`ILpQTHK]D`

���¡���F.#�n£ � Ú u�� �Ëk`·PCODU�QTHsLVcIiKODU�h�]YU¢`^SVcIU_]Y`IJ�j�GIHsLNG�ODU\S�O~QeQTGIS»SV`Ib·]Dh.QTGIS{P^U\]qLVSVJ_J\Hs`IW%LNGCODHs`IJ!� + ]Dc^QTPIcRQ`IS=cIU\]Y`^JVÅ ��Q\GIHKJ�HsJ�OxJ_cIHsQTOD�IiKS�LNGI]YHKL=SDu

��� � ��� � ������������ ��� ��������� E�GIS � O?Z~O7ODPIP^iKS=Q%J\cIwxw�O~U\HK�=SVJ�Q\GIS�w�O QTGIS=w�O~Q\HKLVODiLV]D`ILVS=P^QTJx]Dh�O�J_HK`IWDiKS%wx]Rb^SVi¼`IS=cIU\]D`�u! �i|Otf ODU_]YcI`Ib j�H[QTG QTGIS�PCO~UTODwxS=Q\SVU\J=u EXU_f Q\]cI`Ib^SVU\J�QNOD`^b�GI]?j is]YWYHKLVODir�#"%$OD`Ib º'& LtO~`��rSgHKwxPIiKS=w�S=`mQ\SVbÎ�af�O3J\Hs`IWYiKS�`ISVcIU_]Y`�u(*),+-).( /10325436%798#:<;>=#0?;@=#A@0CB>=#4EDGF

Ëk`�QTG^S{PIU\S=LVS=bIHK`IW�J\cI�IJ_SVLpQTHK]D`�z�QkjF]%QkfRPrSVJ¿]~hyPCODUTO~w�SpQTSVU¢GCOtZYS{�rSVS=`·HK`aQTU_]Rb^cILVS=b�z}ZqHK�~uszjFSVHKWDGmQ\J� �� �OD`Ib O·QTG^U\SVJ_GI]Yisb :��ku %�S�j�HsiKi¼`^]Aj"J\GI]?j QTGIO~Q3QTGIS�QTGIU_SVJ_GI]YiKb LtOD`��rSQTU_StO~Q\SVb�ODJIH_cIJ_Qe]Y`^SnSÐoqQTUTOÈjFSVHKWDGmQVuyE;]3bI]xJ\]3j�S¿j�HsiKi�J�QNODU�Q�h�U\]Yw � Ú u Ú �

�-� . � 13 46 7 S  �� <�98 :<� =?. � 13 46 7 S  �� <� � :<� � 8 Ú � =? £ � Ú uKJI�

%�SÊw�Otf `I]?j bIS=�C`^S�O `ISpj HK`^PIc^Q�iKHs`IS ��LNM 8 Ú j�HsQ\GÍj�S=HKWYGaQ� ��OLH. :��ku E�GIHsJbISp�C`IHsQ\HK]Y`�ODisiK]?j�J¼cIJ�QT]3U_S=j�U\H[QTS$� Ú uKJ���HK`ÎQTGISgJ_HKwxPIiKS�h�]DU\w

�-�/. � 13 46�7>L  �� �� =? £ � Ú u�P �E�GIS»ODb^Z~OD`aQNO~WYSg]Dh�� Ú u�P ��HKJ¼Q\GCO~Q�jFS�ODU_S¿iKSph�Q�j�HsQTG�O3J\Hs`IWYiKS¢QkfRPrSn]Dh.PIODUTODwxS=Q\SVU=u(*),+-),+ /10CQRFS7.8#:<TU0WV#A@QXDYTU0Z;\[]4*A@^`_aA@QXb'=#B

c HsZYS=`�Q\GIS�OD�}]?ZDS�bISp�C`IH[QTHK]D`IJÈ]Dh¿O~`ÌODU�QTH[�CLVHKODi�`IS=cIU\]D` jFS�LVOD` Hsw�wxSVb^H|O~Q\SVisfÊU_StODbÌO`IS=cIUTODi}`IS=QkjF]YU_l�WYU\ODPIGÎODJFQTGIS¢]Y`ISdHs` ".HsWIu Ú u Áqu��¼Q¼QTG^SdiKSph�Q�S=`IbÎ]Dh/QTG^S�`ISpQkj�]YU_l©z©O�J\SpQ

Page 5: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

x hidjwjk

wij

k

(1)

(2)

x

gg (1) (2)

xioutin

������� Ú u Áq��� w{cIisQ\HKiKO?fDSVU¼`^S=QkjF]YU\l©u�E�GIS»Hs`IPIc^Q�� ��� HsJ¼QTUTO~`IJ_h�]YU_w�S=bÎQT]xOD`�]Yc^QTP^c^Q&�������Tu]Dh�HK`^PIc^QTJ � ��� j�H[QTG Ú� �� ¬ HsJ¿ODPIPIisHKS=b�u»E�G^SÈJ\S=Qg]~hF]Dc^QTPIcRQTJg]Y`�QTG^SÈU\HKWDGmQdSV`Ib�HKJ�������� z Ú� � ª·u�AMSpQ�cIJ�h�]RL=cIJ¼]Y`ÎO»J\HK`^WYiKSeLV]YwxPr]Y`ISV`aQ �������� ]~h/QTGISd]Dc^QTPIcRQtu�Ë Q\J�Z~ODiKcIS

� ������ . �������_ÀÂ� ������ Ã. �������_À 6   ������ ��� ��� Ã. � ����� À 6   ������ � � S � �Ä� � S � ��Ã. � ����� À 6   ������ � � S � � 6

 � � ��� ��à � Ú u��I�

Ëk` � Ú u��I��`I]�iK]?jFSVUgOD`IbÊcIPIPrSVUg�r]YcI`Ib^JnGIO?ZDS��rSVS=`�w�ODU_lDSVb�u�%�SxODisj�OtfqJ»O~J\J\c^w�S3HKwÈ�PIisHKLVH[QTi[f�QTGIO~Q¢Q\GISnJ\cIwxJ�U_cI`�]?ZYS=UdODisi/LV]YU_U\SVJ_P}]D`IbIHK`^W�HK`^PIc^Q¢iKHK`^SVJVu�E�GIS=f�J_QTODU_Q�O~Q¢�VSVU_]OD`Ib7QTG^SVU\Sph�]YU\S%h�]DU\w�ODiKi[f�Hs`ILViscIbIS%Q\GIS%QTGIU_SVJ_GI]YiKb�u����©u � Ú u�����WYHsZDSVJ{QTG^S�]Dc^QTPIcRQxODJxOh�cI`ILpQTHs]Y`7]Dh¢Q\GIS�HK`IP^c^Q!� ��� u E�GIS�PCODU\ODwxS=QTS=U\J3]DheQTGIS�Hs`IPIc^Q��k]Yc^Q\PIc^QÈQ\UTOD`IJ�h�]YU\w�O~Q\HK]Y`ODU_SnQ\GIS»jFSVHsWYGaQTJVu�E�G^S»jFSVHKWDGmQ\J¢P^i|Otf�OD`�Hsw�Pr]YU�QNOD`aQ�U\]DiKSgHK`�QTGISgQTG^SV]YU�f�]~h�J\c^P}S=U_ZqHKJ_SVbiKSVODU\`^HK`IWIu

®3¯�� ��¶! �Ö¿³#"�¹t×.Ö¿µ $ ÖdÓ�³y±·¹t±&%

(*)(' ).( ) 4R;@7,6RQI;>794E8

EX]%w�]~QTHsZ~O~Q\SdQTGIS»PCODU\ODbIHKWDw ]Dh�J\c^P}S=U_ZqHKJ_SVb·iKSVODU\`^HK`IWIzCisS=Q¢cIJ�L=]Y`IJ_HKbIS=UdO�L=i|ODJ_J\H[�CLtO~Q\HK]Y`PIU_]Y�IiKS=w �#";HKWIu Ú u�� �Ðu$%�SÈj¼O~`mQnQT]�GCOtZYS�O�w�ODLNG^HK`ISÈj�GIHsLNG�LViKODJ\J_Hs�CS=JgHK`IPIcRQ»PIO~Q\Q\SVU\`^JHK`aQ\]�bIH[Æ�S=U\SV`aQ�LVi|O~J\J\S=JVu E�GIS�Hs`IPIc^Q�PCO~Q_QTSVU_`IJ�L=]YcIisb�z�h�]YUxSpo^ODwxPIiKS~z��}S�GCOD`^b^j�U\H[Q\QTS=`LNGCODU\ODL=Q\SVU_JgODJ�QTG^S=f�h�U_S*�mcIS=`mQ\isf�]RL=LVcIU�]Y`·LNGIS*�mcIS=Jg]YU�Pr]YJ_QTODi�O~bIbIU\S=J\J_SVJVunE�GIS{]Dc^QTPIcRQJ\G^]YcIiKb �rS�Q\GIS�LV]YU_U\S=L=Q�i|OD�rSVid]~h»Q\GIS�LNGIODUTODLpQTS=UVu "©]DUÎSpo^ODwxPIiKS~zdO7w�ODLNG^HK`IS�j�GIHsLNGU\S=LV]YWD`IHK�=SVJX��ÅÂJ;J_GI]YcIisb»WYH[ZYS�O Ú Hs`¿QTGIS�]Yc^Q\PIc^QXHshqQTGISyHs`IPIc^QXHKJMO~`»��OD`Ibn�VS=U\]¢]DQTGIS=U_j�HsJ\SDuº h�L=]YcIU\J_SDzIQ\GISgw�ODLNG^HK`IS¿HsJ�`I]DQeP}S=U_h�S=L=Q¢OD`Ib�w�O~lDSVJ�]qLVLVODJ\Hs]Y`CODisisfxSVU_U\]YU_JVu"©]DU.QTGIS�wx]YwxSV`aQtzYjFS�w�Otf»QTU\SVO~Q�QTG^S�LVi|O~J\J\H[�CLtO QTHK]D`Èw�ODLNG^HK`IS�O~JFOd�^i|ODLNl{�r]to{j�GIHsLNGU\S=PIU\S=J\S=`mQ\JyJ\]YwxS¼HK`^PIc^Q_� ]Yc^Q\PIc^Q.Q\UTOD`^J_h�]YU_w�u.vRcILNGxO¢Q\UTOD`IJ�h�]YU\wÉj�HKisimGCOtZYS�J\]Dw�SFPCODUTO~w3�

Page 6: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

@ �neural

a class Anetwork

9 �

superviser

x

t

out(µ)

x

input

error

out(µ)

(µ)in

������� Ú u��^��O ��E�GIS�QTODJ\l�]Dh�O~c^QT]Yw�O~Q\HKLgLViKODJ\J_Hs�CLVO~QTHs]Y`�u���`�Hs`IPIc^QVzrh�]DU¢SÐoIO~w�PIisS{OxPIH[oRSViPCO~Q_QTS=U\`Î]DhXO�GIOD`Ib^j�U_HsQ\Q\SV`%LNGIODUTODLpQTS=UVzIHsJ�Q\]{�}S�LVi|O~J\J\H[�CSVb%ODJ�S=HsQTG^SVU��rSVis]Y`IWYHs`IW»Q\]�L=i|ODJ_J8 ]DU¿`I]DQtu3���dE�GISxPCODU\ODwxS=QTS=U\Jg]Dh�QTGIS3L=i|ODJ_J\Hs�ISVUnODU\SxODbIODPCO~Q\SVbÊcIJ\Hs`IWÎQTUTO~HK`IHs`IWÎbCO~QTOj�GIS=U\S�QTGIS�J\c^P}S=U_ZqHKJ_SVUylm`I]?j�J�Q\GIS�LV]YU_U\S=L=Q�]Yc^Q\PIc^Qy����������� �Ðu.E�GIS�SVU_U\]YUF����������� � 8�������� ��� �HKJ¼h�S=b��IODLNl%QT]ÈQTG^Sn`^SVcIU\ODi/`IS=QkjF]YU_lruS=Q\SVU_Jnj�GIHsLNG�jFS�LVOD`ÊLNGCOD`IWYS~uC%�Sxj�OD`aQgQT]�]YP^Q\HKwxHK�VS»QTGI]YJ_S�PIODUTODwxS=Q\SVU_JnJ_]�Q\GCO~QgQTG^Sw�ODLNGIHK`^S¿w�ODl~SVJ¢ODJ¼h�S=j#SVU\U_]YU\J�O~JePr]YJ_J\HK�^iKSDuJ¢]?j LtO~`�jFS�]YPRQTHKwxHK�=S�QTG^SVJ\S�PCODU\ODw�SpQTS=U\J�� Ëk`ÌJ_cIPrSVU_ZqHsJ\SVbÌiKStO~U\`IHs`IW�j�S�ODisj�OtfqJODJ_J\cIwxS�QTGIO~Q�Q\GISVU_S{HKJ¢O�bCO~QTO��CODJ_S�� j�GIHKLNG·L=]Y`aQNODHs`IJdO�`qc^w{�}S=U�]DhySÐo^ODw�P^iKSVJej�GISVU_SQTG^S»Hs`IPIc^Q�HsJeWDHsZYS=`H�,� �� ���-� ��j�HsQ\G�Q\GISgLV]YU_U\S=L=Q¢]Yc^QTP^c^Qtu��ÉbCO~QNOÈ�CO~J\S� HK`�J\c^P}S=U_ZqHKJ_SVbiKSVODU\`^HK`IW%L=]Y`IJ_HKJ_Q\J¿]Dh� Hs`IPIc^Q��k]Yc^Q\PIc^Q¿PIODHKU_J � ��� ��� ���_< ����� ��� ��j�GIHKLNGÊODU_S{`mcIw{�rSVU\S=b��afQTG^SnHs`IbISÐo����

�5.������ ��� ��� ���\< ����� ��� ���e¾ Ú � ���£ � Ú u�� �E�GIS�]YcRQTPIc^Q;Z~ODiKcIS�< ����� ��� �XHKJ;]Dh�QTS=`{LtO~iKiKS=b»Q\GIS ����� �� ��� ���O�-�/j�GIHsLNGÈw�]DQ\HsZ~O~Q\SVJMQTGIS¼isS=Q_QTSVU< ������ODJ�O�J\GI]DU_QTGIOD`Ib�u�E�GIS�bCO~QNO»�CODJ\S���LtOD`Î�rS�cIJ_SVb%Q\]{ODbCO~P^Q�Q\GISdPCODU\ODwxS=QTS=U\JF]Dh�QTG^SHK`^PIc^Q_� ]Yc^Q\PIc^Q�QTU\OD`IJ�h�]YU\w�uº h.LV]Yc^U\J\S~z}Q\GISn�I`CODi/QNODJ_lÎ]Dh�Q\GIS»w�ODLNGIHs`ISgj�HKiKi��}SgQT]�WYHsZDSnQ\GIS»L=]YU\U_SVLpQ¿OD`IJ�j�S=U¢Q\]

`ISpj Hs`IPIc^QnbCO QNO�j�G^HKLNG H[Q»GIODJ�`ISpZYS=U�J\S=SV` �rS=h�]YU_SDu�Ë Q»HKJgQTGIS=U\S=h�]DU\Sx`I]DQ»J\c 'xLVHsSV`aQ{Q\]iK]q]Yl3J\Hsw�P^isf�O~Q¼Q\GISdPrSVU_h�]DU\w�OD`ILVS�]DhMQTGISdw�ODLNGIHs`IS�h�]YUFQTGISdlm`I]?j�`�HK`IP^c^Q_� ]Yc^QTP^c^Q¼PCO~HKU\JHK`3QTG^S�bCO~QTOn�IODJ\S~u %*GCO~Q�j�Sej¼OD`aQ�HKJ�QTGCO QFQ\GIS¢w�ODLNGIHs`IS + isStODU_`IJVÅaQ\GIS¢S=J\J_SV`aQTHKODi�O~J\PrSVL=Q\J]DhXQTGISgHs`IPIc^Qe]Yc^Q\PIc^Q�w�ODPIPIHs`IW3OD`Ib�QTG^SV`5+ WYS=`ISVU\ODiKHs�VS=JVÅIQT]3`ISpj#bCO QNO^u

Page 7: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

αa a a u u u u uaa µ

UA label

Data µx( )

µt( )������� Ú u��I� �.o^ODw�P^iKS3]Dh�O�bCO~QTO��IODJ\S3h�]YUgJ\cIPrSVU�ZqHKJ\S=b iKSVODU\`^HK`IWIu��yODLNG�Hs`IPIc^QnPCO Q\QTS=U\`�zh�]YU�SÐoIO~w�PIisS�QTG^S¿PIH[oRSVi�PCO~Q\Q\SVU_`�]~h�O{LNGCO~UTODLpQTSVU=zCHKJ�O~J\J\]qLVHKO~QTS=bÎj�HsQTGÎQ\GIS¿LV]YU_U\S=L=Q�i|O~�}S=i¡zSDuÂWIu[z©8½h�]DU��Du

xx

x

x

xxo

o

o

oo

oo o

ox

class Apoint not in class A

x opoint in

data space

����� � Ú u�JR��E�GISgbCO~J\GIS=b�iKHs`ISdJ_SVPCODU\O~QTS=JeQ\GISgLVU_]YJ\J_SVJ¢h�U_]Yw Q\GISg�VS=U\]YJ=u(*)(' ),+ _a034E2 0 ; A�7 � QXD�6 79B V#QXD.7�� QI;@7G4E8

Ëk`�WYS=`ISVU\ODi;Q\GIS�Hs`IPIc^Q¢bCO~QTO � ��� ��� ��LtOD`��}S»GIHKWYG�bIHKwxSV`^J\HK]D`CODi�ZYS=L=Q\]YU\J � ����� Ë & 4 j�HsQ\GLV]Dw�Pr]Y`IS=`mQ\J�� ��� z Ú � ¬.u�Ëk`%Q\GIS¿LtODJ_Sd]DhXGCOD`^b^j�U\H[Q\QTS=`ÎLNGCODU\ODL=Q\SVU�U\S=LV]YWD`IHsQ\HK]Y`�zajFSLV]DcIiKbÎQTU�f%QT]ÈjF]YU\lÎb^HKU\S=L=Q\isf�j�H[QTGÎQTG^SnP^H[oRSVi�PIO~Q\Q\SVU\`^Jej�GIHsLNG�wxHKWDGmQ¼GCOtZYSnOxU_SVJ_]YiKc^Q\HK]Y`]Dh Ú P�� Ú P^uÎE�GmcIJ{¬ . Á\J�P^u�%�S�w�Otf�HKw�ODWYHs`IS{QTGIS�bCO~QTO�ZYS=L=Q\]YU\JÈO~J�Pr]YHK`aQTJgHs`�QTG^S¬r� bIHKwxSV`^J\HK]D`CODi.J_PCODL=S2� ".HKWIu Ú u�JI�puxvR]Dw�SÈ]Dh�QTG^SxHs`IPIc^QgPIO~Q\Q\SVU\`^JnGIO?ZDS�O%QTODU\WYSpQ¿Z~ODiKcIS������� ��� ��. Ú u�E�GIS=f�ODU\S�i|OD�rSVisSVb�ODJ�wxSVw��}S=U\Jn]Dh�QTGIS�LViKODJ\J»OD`Ib w�ODU_lDSVb��mf�LVU_]YJ\J_SVJ=uº QTGIS=U\JÈGCOtZDS������ � ��� �!. E�O~`Ib�ODU\S%w�ODU_lDSVb �af��VSVU_]YJVuÊËk` QTG^SÎWYSV]YwxS=Q\U\HsLtODiyPIHsL=QTc^U\SDzQTG^S�QNODJ_l�]~h�WYSV`IS=UTODisHK�VO~QTHs]Y`�L=]YU\U_SVJ_P}]Y`^bIJ{QT]��I`IbIHK`^W·O�J\c^U_hÇODL=S�j�GIHKLNG J_SVPCO~UTO~Q\SVJ{QTG^SSVisSVwxSV`aQTJ�]Dh;LViKODJ\J�� h�U\]Dw QTG^Sn`^]Y`R�kS=iKS=w�S=`mQ\JVu%�S{LVOD`·U\S=PIGIU\ODJ\SÈQTG^HKJ�J�QNO~Q\SVwxSV`aQgw�O~QTGIS=w�O QTHKLVODiKi[fr��j�S{j�OD`aQ¿QT]%�I`Ib�O�h�cI`ILpQTHK]D`��� � � ��� ��J\]nQTGCO~Q���� � � ��� ��D Egh�]YUFODiKiCPr]YHK`aQ�� ��� ��� ��j�GIHKLNG�ODU\SeSVisSVwxSV`aQTJF]Dh�L=i|ODJ_JF�»zRO~`Ib��� � � ��� � E3h�]YU�P}]DHK`aQTJ�j�GIHKLNG�bI]�`^]DQe�}S=iK]Y`IW3QT]�LViKODJ\Je��u©E�GIS»J\SVPIODUTO~Q\HK`IWxJ\c^U_hÇODL=S�HKJQTG^SxJ_S=Qg]DhFPr]YHK`aQTJdj�H[QTG���� ��� ��� � . E^u!"C]YU¿OD`af·`^S=j bIO~QNO%Pr]YHK`aQ � ��� jFS3w�Otf�PIU\S=bIHKLpQQTG^S%LViKODJ\J_Hs�CLVO~QTHs]Y` J\Hsw�P^isf��af SpZDO~iKcCO~Q\HK`IW�QTGIS�h�cI`IL=Q\HK]Y` ��� ��� ��� �pu·Ë he��� ��� ��� � D E�jFSWYcIS=J\J�Q\GCO~QyQTG^S�Pr]YHK`aQ��}S=iK]Y`^WYJ�QT]�L=i|ODJ_JF� OD`IbxZqHKLVSeZYS=U\JTORu�E�GIS¢h�cI`^L=QTHs]Y`%���%jF]YcIisb��rSLtO~iKiKS=b�O3b^HKJ\L=U\Hsw�Hs`COD`aQ�h�cI`^L=QTHs]Y`�h�]YU�LViKODJ\J��»u

Page 8: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

g(h) =

w

xin

j

j

(µ)(µ) =

out(µ)t

outx

?

������� Ú u�P^��E�GIS�J_HKwxPIiKS�PrSVU\L=SVP^Q\U\]Y`ÍL=]Y`IJ_HKJ_Q\J%]DhnO�J_HK`IWDiKS�`ISVcIU_]Y` j�HsQ\GÍO�Q\GIU\S=J\GI]Yisb`I]Y`^iKHK`^StODU_HsQkf$�/�Ä���F. GH�¡���pu®3¯�� ��¹VÒ ·ÔVÖ �5Ö¿³y¸�Ö �²�³�´x±·×A/S=Q�cIJ�J�QNODU�Q�j�HsQ\G Q\GIS�OD`IODisfqJ\HsJ�]~hnO�J\Hs`IWYisS�`^SVcIU_]Y` j�GIHKLNGÌU\SVL=SVH[ZYSVJ�HK`IPIcRQ�h�U_]Yw O`mcIw{�rSVUe]Dh;HK`IPIcRQ�LNGCOD`I`IS=iKJ&� ��� j�HsQTG Ú � ¬�E�GIHKJeHKJ�LVODiKisSVb�OÈJ\Hsw�PIisS¿P}S=U\L=SVP^Q\U\]Y`�uË h.jFSnODPIPIi[fÎHK`^PIc^Q�PCO~Q_QTS=U\` ��z^QTG^Sn]Dc^QTPIcRQ¢]~h;Q\GISg`ISVcIU_]Y`�HKJ

� ��� � ��� �F. G��546 7 S   � ��� ��� � 8;:�� £ � Ú u�� �

"¢]~QTSFQ\GCO~QXQTGISFJ\cIwÉJ�QNODU�QTJ�O Q � . Ú OD`Ib�Q\GISFQ\GIU\S=J\GI]Yisb�GCO~J.�rSVSV`�w�ODb^SFSÐo^P^iKHKL=HsQVu.vqHK`IL=SQTG^SVU\SeHKJy]Y`^isf3OgJ\Hs`IWYiKS�`^SVcIU_]Y`�zmQTGIS=U\SeHKJy`I]n`ISVS=b�QT]nlDS=SVP�Q\GIS¢Hs`IbISÐo3]Dh�Q\GISe`ISVcIU_]Y`��MHs`QTG^Sdj�S=HKWYGaQTJ=uF%�S¿GCOtZDSgQ\GISVU_S=h�]YU_S¿w�O~bIS�QTG^S¿U\SVP^i|ODL=SVwxSV`aQ� �� 8   u %�S¿LVOD`ÎQTGIHs`Il]Dh�Q\GIS¢jFSVHsWYGaQTJF  z Ú � ¬�ODJ¼OgZYSVLpQT]YU�� j�G^HKLNG%GCO~JFQTG^S�JTO~w�SebIHKwxSV`^J\HK]D`CODiKH[Qkf{O~JQTG^S¼HK`IP^c^Q;ZDSVLpQT]YU_J � ��� ��� �puXE�GIS¼L=i|ODJ_J\Hs�ILtO~Q\HK]Y`gQNODJ_l»L=]Y`IJ_HKJ_Q\J�HK`»]YP^Q\HKwxHK�VHs`IW¼QTG^S�j�S=HKWYGaQ\JJ\]3QTGIO~Q�QTGISg]YcRQTPIc^Qe]DhXQTG^Sn`^S=QkjF]YU\l�� ����� ��� ��HsJ�S*�mcCODi/Q\]3Q\GIS¿QNODU_WYS=Q�Z~ODiscISd� ����� ��� �Ðu(*)� ).( �Y7.8#0CQRA�� 03b#QRA@Q��'7.D97,;��A/S=Q�cIJ�J_Q\cIb^f � Ú u��I�ÎHs`Íw�]DU\S·bISpQNODHsi¡u %*GIS=`IS=ZDSVU�Q\GISÊODU\WDcIw�S=`aQ�]Dh»Q\GIS J¢SVO?ZqHsJ\HKb^Sh�cI`ILpQTHs]Y`�� � � ��� � M � 4 7 S   � ��� 8 : D E^z�QTGISÎ`IS=cIU\]D`7j�HsiKi�GCOtZYS�OD`7]Yc^Q\PIc^Q3]Dh � Ú uE�GCO~QdHKJVzrQTGISÈ`^SVcIU_]Y`�j�HKisiXL=i|ODJ_J\H[h�f�Q\GIS{HK`^PIc^Q¿O~J¿OD`·SVisSVwxSV`aQd]~h�QTGIS{L=i|ODJ_JVu»vRHsw�Hsi|ODU_isfYzj�GIS=`IS=ZDSVU�QTGISdODU\WYc^w�S=`mQFHKJF`ISVWYO~QTH[ZYSdO~`%HK`IP^c^Q�j�HsiKi©�}S¢LViKODJ\J_Hs�CS=bÎODJ¼`I]~Q¼�rSViK]D`IWYHK`^WnQ\]QTG^SdLViKODJ\J=u�E�Gqc^J�� � � ��� �FHsJ¼O�b^HKJ\L=U\Hsw�Hs`COD`aQyh�cI`IL=Q\HK]Y`�u�E�GISdJ\SpQ�]DhML=U\HsQ\HKLVODi©P}]YHs`aQTJ�Hs`�QTG^SHK`^PIc^Q¼J_PCODL=Sdj�GIHKLNGÎJ_SVPCODU\O~QTS¢QTGISdL=i|ODJ_J¼wxSVw{�rSVU_JFh�U\]Dw Q\GISd`I]D`R�kwxSVw{�rSVU_J�HsJ�WYH[ZYSV`Î�af�<��� ��� � . E^zIGIS=`ILVS

E . 46 7 S   � ��� 8 :{£ � Ú u Ú E �

� �©u � Ú u Ú E ��HKJFO»isHK`ISVODUyS*�mcCO~Q\HK]Y`�OD`Ib�b^S=�C`IS=J�O»GafqPrSVU\P^i|OD`IS¢HK`xQTGIS¢HK`IPIcRQFJ_PCODL=SDuyE�GmcIJjFSeGIO?ZDSeQ\GIS�U\S=J\cIi[Q�QTGCO Q�OgJ_HKwxPIiKSFP}S=U\L=SVP^Q\U\]Y`xLtOD`3]Y`^isf{J_]YisZDS�PIU\]D�IiKS=w�J.j�G^HKLNGxLtOD`3�rSJ\S=PCODU\O~QTS=b��af3O¿GafRPrSVU_PIi|O~`ISDu�E�GIS=J\SePIU\]D�IiKS=w�JyODU_S�LtODisiKS=bxisHK`ISVODU\i[fnJ\SVPIODUTOD�^iKSDu ".HKWIu Ú u��HKisiKcIJ�QTU\O~QTS=J�QTGISgHsbIStOÈ]Dh;iKHs`IStODU�J\SVPIODUTOD�^HKiKH[Qkf�Hs`ÎQkj�]�bIHKwxSV`IJ_HK]Y`^JVu

Page 9: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

o

oo

o

o

oo

x

x

x

x

x x

������� Ú u��q� A/Hs`IStODU¿J_SVPCO~UTOD�IHsiKH[Qkf}�¿E�G^S�L=U\]YJ_J\SVJ�OD`Ib�QTGIS3�=SVU\]DJ»LVOD`��rS3J\S=PCODUTO QTSVb��afÊOJ_Q\UTODHsWYGaQ�iKHs`ISDu

%�S3SVwxPIGCO~J\HK�=SÈQTGCO~Q¿jFSxGCOtZYSxcIJ\S=b O�`I]DQNO QTHK]D`·HK`�¬7bIHKwxSV`IJ_HK]Y`�O~`Ib�O~`�SÐo^P^iKHKL=HsQQTG^U\SVJ_GI]Yisb�u�E�GIS�Q\GIU\S=J\GI]Yisb�HsJ»U_SVi|O QTSVbÊQT]�QTGISxbIHKJ�QNOD`^LVS�]~h¼QTGISxGafqP}S=U\PIiKOD`IS�h�U_]Yw QTG^S]YU_HKWYHs`�u3Ë h�jFS�HK`^LViKc^bISÈQTGISÈQTG^U\SVJ_GI]Yisb�HK`�QTG^S3jFSVHsWYGaQTJ=z;jFS�jF]YU\l·Hs`ʬ � Ú bIHKwxSV`IJ_HK]Y`OD`Ib�QTG^SnGafqPrSVU\P^i|OD`ISgw{c^J_QeWY]ÈQTGIU_]YcIWYG�QTG^Sn]DU\HKWDHK`�u(*)� ),+ � 0CA � 03b ;>A@4E8��aDG:*4EA�7 ;@='2

E�GISdJ_HKwxPIiKS�PrSVU_LVS=P^QTU_]Y`%LtO~`%J\]Yi[ZYS¢PIU\]Y�^iKSVwxJ�j�GIHKLNG%ODU\SeiKHs`IStODU_isf�J\SVPIODUTOD�^iKSe�;�IcRQ¼GI]?jLtO~`�j�S»�C`Ib�Q\GIS�Pr]YJ\H[QTHs]Y`�]Dh�QTGISn]YP^Q\HKw�ODi/GafqP}S=U\PIiKOD`IS � E�GIS�HKbISVO�]Dh�Q\GIS�PrSVU_LVS=P^QTU_]Y`ODisWY]YU\H[QTGIw&HKJ¿Q\GCO~Q¿jFSxQ\SVJ_Q»]Y`IS3bCO QNO�P}]YHs`aQ � ��� ��� �dO~h�QTS=U¿QTGIS3]DQ\GISVU=u�EXSVJ�QTHK`^W�O�bCO~QTOPr]YHK`aQMwxStOD`IJ/Q\GCO~Q/jFSFO~PIPIisf � ��� ��� ��O~Q/QTG^S�Hs`IPIc^QMiKOtfYSVUM]DhqQTG^S�PrSVU_LVS=P^QTU_]Y`�O~`Ib»L=]YwxPCODU\SQTG^SÊ`^SVcIU_]Y`CODid]Dc^QTPIcRQ�� ����� ��� �xj�HsQ\G QTGIS�bIS=J\HsU\b*]Yc^Q\PIc^QÎ� ����� ��� �Ðu�Ë hnQTGIS·]Dc^QTPIcRQ�]DhQTG^SÎP}S=U\LVS=P^QTU_]Y`7HKJ{L=]YU\U_SVLpQtzyj�SÎbI]D`�ÅÂQÈQTODlDS�O~`mf ODL=Q\HK]Y`�uÊË h�Q\GISÎ]Yc^Q\PIc^Q3HKJ�HK`IL=]YU\U_SVL=Q� ����� ��� ���.� ��� � ��� �pz�Q\GIS�jFSVHsWYGaQdZYS=L=QT]DU � HsJdLNGCOD`IWDSVb � 8 � ��� ��u¿E�GIS{P^U\]qLVSVJ_J]DhXj�S=HKWYGaQ¢ODbCO~P^QNO~Q\HK]Y`�HsJ�LtODisiKSVbÎisStODU_`IHK`^WIu�E�GISgiKSVODU\`^HK`IWÈU_cIiKS¿HsJ

� � .�� � ����� ��� � 8 � ����� ��� ����� ��� ��� � � Ú u ÚYÚ �j�GIS=U\S ��D ExHsJ�J\]YwxSgJ\w�ODiKi�PIODUTODwxS=Q\SVU=u�Ë QeHsJec^J\S=h�c^iMQ\]�Hs`aQTU\]qbIcIL=SnOÈZ~ODU_H|OD�^iKS�� ��� ��.������� ��� � 8 ����� � ��� �pu�E�GISgiKSVODU\`^HK`IWÈU_cIiKSdQ\GISV`��}S=LV]YwxSVJ

� � .���� ��� � � ��� ��� � � Ú u Ú ÁI�j�GIHsLNG�w�ODlDS=J¼QTGIS¿WDSV]YwxS=Q\U\HKLVODi�J�QTU_cIL=Q\cIU\Sg]DhMQTG^S¿iKStO~U\`IHs`IW{PIU_]RL=SVJ\J�wx]YU\S¢QTUTO~`IJ\PCO~U\SV`aQVuË hyQTGIS3O~L=QTcIODi.]YcRQTPIc^Q ������� ��� �¢HsJ�LV]DU\U\S=L=QVz�� ��� �eHsJd�VS=U\]�OD`Ib�Q\GIS{jFSVHKWDGmQ�ZYSVLpQT]YU¿HsJd`I]DQLNGCOD`^WYSVb�u@A/S=Q�cIJ�L=]Y`IJ\HsbISVU»O�bIO~QNO�P}]YHs`aQ � ��� ��� ��j�H[QTG�QTODU\WDS=QnZDO~iKcIS3����������� ��. Ú h�]YUj�GIHsLNGÌQTGIS�PrSVU\L=SVP^Q\U\]Y`ÌWYHsZDSVJ3QTGIS�hÇODiKJ_S�]Dc^QTPIcRQC� ����� ��� ��. E^uÌËk` QTG^HKJxLtODJ_S�� ��� �{HKJPr]YJ\H[QTHsZDS%OD`^b O�LNGCO~`IWYS � �(]~h�QTGISxj�S=HKWYGaQ�ZDSVLpQT]YU ����� � � � � ����]Dh � ��� �nHsJ{ODPIP^iKHKS=b�u

Page 10: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

o

o

x

x

w

x

∆w

o

o

x

o

o

x

x

������� Ú u �^�% XSVU_LVSVPRQTU\]D` ODisWY]YU\H[QTGIw�udË hFO%Pr]YHK`aQ¿HsJdw�HsJ\L=i|ODJ_J\Hs�ISVb�isHKlDS»QTGISÈL=U\]YJ_J$��ZYS=L=Q\]YU���d]Y`·QTG^SxisS=h�Q��kGCOD`^b·J\HKb^SÈ]DhFQ\GIS3J\S=PCODUTO QTHK`^W�isHK`IS��ÇbCODJ_GISVb-�pz/QTGISÈjFSVHsWYGaQnZDSVLpQT]YU � HKJLNGCOD`^WYSVb%Hs`�b^HKU\S=L=Q\HK]Y`3]Dh ��u�E�GIHsJFU_]DQNO~Q\SVJyQTGIS�J_SVPIU\O~QTHs`IW�isHK`IS�Hs`xQ\GIS�bISVJ_HKU\S=b%bIHsU\SVLpQTHs]Y`�uE�GIHsJ¿U\]DQTO~QTS=J�QTGIS�GmfqPrSVU_PIi|OD`^S3ODU\]Yc^`Ib�QTGISÈ]DU\HKWDHK`�u%"¢]DQ\S{QTGCO~Q¢QTGIS3O~iKWY]YU_HsQ\GIw½ODJdH[QdHKJPIU_SVJ\S=`aQTSVb G^SVU\SxJ\c^PIP}]DJ\SVJnQTGCO Q»Q\GISÈQTGIU_SVJ\G^]YiKb�HKJnOD�IJ_]YU\�rSVb�HK`ÊOD` O~bIbIHsQ\HK]Y`IODi;jFSVHsWYGaQLV]Dw�Pr]Y`IS=`mQVu %�Sej�HKisirJ_SVSdHs`�Q\GIS¢h�]YisiK]?j�HK`^WgQ\GCO~Q�`IStODU_isf�ODisiC]Dh/QTGIS¢iKSVODU\`IHs`IWnU\cIisSVJ�GIO?ZDSO3J_QTU_cIL=Q\cIU\SnOD`IODiK]YWD]YcIJ¼QT]@� Ú u Ú ÁI�pu

��� � ��� � � � � � ������<� � ����� ����� �@������ ��� �pu���GI]q]YJ_S�QTGIS»QTGIU_SVJ\G^]YiKb·`I]D`IiKHs`IStODU_HsQkf�O~`IbbISp�C`IS3O +¥�#"%${Å}]YU + º'& Å}PIU\]D�IiKS=w�u %�O~Q\LNG·GI]?j�Q\GIS{PrSVU\L=SVP^Q\U\]Y`�isStODU_`IHK`IW�U\cIisS»�C`^bIJQTG^SnL=]YU\U_SVLpQ�J_SVPCODU\O~QTHs]Y`�u(*)� )(' _aA@QRFS79038 ;1F'0CB � 038 ;

��ZYS=`�HshXj�S�ODU\SgHs`mQ\SVU_SVJ_Q\SVb�HK`�O3L=i|ODJ_J\H[�CLtO~Q\HK]Y`ÎQTODJ\l©zCj�S»w�OtfÎ`^S=ZYS=U_Q\GISVisSVJ\J¢LV]Y`^J\HKb^SVU¢O`IS=cIU\]Y`�j�HsQ\GÊO�L=]Y`aQTHs`qc^]YcIJg]Yc^Q\PIc^Qgh�cI`ILpQTHK]D`5���Ä�<�Ðu!"C]YUdSÐoIO~w�PIisSDz�jFS�w�Otf�QTODlDSÈQTG^SJ\HsWYwx]YHKbCO~i©h�c^`IL=Q\HK]Y` ���¡���F. � Ú �YÁI�=À Ú � QNOD`IG �¡����Ã/Hs`aQTU\]qbIcIL=SVb�HK` � Ú u�� �pu�E�G^SgODb^Z~OD`aQNODWDS]DhrQTGIS�L=]Y`aQTHs`qc^]YcIJy]Yc^Q\PIc^QyHKJ�Q\GCO~Q�jFS�LtOD`xODPIP^isf�Q\GIS�WYS=`ISVU\ODiCHKbISVOd]Dh}WYUTODb^HKSV`aQ�b^SVJ\L=SV`aQQT]»QTGIS¢iKStO~U\`IHs`IW»P^U\]qLVSVJ_JVuyE�GIS�Q\]DQNO~i �mcCO~bIUTO~Q\HKL¢SVU\U_]YUyQTGCO~QFQTGIS¢`ISVc^UTODir`IS=QkjF]YU_l�w�ODlDS=J]Y`�ODiKirQTU\ODHK`IHs`IWÈJTO~w�PIisSVJ�Hs`�Q\GISgbCO~QTO3�IODJ\S � HsJ

� �B�F. ÚÁ 6

À � ����� ��� � 8 � ����� ��� ��à �X£ � Ú u Ú � �vRHs`ILVS ����������� �F. ��ÀÂ� ��� �kÃ<. ��À �   � ��� ��� ��Ã�bISVPrSV`Ib^J¢]Y`ÎQ\GISdj�S=HKWYGaQ\Je  zIQTG^S¿SVU\U_]YU�HKJO�h�cI`ILpQTHs]Y`È]Dh©QTGISFj�S=HKWYGaQ�ZYS=L=Q\]YU ��u���GCOD`IWYHs`IWdQTG^S�j�S=HKWYGaQ\J�w�Otf»HK`IL=U\StO~J\S�]YU�b^SVLVU_StODJ_SQTG^SxS=U\U_]YUVu %�S3w�Otf�Q\GISVU_S=h�]YU_SxODb�H_cIJ�QnQ\GISÈj�S=HKWYGaQ\JnJ_]�O~JdQT]�w�Hs`IHKwxHK�=S»Q\GISÈSVU_U\]YU=uÈ�J\Hsw�P^iKS¿wxS=QTG^]Rb�QT]�U\SVb^cILVSnQTGISnSVU_U\]YU�HKJ�WYU\ODbIHsSV`aQebISVJ_LVSV`aQVueE�G^SnjFSVHsWYGaQTJdO~U\SgLNGCOD`IWDSVbHK`�bIHsU\S=L=QTHs]Y`�]DhXQTGISg`IS=WaO~QTH[ZYSgWYU\ODbIHKS=`aQ

�   . 8 � � �m  � Ú u Ú � �

Page 11: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

E

ww* kk

E

wk

������� Ú u �^� c U\ODbIHsSV`aQdbIS=J\L=SV`aQtug� LNGCO~`IWYSÈ]Dh�Q\GIS�jFSVHKWDGmQdHK`�bIHsU\S=L=QTHs]Y`�]~h�QTGIS{`^SVWaO~Q\HsZDSWYU\ODbIHKS=`aQ �   . 8 �R� �D�a  iK]?jFSVU_J�Q\GISgSVU_U\]YU��af�OD`�ODwx]YcI`aQ � uj�GIS=U\S �%HKJ�J_]Yw�SgJ_w�ODisi�PCO~UTODwxS=Q\SVUVuE�GIS�WYU\ODbIHsSV`aQ¢� �D�a  LtOD`��}SnLtODisLVcIiKO~QTS=b�c^J\HK`^W�QTG^S»LNGCO~HK`�U_cIiKS~u�%�SnJ\SpQg� ��� �9.�  � � ��� ��� �¼O~`Ib��I`Ib

� �a  . 6

� �R� ��� � �q� ��� �

�a  . 8 6

� ����� ��� � 8 � ��� � ��� ��� � ��� � � � � ��� ��� �. 8 6

� ��� � � ��� ��� � � Ú u Ú JI�E�GIS3hÇODL=Q\]YU � � HKJdQ\GIS3bISVU_HsZ~O~Q\HsZYSÈ]~hFQ\GIS3WaODHK`�h�c^`IL=Q\HK]Y`2���¡����SpZDO~iKcCO~Q\SVbÊO~Q»� . � ��� �pu"¢]~QTS�Q\GCO~Q � Ú u Ú JI�yLV]Y`aQNO~HK`IJ�QTGIS¢J\cIw ]?ZYSVU¼ODiKi©PCO~Q_QTS=U\`IJ=u�Ë h/j�SdP^c^Q�� Ú u Ú J��yHs` � Ú u Ú � ��jFSGCOtZYS¢OdiKSVODU\`^HK`IWdU_cIiKS¼j�G^SVU\S�jFS�LNGCOD`IWYS�Q\GIS¼j�S=HKWYGaQ\J�]D`Iisf�O~h�QTS=U�j�S�GCOtZDS�Q\SVJ�QTSVb�ODisiRQTG^SPCO~Q_QTS=U\`IJ�O~`Ib%LtO~iKLVc^i|O~Q\SVb3QTGISeQTSVU_w � ��� ��h�]YU Ú� � 3uyvRc^LNG�O»iKSVODU\`^HK`IWnU\cIisS¢jF]YcIisb�rS¢LVODiKisSVbxOxÅÂ�CO~Q\LNG�ÅmU\cIisSDu�Ëk`xPIU\ODL=Q\HKLVS�H[QyHKJyStODJ_HKS=UyQ\]»c^J\SeiKStO~U\`IHs`IWgHK`�OD`�]D`R�kisHK`IS¼wx]qbISDuE�GISgj�S=HKWYGaQ\J¢O~U\SgLNGCOD`IWDSVb�HKwxw�S=bIH|O~Q\SVi[f�O h�QTSVU�O3J\Hs`IWYisSdPCO~Q_QTSVU_`�GIODJ��}S=SV`�ODPIPIisHKSVb�z

� � .���� ��� � � ��� ��� � � Ú u Ú P �j�GIS=U\S�jFS�GCOtZDS�J_j�H[QTLNGIS=b�QT]xQTGISnZYS=L=QT]DU�`I]DQTO~QTHs]Y`�uFE�GIS»h�]YU_w ]Dh�Q\GIS»isStODU_`IHK`^WxU_cIiKSnHKJHKb^SV`aQTHsLtODiqQT]$� Ú u Ú Á��pzDSÐoRLVSVPRQ�Q\GCO~Q�Q\GIS¼hÇODLpQT]YU �¢HKJ.`I]?j�� ��� �F.�À ����������� � 8!������� ��� �kà � � � � � � uE�GIS»]Y`Iisf�b^HsÆ}SVU\S=`ILVS»LV]YwxPCODU_SVb�QT]�Q\GISnP}S=U\LVS=P^QTU_]Y`�isStODU_`IHK`IWxU\c^iKSC� Ú u ÚYÚ ��HKJ�Q\GIS{ODb^bIH[�QTHs]Y`CODi}hÇODL=Q\]YU�� � uËk`ÌQTGIS�]Y`IiKHs`IS�w�]qbISDz�HsQ�HKJ�`^] iK]Y`^WYSVU�WYcCODU\OD`aQTSVS=bÌQTGIO~Q�Q\GIS�SVU_U\]YU bIS=LVU_StODJ_SVJ

O~Q�StODLNG7J_Q\SVP�u��"LNGCOD`IWDS � � j�GIHKLNG�HKJ�WD]R]qb�h�]YUgQTGIS�PIU\S=J\SV`aQ3PCO Q\QTS=U\` w�Otf��rS��IODbh�]YUÈJ_S=ZYS=UTODi�]~QTGIS=UÈPCO~Q\Q\SVU_`IJxOD`Ib QTG^SVU\Sph�]YU\S�Hs`ILVU_StODJ_S%QTGIS%Q\]DQNODi�SVU\U_]YUVu�Ë hePCO~Q\Q\SVU_`IJ �ODU_S�LNG^]YJ\S=`ÌUTO~`IbI]Ywxisf�h�U\]YwÙQTGIS�bCO~QTOÊ�IODJ\S��yzFQ\GIS�]Y`IiKHs`IS%wx]Rb^SÎLV]YU_U\SVJ_P}]D`IbIJ3QT]�OJ_Q\]RLNGIODJ_Q\HKLgWYUTO~bIHKS=`mQ�b^SVJ\L=SV`aQ¿O~iKWY]YU_HsQ\GIw�u

Page 12: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

outx (µ)

out(µ)t

w

xin

j

j

(µ) µh

?

������� Ú u Ú E^�¿��bIODiKHs`ISDu»E�GISxQTODU\WDS=Q¿Z~ODiKc^S{������� ��� � . �ÈÚ HsJ¿LV]YwxPCODU_SVb·j�HsQ\G·QTGIS �O��������]Yc^Q\PIc^Q»� . � 4   � ��� ��� �eQT]ÎLVODiKL=cIi|O QTS»Q\GISÈSVU_U\]YU=u�E�GIS{Q\GIU\S=J\GI]DiKb ����������� � . �/�Ä� �HKJ�b^HKJ\U_SVWaO~U\bIS=b�bIc^U\HK`^W3Q\GISgiKSVODU\`IHs`IWÈPIU_]RL=SVJ\J=u(*)� )� � F'QXD9798#0 QXDG:E4*A�7 ;@='2

Ëk`{QTG^SF�Ih�Q\HKSVJ.OD`IbÈJ_H[oqQTHsSVJVz %*HKbIU_]?j�OD`Ib�J¢]~Æ�GIODb{j�]DU\lDS=bÈj�HsQTG�O¢Z~ODU\HKOD`aQ.]~hrO�WYUTO~bIHKS=`mQbIS=J\LVS=`aQdODisWY]YU_HsQTG^w�¾aJ_SVS�À Ú Ã¡u�E�GIS¿S=U\U_]YU¼j¼O~J�w�SVODJ\cIU_SVb�bIHsU\SVLpQTi[f�O h�QTSVU¼Q\GISdisHK`ISVODU�J_cIw3�w�O~QTHs]Y`�J�QTS=P�zI�rS=h�]YU_S¢QTG^S¢QTG^U\SVJ_GI]Yisb�¾^Lph�u�".HKWIu Ú u Ú E^u.E�GIS�`CO~w�S¢HKJ�J\GI]YU�Q¼h�]YU��#$���P^Q\HsZDSA/Ëk`IStO~U " ��cIU\]Y`�]YU=zCw�]YU_S¿WYSV`^SVUTO~iKisfDz^�%$e�¢P^QTH[ZYS�A/ËG" �yODU ��iKSVwxSV`aQVuE;]ncI`IbIS=U\J�QNOD`Ib%Q\GISePIU\Hs`ILVHsPIiKS~zabIS=�C`^S¢����������� �F. � Ú Hsh�HK`IP^c^Q�PCO~Q\Q\SVU_` ���rSVis]Y`IWYJ�Q\]QTG^S{LViKODJ\J¿O~`Ib�������� ��� ��. 8 Ú ]DQ\GISVU�j�HKJ_SDu¿Ë h�QTG^S{J\cIwxwxSVb�Hs`IPIc^Q¿����� �&. � 4   � ��� ��� �

HKJxPr]YJ\H[QTHsZDSDz�Q\GIS�Q\GIU\S=J\GI]DiKb J�QTSVP j�HsiKi�WYH[ZYS�OD` ]YcRQTPIc^QC� ����� ��� �B. � Ú ¾eHsh¿����� � EQTG^S%]Yc^Q\PIc^Q�j�HsiKi��rSC� ����� ��� ��. 8 Ú u2"C]YU»O�PCO~Q_QTS=U\` j�HsQ\G�� ����� ��� � . � Ú z�O�J_cIwxw�S=bHK`^PIc^Q¼]~h�� ��� �F. � Ú j�HKisi©WYcCODU\OD`aQTSVS¢QTGISdL=]YU\U_SVLpQ�]Yc^Q\PIc^Qtu�vqHKwxHKi|O~U\isfDzDQTG^SdU\S �qc^HKU\S=w�S=`aQ� ��� �B. 8 Ú h�]DUxPIO~Q\Q\SVU\`^J�������� ��� ��. 8 Ú HsJ�J_c 'xLVHsSV`aQ�h�]YU�O�L=]YU\U_SVLpQ%]Yc^Q\PIc^QVu "¢]DQ\SQTGIO~Qg� ��� ��. � Ú HKJ¢`I]DQdO�`IS=LVSVJ_JTODU�f·U\S �mcIHKU_SVwxSV`aQdh�]YU¢OD`�]YcRQTPIc^Qd]Dh�]Y`IS~ud��`af�Z~ODiKcIS� ��� ��D E�j�]DcIiKb WDHsZYSxQTGIS�JTODwxS�U_SVJ_cIisQ ������� ��� � . Ú u���c^Q�Hsh¼jFS�QTODlDS�Q\GIS�J�QTU_]Y`IWYS=UU\S �mcIHKU_SVwxSV`aQ¢Q\GCO~Q¢� ��� ��J_GI]YcIisb��rSnODJ�LVis]YJ\SnODJ�Pr]YJ\J_HK�IisSdQT]È������� ��� �pzRj�SnLtOD`�bISp�C`IS{O~`SVU_U\]YU

�� ��� � �B�F. ÚÁ 6

� ��� � ��� � 87� ��� � ��� � £ � Ú u Ú �I�E�GISnSVU_U\]YU�HsJ��VSVU_]�H[h;����� � ��� �F.#� ��� �ÐuvRHK`IL=Sd� ��� �F. � � ��� zaQTG^S¢S=U\U\]DU � Ú u Ú �I��HKJ�O �mcCODb^UTO~Q\HKL�h�cI`ILpQTHK]D`�Hs`xQ\GISejFSVHsWYGaQTJ=u�Ë Qh�]YisiK]?j�J¼QTGCO Q �� ��� � ����GCODJeOxc^`IH �mcISgwxHK`IHsw{cIw j�GIHKLNG�LtOD`�SVH[QTGIS=U��}SnODPIP^U\]aODLNG^SVb��af

WYU\ODbIHKS=`aQybISVJ_LVSV`aQF]YU�LtO~iKLVc^i|O~Q\SVbÈSpoRPIisHKL=HsQTi[fYuME�GIS�wxHK`IHsw{cIw ��HKJ.WYHsZDSV`3�af3� �D�a  .EÈh�]YU&E � ¬;u�E�GmcIJ6

� ����� ��� � � ��� ��� �F. 6   6

� ��� ��� � � ��� ��� ��£ � Ú u Ú � �E�GIHsJ�HKJeOxiKHK`^StODU�S*�mcCO QTHK]D`�h�]YU � j�GIHKLNG�LtOD`��}SnJ\]Yi[ZYS=b��af�J�QNOD`^bCODU\b�w�SpQTGI]qbIJVu�E�G^SODb^Z~OD`aQTODWYS·]DhgQTG^S·iKHK`^StODU�SViKS=w�S=`aQ�cIJ\S=b h�]YU�QTGIS·isStODU_`IHK`IW�J_QTS=P*HK`Í��bIODiKHs`IS�HKJ�QTGCO~QbIHsU\SVLpQnw�O~Q\GISVw�O~Q\HKLtO~i;wxS=Q\GI]Rb^JgODU\SxOtZ~ODHKiKOD�IiKS~u»E�G^S�bIHsJTODbRZDO~`mQTODWYS{j�H[QTG·ZqHKS=j�QT]ÎQTG^SLViKODJ\J_Hs�CLVO~QTHs]Y`�QTODJ\l%HsJ�QTGIO~Q¼jFS»O~U\Sd]YPRQTHKwxHK�=HK`IWgQTG^Sdj�U\]Y`IW3S=U\U\]DU�h�cI`ILpQTHK]D`�u�Ëk`ÎQTGIS¿S=`Ib

Page 13: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

jFS�ODU_S�HK`aQTS=U\SVJ�QTS=b�HK`xOgLV]YU_U\S=L=QFLVi|O~J\J\H[�CLtO QTHK]D`,� � � � �.Q\GIS�QTGIU_SVJ_GI]YiKbxJ_Q\SVP�OD`Ibx`I]DQ�HK`ÈQTG^S�rSVJ_Q¢iKHs`IStO~U�ODPIPIU_]to^Hsw�O QTHK]D`�u

��� � ��� � � ������� ��� � �� � � ������<�#���� � ��� �� ��� � �<�� � � � ��� ���CudËk`�QTGIHsJdODP^PIiKSpQtz�fD]YcLtO~`�bISp�C`IS¿fY]DcIU�]?j�`�L=i|ODJ_J\Hs�ILtO~Q\HK]Y`%P^U\]Y�IisSVw�uyvqQTODU_Q�j�H[QTG�OÈiKHs`IStODU_isfxJ\S=PCODU\OD�IiKS¿P^U\]Y�R�iKS=w�uI$dS=�C`^S¢]Y`^SeJ_S=QF]Dh +¥U\S=b�ÅmOD`Ib�]Y`IS�J\SpQ�]~h +¥�IiKc^SDÅaPr]YHK`aQTJy�af3LVisHKLNlmHK`^Wn]D`xQ\GIS¢J_cIU_hÇO~LVSDu� J_S¿QTGISS XSVU\L=SVP^Q\U\]Y`�ODisWY]YU\H[QTGIw�za�#$�� A/ËG" ��z^]YU�WYUTO~bIHKS=`mQ¼bISVJ_LVSV`aQ�QT]ÈJ_]YisZDSdQTGIS¿P^U\]Y�R�iKS=w ��WYUTO~bIHKS=`mQ�bISVJ_LVSV`aQ�HKJ.LtODisiKSVb �¼ODLNlmPIU_]YPCODWaO QTHK]D`ÈHK`�Q\GIHKJ��¢PIPIisS=Q �Ðu �¼OD`ÈfD]YcÈbIS=�I`ISeOPIU_]Y�IiKS=w j�GIHsLNG�HKJ¼L=]YU\U_SVL=Q\isf�J\]Yi[ZYS=b��af%Q\GISS ;S=U\L=SVP^Q\U\]Y`�ODiKWD]YU\H[QTGIw�zm�Ic^Q¼j�GIS=U\Sg�#$��e�A/ËG" � bI]qSVJ�`I]~Q��C`Ib�O3J_]YiKcRQTHK]D` �(*)� )�� � b ;@7925QXD � 0CA � 03b ;>A@4E8A/S=QxcIJ3J\c^PIP}]DJ\S�QTGCO~Q3jFS�GCOtZYS�HK`IbIS=SVb OÊP^U\]Y�IisSVwÙj�GIHKLNG�HKJÈisHK`ISVODU\i[f�J_SVPCODU\OD�IisSDu7Ë hQTG^SVU\S¿SÐoRHKJ_Q\J¼]Y`IS�J\]Yisc^QTHs]Y`�zaQTGIS=U\S¿O~U\S¿ODisw�]DJ_Q�ODisj�OtfRJ�w�OD`afx]DQ\GISVU_JVuF%*GIHKLNG�]Y`ISdHsJFQTG^S�rSVJ_Q�� º `IS»P}]DJ\J\Hs�IHKisHsQkfÎHsJeQ\]%LNGI]q]YJ\S»QTGIS»J\]Yisc^QTHs]Y`�j�H[QTG�Q\GIS�w�O oRHKw�ODi�J\O~h�S=Qkf�w�ODU\WYHs`�u".HsWIu Ú u ÚYÚ HKiKiscIJ_Q\UTO~Q\SVJ�Q\GISnHKbISVO^uFE�G^S»bCO~J\GIS=b�iKHs`IS¿LV]DU\U\S=L=Q\isf�J\S=PCODU\O~QTS=JeQ\GIS»�=SVU_]YJeh�U_]YwQTG^SÎLVU\]DJ\J\S=JVzF�Ic^Q3J\]Dw�S%]~heQ\GISÎbCO~QTO�P}]DHK`aQTJÈO~U\SÎLVis]YJ\S�QT]·QTGISÎJ_SVPCO~UTO~Q\HK`IW·isHK`IS~uÊE�G^S]YP^Q\HKw�ODi�J\SVPIODUTO~Q\HK]Y`7HsJÈWYHsZDSV`7�af QTGIS%Q\GIHKLNl�J\]YisHKb isHK`IS~u]$¿O~QTO�P}]YHs`aQTJ{]Y`7�r]DQTG7J_HKbIS=JGCOtZYS�O~QÈisStODJ�QxO�bIHKJ�QNOD`^LVS�]Dh¢�Cu]"¢]~QTS%QTGIO~Q3J\SpZYSVU\ODi�Pr]YHK`aQTJ{j�HsiKiFiKHKS�bIHKU_SVLpQTisf�]Y` QTG^Sw�ODU\WYHs`�u�E�GIS=J\SnP}]DHK`aQTJ�ODU_SgLtODisiKSVb%Q\GISgJ\cIP^P}]YU�Q�ZYSVLpQT]YU_JVuAMSpQXcIJXODJ\J_cIw�SyQTGIO~QMj�Syj�]DU\ldHs`»¬ � Ú bIHsw�S=`IJ\Hs]Y`IJ�j�H[QTGgQTGIS�QTG^U\SVJ_GI]Yisb :3HK`aQ\SVWYU\O~QTS=bODJ�QTGISe�CU\J�Q¼LV]Dw�Pr]Y`IS=`mQF]Dh�Q\GIS¢jFSVHsWYGaQ�ZDSVL=Q\]YUVu�"C]YU_w�O~iKisf»QTGIS¢]YP^Q\HKw�ODiIJ\S=PCODU\O~QTHs]Y`�LVOD`QTG^SV`��rS¿bISp�C`ISVb�ODJ�QTGISgisHK`IS�j�G^SVU\SgQTG^SnL=iK]YJ_SVJ�Q¢Pr]YHs`mQ�GIODJeO3w�O oRHKw�ODirbIHKJ�QNOD`^LVS

� . w�O o����}w�Hs`�� � � ��� ��� �� � � � Ú� � ���7£ � Ú u Ú � �º P^QTHsw�Hs�VHs`IW¿QTGISdw�ODU_WYHK`IJyJ_GI]YcIisb%w�O~lDS¢Q\GISdJ�fRJ�QTS=w�U\S=i|O~Q\HsZDSVisf3J�QNOD�^iKS¢j�H[QTG%U_SVJ_P}S=L=Q¼Q\]`I]YHsJ\S~u(*)� )�� �?7GB � V#B B>7G4 8

E�GISÎQTG^SV]YU�f ]DheJ\Hsw�PIisS%PrSVU\L=SVP^Q\U\]Y`^JxGIODb7�}S=SV`�bIS=ZDSViK]DP}S=b Hs` QTGIS%�Ih�Q\HKS=JÈbIcIU\Hs`IW�QTG^S�CU_J_Q��IHsW�Z~ODWYcIS¢]DhM`IS=cIUTODi}`IS=QkjF]YU_lqJ=uFE�G^SdJ\Hsw�PIisS¢PrSVU_LVS=P^QTU_]Y`ÎGCODJ¼]D`ISd]Y�aZqHK]Yc^J�bIHsJTODbR�Z~OD`aQNODWDSD��H[QFLVOD`�]D`IisfÈJ_]YisZDS¢isHK`ISVODU\i[f{J_SVPCODU\OD�IisS¢PIU_]Y�IisSVwxJVu º �aZqHK]YcIJ_isf{Q\GISVU_SdODU_S¢w�OD`afPIU_]Y�IiKS=w�Jxj�GIHKLNG ODU\S�`I]DQ%isHK`ISVODU\i[f J\S=PCODU\OD�IiKS~u#E�GIS�P^U\]DQ\]DQkfqP}S�]DhnO�`I]Y`q�kJ\S=PCODU\OD�IiKSPIU_]Y�IiKS=w"HKJ¼Q\GIS�� º'& � PIU\]Y�^iKSVw�u%*GCO~QgLtO~`ÊjFS3bI]Îj�HsQTG·Q\GI]YJ\S3PIU_]Y�IisSVw�j�G^HKLNG�ODU\S3`I]DQgisHK`ISVODU\i[f�J\SVPIODUTOD�^iKS � º `^SHKb^StO�HKJ»QTGCO~Q�j�SÎw�Otf��rS�OD�IisS�QT]��I`Ib�O�PIU\S=PIU\]qLVS=J\J\Hs`IW�J\LNGIS=w�SÎj�GIHsLNG7U\SVL=]Rb^SVJ{QTG^SPIU_]Y�IiKS=w J\]�QTGCO~QgQ\GIS�U_SVw�ODHK`IHs`IWÎPIU_]Y�IiKS=w HKJgiKHs`IStO~U\isf�J\S=PCODUTO~�IiKS~u%E�GIS�HsbIStO�HKJgHsiKiKc^J��QTU\O~QTS=b·HK` ".HKWIu Ú u Ú ÁRueE�GIS{Hs`IPIc^Q¢ZYS=L=QT]DU � ��� ��� �eHsJ¢P^U\Sp� PIU\]qLVS=J\J_SVb�HK`·O3�CU\J�Q¿i|OtfDSVUdO~`IbfqHKS=iKbIJyOdJ_S=Qy]Dh©h�StO QTcIU_SVJ�j�HsQ\GÈLV]qS('xLVHsSV`aQTJ � S ��� ��� ��� � ��£t£t£ �!� 4 ��� ��� ��� � �pu.E�G^SVJ\SeODU_S¼QTGIS=`QTU_StO~Q\SVb�ODJ�HK`IP^c^Q�QT]xO3J\HKwxPIisSdP}S=U\L=SVP^Q\U\]Y`B������� ��� �F. G � 4 7 S   � ��� ��� ��� ��� �Au

Page 14: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

o

oo

o

x

x

x

x x

x

o

o

x

x

x

o

d

������� Ú u ÚYÚ ��E�GIS{]YP^Q\HKw�ODi�PrSVU_LVSVPRQTU\]D`�u�E�GIS»QTGIHsLNl�isHK`ISgPIU_]?ZRHsbISVJ¢QTGIS»J\SVPIODUTO~Q\HK]Y`�j�HsQ\GQTG^Snw�O oRHKw�cIw�w�ODU\WDHK`�u;E�GIS»bIODJ\GIS=b�isHK`IS¿WDHsZYS=JeO3J_cI�R� ]YP^QTHsw�O~i�J\S=PCODU\O~QTHs]Y`�u� `^h�]YU�QTcI`IO~QTS=isfYzDGI]?j�SpZYSVU=zqQ\GISVU_S�SpoRHKJ�QTJ�`I]¿cI`^HsZYS=U\J\ODiCPIU\S=PIU\]qLVS=J\J_HK`IWgwxS=QTG^]Rb{j�GIHsLNG

HKJ � � �����DHs`�Q\GIS¢Hs`IPIc^QFJ\PIODLVS�OD`Ib�jF]YcIisb�QTU\OD`IJ�h�]YU\w OD`afxbIH '�L=cIisQ�PIU_]Y�IisSVw HK`�O»isHK`ISVODU\i[fJ\S=PCODU\OD�IiKS�]Y`^SDu�Ëk`ÈhÇODLpQtzqØ�Hs`IJ\laf3OD`^b ;ODP}S=U_QyWaOtZDS�Q\GIS�Spo^ODwxPIiKS�]~hrQTODJ\l»j�GISVU_Se�CWDcIU\S=JGCOtZYS�QT]��}SxLViKODJ\J_Hs�CS=b�HK`aQ\]�LV]D`I`ISVLpQTS=b ]Y`IS=J��ÇL=]Y`IJ_HKJ_Q\HK`IW�]Dh�O�J\Hs`IWYisSxisHK`IS �¿OD`Ib�Q\GI]YJ_Sj�GIHsLNG�ODU_S�`I]DQyLV]D`I`ISVLpQTS=b�uFvRHK`IL=S�QTGIHsJ�HKJyO¿WYiK]D�CODi �mcIS=J_QTHs]Y`3j�GIHKLNGxLtOD`x`I]DQy�rS�bISVL=HKbIS=biK]qLtO~iKisfDzY`I]»iK]qLtODiIP^U\SVP^U\]qLVSVJ_J\Hs`IW{LtO~`�J\Hsw�P^iKHsh�fnQTG^S¢PIU_]Y�IisSVw��XQTGISeU\S=w�O~HK`IHs`IWdQNODJ_lÈQTGCO~QGCODJÈQ\]��rS�J\]Yi[ZYSVb�HK` Q\GIS�LVi|O~J\J\H[�CLtO QTHK]D` J_QTS=PÌHsJ3ODisj�OtfRJx]DheQTGIS � º'& QkfqP}S�OD`^b LVOD`QTG^SVU\Sph�]YU\Sg`I]~Q��}S¿J_]YisZDSVb��af�OÈJ\HKwxPIisS�PrSVU\L=SVP^Q\U\]Y`�u�E�G^Sn�r]q]Yl�]Dh.Ø�Hs`IJ\laf�O~`Ib� .ODPrSVU�QÀ � Ã�GCO~Jd�}S=SV`�ZDSVU_f�HK` � c^SV`aQTHKODi.O~`Ib�QTG^SVHKU¢LVU_HsQTH �mcIS�]DhyQ\GIS{PrSVU\L=SVP^Q\U\]Y`·�IODJ\HsLtODisisf�lmHKisiKSVbQTG^S��ISViKbx]Dh}`ISVc^UTODiC`ISpQkj�]DU\lmJ�h�]DUyOnis]Y`IW¿PrSVU\Hs]Rb�u.EX]RbCOtfÈH[Q�HKJ�]~h�QTSV`xJ_QTO~QTS=bxQ\GCO~QyJ_HKwxPIiKSPrSVU\L=SVP^Q\U\]Y`^J�ODU_Sg]Dh.G^HKJ_Q\]YU\HsLtODi}HK`aQTS=U\S=J_Qe]Y`Ii[fYuE�GIHKJ�HsJVzYGI]?jFS=ZDSVUVzR`I]DQyL=]Yw�P^iKS=Q\SVi[fnQ\U\cIS~uyØ�]YU_S�U\SVL=SV`aQTi[f{QTG^S�HKbISVOd]Dh�P^U\SVP^U\]qLVSVJ_J\Hs`IW

h�]YisiK]?j�S=b��af�O�LViKODJ\J_Hs�CLVO~QTHs]Y`��af�J\Hsw�PIisS3P}S=U\LVS=P^QTU_]Y`IJB��QTGIHsJ»HsbIStO�HK`�hÇO~L=Q»`IS=ZDSVUÈLV]Dw3�PIisS=QTS=isf�bIHKS=b���GIODJ�LV]YwxS��IODLNl�Hs`�QTGIS¿L=]Y`aQTSÐoRQ�]~hF+ vRc^PIP}]DU_Q��ySVLpQT]YU�Ø�ODLNGIHs`ISVJ=Å �¡vq�¿Ø2�pu �U\S=PIU\]qLVS=J\J\Hs`IWx�mf%LV]Y`aZY]DiKc^Q\HK]Y`%j�H[QTG�O{J\SpQ¢]~h;l~SVU_`ISVisJew�ODPIJ¼Q\GIS¿PIU_]Y�IiKS=w�Hs`mQ\]3O{GIHKWDG�ÇPr]DQ\SV`aQTHKODiKi[f�HK`^�C`^HsQTS �nbIHsw�S=`IJ\Hs]Y`CODiyh�StO QTcIU_S%J\PCO~LVSDuÊËk` QTG^S�h�StO~Q\cIU\SÎJ_PCODL=S%QTGIS%J_SVPCOA�UTO QTHK]D`�j�H[QTG�w�O oRHKw�cIw�w�ODU\WDHK`�HKJeLNGI]YJ_SV`�u�E�GIS»LVi|O~J\J\H[�CLtO QTHK]D`�O~PIPIU\]YODLNG�HsJeQ\GISVU_S=h�]YU_SSpo^ODLpQTi[f%QTGISg]Y`^Snc^J\SVb�HK`ÎQTG^S�+¥]YP^Q\HKw�ODi�PrSVU_LVS=P^QTU_]Y`�Å[u� J\Hs`IWnOnJ_w�O~U_Q�w�O QTGIS=w�O~Q\HKLVODiRh�]YU_w{cIiKO~QTHs]Y`{]Dh}QTGIS�PIU_SVPIU_]RL=SVJ\J_HK`IW»J_Q\SVP�zqHsQ�HKJ�Pr]YJ_J\H[��IisSdQT]xOtZY]YHsb�Q\GISgSpoRPIisHKLVH[Q�LtO~iKLVc^i|O~Q\HK]Y`%]~h;Q\GISdh�StO~Q\cIU\S=J��mf�L=]Y`aZY]Yisc^QTHs]Y`�u�E�G^S»PIU_]Y�IisSVw]Dh/�C`^bIHK`IWnQTGIS�]YP^QTHsw�O~iCJ\SVPIODUTO~Q\HK]Y`�LtOD`%�rS¢h�]DU\w�ODcIi|O QTSVbxbIHsU\SVLpQTi[fxODJ�O �mcCO~bIUTO~Q\HKL¢PIU\]~�WYU\ODw�wxHK`^W{PIU\]D�IiKS=w�uF"C]YU�b^S=QNO~HKiKJ�J_SVS~zCSDuÂWIuszXÀ ÚYÚ ÃÄu

Page 15: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

w

w

ϕ

n

n

1

smart preprocessing problemlinearly separable

fixed weights adaptive weights

xout

������� Ú u Ú ÁR��E�GIS�HsbIStO�]Dh¢QTGIS�PrSVU\L=SVP^Q\U\]Y`�uÌ�&PIU\S=PIU\]qLVS=J\J\Hs`IW�J�QTS=PÌHKJ{h�]DiKiK]?jFSVb��af�OJ\Hsw�P^iKSdPrSVU_LVSVPRQTU\]D`�u®3¯�� � ¶·Ô=²�¹VÔVÓ��xÖ¿³ �5Ö¿³y¸eÖ �²�³�´�±·×���� $ ��Ø�cIi[QTHsi|OtfYS=U�P}S=U\LVS=P^QTU_]Y`IJ�ODU\Sg]YU_WaOD`IHs�VSVb�HK`�iKO?fDSVU_J¢]Dh.`ISVc^U\]Y`IJ¢OD`Ib�HKwxPIisSVwxSV`aQ�OÈh�SVSVbq�h�]YU�j¼ODU_b PIU\]qLVS=J\J_HK`IW·LNGCO~HK`�u�E�G^SÎi|OtfYS=U\J{�rS=QkjFSVS=`7Q\GIS%Hs`IPIc^QÈ`^]RbIS=JÈOD`Ib�QTGIS%]Dc^QTPIcRQ`IS=cIU\]Y`^J»O~U\SÈLtO~iKiKS=b�GIHsbIbISV`�iKO?fDSVU_JVuÈØ�cIisQ\HKi|OtfDSVU' XSVU\L=SVP^Q\U\]Y`^J�ODU_S{wx]YU\S � SpoRHK�IisS�QTGIOD`J\Hsw�P^iKS�P}S=U\L=SVP^Q\U\]Y`IJ=u�E�GIS�wx]YJ�Q�Hsw�Pr]YU_QTOD`aQyiKSVODU\`IHs`IWgU\cIisSeh�]DU�`^S=QkjF]YU\l3QTU\ODHK`IHs`IWgHKJ�QTG^S�CODLNlmPIU_]YPCODWYO~QTHs]Y`�ODiKWY]DU\HsQ\GIw�u(*)��-).( ]=#0�� � / b#A@4 �'D9032Ëk`�Q\GIS»P^U\SVL=SVbIHs`IW�J_SVLpQTHK]D`�jFS�GCOtZYS»J\S=SV`�Q\GCO~QeQTGISnJ\Hsw�PIisSgP}S=U\LVS=P^QTU_]Y`�LVOD`�]Y`^isfÎJ_]YisZDSiKHs`IStO~U\isf�J_SVPCODU\OD�IisS{PIU\]D�IiKS=w�J=unE�G^SÈPIU\]DQ\]DQkfqP}S�]DhFOD`·Spo^ODwxPIiKS»j�GIHKLNG�HKJ¢`I]DQgisHK`ISVODU\i[fJ\S=PCODU\OD�IiKS�HKJ3QTGIS � º'& PIU_]Y�IisSVw�uÍË Q%HKJxJ_Q\UTODHsWYGaQ\h�]YU�j¼O~U\b Q\]�L=]Y`IJ_Q\U\cILpQ�OÊQkjF]~� i|OtfYS=UPrSVU\L=SVP^Q\U\]Y`�j�HsQTG�QkjF]�`IS=cIU\]Y`^J�HK`ÊO�GIHKb^bISV`�i|OtfYS=Unj�GIHsLNG�J_]YisZDSVJgQTGIS � º'& � PIU\]Y�^iKSVw�¾".HsWIu Ú u Ú �^u�E�GISÎ�CU\J�Q3`ISVc^U\]Y`�HK` Q\GISÎGIHKb^bISV`7i|OtfDSVUÈcIJ_SVJ�O�iKHK`^StODU{J_SVPCO~UTO~Q\HK]Y` j�GIHsLNGJ\P^iKHsQ\J�]DÆÊQTG^S º " "� º " "�HK`IPIcRQtudE�GIS�J\SVL=]Y`Ib�`IS=cIU\]Y`·J_SVPCO~UTO~Q\SVJdQTG^S º "� º "�Hs`IPIc^Qh�U\]Dw�QTGISgU_SVJ_QVuyË h��r]DQTG�`IS=cIU\]Y`^J¢Hs`�Q\GISgGIHKb^bISV`�i|OtfYS=U�ODU\SgHs`CODL=Q\HsZDSDz^Q\GISV`�QTGISgHK`^PIc^Q�HKJSVH[QTGIS=U º "� º " "Ê]DU º " "� º "nuI%*GCO~QFU\S=w�ODHs`IJ�h�]YU�QTGIS¢`ISVc^U\]Y`�HK`3QTGIS¢]Yc^QTP^c^Q�iKOtfYSVU�HKJ`I]?j�O�iKHs`IStO~U\isf%J\SVPIODUTOD�^iKS�P^U\]Y�IisSVw�u�E�GISÈOD�r]?ZYSÈODU_WYcIwxSV`aQTJ¢J\GI]?jÉQTGIO~Q¿Oxw{cIisQ\HKiKO?fDSVUPrSVU\L=SVP^Q\U\]Y`7HsJ�wx]YU\S � SpoRHK�^iKS%O~`Ib LtOD`�z�HK` PIU_HK`IL=HKPIisSDz;J\]Yi[ZYS%PIU_]Y�IisSVwxJ»QTGIO~Q3O�J_HKwxPIiKSPrSVU\L=SVP^Q\U\]Y`�LVOD`I`I]DQ¼J\]Yi[ZYSDu�E�G^S¿LV]Y`IJ�QTU_cIL=Q\HK]Y`%b^]RS=J�`I]DQtzRGI]?j�SpZYS=UVzIQTS=iKircIJ¼GI]?j QT]��I`IbQTG^S�]YPRQTHKw�ODiXj�S=HKWYGaQTJnHK`ÊO�WYSV`^SVUTO~i¡zMP}]~QTSV`aQ\H|ODisisf�w{cILNGÊw�]YU_S3LV]YwxPIiKHsLtO~Q\SVb·J_HsQTcIO~QTHs]Y`�uEX]�WYSpQ�j�S=HKWYGaQTJeODcRQT]Yw�O~QTHsLtODisisfDzmjFSn`ISVS=b�O3iKSVODU\`IHs`IW{U_cIiKS~u

Page 16: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

#1

#2

On/On

Off/Off

x

o

oXOR

first layer

Neuron#1 active

Off/Off

Neuron#2 active

On/Onx o

xo

second layer

XOR problem is solvable

������� Ú u Ú �^�.vR]YiKcRQTHK]D`{]Dh©QTGIS � º'& P^U\]Y�IisSVw�af3OgÁA�kiKOtfYSVU�PrSVU_LVS=P^QTU_]Y`@� � iKOtfYSVU�]~h}Hs`IPIc^Q`I]qbISVJ �puyE�GIS=U\S»ODU\S¿QkjF]�`IS=cIU\]D`IJ¢Hs`ÎQTGISgGIHsbIbISV`�iKO?fDSVU=u(*)��-),+ � Q � ^ b#A@4Eb#QR:EQI;>7G4 8�� D9:*4EA�7 ;>='2E�GIS �¼ODLNlmPIU\]DPCODWaO~Q\HK]Y`�ODisWY]YU\H[QTGIwxJdHsJgQ\GISxWYUTODb^HKSV`aQ»bISVJ_LVS=`mQ{U\cIisS�O~PIPIiKHsSVb·QT]�O�w�cIi[�QTHsi|OtfYS=U3P}S=U\LVS=P^QTU_]Y`�u �&LVisS=ZDSVUxcIJ\S�]Dh�Q\GIS�LNGCODHK` U\cIisS�ODiKis]Aj�JÈc^JxQ\]�HKwxPIisSVwxSV`aQ{QTG^SODisWY]YU\H[QTGIw UTO QTGIS=U�S('xLVHsSV`aQTi[fYu%�S{c^J\S{QTG^S{`I]DQTO~QTHs]Y`�Hs`mQ\U\]qbIcIL=SVb·HK`2".HKWIu Ú u Á�OD`Ib � �©uC� Ú u��I�Ðu¿��JdHs`�QTGIS�J\SVLpQTHs]Y`]Y`�WYUTO~bIHKS=`mQ�b^SVJ\L=SV`aQtz©QTG^S»O~HKw HKJ¼QT]xwxHK`IHsw�Hs�VS�QTGIS��mcCODbIU\O~QTHsL¿SVU_U\]YU

� � � S � � � ����� ��. ÚÁ 6

6 � � ������ ��� � 8 � ������ ��� � � � � Ú u Á�E �j�GIS=U\SdQTG^S�J\c^w ]?ZYS=U��.U_cI`IJ¼]?ZYS=U�ODisir`^SVcIU_]Y`IJ¼Hs`�QTGIS¢]Yc^Q\PIc^Q¼iKOtfYSVU=u�Ëk`Î]YU\b^SVUFQ\]ÈODPIP^isfQTG^SnWDUTODbIHsSV`aQ�bIS=J\LVS=`aQdU\c^iKS

�   � �� . 8 � � �m  � �� � Ú u Á Ú �jFS�`IS=SVb7QT]�LtO~iKLVc^i|O~Q\S�QTGIS�bIS=U\H[ZDO QTHsZDS�� �D�a  � �� u E�GIS�J_cIP}S=U\J_LVU\HsP^Q � U_S=h�S=U\JÈQT]·QTG^Si|OtfDSVUVu�"C]YUyQTG^S�JTO~lDS�]~h/J\Hsw�PIisHKL=HsQkfYzYjFS�Hs`aQTU\]qbIcIL=S¢Q\GIS¢Q\]DQNODi©Hs`IPIc^Q�QT]»`ISVcIU_]Y`%�;HK`xi|OtfYS=U� ODJÈ� � �� ��� � . �   � �� � � �� S � ��� �gj�GIS=U\S � � L � ��� � . � ��� ��� �puB%�S�cIJ\S�Q\GIS�LNGIODHK` U_cIiKSOD`Ib�j�U\H[QTS �

�a  � �� . 6

� �q� � � ��� � �q� �

�� ��� ��a  � �� £ � Ú u ÁYÁI�

A/S=QecIJ�bISp�C`IS � � �� ��� �F. 8�� �~�R� � �� u�E�GIHKJ�fqHKS=iKbIJ�OÈiKSVODU\`^HK`IWÈU_cIiKSg]DhXQTGIS¿h�]YU_w�   � �� .�� 6

� � �� ��� � � � �� S � � Ú u Á�� �j�GIHsLNG�jFS»U_SVL=]YWY`IHs�VSD¾CLph�u�� �qJ=u � Ú u Ú ÁRz Ú u Ú P �pu�E�GIS ��hÇODLpQT]YU_J�ODU\S

� � 4 �� . � ������ ��� � 8 � ������ ��� � � � � � 4 � � ������� � �� Ú u Á � �

Page 17: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

wjk(1)

δδ (2)(1)

(0)kx (1)

jx

��� � � Ú u Ú �I� �¼ODLNlmPIU_]YPCODWaO QTHK]D`�]~h;Q\GIS ��ZDO~iKcIS=JVuh�]YU¼Q\GISg]Yc^QTP^c^Qei|OtfYS=U � . ¬ÊOD`^b

� � � S � . � � � �� S � � ��� ����� ��

��� � 6 �   � �� � � �� � Ú u Á\JI�h�]YU�ODisiC]DQTGIS=Uyi|OtfYS=U\J Ú � ¬ 8 Ú u.E�GIS¢�C`IODiCS*�mcCO~Q\HK]Y` � Ú u Á\J���WYO?ZDS�U_HKJ\S�Q\]nQ\GIS¢`IODw�SÅÂ�CODLNlmPIU\]DPCODWaO~Q\HK]Y`Ì]Dh¿SVU_U\]YU_JVÅyh�]YU3QTGIS�ODiKWY]DU\HsQ\GIw�u E�GIS��t� hÇO~L=QT]DU\J�ODU\S�J\SVS=`*ODJ�is]RLVODiSVU_U\]YU_JVudEX]%LVODiKL=cIi|O~Q\SnQ\GIS{S=U\U\]DUdO~Q�i|OtfYS=U � 8 Ú z©j�SÈ`^SVSVb�Q\GIS�S=U\U_]YU¿O~Q¢i|OtfYS=U � j�GIHsLNGHKJeQTGIS=U\Sph�]YU\S»PIU\]YPIODWaO~Q\SVb��CO~LNlmj�ODU_bIJVu ��ZDSV`·QTGI]DcIWYG�]DcIU�bIHsJ\L=cIJ\J_HK]Y`�GIODJ¢h�]qLVcIJ_J\S=bÊ]D``ISpQkj�]YU_lmJ%j�HsQTGÌO�J_HK`IWYisS�GIHKbIb^SV`ÌiKOtfYSVU=z¼QTGIS�JTO~w�S�ODiKWD]YU\H[QTGIw LtOD`ÍO~iKJ\]Ê�rS�cIJ_SVbÌh�]YU`ISpQkj�]YU_lmJ¢j�HsQ\G�J\S=ZDSVU\ODi;G^HKbIbIS=`�i|OtfYS=U\JVu� WYU\ODbIHsSV`aQnbISVJ_LVSV`aQxODisWY]YU_HsQTG^w�JdL=]Y`aZYS=U\WYS=J�QT]�iK]qLtODi�wxHK`IHsw�ORu�Ë Q»HKJg`I]DQ»WYcCO~UTOD`R�

QTS=SVb�Q\GCO~Q¿H[Q¢�C`^bIJ¿O�WYis]Y�CODiMwxHK`IHsw{cIw�u�Ë Q¿HKJeQTGIS=U\Sph�]YU\S»`ISVL=SVJ\J\ODU_f�HK`·ODP^PIiKHsLtO~Q\HK]Y`IJ�Q\]U\S=J_QTODU_QnQTGIS�ODisWY]YU\H[QTGIw&J\SpZYS=UTODiyQTHsw�S=Jdj�HsQTGÊbIH[Æ�S=U\SV`aQnHK`^HsQTHKODi.L=]Y`IbIH[QTHs]Y`IJVuxE�GISx]Y`IisHK`ISZYS=U\J_HK]Y`�]~h�QTGIS»ODisWY]YU\H[QTGIw j�GIHKLNG�HK`aQTU_]RbIc^LVSVJ¢O�L=SVU�QNODHs`�bIS=WYU\S=S�]Dh�J_QT]qLNGCODJ�QTHsLVHsQkf�G^SViKP^JQT]�SVJ\LVODPrS�h�U\]Yw J_w�O~iKi©iK]qLtODiCwxHK`^HKw�O^zY�Ic^QFQTGIS=U\Sdw�Otf3�}S¢bISVS=PÎiK]qLtODi©wxHK`IHsw�OdHs`�j�GIHsLNGQTG^S»O~iKWY]YU_HsQ\GIw HsJ¼QTU\ODPIPrSVb�u

��� � ��� � � ����� � � �� �� � ���-� ������<� � �����5$dS=�C`^S�O PIU_]Y�IisSVw ]DhnQTG^S + � º'& Å � QkfqPrS��afbIHsJ_QTU_HK�IcRQTHK`^W OD�r]Yc^Q�Qkj�S=`mQkf*Pr]YHs`mQ\J�L=iK]YJ_S�QT]�Q\GIS�h�]Yc^U%LV]YU_`ISVU_JVuÉE;ODlDS�h�]YU�Spo^ODwxPIiKSO�`ISpQkj�]DU\l7j�HsQTG O�J\Hs`IWYisS�GIHsbIbIS=` i|OtfYS=U�Q\GCO~Q%L=]Y`aQNODHs`IJ�h�]DcIU�G^HKbIbIS=` `IS=cIU\]Y`^JVu#EXU_fQT]�]YPRQTHKwxHK�=S�Q\GIS�iKStO~U\`IHs`IW�PCODU\ODwxS=QTS=U\J=u J¢]?j�]~h�QTSV`�WYSpQTJÈiKSVODU\`^HK`IW·J�QTcILNl Hs`�O�is]RLVODiwxHK`IHsw{cIw �,Je]Aj5]Dh�QTS=`�bI]RS=J�HsQ��C`Ib�OÈLV]YU_U\S=L=QeJ\S=PCODUTO QTHK]D`�]~h.QTG^SnPr]YHs`mQ\J��Yu(*)��-)(' ) 4E25038 ;>V'2 ; 03A�2 B

Ëk`·PIU\ODL=Q\HKLtO~i;O~PIPIiKHsLtO~Q\HK]Y`^JeQ\GIS�PIc^U\S�h�]YU_w½]Dh�O�WYU\ODbIHsSV`aQdbIS=J\L=SV`aQnODiKWD]YU\H[QTGIw"HsJ�U\ODU\S=isfcIJ_SVb�ueE�GISVU_SÈODU_S»J_S=ZYS=UTODiXQTU_HKLNlmJ�O~`Ib�wxS=QTG^]RbIJ�QT]�J\PrSVS=b�cIP�L=]Y`aZYSVU_WYSV`^LVSDu º `IS�J�QNOD`R�bCODU_b�Z~ODU_H|O~Q\HK]Y`�]DhXWYUTODb^HKSV`aQ�bIS=J\L=SV`aQdHsJ�QTGISnODb^bIHsQ\HK]Y`%]~h�OÈwx]Yw�S=`aQTcIw QTSVU_w�u��¼QeSVODLNGHsQ\SVU\O~QTHs]Y`�zFQ\GIS�jFSVHsWYGaQ�LNGIOD`IWYS�l~SVS=PIJÎO�isHsQ_QTiKSÎ�^HsQx]DhdQ\GIS�bIHsU\S=L=QTHs]Y`�]DhdQTG^S�PIU_S=ZqHK]Yc^JjFSVHKWDGmQ¢LNGCOD`^WYSDuFE�Gqc^J¢QTG^SgjFSVHsWYGaQTJe�}S=GCOtZYS�ODJ�HshXQTGISpf�GCODb�J_]YwxSnHs`ISVU�QTHKO{]YU + wx]YwxSV`R�QTc^w�Å[uAMSpQ�cIJ�ODJ_J\cIwxS QTGCO Q�QTGIS7LNGCO~`IWYS ]Dh3jFSVHKWDGmQ�  � �� HK`#Q\GIS i|O~J_Q�Q\HKwxS�J_Q\SVPÉj¼O~J�   � �� ���<8 Ú �pu "©]DU�Q\GIS�LNGCO~`IWYS¿O~QFQTHsw�S��yPIcIU_SdWYU\ODbIHKS=`aQ�bIS=J\L=SV`aQ�j�]DcIiKb%WDHsZYS �   � �� .

Page 18: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

8 �^� �~�m  � �� u��¢bIbIHs`IWxOxwx]YwxSV`aQTcIw QTS=U\w"wxStOD`^J¼QTGCO~Q�jFSgcIJ\SnHK`IJ�QTSVODb�   � �� ��� �F. 8 �^� �~�m  � �� � � �   � �� ��� 8 Ú � � Ú u Á�P �

j�HsQ\G�J_]Yw�S�PCODU\ODwxS=QTS=U E � Ú u;E�G^S�wx]Yw�S=`aQTcIw#Q\SVU\wxJXGISVisPIJ;Q\]�OtZY]DHKb�]DJ\LVHsiKiKO~QTHs]Y`IJj�GIS=`�OÈw�Hs`IHKw�cIw HsJ�ODPIPIU_]aODLNGIS=b�u

®3¯�� ��Ó�µ·¹VÓ{Ô�� Ó�×�¹t× Ñ�¶·±·¸�²�¹V´x± Õ-Ö�²��"´x³�Î×"¢]~Q�ODisir`^SVcIU\ODi�`ISpQkj�]DU\lmJ�ODU\SdØ�cIi[QTHKiKOtfYSVUE ;S=U\L=SVP^Q\U\]Y`IJ=uFE�G^S�QTS=U\w `ISVcIU\ODi�`^S=QkjF]YU\lmJ�HKJcIJ_SVb3QTGIS=J\S�bCOtfqJyw�]YU_S¼WYS=`ISVU\ODiKi[fYuX��`3HKwxP}]DU_QNO~`mQ;LViKODJ\J.]Dhr`ISVcIU\ODiI`ISpQkj�]DU\lmJ�O~U\S�Q\GIS�J\]~�LtO~iKiKS=b & ODbIH|O~i ��ODJ\HsJ "CcI`IL=Q\HK]Y` "¢S=QkjF]YU_lqJC� & ��" �purE�GISVU_S3ODU\S�QkjF]�i|OtfYS=U\Jd]~hy`ISVcIU_]Y`IJ=uE�GIS%�CU_J_Q3]Y`^S%LtODisLVcIiKO~QTS=JÈO�`I]Y`^iKHK`^StODUgh�cI`ILpQTHK]D` � ��� ��.�&� � � ��� 8*B � �¿j�GISVU_S�B 3HKJQTG^S�LVS=`aQTSVU¢]Dh�Q\GIS»U\ODbIHKODi/�CODJ_HKJ�h�cI`IL=Q\HK]Y` � Au¼��LV]Ywxw�]D`�SÐo^ODw�P^iKSn]Dh�O & ODb^H|ODi �¼O~J\HKJ"CcI`ILpQTHK]D`�HsJ¼QTGIS c ODcIJ_J\H|O~`

&� � � ��� 87B � �F. SÐoRP �� � 8 � � ��� 87BÁ�� � � ��� �� � Ú u Á �I�

E�GISnJ\S=LV]Y`Ib�i|OtfDSVU�LV]Y`aQTODHK`IJ¼Q\GISg]Yc^Q\PIc^Qe`ISVc^U\]Y`IJ=uyE�GIS=f�GCOtZDS�OÈiKHs`IStO~U�QTU\OD`IJ_h�S=U¼h�cI`ILÐ�QTHs]Y`�u�E�GmcIJ�QTGISg]YcRQTPIc^QeHsJ

� ������ . 46 7 S  �� �� � � ��� � �   L ��Lt£ � Ú u Á � �j�GIS=U\S���L M 8 Ú HKJ�O¿LV]Y`^J_QNO~`mQVu�E�GIS�QTS=U\w   L!��LFPIiKOtfRJ�Q\GIS�JTODwxS�U\]YisS�ODJ�QTGIS�Q\GIU\S=J\GI]YisbHK`�QTGIS»LtODJ_SÈ]Dh�PrSVU\L=SVP^Q\U\]Y`^JVu "C]YU\w�ODisisfYzCH[Q�LVOD`·�rS�HK`^LViKc^bISVb�Hs`�QTG^S�J\c^w�w�O~QTHs]Y`�Hsh�jFSJ_QTODU_Q�Q\GISgJ\cIw O Q9) . E^u(*)�� ).( �Y7.8#0CQRA � b ;@792<7�� QI;>794E8

º h�QTS=`�QTG^S�L=SV`aQTS=U\J{B {]~h�QTG^S��CO~J\HKJ¿h�cI`^L=QTHs]Y`IJ �ÄOD`^b�J_HKwxHKi|O~U\isf�Q\GISxZ~ODU_H|OD`^LVS�� ]~h�QTG^Sc ODcIJ\J_H|OD`^J��¼ODU_S¿LNGI]YJ\S=`��afÎJ_HKwxPIiKS¢GISVcIU_HKJ�QTHKLgO~U\WYcIwxSV`aQ\JVu�"C]YU�Spo^ODwxPIisS�j�Sgw�OtfÎODU_�IH[�QTU\ODU\Hsisf�LNGI]YJ\S�¬�]YcRQ.]DhRQTGIS D̬xbCO~QTO¢J\ODw�P^iKSVJMHs`�]YcIUMbCO QNO¢�IODJ\S�OD`Ib�J_S=Q.¨ &.0� ��� ���-��h�]YU Ú� ) ¬.unE�GISÈL=SV`aQTS=U�� ]~h�Q\GIS c ODcIJ\J_H|OD`^JdLtOD`��rS{LNGI]YJ_SV`ÊJ\]ÎQTGIO~Q¿StO~LNG��CO~J\HKJh�cI`ILpQTHs]Y`·QT]YcILNG^SVJg]Y`IS3]DhyQTG^SxL=SV`aQTS=U\Jn]DhyQTGIS3]DQ\GISVU_JVu3Ø�]YU\S3HK`aZD]YisZDSVb�J\LNGIS=w�S=J»L=]YcIisbw�ODlDSgcIJ_S»]Dh;J\]Dw�S¿cI`^J\cIPrSVU�ZRHsJ\S=b�iKSVODU\`IHs`IW{PIU_]RL=SVbIc^U\SDuº `^LVS�Q\GIS�L=SV`aQTS=U\J�OD`Ib%Q\GIS�]~QTGIS=U�PCODU\ODwxS=QTS=U\J¼]~h�QTGIS�UTODbIHKODi©�CODJ_HKJFh�c^`IL=Q\HK]Y`IJ � �����

GCOtZYS��rSVS=`ÈLNGI]YJ_SV`�zYQ\GIS�]Y`^isfnPCODU\ODw�SpQTS=U\J;Q\]�]YPRQTHKwxHK�=S�O~U\SFQ\GISFjFSVHsWYGaQTJ� �� Au ��c^Q;QTGIHsJ.HKJ`I]?j�O �O���������]YPRQTHKwxHK�VO~QTHs]Y`ÎPIU_]Y�IiKS=w�u $dSp�C`IS���

.�� �� � ��� ��� � �Cu "C]YU¢J_HKwxPIiKHsLVH[Qkf�jFS

bIHsJ\LVc^J\J¢Q\GISnLtODJ_S»]Dh�OxJ_HK`IWDiKSg]Yc^Q\PIc^QecI`IH[Q�O~`Ib�J_cIPIPIU_SVJ\JeQTGISnHK`^bISpo��_u�E�GIS �qcIODbIUTO QTHKL

Page 19: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

φ φ

x

1 n

outi

i1w

����� � Ú u Ú JR���ÉU\ODbIH|O~i��CODJ_HKJ�h�cI`ILpQTHs]Y`�`IS=QkjF]YU\l � & �9"F�puSVU_U\]YU�HsJ

� �B� . ÚÁ

�67 S � ����� ��� � 8 � ����� ��� ��� �

. ÚÁ

�67 S

�� 46�7>L  � �9

8�� ����� ��� ���� � � Ú u Á�� �E�GISnLV]Y`^bIHsQ\HK]Y`Î� �D� � . E{fqHKSVisbIJ�O �O���������S �qcIO~QTHs]Y`Îh�]YU � j�GIHsLNG�LVOD`��}SgJ\]DisZYS=b��afbIHsU\SVLpQ¼wxS=Q\GI]Rb^JVu�E�GIS�JTODwxS�isHK`ISVODUy]YP^QTHsw�Hs�tO~Q\HK]Y`ÈP^U\]Y�IisSVw GCODJ�ODiKU_StODbRf3�}S=SV`ÎSV`^LV]YcI`q�QTS=U\S=b�HK` � Ú u Ú � ��HK`ÎQ\GISgLV]Y`aQTSÐoqQ�]Dh;�#$�� A/ËG" ��u

��� � ��� � ��� ��� �� ��� ���� ���Z��� � � ��� � � �� � � ���5Ëk`ÌQTGIHsJ%ODP^PIiKSpQ%O & ��"`IS=QkjF]YU\lHKJÎc^J\SVb*h�]YU%h�cI`^L=QTHs]Y` ODPIPIU_]to^Hsw�O QTHK]D`�u�E�G^SÊL=SV`aQTS=U\J�]DhnQTGIS·h�cI`ILpQTHs]Y`IJ�ODU_S·S*�mcCODisisfbIHsJ_QTU_HK�IcRQTSVb�]?ZYSVUnQTGIS�]Y`ISÐ�kbIHsw�S=`IJ\Hs]Y`CODi�Hs`IPIc^QnJ\PIODLVS~u�$dSp�C`IS�O�J\SpQ{]Dh�OD�}]Dc^Q»�^h�QTSVS=`HK`^PIc^Q_� ]Yc^Q\PIc^QxPCODHsU\JVu % O~Q\LNG Q\GIS�]Dc^QTPIcRQ�]Dh�QTGIS�`IS=QkjF]YU_lru "e]?j½U\SVb^cILVS�QTGIS�`mcIw3��rSVU¿]Dh�bCO~QTO%P}]DHK`aQTJ�j�G^HKiKS�lDSVS=PIHK`^W�Q\GISÈ`mcIw{�rSVU¿]Dh��CO~J\HKJ¢h�cI`IL=Q\HK]Y`^JdLV]Y`^J_QNO~`mQVu %*GCO QGCODP^P}S=`IJ��(*)�� ),+ TU4 8'D9798#03QRA � b ;>7.257 � QI;>7G4 8

Ø�]YU_SÎWYSV`^SVUTO~iKisf�jFSÎw�OtfÊj�HKJ_G QT]·]YP^Q\HKwxHK�=SxQ\GIS%LVS=`aQTSVU_JxB �OD`^b QTGISÎPCO~UTODwxS=Q\SVU\J�]DhQTG^S��CO~J\HKJdh�c^`IL=Q\HK]Y`IJg�afÊO�J\cIPrSVU�ZRHsJ\S=b�iKSVODU\`^HK`IWÎPIU_]RL=SVbIc^U\SDuC"C]YiKis]?j�HK`IW�Q\GISxJTODwxS3ODU��WYcIwxSV`aQ\J3ODJ�h�]YU�Q\GISÎbIS=U\HsZ~O~Q\HK]Y`�]Dh�QTGIS��CODLNlmPIU\]DPCODWaO~Q\HK]Y`7O~iKWY]YU_HsQ\GIw�zMjFSÎLtOD`�ODPIP^isfWYU\ODbIHKS=`aQgbISVJ_LVSV`aQgQT]�B O~`Ib·QT]%QTG^S{ZDO~U\H|O~`ILVS ��unE�GIS3bIS=U\HsZ~O~Q\HK]Y`�]DhFQ\GIS{h�]YU_w{cIi|O~J�HKJ

Page 20: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

J_Q\UTODHsWYGaQ\h�]YU�j¼O~U\b�z��Ic^QÈQ\SVbIHs]YcIJVu �¢`I]DQ\GISVU3Pr]YJ\J_HK�IHsiKHsQkfÊ]Dh¢PCODU\ODwxS=QTS=UÈ]YP^Q\HKwxHK�tO QTHK]D`�HKJWYH[ZYSV`Ê�af�QTG^S��.oRPrSVL=QTO~QTHs]Y`�Ø�O oRHKwxHK�VO~QTHs]Y`·ODisWY]YU_HsQTG^w�ugËk`ÊiK]?j�b^HKwxSV`IJ_HK]Y`IJ�HsQgHKJdODiKJ_]Pr]YJ\J_HK�IisS�QT]�cIJ\S~zeHs`IJ_Q\StODbÍ]~h¿UTODb^H|ODielDS=U\`IS=iKJVz c ODcIJ_J\H|O~`IJ�j�H[QTGÍODU_�IHsQ\UTODU�f�LV]?Z~ODU\HKOD`ILVSw�O~QTU_H[o}u

��� � ��� � �%� � ��� � �� ��� �� � � �� � � � ���� � � � �>$dS=�I`IS¿O{J\SpQ�]DhXOD�r]Yc^Q�Á�E{bCO~QTO�Pr]YHK`aQTJj�GIHsLNG�fY]�w�OtfÎj�OD`aQ¢Q\]�b^HKJ_Q\U\Hs�Ic^QTSgHs`mQ\]xQkjF]�L=iKcIJ�QTS=U\JVu�vRS=QeQTGISg`mcIw{�rSVUe]Dh.lDSVU_`ISVisJ¢Q\]QkjF]Iu % O QTLNG�G^]AjÌQTGIS�Qkj�]»lDS=U\`IS=iKJ�wx]?ZYS�QT]gQTGISeLViscIJ_Q\SVU_J�OD`^b%ODb�H_c^J_QyQTGIS=U\S¢LV]?Z~ODU\HKOD`ILVSw�O~QTU_H[o�J\]7O~J�QT] ]DP^QTHsw�ODisisf wx]qbISVi�QTG^S�bCO~QTO bIHKJ�QTU\Hs�Ic^Q\HK]Y`�u %*GCO~Q%GCODPIPrSV`IJÎH[hdQTG^S`mcIw{�rSVU�]Dh;lDS=U\`IS=iKJebI]RS=J�`I]DQew�O QTLNGÎQTGISg`mcIw{�rSVU�]Dh;LViscIJ_Q\SVU_J��(*)�� )(' �?7GB � V#B B>7G4 8

E�GIS�h�UTODwxS=jF]YU_l ]Dh�Q\GIS�UTODb^H|ODi¼�IODJ\HsJ3h�c^`IL=Q\HK]Y`�`IS=QkjF]YU_l w�ODl~SVJ3QTGIS�LV]D`I`ISVLpQTHs]Y` �rSp�QkjFSVSV`·`^SVcIU\ODi;`^S=QkjF]YU\lmJgOD`Ib�LViKODJ\J_HKLtO~i;O~PIPIU\]toRHKw�O~Q\HK]Y`ÎQTS=LNGI`IH �qc^SVJdHs`�J�QNO~Q\HKJ_Q\HKL=J¢wx]YU\SQTU\OD`IJ_PCODU\S=`aQtu*Ëk`ÌhÇODLpQtz¼wxS=Q\GI]Rb^Jxj�GIHsLNGÌcIJ_S�OÊJ\cIPrSVU_P}]YJ_HsQ\HK]Y`�]Dh¿J_S=ZYS=UTODi c O~cIJ\J_H|OD`IJODU_S%LV]Ywxwx]Y`Iisf�c^J\SVb7Hs` bISV`^J\HsQkf�SVJ�QTHKw�O~Q\HK]Y`�u�Ëk` J_QTO~QTHsJ_QTHsLVJnQTGIS=J\SÎwxS=QTG^]RbIJ{ODU\S�ODiKJ_]LtO~iKiKS=b�wxH[oqQ\cIU\S3wx]RbIS=iKJg]YU=z;wx]YU\SxJ\PrSVL=Hs�CLVODiKi[fYzXO�wxH[oqQ\cIU\S3]Dh c ODcIJ_J\HKOD`IJVu�E�GIS�w�ODHK`bIH[Æ�S=U\SV`^LVSÈHKJeQTGCO QdUTO~bIH|ODiX�CODJ_HKJ�h�c^`IL=Q\HK]Y`�`^S=QkjF]YU\l�cIJ\cCO~iKisf�ODJ_J\cIwxS�Q\GCO~Q¿J_S=ZYS=UTODi.]Yc^Q_�PIc^Q�cI`IH[QTJgLtOD`�J\GCODU_SxQ\GIS�J\ODwxSx�IODJ\HsJnh�cI`^L=QTHs]Y`IJ � �����Ðz Ú � ¬.uÎE�GIS�J_QTOD`IbCODU_bODPIP^U\]aODLNG�HK`7bIS=`IJ\H[Qkf7SVJ�QTHKw�O~Q\HK]Y`�jF]YcIisb7�}SÎQT]�cIJ_S�h�]DUÈStODLNG�LViKODJ\JxOD`7HK`^bISVPrSV`Ib^SV`aQJ\SpQn]Dh��CODJ\HsJdh�cI`ILpQTHK]D`IJVu{vRSVSÈQTG^SÈ�}]q]Yl�]Dh �FHKJ\G^]YP�h�]YUgOD`·Hs`R�kbIS=P^QTG�bIHsJ\L=cIJ\J_HK]Y`�]DhyQTG^SU\S=i|O~Q\HK]Y`ÊÀ �DÃÄu��`I]DQ\GISVU�O~b^Z~OD`aQNODWYS¿]~h;U\ODbIHKODi��CO~J\HKJ¼h�c^`IL=Q\HK]Y`IJ�HsJ�QTGIO~Q�QTGISpf�ODisiK]?j*w�]DU\SdSVODJ\HsisfÎO~`

HK`aQ\SVU\P^U\S=QTO~QTHs]Y`·]Dh�j�GCO Q¿QTGIS{`^S=QkjF]YU\l�HsJdbI]YHs`IWIugE�GIHsJdWY]qSVJdHs`�Qkj�]�bIHsU\SVLpQTHs]Y`IJVu ";HKU\J�QtzSpoRPrSVU�Q�lq`^]Aj�isSVbIWDS·LtOD`*�rS�StODJ_HKi[f Hsw�P^iKSVwxSV`aQ\SVbÍOD`^bÍcIJ\S=b*h�]DUÎOD` Hs`IHsQ\H|ODisHK�tO QTHK]D` ]DhPCODU\ODwxS=QTS=U\J=u�vRSVL=]Y`Ib�z}O~h�Q\SVU�QTU\ODHK`IHs`IW{QTG^S»w�ODPIPIHs`IWÈQTGCO Q¢Q\GIS»`^S=QkjF]YU\l�GCODJ�h�]YcI`^b�LVOD`�rS�OD`IODisfq�VS=b�uÎËk`�w�OD`af�LtO~J\SVJ»HsQnHKJgPr]YJ\J_HK�IisSÈQT]�SÐoqQTUTO~L=QnQTGISxlm`I]?j�iKSVb^WYS�Hs`ÊQ\SVU\wxJn]DhU\c^iKSVJ=u3E�GIS�U_SViKO~QTHs]Y`��rS=QkjFSVSV`�`ISVcIU\ODi�`ISpQkj�]YU_lmJ{OD`IbÊSpoRPrSVU�Q»lm`I]?j�isSVbIWYSxHKJ¿SÐoRPIiK]YH[QTS=bHK`ÎQ\GISgLV]Y`aQTSÐoqQ�]DhFÅ�"¢SVc^U\]~� "©c^�V�=fa�,"¢S=QkjF]YU_lqJ=Åsu®3¯�� ����Ö ��³�´��·ÔVÖ¿Ò ´�� "�Öd³� ·²;²�¹t±&%-Ó{±·µ �ÙÖ¿±�Ö¿³�Ó{ÔV¹��¢Ó��

²�¹V´x±(*)��-).( ) 4R;@7,6RQI;>794E8

%�SÈGCOtZYS3J\S=SV`�HK`�Q\GISÈPIU\S=LVS=bIHK`IWÎJ_SVLpQTHK]D`IJdQTGCO QnO%J\HKwxPIisS»PrSVU_LVSVPRQTU\]D`�LVOD`·]Y`Ii[f�J_]YisZDSiKHs`IStO~U\isf�J\S=PCODUTO~�IiKS�PIU_]Y�IiKS=w�J{j�G^SVU\SVODJ%O�w{cIi[QTHsi|OtfYS=U{P}S=U\L=SVP^Q\U\]Y` HKJ3w�]DU\SÎPr]AjFSVU�h�cIi¡uE�GIS �mcISVJ�QTHK]D`%ODU_HKJ\S=J�j�GIS=Q\GISVUFHsQyHKJ�ODi[j¼OtfqJybISVJ_HKU\OD�IiKS�Q\]»GCOtZDS�O � SpoRHs�IiKS�`ISpQkj�]YU_l©u�E�G^SOD`IJ�j�S=UÈHKJ{`^SVWaO~Q\HsZDSDu·Ëk` J_]Yw�S�LtODJ_SVJÈHsQ�HKJ»�}SpQ\QTS=U�QT]�GCOtZYSÎ`ISpQkj�]YU_l�j�GIHsLNG7bI]RS=J{`I]DQPrSVU_h�]DU\w PrSVU�h�SVL=Q\isf�]Y`·QTGIS3bCO~QTOÎJ\S=QVuÈE;]�cI`Ib^SVU\J�QNOD`^bÊj�GafYzXiKSpQgcIJgU\S=LtODisi;QTG^S3QTODJ\l�]DhJ\c^P}S=U_ZqHKJ_SVbÎiKSVODU\`^HK`IWIu;E�GISdbCO QNO»J_S=Q�HsJFc^J\SVb%Q\]»Q\UTODHs`%O»`^S=QkjF]YU\lxQT]�PrSVU�h�]YU\w OnbISVJ_HKU\S=b

Page 21: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

@ �

o

oo

o

o

oo

x

x

x

x

x x

o

ooo

oo

o

o

o

xx

x

x

x

x

x

x

x

x

x

o

o

9 �

o

oo

o

o

oo

x

x

x

x

x x

o

ooo

oo

o

o

o

xx

x

x

x

x

x

x

x

x

x

o

o

������� Ú u Ú P^�gE�GIS�J_SVPCO~UTO~Q\HK]Y`�]Dh�O�bIO~QNO�J\SpQ�OI�¿�afÊO�J\Hsw�PIisS{PrSVU\L=SVP^Q\U\]Y`�OD`IbÊ���d�afÊOw{cIi[QTHsi|OtfYS=U�PrSVU_LVS=P^QTU_]Y` �ÇJ_LNGISVw�O~QTHsL �Ðu�E�GIS�w{c^isQTHsi|OtfYS=UyP}S=U\LVS=P^QTU_]Y`ÎPrSVU_h�]DU\wxJFPrSVU�h�SVL=Q\isf]Y`xQTGIS�bCO~QTOnJ_S=QVu %*GCO~Q�w�O Q\QTS=U\J=zqG^]AjFS=ZDSVU=zIHK`�ODPIPIisHKLVO~QTHs]Y`IJ�HsJyQ\GIS�PIU\S=bIHKLpQTHs]Y`xh�]DU�`^S=jbCO~QTOnPr]YHs`mQ\J�j�GISVU_SeQ\GISeOD`IJ�j�S=UFHsJ�`^]DQylm`I]?j�`�zRisHKl~S¼QTGISeP}]DHK`aQyHK`Ib^HKLtO QTSVbÈ�afÈQ\GISeODU\U_]AjguHK`^PIc^Q_� ]Yc^Q\PIc^QXw�O~PIPIHK`^WIzASDuÂWIusz h�]YUXODc^Q\]Yw�O QTHKL�L=i|ODJ_J\H[�CLtO~Q\HK]Y`�uXE�G^SF�C`CO~iq`^S=QkjF]YU\l¿j�HKisiY�rScIJ_SVb�]Y` ��� �·bCO QNO»j�GIHsLNG�ODU\S¢`I]DQ�PCODU_Q�]Dh/QTG^S�QTU\ODHK`IHs`IWnbCO~QNO»�CODJ\S~uyE�GISdPrSVU_h�]DU\w�OD`ILVS]Dh�QTG^SÎ`IS=QkjF]YU\l�GCODJ{QTG^SVU\Sph�]YU\S%Q\]·�}S�w�SVODJ\cIU_SVb7]Y`7`ISpj�bCO QNO�j�GIHsLNG�GIODJÈ`I]DQÈ�rSVS=`cIJ_SVb�b^cIU\Hs`IWÈQTUTO~HK`IHs`IWIuE�GIS��CODJ_HKL¼HsbIStOdHsJ�HKisiKcIJ�QTUTO QTSVb»HK`�".HsWIu Ú u Ú P^u.Ëk`xO �XQ\GIS¼bCO QNOdJ\SpQ�GCODJ��rSVS=`�J_SVPCODU\O~QTS=b�af�OxJ\Hsw�PIisS¿P}S=U\L=SVP^Q\U\]Y`�u�vRHs`ILVSgQTGIS»bCO~QTO�J\SpQdHsJ¢`I]~Q�isHK`ISVODU\i[f%J\S=PCODU\OD�IiKS»Oxh�SpjÉSVU_U\]YU_J

U\S=w�O~HK`�udE�G^SÈw�]YU_S � SÐoRHK�IisS�`ISpQkj�]YU_l�HK`����¢HKJ¢LtODPIOD�IiKS�]Dh�O�PrSVU_h�S=L=QgJ_SVPCODU\O~QTHs]Y`�u A/SpQcIJg`I]?j�J\SVS3GI]?j�QTGISÈ`ISpQkj�]DU\l·PrSVU_h�]DU\wxJd]Y`�`IS=j�bCO~QTO^z�h�]YUdSÐo^ODw�P^iKS{QTG^SÈbCO~QNO%Pr]YHs`mQHK`^bIHKLVO~QTS=b·�mf�OD`�ODU_U\]?jHK`�QTG^S{HK`IP^c^Q¿J\PIODLVS~u�E�GISÈ`ISpQkj�]DU\l�Hs`����ejF]YcIisb�O%P^U\SVb^HKL=Q¿OLViKODJ\J_Hs�CLVO~QTHs]Y` ODJ3O�L=U\]YJ_JVz�QTG^SÎ]Y`IS%Hs`7O ��ODJÈO��=SVU_]Iu�E�G^S�P^U\]Y�IisSVwÙHKJnQTGCO~QxO�P^U\HK]DU\HjFS�bI]Y`�ÅÂQxlm`I]?j"j�GIHsLNGÌ]Y`IS�]Dh¢QTGIS�QkjF]�LViKODJ\J_Hs�CLVO~QTHs]Y`IJÈHsJxL=]YU\U_SVLpQtu "©]DUxSÐo^ODw�P^iKS�HsQw�O?f3�rS¢Q\GCO~Q�QTGIS¢LVU_]YJ\J�j�GIHKLNG%LVODcIJ_SVb�Q\GIS¢Q\]Y`IWYcIS¢HK`3QTGIS¢J\S=PCODUTO QTHK]D`��r]YcI`IbCO~U_f3HKJyQTG^S

Page 22: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

U\S=J\cIi[QTJ¼]~hXO�`I]YHsJ_f�w�SVODJ\cIU_SVwxSV`aQ�O~`Ib%QTGCO Q�QTG^SdiKHslDSVisHKGI]q]qbx]~hM�VSVU_]YJ¼HsJ�w{cILNGÎG^HKWYGIS=U�Hs`QTGIO~QdU_SVWYHs]Y`�Q\GCOD`�Q\GIS�]Y`^S»h�]YUeLVU_]YJ\J_SVJVu�E�GISV`�Q\GIS�PIU_SVbIHsL=Q\HK]Y`�]Dh�QTG^S{J\Hsw�PIisSg`IS=QkjF]YU\ljF]YcIiKbÎHs`�hÇODLpQ¼�rSd�rS=Q\Q\SVU�QTGCOD`%Q\GIS�]D`ISd]Dh/Q\GIS�wx]YU\S � SpoRHs�IiKS¢`IS=QkjF]YU\l©uyË Q¼h�]YisiK]?j�JyQTGCO~QHK`�PCODU�QTHsLVcIiKODU{h�]YU3`I]YHsJ_f7bCO~QTO^zFjFS�GCOtZYS�Q\]�L=]Y`aQTU_]Yi�QTGIS � SpoRHs�IHKisHsQkf ]~hd]YcIUx`ISpQkj�]YU_l©uº QTGIS=U_j�HsJ\S»Q\GIS�`^S=QkjF]YU\l�w�O?f�isStODU_`�Q\GIS$+¥`I]YHsJ\S~ÅrHs`IJ_Q\StODb�]Dh�Q\GIS�cI`^bISVU_isfqHK`IWxJ_Q\U\cILpQTcIU_S]Dh�QTG^SÎHK`IPIcRQ_�k]Dc^QTPIcRQÈw�O~PIPIHK`^WIu5A/StODU_`IHK`IW�Q\GISÎJ\PrSVL=Hs�CLÎbIO~QNO�J\ODw�P^iKS%Hs`ILViscIbIHK`^W�QTG^S`I]YHsJ\SgHKJ�lm`I]?j�`�ODJ�QTGISgPIU_]Y�IiKS=w�]Dh;]?ZYS=U_�IQ_QTHK`^WIuE�GIS{JTO~w�S»PIU\]Y�^iKSVw½HsJ�ODisJ\]%lm`I]?j�`·Hs`�h�cI`ILpQTHs]Y`·ODPIP^U\]toRHKw�O~QTHs]Y`�u A/S=Qdc^JdJ\cIP^P}]YJ_S

jFS�GCOtZDS O bCO~QTO��CO~J\S�j�GIHKLNG LV]Y`aQTODHK`IJ�`I]DHKJ_f HK`IPIcRQ_�k]Dc^QTPIcRQ�PIODHKU_J ��� ��� ��� ���_� ����� ��� ���j�HsQ\G � ��� �_������� � Ë & u¢E�GIS»QNODJ_l�]~h�h�cI`IL=Q\HK]Y`�ODPIPIU_]to^Hsw�O QTHK]D`�HsJeQ\]��C`Ib�Q\GIS�c^`IbISVU_isfqHK`^WJ_Q\U\cILpQTcIU_S�]~h»Q\GIS�bCO~QNO bIHsJ_Q\U\HK�^c^QTHs]Y`�u�� �IQ��af O Pr]Yisfq`I]YwxH|O~iej�H[QTG ODJ�w�O~`mf h�U\S=SPCODU\ODwxS=QTS=U\J¿O~J�bCO~QTO�Pr]YHK`aQTJ�ODiKis]?j�J¢]Y`^S�QT]%Hs`aQTSVU_P}]Di|O~Q\SgQ\GIS{bCO QNO�PrSVU�h�SVL=Q\isfDz��Ic^Qdw�OtfLtO~cIJ\S·O~U\�IH[QTUTO~U\HKi[f i|O~U\WYS�]YJ_LVHKisi|O~Q\HK]Y`^JVuÍE�GIS�]Dc^QTPIcRQ%]Dh¿Q\GIS�h�cI`^L=QTHs]Y`Ìh�]YUx`ISpj�Hs`IPIc^QPr]YHK`aQTJ � ��� HsJ�QTG^SV`7w�SVOD`IHs`IWYiKS=J\J=u�� WY]q]qb �IQÈJ\G^]YcIiKb7L=]Y`aQNODHs` h�S=j h�U\SVS�PCO~UTODwxS=Q\SVU\Jj�GIHsLNG�h�]YU_LVS=JeQ\GIS¿h�cI`IL=Q\HK]Y`ÎQ\]�OtZDSVUTO~WYS�Otj�OtfÎPCODU�Q¢]~h;Q\GISg`I]YHKJ_SDuËk`�`IS=cIUTODiy`ISpQkj�]DU\lmJVz.Q\GIS3j�S=HKWYGaQTJ» �� {PIiKO?f�QTGISxU\]YisS3]Dh�Q\GIS��IQnPCO~UTODwxS=Q\SVU\J=u %�S

w{cIJ�Q¿QTGIS=U\Sph�]YU\SÈL=]Y`aQTU\]Di.QTGISÈSpÆ�S=L=Q\HsZYSÈ`mcIw��}S=U¿]Dhyj�S=HKWYGaQTJ=uÈØ�]DU\SÈ]YU¿isSVJ\J�J_fqJ_Q\SVw�O~QTHsLwxS=QTG^]RbIJ�]~h}Q\GIS�LV]Y`aQTU_]YiC]Dhrwx]RbIS=i � SÐo^Hs�IHKisHsQkf»ODU_Sec^J\cCODisisf»J\cIwxw�ODU\Hs�VSVbÈc^`IbISVU�Q\GIS�QTHsQ\iKS]Dh�U_SVWYcIiKODU\Hs�tO~Q\HK]Y`�PIU_]RL=SVbIc^U\SVJ=uÊvR]YwxS�]~h�QTGIS=J\S%wxS=Q\GI]Rb^J{ODU_S�bIHsJ\LVc^J\J\S=b7HK`�Q\GIS%`ISÐoqQJ\c^�IJ\S=L=QTHs]Y`IJ=u

��� � ��� � � � ��� �� ��� ���� � �Z��� � � ���Y� � �� � � ��� c ]g�CODLNl�Q\]gQ\GIS & O~bIH|ODi �¼ODJ_HKJ "CcI`ILp�QTHs]Y` "¢SpQkj�]DU\l�OD`Ib�J�QTcIb^f%GI]?j Q\GISg]YJ\L=HKiKiKO~QTHs]Y`IJ�HK`%Q\GIS¿U\S=PIU\S=J\SV`aQTO~QTHs]Y`�Hs`ILVU_StODJ_S¿HshMQTG^S`mcIw{�rSVUF]Dh��IQ�PCODUTO~w�QTS=U\JFODPIPIU_]aODLNGIS=J�QTGIS¢`mcIw{�rSVU�]Dh/bCO~QTO»Pr]YHK`aQ\JVuX$dS=�I`ISdOnbCO~QNOnJ\SpQj�GIHsLNG bI]qSVJ�`^]DQ{L=]AZDSVU�Q\GISxHK`IPIcRQ{J\PIODLVS�S=ZYS=`IisfDz�h�]YUgSpo^ODwxPIiKS~z;fD]Yc LV]DcIiKb�LNGI]R]DJ\S�Q\]GCOtZYSÈwx]YU_S�Pr]YHK`aQTJeQT]?j�ODU\bIJ¢QTGIS{�r]YU_bISVU_J�QTGCO~`�HK`�Q\GIS{wxHKbIb^iKSg]Dh�QTG^S{HK`aQTS=U_Z~ODiÄu %*GCO QGCODP^P}S=`IJ��(*)��-),+ �A@QX798'7.8#:5QX8#F 6RQXD979F'QI;>7G4 8 B 0Z;

%*GCO~Q\S=ZDSVU�QTGISgJ\PrSVL=Hs�CLgU_SVWYcIiKODU\Hs�tO~Q\HK]Y`�w�SpQTGI]qb�z^jFSnODisj�OtfqJeJ_PIiKH[Q¼QTG^SnbIO~QNOÈJ\SpQ ��HK`aQ\]QkjF]ÈPCODU_Q\JVz � S OD`Ib � � u�Ë h�Q\GISdbCO~QTO»J_S=Q�L=]Y`aQNODHs`IJ¼O»Q\]DQNO~ir]~h *. Ú EIEIEnbCO~QNOnP}]DHK`aQTJ=zqjFSw�O?fÈh�]DUFSÐoIO~w�PIisS¢J_SVisSVL=QFJ_Q\]RLNGIODJ_Q\HKLtO~iKisf S .?J�EIEgP}]DHK`aQTJyh�]YUybCO~QTO»J\SpQ � S OD`^b�cIJ_S¢QTG^SU\S=w�O~HK`IHs`IW 8 S Pr]YHK`aQ\J¼h�]YU � � uº `^isf�bCO~QNO·J_S=Q � S HsJÈcIJ\S=b bIc^U\HK`^WÊisStODU_`IHK`^WIu�Ë QxHsJ{LtODisiKS=b QTGISÎQTU\ODHK`^HK`IW�J_S=QVu �¼QStO~LNG�J_Q\SVP�]~h;Q\GIS»isStODU_`IHK`^WxP^U\]qLVSVb^cIU\S~z©jFSgQNODl~S�O3PCO~Q_QTSVU_` � � � S z}O~`Ib�LVODiKL=cIi|O QTSdQTG^SjFSVHKWDGmQ¢cIPrbCO~Q\SDuy�¢h�Q\SVU S cIPrbCO~QTS=J ��]Y`IS ���@� �����pzRj�SnHK`aQTS=U\U_cIP^Q�iKSVODU\`^HK`IWxOD`Ib�QTS=J_Q�QTG^SPrSVU_h�]DU\w�OD`ILVS�]~hrQ\GIS�LVc^U\U\S=`aQF`^S=QkjF]YU\lÈ]Y`ÈQ\GIS 8� S JTO~w�PIisSVJ�]~h�bCO QNOdJ\SpQ � � u�E�GIS�J\SpQ� � PIi|OtfqJ�QTG^S{U\]YisS�]Dh&+¥`IS=jgÅ�bCO~QNOxj�GIHKLNG·QTG^S{`IS=QkjF]YU_l�GCODJd`^]DQ¿J\S=SV`�bIcIU_HK`IW�QTUTO~HK`IHs`IWIuË Q¢HKJ�QTGIS=U\S=h�]DU\SnLtODisiKSVb�Z~ODiKHsbCO~Q\HK]Y`ÎJ_S=Qtu�%�S{O~iKJ\]3LVODiKL=cIi|O~Q\SnO~h�QTS=U¢SVODLNG�SVPr]qLNG�QTG^S�SVU_U\]YU

��� ��� � ]Y`ÎQTGIS¿QTU\ODHK`^HK`IWÈJ_S=Qtu ��]~QTG�SVU_U\]YU_J¢O~U\S¿PIis]DQ\Q\SVb�ODJeO{h�cI`IL=Q\HK]Y`�]Dh;iKSVODU\`^HK`IW{Q\HKwxSDzwxStODJ_cIU\S=b��afÎQTG^Sn`mcIw��}S=Ue]~h.S=P}]qLNGIJVu$dcIU\Hs`IW¿QTGIS¢HK`IH[QTH|O~i^PIGCO~J\Sd]Dh�iKSVODU\`IHs`IWn�}]DQ\G�Q\UTODHs`IHK`IWnOD`^b�Z~ODiKHsbCO~Q\HK]Y`ÈS=U\U\]DUFcIJ_cCODisisf

Page 23: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

E

training time

E

E learn

val

t*������� Ú u Ú �R� º ZDSVU��IQ\Q\HK`IWIuE$dcIU_HK`IWÈQTU\ODHK`^HK`IW{j�H[QTG�WYUTODb^HKSV`aQ�bIS=J\L=SV`aQdU_cIiKS=JVzCQTGISgisStODU_`IHK`IWSVU_U\]YU ��� ��� � bIS=LVU\SVODJ\S=J,�ÇJ_]YiKHsb�iKHs`IS �Ðu�E�GIS�Z~ODisHKbCO~Q\HK]Y`�S=U\U\]DU � ��� ��bCODJ\G^SVb��Ðz�GI]?j�SpZYSVU=z

w�O?f%HK`IL=U\StO~J\SnODWaODHs`�O~h�QTS=U�J\]YwxS¿QTHsw�S~ubIS=LVU\SVODJ\S~u5E�GIHsJ�wxStO~`IJ�Q\GCO~QxQTGIS�`IS=QkjF]YU_l isStODU_`IJxQ\GIS�J�QTU_cIL=Q\cIU\S�]~h�QTG^S�bCO~QTO�ODJ�HsQJ\G^]YcIiKb�uÍË hdQTGIS�`IS=QkjF]YU_l�HsJxQ\]R] � SÐo^Hs�IiKS~z�QTG^SV` Q\GIS�Z~ODisHKbCO QTHK]D` SVU\U_]YU � ��� J_QTODU_Q\J�Q\]HK`^LVU\SVODJ\S¢ODWaO~HK`xO~h�QTS=U�OnL=SVU_QTODHK`x`mcIw{�rSVU�]Dh�S=P}]qLNGIJyj�GIHKisS�QTGIS�QTU\ODHK`IHs`IW¿SVU_U\]YUyL=]Y`aQTHK`mcIS=JQT]·b^SVLVU_StODJ_SDu�E�GIHKJ{wxStO~`IJ�QTGIO~Q{QTG^S%`IS=QkjF]YU_l `I]?j�isStODU_`IJ�Q\GIS%J\PrSVL=Hs�CLÎSÐo^ODw�P^iKSVJ�]DhQTG^SB�Ç`I]DHKJ_f ��bCO~QNO�J\S=QVu¿E�GISÈWYS=`ISVU\ODiKHs�tO~Q\HK]Y`�QT]%`^S=jbCO~QTO^z�GI]?jFS=ZDSVUVz/WDS=QTJ¢j�]YU_J\S~unE�G^S`ISpQkj�]YU_l�J_QNO~U_QTJ�Q\]B+¥]?ZYS=U_�IQVÅ©Q\GISgbCO~QTO^¾IL=h�u ".HsWIu Ú u Ú �qu

��� � ��� � � � � ����� � ���O�� ��� ��� �� ����� � �� �� � � � � ������<� ���� �pu ��f�LVisHKLNlmHK`^W%]Y`·QTGIS�J\cIU��hÇODL=SDz©fY]Yc�w�Otf�bISp�C`IS{OxiKSVODU\`IHs`IW3J\SpQdOD`^b�OxZ~ODisHKbCO QTHK]D`ÎJ\S=QVueØ�ODl~S�J\c^U\S»Q\GISgQkj�]�J\S=Q\JODU_Sn]~h;Q\GISgJTODwxS¿J\Hs�VSDzCS~u¥W^usz@��E3Pr]YHs`mQ\J�StODLNG�uFE;ODlDSnO3`IS=QkjF]YU_l%j�HsQTG �ÈGIHsbIbISV`�`IS=cIU\]D`IJOD`Ib�J�QTcIb^f�QTGISÈSpZY]Yisc^QTHs]Y`·]DhFiKStO~U\`IHs`IWÎOD`Ib·Z~ODisHKbCO~Q\HK]Y`�SVU_U\]YU=u�E;ODlDSxOÎJ\w�ODisi;isStODU_`IHK`IWJ_Q\SVP O~`Ib�L=]Y`aQTHK`mcISxiKSVODU\`^HK`IWÎh�]YUgJ\SpZYS=UTODiyQTGI]DcIJTOD`^b�HsQ\SVU\O~QTHs]Y`IJVu�$d]qSVJgQTGIS3Z~ODiKHsbCO~QTHs]Y`SVU_U\]YU�U_HKJ\SgO h�QTSVU�J_]Yw�SdQ\HKwxS �(*)��-)(' �]4E8 ;>A@4ED�4�� 8#0 ;�[]4*A@^ QRA � ='7 ;>0 � ;>V#A@0

º ZYS=U_�IQ_QTHK`^W�]qLVLVc^U\J�HshrQTGISeS=Æ}SVLpQTHsZDS¢`mcIw��}S=UF]Dhrh�U\S=S¢PIODUTODwxS=Q\SVU_J�Hs`xQ\GISe`IS=QkjF]YU\l3HsJ�QT]q]i|O~U\WYS~u�Ëk`�`IS=cIUTO~ir`^S=QkjF]YU\lmJVzRQTGIS¢`qc^w{�}S=UF]~h/PCODU\ODw�SpQTS=U�Hs`ILVU_StODJ_SVJ�j�HsQTGxQTGIS¢`mcIw{�rSVU�]Dh`IS=cIU\]Y`^JdHK`�QTGIS»GIHKbIb^SV`�iKO?fDSVU=u¢��J\HKwxPIisSnP^U\]qLVSVb^cIU\SnQT]%L=]Y`aQTU\]DiXQ\GIS � SÐoRHK�IHsiKHsQkf%]Dh�QTG^S`ISpQkj�]YU_l�HsJXQ\GISVU_S=h�]YU_SFQT]¢QTSVJ�Q.Z~ODU_HK]YcIJX`ISpQkj�]YU_l{ODU_LNGIHsQ\SVLpQTcIU_SVJ;j�H[QTG{b^HsÆ}SVU\S=`aQ�`mcIw{�rSVU;]Dh`IS=cIU\]Y`^JVu�Ë h©QTGISFZDO~iKHKbIO~QTHs]Y`»S=U\U_]YU�HK`^LVU\SVODJ\S=J�LV]Y`^J\HKJ�QTS=`mQ\isfnQT]?j�ODU\bIJ�Q\GIS�SV`^bx]~h©iKStO~U\`IHs`IWIzQTG^SV`·QTGIS�`IS=QkjF]YU\l�HKJ¢Q\]R] � SpoRHK�^iKSDugËk`�Q\GIHKJdLVODJ\S~zMO�J\w�ODisiKSVUe`ISpQkj�]YU_l�j�HsQ\G·O%U\S=bIcIL=SVb`mcIw{�rSVU3]Dh¢`ISVc^U\]Y`IJxJ\G^]YcIiKb7�rSÎQTU\HsSVb�u º ` QTG^S�]~QTGIS=UxGIOD`Ib�z�Hsh�QTG^S�`^S=QkjF]YU\l HsJ{QT]q]J\w�ODisi¡z^Q\GISV`��r]DQ\G�QTG^S»isStODU_`IHK`IW�OD`Ib�Z~ODiKHsbCO~QTHs]Y`ÎSVU_U\]YU¢ODU_S»cI`^`ISVL=SVJ\J\ODU\Hsisf�i|O~U\WYSgO~QeQTG^SSV`^b ]DheisStODU_`IHK`IW^u·E�GIS�]YP^QTHsw�O~iFJ_HK�VS�]Dh�QTGISÎ`ISpQkj�]DU\l HKJ{ODLNGIHKSpZYS=b H[h�ZDO~iKHKbIO~QTHs]Y`�O~`IbiKSVODU\`^HK`IWÈS=U\U\]DU¢O~U\S¿iK]?j5O~h�QTS=U�LV]Y`aZYS=U\WYS=`ILVS»]DhXQTGISgiKSVODU\`^HK`IWÈPIU_]RL=SVbIc^U\SDu

Page 24: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

(*)��-)� /10C: V'DGQRA�7 � QI;>7G4 8 � � 0CQRA�D � B ;>4Eb'b'798#:

��GCOD`^WYHK`IW�QTGIS{`^S=QkjF]YU\l�ODU\LNG^HsQTS=L=Q\cIU\S{U_SVPrStO~Q\SVbIi[f�HsJdO3QTSVb^HK]YcIJ�PIU\]qLVS=bIcIU\S~ugØ�]YU_SV]?ZYS=UHsQ�HKJ{U\O~QTG^SVU{L=]aODU\J_S%HK`�QTGIS%J_SV`IJ_SÎQTGCO~Q{StODLNG�ODbIb^HsQTHs]Y`CODiy`IS=cIU\]D` w�SVOD`IJ{J_S=ZYS=UTODi�`^S=jPCODU\ODwxS=QTS=U\J¢ �� ?ueE�GmcIJ�HsQeHKJe]Dh�QTS=`�`I]~QdLV]Dw�PIisS=Q\SVisf%LViKSVODU�j�GCO~Q�Q\GISn]YP^QTHsw�O~i/`IS=QkjF]YU\lJ\Hs�VSgU\SVODiKi[f�HsJVu�ÍJ\HKwxPIisSVU.j�OtfÈ]Dh � SpoRHK�^HKiKH[QkfnLV]Y`aQTU_]YiCHKJ�WDHsZYS=`3�mfÈOgwxS=Q\GI]qbxLVODiKisSVbÈSVODU\i[f{J_Q\]YPIPIHs`IWIu

EX]Êc^J\SÎQTGIHsJ{wxS=QTG^]Rb�z�jFSÎQNODl~S�O·`IS=QkjF]YU\l�j�GIHKLNG7HKJ�J\iKHsWYGaQTi[fÊQ\]R]·iKODU\WDS%J\]·QTGIO~Q{QTG^SZ~ODiKHsbCO~Q\HK]Y`�SVU_U\]YUnJ_QTODU_Q\J»Q\]�HK`IL=U\SVODJ\S=J{O~h�Q\SVU�J_]YwxSxQ\HKwxS3� u�E�GIS��}S=J_Q{J_S=QÈ]~h¼j�S=HKWYGaQ\JHKJ¿Q\GISVU_S=h�]YU_SxQ\GIS�]D`IS�O Qn� ��OD`IbÊ`I]DQgQTGISx]Y`IS�O~QgQTG^S�S=`Ib�]Dh�iKSVODU\`IHs`IWIuY$dcIU_HK`IWÎQTG^SiKSVODU\`^HK`IW{P^U\]qLVSVJ_J�j�S¿QTG^SVU\Sph�]YU\S¿l~SVS=P�QTG^S¿J\S=Q�]~hXjFSVHsWYGaQTJeO~Q¼� HK`�O{J_SVPCO~UTO~Q\S¿w�S=w�]YU�fYuE�GIS=J\S¼O~U\S�QTGISyjFSVHKWDGmQ\J/j�GIHKLNGnj�Syj�HKisiYLNGI]q]YJ\S�h�]YU/QTG^Sy�I`CODimODPIP^iKHKLVO~QTHs]Y`¿]DhqQTGIS�`ISpQkj�]YU_l©u

$dcIU\Hs`IW�iKStO~U\`IHs`IWeQ\GISFZ~ODisHKbCO QTHK]D`¿SVU\U_]YUXw�Otf � cILpQTcCO QTS�J_iKHsWYGaQTisf�]?ZYSVU.J\S=ZDSVU\ODiRS=P}]qLNGIJ=u� �IU\J_Q.w�Hs`IHKw�cIw#]Dh � ��� w�Otfn�}S�h�]YiKis]?j�S=b»�af�O¢J\S=LV]Y`^b�zabISVS=P}S=U�wxHK`IHsw{cIw5w�cILNG{i|O QTSVUHK`ÊQTGISxiKSVODU\`^HK`IW�PIU_]RL=SVJ\J=u�� L=]YU\U_SVL=Q�cIJ\S�]Dh¼SVODU\i[f�J_Q\]YPIPIHs`IW�Q\GISVU_S=h�]YU_S�U_S*�mcIHKU_SVJnQTGCO~QiKSVODU\`^HK`IW�OD`Ib�Z~ODisHKbCO~Q\HK]Y`3S=U\U\]DU\J¼O~U\S¢j�O~Q\LNGISVb�]?ZYS=U�O�iK]D`IWnQ\HKwxSDuFA/SVODU\`IHs`IW�J_GI]YcIisb%`I]DQ�rSnJ�QT]YP^P}S=b�Q\GIS¿�CU\J�Q¢Q\HKwxS�QTGCO Q�QTGIS¿Z~ODiKHsbCO~Q\HK]Y`%S=U\U_]YU�HK`IL=U\SVODJ\S=JVu

��O~U\isf�J_Q\]YPIPIHs`IW3bI]RS=J�`I]DQ�h�]YU_w�ODisisfxU\S=bIcIL=SnQ\GISg`qc^w{�}S=U�]Dh;h�U_SVSgPCODU\ODwxS=QTS=U\J=u�E�G^SU\SVODJ\]D` HsQnj�]YU_lmJ{HKJgQTGCO Qtz�O~Q»QTGIS��}S=WYHK`^`IHK`IW^zXQ\GIS%`ISpQkj�]YU_l�b^]RS=J{`I]DQnfYSpQÈcIJ\S%ODiKi�QTG^S� SÐo^Hs�IHKisHsQkfÈP^U\]?ZqHKbIS=bÎ�mf3Q\GISdi|O~U\WYS�`mcIw{�rSVU¼]~h/PCODU\ODw�SpQTS=U\JVu.�¼Q¼QTGIS¢�}S=WYHK`^`IHK`IW^zqJ_S=ZDSVUTO~i`IS=cIU\]Y`^J�HK`�QTG^S�GIHsbIbIS=`�iKO?fDSVUniKSVODU\`�ODPIPIU_]to^Hsw�O QTSVi[f�Q\GIS�J\ODwxSxjFSVHsWYGaQnZDSVLpQT]YU=u º `^isfO~h�Q\SVU�J_]YwxS�QTHsw�S�QTGISpf�J_P}S=LVHKODiKHs�VS�QT]{bISpQTS=L=Q�bIH[Æ�S=U\SV`aQFh�StO~Q\cIU\S=JVu �Ff�StODU_isfxJ_Q\]YPIPIHs`IW»jFSQTG^SVU\Sph�]YU\SnLV]D`mQ\U\]Yi}QTGIS � � � � � ����¼`mcIw{�rSVU�]DhXh�U\S=SgPCODUTO~w�SpQTSVU_J�cIJ\S=b��afÎQTG^Sn`^S=QkjF]YU\l©u(*)��-)�� /10C: V'DGQRA�7 � QI;>7G4 8 � � b 0W8#QXD ; � ; 03A�2

& SVWYcIiKODU\Hs�tO~Q\HK]Y`Î�af�PrSV`CO~isQkfÎQTS=U\wxJ�HKJ�PIU\]D�COD�Ii[f%QTGISnwx]YJ_QeJ_fqJ�QTSVw�O~Q\HKL¿j¼Otf�QT]xLV]D`mQ\U\]YiQTG^S � SÐo^Hs�IHKisHsQkf�]Dh.Q\GIS�`ISpQkj�]DU\l©u�E�GIS�HsbIStO3HKJ�QTGISnU\S=PIi|O~LVSgQTGIS»J\HKwxPIisS �qcIODbIUTO QTHKLnSVU_U\]YUh�cI`ILpQTHs]Y`ÎQTGCO~Q�jFSgGCOtZYSncIJ\S=b�StO~U\iKHsSVU¼�af�OÈ`ISpj#SVU_U\]YU�L=U\HsQ\SVU_H|O

. ÚÁ 6

� ��� � 8 � ����� ��� � � � ����� PrSV`CO~isQkf���£ � Ú u��IE �E�GISdSÐoqQTUTO�Q\SVU_w ��j�GIHKLNGÎHsJ�J_P}S=LVHs�ISVbÎ�rSViK]?j ��HKJFHK`aQTS=`IbISVb%Q\]{PrSV`CODisHK�=S¢J_]YiKc^Q\HK]Y`^J�j�GIHsLNGODU_S�QT]q] � SpoRHK�IisSDu�E�GIS�SVU\U_]YU»h�c^`IL=Q\HK]Y` � Ú u��IE �¿bISVPrSV`^bIJ{]Y`ÊQTGIS�PCODUTO~w�SpQTSVU � OD`Ib O~J�rS=h�]YU_Sn]D`�Q\GIS¿Z~ODiKcIS¿]~h.QTG^SgjFSVHsWYGaQTJ�  � �� uJ¢]?jÍLtO~`xjFS¢LNGIODUTODLpQTS=U\HK�=S¢J_]YiKcRQTHK]D`IJ�j�GIHKLNG�ODU\S�QT]q] � SpoRHs�IiKS ��Ëk`�h�c^`IL=Q\HK]Y`xODPIP^U\]tom�HKw�O~Q\HK]Y`�j�HsQ\G � ��� �\� ��� � � Ë & j�S�LV]YcIisb�WYH[ZYSÈO�PrSV`IODisQkf�QT]�J\]Yisc^QTHs]Y`IJ¢j�H[QTG�G^HKWYG�Z~ODiscISVJ]DheLVc^U_Z~O~QTc^U\SDu·��WY]R]qb LNGI]DHKLVS�]Dh�QTGIS�P}S=`CODisQkfÊQTS=U\w j�]DcIiKb Q\GISVU_S=h�]YU_S%�}S�QTGIS%wxStO~`�mcCODbIU\O~QTHsLÈLVcIU�Z~O~QTcIU_S��MÀÂ� � ��������� �Ä�I� ��� � � à � �I� ��� j�GISVU_SxQ\GISÈHK`aQ\SVWYU\ODi�U\c^`IJ¿]?ZYSVU¿Q\GIS3PCODU_Q]DhXQTGISgHs`IPIc^QeJ\PIODLVS¿QTGIO~Q�j�SnODU_SnHs`aQTSVU_SVJ�QTSVb�HK`�uËk` LtODJ_S%]Dh�`^SVcIU\ODiF`^S=QkjF]YU\lmJ{j�HsQ\G GIHsWYGR�kb^HKwxSV`IJ_HK]Y`CO~i�HK`IP^c^Q�bIO~QNO^z;QTGIS�LVcIU�ZDO QTcIU_S

wxStODJ_cIU\S�HKJ.`I]DQyJ\]gSVODJ_f{Q\]gGCOD`IbIisSDu ��c^Q�jFSew�Otf H_cIJ�Q�ODJ�j�S=iKi^QTODlDSeOdbIH[�S=U\S=`mQ�PrSV`CO~isQkf

Page 25: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

E

E

E learn

val

(1/λ∗)10 −2 10 3 (1/λ)������� Ú u Ú �^� A/SVODU\`IHs`IW�OD`Ib·Z~ODiKHsbCO~Q\HK]Y`�SVU_U\]YUgODJgO%h�cI`^L=QTHs]Y`·]Dh�QTGISÈU_SVWYc^i|ODU_HK�tO QTHK]D`�PCO �UTO~w�SpQTSVU � uQTS=U\w�u��ÉP}S=`CODisQkf�QTSVU_w�j�GIHsLNG�HsJ�StODJ�f%QT]xcIJ\SgHsJ

PrSV`IODisQkfC. ÚÁ 6���   � �� � � £ � Ú u�� Ú �

E�GISnJ\cIw J�QNODU�QTJeO~Qe� . Ú � ) . Ú � � . Ú OD`Ib�U\c^`IJ¢]?ZDSVU¢ODiKirj�S=HKWYGaQTJeHK`�ODisi�i|OtfDSVU\J=uFE�G^SJ\c^w�w�O~QTHs]Y` bI]qSVJ3`I]DQ3Hs`ILViscIbIS%Q\GISÎQTGIU_SVJ\G^]YiKbIJ@��j�GIHKLNG7j�]DcIiKb�LV]YU_U\S=J\Pr]Y`Ib7QT]�QTSVU_w�Jj�HsQ\G�Hs`IbIHsLVSVJ�  � ��

�L �Ðu

E�GIS¼wx]DQTH[ZDO QTHK]D`»�rSVGIHs`IbB� Ú u�� Ú �XHsJ;QTGIO~Q�OdJ_]YiKc^Q\HK]Y`nj�HsQ\G{iK]DQ\J.]Dh©L=cIU_Z~O~Q\cIU\S�LtOD`È]Y`^isf�rSxL=]Y`IJ�QTU\c^L=QTS=b�j�HsQ\G�iKODU\WDS�j�S=HKWYGaQnZ~ODiKcIS=JVuY �cI`IHsJ\GIHs`IW�iKODU\WDS{j�S=HKWYGaQTJ¿j�HsiKi.Q\GISVU_S=h�]YU_SLV]D`mQ\U\]YiYQ\GIS�S=Æ}SVL=Q\HsZDS � SpoRHK�IHsiKH[Qkf�]DhRQTGISy`ISpQkj�]DU\l©u º `nQ\GISy]DQTG^SVUMGCOD`Ib�z Q\GIU\S=J\GI]YisbnZ~ODiscISVJ]Y`Ii[f�J\GIH[h�QgQTGIS��IH|ODJnOD`^b�J\G^]YcIiKbÊQTGIS=U\Sph�]YU\S��}S3QTU_StO~Q\SVb�b^HsÆ}SVU\S=`aQTisfDuBAMODU\WYSÈQ\GIU\S=J\GI]YisbZ~ODiKc^SVJ¿ODU_S»Q\GISVU_S=h�]YU_S{`I]DQ�P}S=`CODiKHs�VS=b�udË QdLVOD`·�rS�J\G^]Aj�`·Q\GCO~Q�h�]DU�iKHs`IStO~U¢]YPRQTHKwxHK�VO~QTHs]Y`PIU_]Y�IiKS=w�J ��QTGCO Q�HKJ=zYQTGIS�S=U\U\]DU�HKJ#�mcCODb^UTO~Q\HKL�HK`{Q\GIS�j�S=HKWYGaQ\J���O¿P}S=`CODi[Qkf�QTS=U\w � Ú u�� Ú �.O~`IbStO~U\isf%J_QT]DPIPIHK`^W�O~U\S¿S*�mcIH[Z~ODiKS=`mQVuE;]�w�Hs`IHKwxHK�=S � Ú u��IEI�%jFSÊw�Otf*cIJ_S�WYU\ODbIHsSV`aQ�bISVJ_LVSV`aQVz �   � �� 4 . 8 ��� �D�a  � �� 4 uE�GISÈbIS=U\H[ZDO QTHsZDS»]~h�QTGIS��IU\J_Q�QTSVU_w�Hs`;� Ú u���E �eWYH[ZYS=J�QTGIS»J_QTOD`IbCODU_b�QTS=U\w½QTGCO~Q�GCODJd�rSVS=`bIHsJ\LVc^J\J\S=b PIU_S=ZqHK]Yc^J\isf HK` QTGIS�LV]D`mQ\SpoqQ�]Dhd�CO~LNlqP^U\]YPCO~WaO~QTHs]Y`�u7E�GIS�bISVU_HsZ~O~Q\HsZYS�]DheQTG^S

PrSV`CODi[Qkf%QTS=U\w � Ú u�� Ú ��HKJ�  � �� 4 u�E�GIS»`^S=j#isStODU_`IHK`^WÈU\cIisSnHsJ¼QTGIS=U\Sph�]YU\S�   � �� 4 . � J�QNOD`^bCODU\bRQTSVU_w � 8 � �   � �� 4 � Ú u��aÁI�j�GIHsLNG�HsJ¼QTGISg]YisbÎiKStO~U\`IHs`IWÈU\cIisS¿PIiKc^J�O �9�� � �� �� �����Q\SVU_w�u�E�GISgPrSV`CO~isQkf�Q\SVU_w � Ú u�� Ú �HKJ¼Q\GISVU_S=h�]YU_S»LVODiKisSVbÎU_SVWYcIiKODU\Hs�tO~Q\HK]Y`��mf�j�S=HKWYGaQebISVLVOtfYuE�GIS¢PrSV`IODisQkfÈQ\SVU\w � Ú u�� Ú �;h�]qLVcIJ_SVJ�]D`xQ\GIS¢wxStO~`��mcCODb^UTO~Q\HKL�j�S=HKWYGaQVu�AMSpQ�c^JFbIS=`I]DQ\S

QTG^S3Q\]DQNO~i�`mcIw{�rSVUg]Dh�j�S=HKWYGaQTJn�af���u3� P}S=`CODi[Qkf�QTS=U\w � Ú u�� Ú �¢bI]qSVJg`I]DQnbIHsJ_Q\HK`IWYc^HKJ\G�rS=QkjFSVSV`*O�J\H[QTcCO QTHK]D`�j�GIS=U\S�ODiKi¼jFSVHsWYGaQTJxGCOtZYS�QTGIS�JTODwxS�iK]?j�Z~ODiscIS�]Dh Ú ��� � O~`IbOD`I]~QTGIS=U»]Y`^Sxj�GIS=U\S�O�J_HK`IWYisSÈj�S=HKWYGaQnGCODJ»O�Z~ODiscIS3]Dh Ú OD`Ib�ODiKi.Q\GISx]DQTGIS=U\J»ODU\Sx�VS=U\]IuËk`�hÇO~L=Qtz;HK`�QTGISxi|O Q\QTS=UgLtODJ_S�ODisi�j�S=HKWYGaQ\J»j�GIHsLNG ODU_S��=SVU\]�LV]Yc^iKbÊ�}SxU\S=w�]?ZYS=b�j�HsQ\GI]Yc^QLNGCOD`^WYHK`IW¿Q\GIS�U\S=J\cIi[Qtu�Ë QyHsJ.QTGIS=U\Sph�]YU\SeODU_WYcISVbÈQ\GCO~Q�QTG^S�`qc^w{�}S=U�]Dh}PCODUTO~w�SpQTSVU_J�cIJ_SVb��af

Page 26: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

QTG^S¢`ISpQkj�]DU\l3HK`ÈQTG^S¢J_SVLV]D`Ib�LVODJ\SeHKJyJ\w�ODisiKSVU;QTGCOD`xQTGIS�]Y`^S¢Hs`3Q\GIS��CU\J�QFLVODJ\S~u�E�GISVU_S=h�]YU_SQTG^S¿P}S=`CODisQkf3h�]YU¼O�GI]Ywx]YWYS=`ISV]Yc^J�j�S=HKWYGaQ�bIHsJ_Q\U\HK�^c^QTHs]Y`�J_GI]YcIisb%�}S�i|ODU_WYSVU�QTGCOD`%Q\GISd]Y`^Sh�]YU�O3bIHKJ�QTU_HK�Ic^Q\HK]Y`�j�HsQTG�J\SpZYS=UTODiM�VS=U\]~�¡j�S=HKWYGaQ\JVuy� QTSVU_w�j�GIHsLNG�bI]qSVJ�Q\GIHKJ�HsJ

PrSV`CODi[QkfC. 6 �   � �� � �

¨ �   � �� � � � Ú u��\� �ODJeLtOD`��rS»LNGIS=LNlDS=b·�mf�J_]YwxSnSÐo^ODw�P^iKSVJ=u�E�GISnPCODU\ODwxS=QTS=Ue¨dHKJeOÈP}]YJ_HsQ\HsZYSgL=]Y`IJ_QTOD`aQtuF�PrSV`CODi[Qkf�Q\SVU_w ]Dh�QTGIS�h�]DU\w � Ú u��\� �gHKJ»LtODisiKSVb �9�� � �� ���O

���<��� ���Cu�E�GIS�`CODwxS�LV]Dw�S=J

h�U\]Dw�QTG^SÈHKbISVOÎQ\GCO~QdjFSVHsWYGaQTJ¿j�GIHsLNG�ODU_SÈLVis]YJ\S{Q\]Î�VSVU_]�L=]YcIisb·�}SÈS=iKHKwxHK`IO~QTS=b�J\]�ODJdQ\]U\S=bIcIL=S�QTG^SxQ\]DQNODi�`mcIw��}S=Un]~h¼PCODU\ODwxS=QTS=U\Jn]Dh�QTGISx`IS=QkjF]YU_lru�Ø�S=QTG^]RbIJgj�GIHsLNG�U\S=w�]?ZDSjFSVHKWDGmQ\J�]YUg`IS=cIU\]D`IJ�O~U\SxJ\cIwxw�O~U\HK�=SVb�cI`Ib^SVUgQTGIS3QTH[QTiKSÈ]~h¼PIU_cI`IHK`^W�ODisWY]YU_HsQTG^w�J=uxE�G^SPrSV`CODi[Qkf QTS=U\w � Ú u��\�I��HKJVzFGI]?j�SpZYS=UVz�cIJ\Sph�cIi�S=ZDSV` H[h�L=]Y`I`IS=L=QTHs]Y`IJxj�HsQTG�J\w�ODisi�j�S=HKWYGaQ\JODU_S�`I]DQ�U\S=w�]?ZDSVb�u*E�GIS�PrSV`IODisQkf Q\SVU\w L=]Y`aQTU\]DiKJ�ODJ�c^J\cCODi�QTG^S � � � � � ����È`mcIw{�rSVU�]DhPCODU\ODwxS=QTS=U\J��}O�U\S=bIcIL=Q\HK]Y`n]DhqQTGIS�Q\]DQNODi~`mcIw{�rSVUM]DhRPCODUTO~w�SpQTSVU_JM�mfdPIGafRJ_HKLVODiKi[fdU\S=w�]?ZqHK`^WQTG^SnL=]Y`I`IS=L=Q\HK]Y`�HKJ�`I]~Q¢`^SVLVS=J\J\ODU_fDu��iKi¿U_SVWYc^i|ODU_HK�tO QTHK]D`ÌQTS=U\wxJ�ODU_S�O~bIbISVb j�HsQ\G5O7PCODU\ODw�SpQTS=U � u�E�GIS�LNGI]YHsLVSÊ]Dh �LV]D`mQ\U\]YisJÎQTGIS � SpoRHs�IHKisHsQkf ]~h»Q\GIS�`^S=QkjF]YU\l©u"Ëk` ]YU\bIS=UÎQT]�]YP^QTHsw�Hs�VS � jFS�LVOD`5c^J\S�OwxS=QTG^]Rb L=]YwxPIiKSpQTSVi[fÊOD`CODis]YWY]Yc^JnQ\]�QTGIS�]Y`IS%cIJ_SVb h�]YU»StODU_isfÊJ_Q\]YPIPIHs`IWIu,%�S%wxStO~J\cIU_S

QTG^SxisStODU_`IHK`^W�S=U\U_]YUgOD`Ib�QTGISÈZ~ODisHKbCO~Q\HK]Y`�SVU\U_]YUdh�]YUgbIH[Æ�S=U\SV`aQ¿Z~ODiscISVJg]Dh � u$"C]YU¿SVODLNG �jFS¢J�QNODU�QyiKStO~U\`IHs`IWdj�HsQ\Gxb^HsÆ}SVU\S=`aQyHK`IH[QTH|O~iKHK�VO~QTHs]Y`IJMOD`^bxj�ODHsQ�Q\HKisiqQ\GIS�iKStO~U\`IHs`IW¿PIU\]qLVS=bIcIU_SGCODJ¿h�cIisisf�LV]Y`aZDSVU\WDSVb�uxE;U\ODHK`^HK`IWÎO~`IbÊZ~ODisHKbCO QTHK]D`�SVU_U\]YU_JnODU\SÈPIis]DQ\Q\SVbÊODJgO%h�cI`ILpQTHs]Y`�]DhÚ � � u�Ëk`�O¿J\SV`^J\SDz Ú � � P^i|OtfqJyQ\GISeU\]YisS¼]Dh�Q\GIS�`mcIw{�rSVUy]Dh�S=P}]qLNGIJyHK`3SVODU\i[fÈJ_Q\]YPIPIHs`IWIu "C]YUi|O~U\WYS � QTGIS»`IS=QkjF]YU\l�w�ODHK`Ii[f�Q\U\HKS=JeQ\]�wxHK`IHsw�Hs�VS�Q\GIS�PrSV`IODisQkfÎQ\SVU\w&OD`^b�GCODU_bIisf�LVODU\S=JOD�r]Yc^Q»QTGIS�bCO~QNORu@"C]YUnJ\w�ODisi � z;Q\GIS�`^S=QkjF]YU\l�HKJgQT]q] � SÐo^Hs�IiKS�OD`Ib�]AZDSVU��IQTJ{Q\GIS�bCO QNO^uE�GIS»iKStO~U\`IHs`IWÈSVU_U\]YU�HKJ�J_w�ODisi¡zI�^c^Q�QTGISgZ~ODiKHsbCO~QTHs]Y`%S=U\U\]DUeiKODU\WDSDu�E�GIS»]DP^QTHsw�ODirZ~ODiKcIS � HKJ�O QeQ\GISgw�Hs`IHKw�cIw ]Dh;Q\GIS¿Z~ODiKHsbCO~QTHs]Y`%S=U\U\]DUVu

��� � ��� � � � � ����� �����O�� ��� ���?�� ��� � � �� �� � � � � ������<� � ��� � � & SVPrStO~Q�QTGISÊPIU_S=ZqHK]Yc^JSpoRS=U\LVHsJ\Sn�Ic^QeHK`^LViKc^bISgOÈ`I]Y`R� �VSVU_]xjFSVHsWYGaQebISVLVO?fÎhÇO~L=QT]DUVu(*)��-)�� �?7GB � V#B B>7G4 8

Ëk`�ODiKi/O~PIPIiKHsLtO~Q\HK]Y`^JVzq`ISVcIU\ODi/`ISpQkj�]YU_lmJ¢j�HKisi��rS¿cIJ\S=b�]Y`�`ISpj bCO~QTO{j�GIHKLNG�ODU\S¿`^]DQePCODU_Q]Dh/Q\GISdbCO~QTO{�CODJ_SDu�E�GIS¿U_SViKSpZ~OD`aQ¼PrSVU_h�]DU\w�OD`ILVS¢w�SVODJ\c^U\SdHsJFQTG^SVU\Sph�]YU\S�`I]DQ¼Q\GIS�QTU\ODHK`^HK`IWSVU_U\]YU=z��Ic^Q{Q\GIS�Z~ODisHKbCO~Q\HK]Y`ÊSVU_U\]YU=u ��ZYSV`7QTG^SV` HsQ�w�Otf��}S%ODU\WYc^SVb QTGIO~Q�Q\GIS%bCO~QTO�J\SpQ� � ]Y`�j�GIHKLNG�QTGISgZ~ODiKHsbCO~QTHs]Y`ÎSVU_U\]YUeHKJ�wxStODJ_cIU\S=b�HKJ�`I]~Q�L=]Yw�P^iKS=Q\SVi[fÎ`IS=jgzrJ\Hs`ILVSnHsQeGCO~JODisU\StO~b^f��}S=SV` cIJ_SVb Q\]�]YP^Q\HKwxHK�=S�Q\GIS�PIODUTODwxS=Q\SVU � ]~hdQTGIS�U\SVWDcIi|ODU_HK�VO~QTHs]Y` QTSVU_w ]YUVzJ\Hsw�Hsi|ODU_isfDzmQ\GISgJ_Q\]YPIPIHs`IWÈQTHKwxSdh�]YU�SVODU\i[f%J_Q\]YPIPIHs`IWIuË Q�]YU\bIS=U�QT]xGCOtZYS»O3PrSVU�h�]YU\w�OD`IL=S¿w�SVODJ\c^U\S¿j�GIHKLNG�HKJeOD�^J\]Yisc^QTS=isf%`^SVc^Q\UTODiÄzIHsQ�jF]YcIisb

QTG^SVU\Sph�]YU\S��rS�`IS=LVSVJ_JTODU�fÈQT]¿J_PIiKH[Q�QTGIS�bIO~QNOd�CO~J\S ��Hs`aQT]�Q\GIU\S=SePIODU_Q\JVza]Y`IS¼h�]DU�iKSVODU\`IHs`IWIzDOJ\S=LV]Y`^b�]Y`ISdh�]DU¼ZDO~iKHKbIO~QTHs]Y`�zqOD`Ib�O{QTGIHsU\bÎ]Y`ISdh�]DU¼QTSVJ�QTHs`IWIu�E�GIHsJeHsJVzIG^]AjFS=ZDSVU=z}OÈiscRoRcIU_fj�GIHsLNGxLVOD`È�rS�O~Æ}]YU\bIS=bÈ]Y`Ii[f»H[hCQTGIS�bCO~QNOd�IODJ\S�HsJ;ZYS=U_f�i|ODU_WYSDzYS~u¥W^uszYJ_S=ZDSVUTO~iIQTGI]Yc^JTOD`Ib^J�]Dh

Page 27: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

JTO~w�PIisSVJ=u�Ëk`�PIU\ODL=Q\HKLVS~zIQTGISg`mcIw{�rSVU�]Dh.Spo^ODwxPIiKS=J�HKJ�UTO QTGIS=U¼QT]q]xJ_w�O~iKi�Q\GCOD`�QT]q]xiKODU\WDSDuE�GIS=`�S=ZDSV`�OÈJ\SVPIODUTO~Q\HK]Y`�]DhXQTG^S¿bCO~QNOÈ�CO~J\SgHK`aQT]{QkjF]xPCODU_Q\J�HKJ¼bIH 'xLVcIi[Qtu�E�GIS��mcISVJ�QTHs]Y`ODU_HKJ\S=J�]Dh�GI]?j*w�OD`af3]Dh�QTGIS¢JTODwxPIiKS=JFJ_GI]YcIisb%�rS¢U_SVJ\S=U_ZDSVbÎh�]YUyQTGISeZDO~iKHKbIO~QTHs]Y`ÈJ\SpQtu�Ë Q¼HsJVz]Dh�LV]DcIU\J_SDzM`I]DQg`IS=LVS=J\JTO~U_f·QT]Îl~SVS=P�GCO~ishy]DhyQTG^SÈbCO~QNO%h�]YU¢ZDO~iKHKbIO~QTHs]Y`�z©�Ic^QgGI]?j�w�O~`mf �E�GIHsJ�HKJgbIH 'xLVcIi[Q»Q\]�bIS=LVHsbISDu�Ëk`�Q\GIS�SÐoqQTU\S=w�S�LtODJ_SDz.jFS�w�Otf�]YP^Qnh�]YU»O�QTODlDSÐ�k]Y`ISÐ�k]YcRQLVU_]YJ\J�� Z~ODisHKbCO~Q\HK]Y`�u º `ISe]Dh�Q\GIS¢J\ODwxPIiKS=JFHsJ�P^HKLNlDS=b�h�]YUyZ~ODiKHsbCO~QTHs]Y`�z QTGIS¢U\SVw�ODHs`IHK`IW 8 ÚODU_S�c^J\SVb�h�]YUÈQTU\ODHK`IHs`IWIu E�G^S�Q\UTODHs`IHK`IW�PIU\]qLVS=bIcIU\S�HKJ3U_SVJ_QTODU_Q\SVb �QTHsw�S=JVz�StODLNG�QTHsw�Sj�HsQ\GÊO�b^HsÆ}SVU\S=`aQgJTODwxPIiKS�HK`�QTG^S3Z~ODisHKbCO QTHK]D`�J\SpQtu3vqcILNG�OÎL=U\]YJ_J�� Z~ODisHKbCO QTHK]D`�PIU\]qLVS=bIcIU_SHKJ�c^J\S=h�c^iMh�]DU¼ZYSVU�f�J\w�ODiKi}bCO~QTOxJ_S=QTJ=u

®3¯�� Ñ�¶·³�²���Ö¿³ ��ÖdÓ{µ·¹t±&%

E�GISn�}]q]Yl%]~h ��HsJ\GI]DP À �DÃMSVwxPIGCO~J\HK�=SVb�QTGISnU\S=i|O~Q\HK]Y`Î]~h.J_cIP}S=U_ZqHKJ_SVb�isStODU_`IHK`^WÈHK`�"¢S=cIUTODi"¢SpQkj�]DU\lmJVu�Q\]�LViKODJ\J_HKLVODimJ_QNO QTHKJ�QTHsLtODiawxS=Q\GI]Rb^J;j�GIHsLNG{ODU_S�cIJ_SVb{Hs`»QTG^S�LV]D`mQ\SpoqQ�]~hCPCO~Q_QTSVU_`U\S=LV]YWD`IHsQ\HK]Y` PIU_]Y�IisSVwxJVu ��JxO��CU_J_QxHK`aQTU_]Rb^cIL=Q\HK]Y` Q\] "eSVcIU\ODi "¢SpQkj�]DU\lmJxQ\GIS��}]q]Yl�]Dh& ]�H\ODJ�À �~ÃFLtOD` �rS%U\S=LV]Ywxw�OD`IbIS=b�h�]YU�H[QTJ{c^J\S%]Dh�WDUTODPIG^HKLtO~iFHsiKiKc^J_QTU\O~QTHs]Y`IJ¿j�GIHsLNG GISVisPQTG^S{U\SVODbISVU¢QT]�ZqHsJ\cCODisHK�=SnQ\GIS�QTG^SV]YU_SVL=Q\HKLVODi;L=]Y`IL=SVP^Q\JVu¿��L=]YwxPIU\S=GISV`IJ_HsZDS{QTU\SVO~QTwxSV`aQ�]Dh"¢S=cIUTO~iI"eS=QkjF]YU\lmJdHsJ¢WYH[ZYS=`�HK`�QTGIS»�}]q]YlÎ]Dh J�OtfqlmHK`7À J ÃÄu�E�GIS{`I]?j L=i|ODJ_J\HKLVODi/QTSÐoRQ\�}]q]Yl]Dh J¢S=U_QT�~z��gU_]YWYG�zIOD`Ib .ODisw�S=UgÀ P ÃMHKJ�J_Q\HKisi�GIHsWYGIisf�U\S=LV]Ywxw�OD`IbCOD�^iKSDu

;SV]DPIiKS�j�GI]¿ODU_S�HK`aQ\SVU\S=J_Q\SVbÈHK`»QTGISFGIHKJ�QT]YU�f»]~hIQTGISF�CSVisb{J\GI]DcIiKb»LV]Y`IJ_cIisQ�Ø�HK`^J\laf{O~`Ib .O~P}S=U_QnÀ �AÃ�ODJFjFSVisi�O~JFQTG^S�LV]DiKiKS=L=Q\HK]Y`IJ�]Dh/L=i|ODJ_J\HsLtODi©PCODPrSVU_J¿À Ú ÃÄz/À �~áu.E�GISd]YU_HKWYHs`CODiIPCO~P}S=U]Dh & ]YJ_SV`m�Ii|O Q\QF]Y` XSVU\L=SVP^Q\U\]Y`^J�OD`IbxQTGIS¢]Y`ISe]Dh/%*HKb^U\]?j*OD`Ib J¢]DÆ�]Y`��#$�� A/ËG" � O~U\SDzh�]YU»Spo^ODwxPIiKS~z.U\S=PIU\Hs`aQTSVb�HK`ÍÀ Ú ÃÄu�E�GIS *$' .� �}]q]Yl·J\G^]Aj�J»QTGIS%S=`aQTGI]Yc^J\H|O~J\wÙ]Dh�`IS=cIUTODi`ISpQkj�]YU_l3U\SVJ_StODU_LNG�Hs`3Q\GIS�SVHsWYGaQTHKS=J¢À Ú EAáu.��`x]AZDSVU�ZRHsS=jÍ]~h�QTG^SeJ�QNO~Q\S�]Dh}Q\GISeODU_Q�]Dh}`IS=cIUTODi`ISpQkj�]YU_lmJ�ODJ�w�]qbISVisJ�]Dhy�^HK]Yis]YWYHKLVODi/PIGIS=`I]YwxSVw�O%HKJ¢WYHsZDSV`·HK`�QTGIS�J¢OD`IbI�r]R]Dl�]Dhy�^UTODHs`QTG^SV]YU�fÉÀ �~áu���isi¢]DhgQ\GIS·LVH[QTSVb*�r]R]DlqJ�LV]Y`aQNO~HK`ÍSpoqQ\SV`IJ_HsZYSÊiKHsJ_Q\J�]DhnU\Sph�SVU_SV`IL=SVJ�QT] QTG^S]YU_HKWYHs`CODi�isHsQ\SVUTO QTcIU_SDu

Page 28: = g( - lcn.epfl.ch · xi = g(Σ j wijxj − ϑ ) dendrite synapse electrode spike train output summation of inputs threshold (nonlinearity) transmission of output rate T soma axon

� ��� !��;�½�&� ��� ���

����� �������������������������! ����"���$#%�'&(�*)��'�$+�,"���-�'.0/21�3$4"576-598�:;3$<>=@?BA�CEDF5G3$?IH�JG<K=L5G?�MN5POQ4"1M�1�JG4"6�RB.0SUTPVXWY �-�'�-��)�ZX�9[N\��-+(�$]��QSU���-��.()*�'^�_�_�.

� `a���cb��'�"d$���ade�9f�f�&�+hg��9,"+(�����0�9#Fij��k����9&Ii��,PlX���-m$��.on$fp�7g+h�9&I+(�-��k���.qTr�ts-ucucuwv�4"JG?�M�J�6�<>=L59?�Mx=@?y/N13$4-JGz/21�<>{0594"|aM})�b���&(k�[~��_�)$f��9]��'��_�`��7�$^�����)��7^�^B�B.

� �G��S�.���.I���-\�+(\q.Nv;R�1QR�J9?IH���575'|�5�O2�4-JG=@?�<%R�1�594}�tJG?;H�?I1�3$4"J9zq?I1�<>{0594"|aM}.0SUTPV Y �-�'�-�')pZX�9[2\��"+h�$]���)SU��)q�7^�^��$.� �9��Zx.�S�.��X+h������fq.c/21�3$4"JGzI/21�<>{0594"|aMcO5G4x��JG<K<�1�4}?��x1-6�5-A9?p=@<>=L59?�.0Z�&h�9�-�����$��� Y �"�7�"�')��j�B#%�����*)*�'^�^��$.� �a��n;.��j�adBmB+(�q.c/21�3$4"JGzp/N1<K{05G4"|GM}. Y �-����,"+hg�Q�x�9&(&>)��jf�fp�'�xn$�����$&(�� �+�b����7)$ijp)q�'^�^9��.� �G����j���","��)c�����"��]��q)�������  � Y ��&�[~���7.�s}?p<>4-5'H93�6<K=L5G?¡<r5U<%R�1�<%R�1�5G4}�¢5POt?I1�3$4"JGzE6�5G8j:I3$<rJG<K=L5G?�.

�j���$+h�"���$W�£��7��&(��d�)� ��7�$l��B�$��Z�+¤,Pd�ZX�2)q�'^�^���.�¥�7��S�.�¦c.pS�+��p��mBdy������n;.���. Y ��fp�'��,7.0��14-6-1r:I<K4"59?�M}.cS�TPV Y �-�'�-��)�ZX�9[N\��-+(�$]���S����-��.()*�'^���^�.� _G���e. Y �9&([�.c§�4"J9=@?¡v;R�1�5G4}�G.EnBf��-+���]����7)$�X���-&�+(�q)q�7^�_���.� ^G�� Q.� ��9¨�����.�/21�3$4"J9zI?;1<K{05G4"|GM�C�JeM}�aM�<r1�8~J9<>=L62=@?�<K4"57HG3�6�<>=L59?�.�nBf��-+���]����7)$���'�"&(+(�q)����'+(�$�'&�\I���-]�);�7^�^���.���'©G��ª2.E��.X �k�[~��&(���9���*)jp. ¦c.�S�g7Z�&(��&(&(�����*)��9�p�!,"��� Y ª Y �"�7���7�9��g��«]��"��k�fq.¬��J94"JGz@z�1�z�HG=hM}<K4}=L�3$<r1�H

:I4"576�1}M�M}=@?�A�C�u�­:;z�5G4"J9<>=L59?�M�=@?®<%R�1�8e=L64-5aM}<>4}3�6�<K3$4"1�5PO�6�5"A�?�=@<K=L5G?;¯�°p5Gz(¯x±�C�DF5G3$?IH�JG<K=L5G?�M�.¡S�TPVY �-�'�-��)�ZX�9[N\��-+(�$]��QSU���-��.()*�'^�_���.

������t²2.�²c��f���+(mI.Nv;R�1�/NJG<K3$4"125�O�³p<rJG<K=hM}<>=L6�JGz;´o1�JG4}?p=@?�A¢v;R�1�5G4}�G.EnBf��-+���]����"WK²��'�"&h�9]p)�ij��l¶µc���-m;)*�'^�^��$.

Á �