[IEEE ICASSP 2014 - 2014 IEEE International Conference on Acoustics, Speech and Signal Processing...

5
A DISTRIBUTED CONSENSUS PLUS INNOVATIONPARTICLE FILTER FOR NETWORKS WITH COMMUNICATION CONSTRAINTS Arash Mohammadi and Amir Asif 5@1BD=5>D ?6 <53DB931< >79>55B9>7 1>4 ?=@ED5B '395>35 -?B; )>9F5BC9DI (?B?>D? $# 1>141 " % =19<{=1B1C8 1C96}3C5I?B;E31 ABSTRACT "?D9F1D54 2I D85 @B?2<5= ?6 49CDB92ED54 C97>1< @B?35CC9>7 9> C5> C?B >5DG?B;C D85 @1@5B 3?>C945BC D85 75>5B1< @B?2<5= ?6 CD1D5 5CD9 =1D9?> 9> 75?7B1@8931<<I 49C@5BC54 CICD5=C G9D8 >?><9>51B 4I>1= 93C ?@5B1D9>7 9> 1> E>35BD19> 5>F9B?>=5>D G9D8 3?==E>931D9?> 3?> CDB19>DC 9CDB92ED54 @1BD93<5 <D5B 9=@<5=5>D1D9?>C EC54 1C >?><9>51B CD1D5 5CD9=1D?BC 9>DB?4E35 1> 1449D9?>1< 3?>C5>CEC CD5@ G8938 =ECD 3?>F5B75 D? 13895F5 3?>C9CD5>D F1<E5C 6?B <?31< 5CD9=1D?BCN CD1D9CD93C 9> 25DG55> DG? 3?>C53ED9F5 <D5B 9D5B1D9?>C (85 >E=25B ?6 3?> C5>CEC 9D5B1D9?>C @5B 3?>C5>CEC BE> 9C 8978 CE38 D81D D85 3?>C5>CEC CD5@ =1I >?D 3?>F5B75 9> 25DG55> DG? <D5B 9D5B1D9?>C 5C@5391<<I 9> >5DG?B;C G9D8 9>D5B=9DD5>D 3?>>53D9F9DI (? B54E35 D85 3?>C5>CEC <9129<9DI G5 @B?@?C5 1 3?>C5>CEC @<EC 9>>?F1D9?> 21C54 49CDB92ED54 9=@<5=5>D1D9?> ?6 D85 E>C35>D54 @1BD93<5 <D5B ()%) G8938 5HD5>4C D85 <9>51B 3?>C5>CEC 1>4 9>>?F1D9?> 6B1=5G?B; D? >?><9>51B 49CDB92ED54 5CD9=1D9?> (85 )% 4?5C >?D B5AE9B5 D85 3?>C5> CEC CD5@ D? 3?>F5B75 1>4 9C CE9D54 6?B 5>F9B?>=5>DC G9D8 9>D5B=9DD5>D 3?>>53D9F9DI > ?EB "?>D5 1B<? C9=E<1D9?>C D85 @5B6?B=1>35 ?6 D85 )% 6?<<?GC D81D ?6 9DC 35>DB1<9J54 3?E>D5B@1BD 5F5> G9D8 1 <9=9D54 >E=25B ?6 3?>C5>CEC 9D5B1D9?>C @5B 3?>C5>CEC BE> Index Terms?>C5>CEC @B?D?3?<C +9B5<5CC C5>C?B >5DG?B;C 9CDB92ED54 5CD9=1D9?> >D5B=9DD5>D 3?>>53D9F9DI 1>4 %1BD93<5 <D5BC 1. INTRODUCTION +945C@B514 45@<?I=5>D ?6 C5>C?B 175>DC 81C B5F?<ED9?>9J54 ?EB 129< 9DI D? =?>9D?B @8IC931< 5>F9B?>=5>DC #?D ?><I 4? D85C5 C5>C?BC ?2C5BF5 1> 5>F9B?>=5>D 9>45@5>45>D<I D85I @B?35CC =51CEB54 41D1 <?31<<I 1>4 3?<<12?B1D5 D85B52I @B?F949>7 1 CE9D12<5 6B1=5G?B; 6?B 49CDB92ED54 5CD9=1D9?> 9> >?><9>51B 1@@<931D9?>C 1C 49F5BC5 1C C?EB35 <?31<9J1D9?> 9> B?2?D93C / 0 CE2=1B9>5 DB13;9>7 9> C?>1BC /0 1>4 CEBF59<<1>35 9> B141BC /0 ?B D85 C5>C?B >5DG?B;C D? B5138 D859B 6E<< @?D5>D91< D85I =ECD 8?G5F5B 25 31@12<5 ?6 ?@5B1D9>7 9> 8?CD9<5 3?> 49D9?>C $EB 7?1< 9> D89C @1@5B 9C D? @B?@?C5 1 49CDB92ED54 @1BD93<5 < D5B 9=@<5=5>D1D9?> /0/0 6?B CE38 E>CDBE3DEB54 5>F9B?>=5>DC G9D8 3?==E>931D9?> 3?>CDB19>DC 1>4 3?>>53D9F9DI 9CCE5C > B535>D I51BC D85B5 81C 255> 1 CEB75 ?6 9>D5B5CD 9> 3?>C5>CEC 21C54 49CDB92ED54 @1BD93<5 <D5B 9=@<5=5>D1D9?>C /0/0 6?B CD1D5 5C D9=1D9?> 1>4 DB13;9>7 @B?2<5=C 9> CICD5=C G9D8 >?><9>51B 4I>1= 93C 1C54 ?> D85 DI@5 ?6 9>6?B=1D9?> 5H381>754 25DG55> D85 C5>C?B >?45C D85C5 9=@<5=5>D1D9?>C 31> 2B?14<I 25 3<1CC954 9>D? DG? 31D5 7?B95C 1D57?BI /0/0 3?==E>931D5C @B545>54 CD1D9CD93C ?6 D85 <?31< @?CD5B9?BC 57 D85 CD1D5 5CD9=1D5C 1>4?B D859B 3?BB5C@?>49>7 5BB?B 3?F1B91>35C 25DG55> D85 >59782?B9>7 >?45C '81B9>7 CE38 <? 31< @?CD5B9?BNC CD1D9CD93C 9C B5C9<95>D D? @13;5D <?CC5C 5C@5391<<I 9> 5BB?B @B?>5 ?B 3?>75CD54 >5DG?B;C C9>35 1>I <?CD 9>6?B=1D9?> 9> @B9>39@<5 C8?E<4 25 3?>D19>54 9> D85 6?<<?G9>7 @?CD5B9?BC 1>4 D85B56?B5 31> 25 B53?F5B54 1D57?BI /0/0 9>CD514 3?==E>931D5C 1 @B545 >54 6E>3D9?> ?6 D85 <?31< ?2C5BF1D9?>C D? B5138 1 3?>C5>CEC ?> D85 7<?21< <9;5<98??4 BB5C@53D9F5 ?6 G8938 31D57?BI 1> 9=@<5=5>D1 D9?> 25<?>7C D? 3EBB5>D CD1D5?6D851BD 49CDB92ED54 9=@<5=5>D1D9?>C ?6 D85 @1BD93<5 <D5B /0/0 B5AE9B5 C5F5B1< 3?>C5>CEC BE>C 5138 B5 AE9B9>7 1 <1B75 >E=25B ?6 9D5B1D9?>C D? 13895F5 3?>C9CD5>D F1<E5C 6?B <?31< 5CD9=1D?BCN CD1D9CD93C D8B?E78 9>6?B=1D9?> 5H381>75C 25DG55> >59782?B9>7 >?45C (85 @5B6?B=1>35 ?6 D85C5 49CDB92ED54 9=@<5 =5>D1D9?>C 457B145C C5F5B5<I 9> 5>F9B?>=5>DC G9D8 3?==E>931D9?> 3?>CDB19>DC 95 G85> ?><I 1 <9=9D54 >E=25B ?6 3?>C5>CEC 9D5B1D9?>C 9C @?CC92<5 4E5 D? 9>D5B=9DD5>D 3?>>53D9F9DI ?B ?D85B 3?==E>931D9?> 3?>CDB19>DC ?>C5AE5>D<I D85 3?>C5>CEC CD5@ 4?5C >?D 3?>F5B75 25 DG55> DG? 3?>C53ED9F5 <D5B 9D5B1D9?>C (? 41D5 49CDB92ED54 5CD9=1 D9?> G9D8 3?==E>931D9?> 3?>CDB19>DC /0/0 9C <9=9D54 D? <9>51B CICD5=C 21C54 ?> D85 1<=1> <D5B 1>4 81C >?D I5D 255> 5HD5>454 D? >?><9>51B CICD5=C (85 @1@5B 144B5CC5C D89C 71@ 1>4 @B?@?C5C D85 3?>C5>CEC @<EC 9>>?F1D9?> 21C54 49CDB92ED54 9=@<5=5>D1D9?> ?6 D85 E>C35>D54 @1BD93<5 <D5B )% D? 451< G9D8 CE38 3?>>53D9F9DI 9CCE5C 59>7 1 =1BB9175 25DG55> 1D57?B95C 1>4 D85 )% 25>5DC 6B?= 14F1>D175C ?6 2?D8 31D57?B95C 1>4 ;55@C D85 5CD9=1D9?> 5BB?B 2?E>454 5F5> G9D8?ED D85 3?>F5B75>35 ?6 D85 3?>C5>CEC CD5@ 5C97>54 1C 1 3?>C5>CEC @<EC 9>>?F1D9?> 49CDB92ED54 >?><9> 51B 5CD9=1D?B D85 )% 9C D85 >?><9>51B @1BD93<5 <D5B 21C54 3?E>D5B@1BD ?6 D85 <9>51B 3?>C5>CEC 1>4 9>>?F1D9?> <D5B /0 (85 )% 9C 9451<<I CE9D54 6?B 1@@<931D9?>C G85B5 D85 7<?21< <9;5 <98??4 6E>3D9?> C1D9C5C D85 CE6395>D CD1D9CD93C 21C54 613D?B9J1D9?> 1C 9C D85 31C5 6?B 251B9>7?><I / 0 :?9>D 251B9>7B1>75 /0 DB13;9>7 @B?2<5=C 1>4 9> C35>1B9?C G85B5 D85 <?31< <9;5<98??4 6E>3 D9?>C 25<?>7 D? D85 5H@?>5>D91< 61=9<I /0 > ?EB "?>D5 1B<? C9=E<1D9?>C D85 @5B6?B=1>35 ?6 D85 )% 6?<<?GC D81D ?6 D85 35>DB1<9J54 <D5B 5F5> G9D8 1 <9=9D54 >E=25B ?6 3?>C5>CEC 9D5B1D9?>C 2. PROBLEM FORMULATION AND PARTICLE FILTER (85 ?F5B1<< >?><9>51B CD1D5C@135 =?45< 9C 79F5> 2I 'D1D5 "?45< x(k)=f (x(k 1)) + ξ(k), $2C5BF1D9?> "?45< z (1) (k) z (N) (k) z(k) = g (1) (x(k)) g (N) (x(k)) g(x(k)) + ζ (1) (k) ζ (N) (k) , ζ(k) 6?B 1 C5>C?B >5DG?B; 3?=@B9C9>7 N >?45C 1>4 ?2C5BF9>7 1 C5D ?6 n x CD1D5C x =[X1 ,X2,...,Xnx ] T T 45>?D5C DB1>C@?C9D9?> (85 ?2 C5BF1D9?> F53D?B 9C z =[z (1)T ,..., z (N)T ] T G9D8 z (l) (k) 45>?D9>7 D85 ?2C5BF1D9?> 1D >?45 l1 l N 1D D9=5 9>CD1>D k E>3D9?>C {f (·), g(·)} 1B5 >?><9>51B {ξ(·), ζ(·)} 1B5 D85 7<?21< >?>1ECC91> E>35BD19>D95C 9> D85 @B?35CC 1>4 ?2C5BF1D9?> =?45<C B5C@53D9F5<I 2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) U.S. Government work not protected by U.S. copyright 1105

Transcript of [IEEE ICASSP 2014 - 2014 IEEE International Conference on Acoustics, Speech and Signal Processing...

Page 1: [IEEE ICASSP 2014 - 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - Florence, Italy (2014.5.4-2014.5.9)] 2014 IEEE International Conference

A DISTRIBUTED CONSENSUS PLUS INNOVATION PARTICLE FILTER FOR NETWORKSWITH COMMUNICATION CONSTRAINTS

Arash Mohammadi and Amir Asif

{ }

ABSTRACT

( )

Index Terms—

1. INTRODUCTION

2. PROBLEM FORMULATION AND PARTICLE FILTER

x(k)=f(x(k − 1)) + ξ(k),⎡⎢⎣

z(1)(k)

z(N)(k)

⎤⎥⎦

︸ ︷︷ ︸z(k)

=

⎡⎢⎣g(1)(x(k))

g(N)(x(k))

⎤⎥⎦

︸ ︷︷ ︸g(x(k))

+

⎡⎢⎣ζ(1)(k)

ζ(N)(k)

⎤⎥⎦,

︸ ︷︷ ︸ζ(k)

N nxx = [X1, X2, . . . , Xnx ]

T T

z = [z(1)T , . . . ,z(N)T ]T z(l)(k)l 1 ≤ l ≤ N k

{f(·), g(·)} {ξ(·), ζ(·)}

2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP)

U.S. Government work not protected by U.S. copyright 1105

Page 2: [IEEE ICASSP 2014 - 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - Florence, Italy (2014.5.4-2014.5.9)] 2014 IEEE International Conference

k

P (x(k)|z(1 :k−1)) =∫P (x(k−1)|z(1 :k−1))f(x(k)|x(k−1))dx(k−1)

P (x(k)|z(1 :k)) =P (z(k)|x(k))P (x(k)|z(1 :k−1))

P (z(k)|z(1 :k−1)).

P (x(k)|z(1 : k))Xi(k) (1 ≤ i ≤ Ns)

q(x(0:k)|z(1:k))

Wi(k) =P (Xi(k)|z(1 : k))

q(Xi(0 : k)|z(1 : k))

{Xi(k),Wi(k)}

Xi(k) ∼ q(Xi(k)|Xi(0 :k−1), z(1 :k))

Wi(k) ∝ Wi(k − 1)P (z(k)|Xi(k))P (Xi(k)|Xi(k−1))

q(Xi(k)|Xi(0 :k−1), z(1 :k)).

3. CONSENSUS PLUS INNOVATION BASED DUPF

Nc

Nc(U)Nc < Nc(U)

3.1. Linear Consensus and Innovation Estimation

x(k) = Fx(k−1) + ξ(k)

z(l)(k) = G(l)x(k) + ζ(l)(k) l

x(l)(k + 1) = F∑

i∈ℵ(l)Ulix(i)(k)︸ ︷︷ ︸

+B(l) ∑i∈ℵ(l) [G

(i)]T(z(i)(k + 1)−G(i)x(l)(k)

),︸ ︷︷ ︸

ℵ(l) l B(l)

U = {Uli}

Fx(l)(k)

Fx(i)(k) i ∈ ℵ(l)

l l

3.2. The CI/DUPF Implementation

Consensus update

l

kl ∑

i∈ℵ(l) x(i)(k) l

k+1∑i∈ℵ(l) x

(i)(k) z(l)(k+1)

Observation update

l

k

x(l)(k) P (l)(k) k

z(l)(k + 1)l

3.2.1. Consensus Update

Step 1. Local UPF l (2nx+1)

S = {W(l)i ,χ

(l)i (k)}2nx

i=0

χ(l)i (k) = x(l)(k)±

{√(nx+κ)P (l)(k)

}i,

i

χ(l)0 (k) =

x(l)(k) {Wi}2nxi=1

W(l)0 = κ/(nx + κ) W(l)

i = 1/(2(nx + κ))κ

χ(l)i (k + 1|k) = f(χ

(l)i (k))

Z(l)i (k+1|k) = g(l)(χ

(l)i (k+1|k))

l

x(l)

(k+1)=x(l)

(k+1|k)+K(l)(k)(z(l)(k+1)−z(l)

(k+1|k))

P(l)

(k+1)=P(l)

(k+1|k)−K(l)(k)P (l)zz (k+1|k)K(l)T(k)

K(l)(k)=P(l)xz (k+1|k)P (l)

zz (k+1|k)−1

1106

Page 3: [IEEE ICASSP 2014 - 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - Florence, Italy (2014.5.4-2014.5.9)] 2014 IEEE International Conference

Step 2. Consensus Step{x(l)

(k+1),P(l)

(k+1)}Nl=1

P(l, )−1

(k+1) =N∑

j=1

[P(j)

(k+1)]−1−

[P

(j)(k+1|k)

]−1

+[P

(l)(k+1|k)

]−1

x(l. )

(k + 1) =[P

(l, )(k+1)

]−1[[P

(l)(k + 1|k)

]−1x

(l)(k + 1|k)

+

N∑j=1

[P

(j)(k+1)

]−1x

(j)(k+1)−

[P

(j)(k+1|k)

]−1x

(j)(k+1|k)

],

x(l)c (t+ 1) = x(l)

c (t) + ε∑

j∈ℵ(l)(x(j)c (t)− x(l)

c (t))

P (l)c (t+ 1) = P (l)

c (t) + ε∑

j∈ℵ(l)(P(j)c (t)−P (l)

c (t)),

ε ∈ (0, 1/ΔG) t

P (l)c (t = 0) = [P

(j)(k + 1)]−1 − [P

(j)(k + 1|k)]−1

x(l)c (t = 0) = [P

(j)(k + 1)]−1x

(j)(k + 1)

− [P(j)

(k + 1|k)]−1x(j)

(k + 1|k).

{P(l)c (t),x

(l)c (t)}

N

t

Step 3. Generating the ParticlesX

(l)i (k+1) ∼ N

(x

(l, )(k+1), P

(l, )(k+1)

)l

N(l)p X

(l)i (k + 1)

3.2.2. Innovation Update

W(l)i (k+1)

X(l)i (k+1)

W(l)i (k +1)∝P

(z(k+1)|X(l)

i (k+1))P(X

(l)i (k+1)|X(l)

i (k))

N(x

(l, )(k + 1),P

(l, )(k + 1)

) ,

P(z(k+1)|X(l)

i (k+1)) X(l)i (k+1)

z(k+1)

Case 1 – Single Consensus Iteration:

t ≤ 1 lz(j)(k+1)

j ∈ ℵ(l)

W(l)i (k+1)∝P

(z(j∈ℵ(l))(k+1)|X(l)

i (k+1))P(X

(l)i (k+1)|X(l)

i (k))

N(x

(l, )(k + 1),P

(l, )(k + 1)

) .

l

g(j)(·) j ∈ ℵ(l)

Case 2 – Multiple Consensus Iterations:

tt = 2 t = 3

P(z(k)|x(k)

)� T1(z(k))T2

(S(z(k)),x(k)

),

T1(z(k)) x(k)T2(S(z(k)),x(k))

x(k)

S(z(k)) = ∑Nl=1 Y(l)(k) Y(l)(k)

S(z(k))P(z(k+1)|X(l)

i (k+1))

X(l)i (k+1)

t

Example:

Z(l)(k) = g(x(k)) + ζ(l)(k),

1 ≤ l ≤ N ζ(l)(k) ∼ N (0, σ(l)2(k))

P (z(k)|x(k)) ∝ exp{−

N∑l=1

Z(l)2(k)

2σ(l)2(k)−

g2(x(k))

N∑l=1

1

2σ(l)2(k)+ g(x(k))

N∑l=1

Z(l)(k)

σ(l)2(k)

},

1107

Page 4: [IEEE ICASSP 2014 - 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - Florence, Italy (2014.5.4-2014.5.9)] 2014 IEEE International Conference

Fig. 1

et al.

l

G1(k) =∑N

l=1

Z(l)2(k)

2σ(l)2(k)︸ ︷︷ ︸Y(l)1 (k)

, G2(k) =∑N

l=1

1

2σ(l)2(k)︸ ︷︷ ︸Y(l)2 (k)

G3(k) =∑N

l=1

Z(l)(k)

2σ(l)2(k)︸ ︷︷ ︸Y(l)3 (k)

.

4. EXPERIMENTAL RESULTS

N 15 × 15 2

√2 log(N)/N

f(x(k))

{10, 10} −110◦

σξ(k) = 1.6 × 10−2

σ2ζ(l)

(k) l

D(l)(x(k))

σ2ζ(l)

(k) = Bm[D(l)(x(k))]2 + 0.11D(l)(x(k))

σθ = 2.5◦

Ns = 1000

(k)=

√√√√ 1

n

1

N

n∑j=1

N∑l=1

(Xj(k)−X(l)

j (k))2+(Yj(k)−Y (l)

j (k))2

Fig. 2

k = 20 t = 1, 2, 3

nScenario 1:

1629

Scenario 2{2, 3}

tScenario 3

N = {10, 20, 30, 40, 50}

5. SUMMARY

1108

Page 5: [IEEE ICASSP 2014 - 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - Florence, Italy (2014.5.4-2014.5.9)] 2014 IEEE International Conference

6. REFERENCES

IEEE Tran. Sig. Proc.

IEEETransactions on Robotics

CRCPress

Artech House

IEEE Transactions on Signal Processing

IEEE Signal Processing Magazine

IEEE Inter.Con. on Acoustics, Speech, & Signal Processing (ICASSP)

Nonlin-ear Estimation and Applications to Industrial Systems Control

IEEE Workshop on Statistical SignalProcessing (SSP)

IEEE Int. Con. on Informa-tion and Automation

Proc. IEEE Int. Con. on Info. Fusion

IEEE Inter. Con. on Robotics and Automation

IEEE Transactions on Signal Processing

IEEE Transactions on Signal Processing

IEEE Int. Con. on Communications (ICC)

IEEE Int. Con. onAcoustics, Speech, & Signal Processing (ICASSP)

IEEE Int. Con. on Acoustics, Speech, & SignalProcessing (ICASSP)

IEEE Int.Con. on Acoustics, Speech, & Signal Processing (ICASSP)

IEEE Int. Con. on Acoustics, Speech, & Signal Pro-cessing (ICASSP)

IEEEInt. Conference on Robotics and Automation

Proceedingsof the IEEE

IEEE Journalon Selected Areas in Communications

Proceedings of the IEEE

IEEE Transactions on Infor-mation Theory

IEEE Signal Processing Magazine

arXiv preprint arXiv:1111.4580

EURASIP App. Sig. Proc.

IEEE Transac-tions on Robotics

IEEE SignalProcessing Magazine

IEEE Transactions on Signal Processing

Multi-target Multi-sensor Tracking

1109