Multimodal Model Agnostic Meta-Learning via Task-Aware Modulation

Risto Vuorio* Shao-Hua Sun* Hexiang Hu Joseph J. Lim

05:00 -- 07:00 PM @ East Exhibition Hall B + C #31

Data SampleGround Truth

Data SampleGround Truth

Data SampleGround Truth

θData SampleGround TruthMAML

Sinusoid

AbsoluteValue

Tanh

Data SampleGround Truth

Tanh

Data SampleGround Truth

Sinusoid

AbsoluteValue

Tanh

θData SampleGround TruthMAML (1-mode)

Sinusoid

AbsoluteValue

θ3θ2

θ1

Tanh

Data SampleGround TruthMAML (1-mode)MAML (3-mode)

Sinusoid

AbsoluteValue

Task Network

x

yy

Task Network

x

yy

x

y

( (Samples

× K

Modulation Network

Evaluations: Regression

Evaluations: Regression

ProMP

Evaluations: Reinforcement Learning

Ours

Evaluations: Classification(a) Omniglot (e) Aircraft(c) FC100(b) Mini-ImageNet (d) CUB

Evaluations: Classification(a) Omniglot (e) Aircraft(c) FC100(b) Mini-ImageNet (d) CUB

Multimodal Model Agnostic Meta-Learning via Task-Aware Modulation

Risto Vuorio* Shao-Hua Sun* Hexiang Hu Joseph J. Lim

05:00 -- 07:00 PM @ East Exhibition Hall B + C #31