Exploratory Mediation Analysis with Many Potential Mediators€¦ ·...

28
exploratory mediation analysis with many potential mediators Erik-Jan van Kesteren & Daniel Oberski March 15, 2018 Utrecht University, Department of Methodology & Statistics

Transcript of Exploratory Mediation Analysis with Many Potential Mediators€¦ ·...

Page 1: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

exploratory mediation analysis with manypotential mediators

Erik-Jan van Kesteren & Daniel OberskiMarch 15, 2018

Utrecht University, Department of Methodology & Statistics

Page 2: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

mediation

Page 3: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

single mediator model

Q: When is M a mediator?

βα

X Y

M

τ

2

Page 4: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

single mediator model

MacKinnon et al. (2002):

1. Causal steps: α & β

2. Difference in coefficients: τ − τ |M3. Product of coefficients: α× β

VanderWeele (2015, p. 46): “Also take into account X ·M interaction!”

Theory-based decision functions using data from X,M, Y:

D : {x,m, y} 7→ {0, 1}(0 = not mediator, 1 = mediator)

3

Page 5: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

many mediators

Page 6: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

many mediators

Q: When is Genei a mediator?

β1α1

...

α2 β2

αp βp

X Y

Gene1

Gene2

Genep

2

5

Page 7: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

multiple mediation

Preacher and Hayes (2008):

1. Fit the full SEM so your parameter estimates take all mediatorsinto account

2. Select mediators using the estimated parameters

D(x,mi, y) conditional on M−i

6

Page 8: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

filter

p single mediator models

X Y

M1

X Y

M2

Y

Mp

XX Y

M3 . . .

for (i in 1:p) D(x,mi, y)

The “filter” method (Guyon and Elisseeff, 2003)

7

Page 9: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

filter

Good Bad

∙ Simple∙ Quick∙ Flexible

∙ Assumes uncorrelatedmediators: won’t work ifmediation only visibleconditionally

8

Page 10: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

regularisation

Jacobucci et al. (2016): We can now penalise SEM parameters

Fregsem = FML + λP(·)

Serang et al. (2017): We can use this to select mediators! Put a lassopenalty on α and β

The “XMed” method

9

Page 11: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

regularisation

Good Bad∙ ”Full” SEM∙ Does not assumeuncorrelated mediators

∙ Regularisation is hip

∙ What are we actuallyoptimising for?

∙ Find M for which α OR β butwe want α AND β.

10

Page 12: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

optimal method

Our contribution:

D(x,mi, y) conditional on M−i

11

Page 13: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

coordinate descent

Insight from regularisation literature (Hastie et al., 2015):

conditional parameter == parameter estimated on residual

Idea:

12

Page 14: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

coordinate-wise mediation filter

for each mediatorperform the decision function

throw it out if 0

Coordinate-wiseMediationFilter

conditional on the other selected mediators

repeat until convergence

13

Page 15: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

coordinate-wise mediation filter

Good Bad∙ Uses theoretically relevant D∙ Does not assumeuncorrelated mediators

∙ Nonconvergence

14

Page 16: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

simulation

Page 17: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

simulation

Conditional-only

-0.4

0.4

-0.44

0.24

0.4M1

M2

X Y

Noise (α paths)

0.8, 0.4noisep = 15

0.3 0.3

X Y

M

High-dimensional

-0.4

0.4

-0.44

0.24

0.4M1

M2

X Y

noise

Noise (β paths)

0.8, 0.4noisep = 15

0.3 0.3

X Y

M

16

Page 18: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

implementation

Page 19: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

how to use

> devtools::install_github(”vankesteren/cmfilter”)> library(cmfilter)> res <- cmf(x, M, y, verbose = TRUE)

# CMF Algorithm## -----------## 1 0 0 1 1 1 1 0 1 0 0 0 0 1 1 0 0# 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0# 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0# 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0## Algorithm converged## -----------

18

Page 20: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

conclusion

Page 21: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

conclusion

∙ Novel method for selecting among many mediators∙ Flexible choice of D∙ Conditional on M−i

∙ Stable in boundary cases∙ Traditional power/type-I tradeoff

20

Page 22: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

future work

∙ Group lasso∙ Bayesian regularisation prior on α× β

21

Page 23: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

references

Guyon, I. and Elisseeff, A. (2003). An Introduction to Variable and Feature Selection.Journal of Machine Learning Research (JMLR), 3(3):1157–1182.

Hastie, T., Tibshirani, R., and Wainwright, M. (2015). Statistical Learning with Sparsity:The Lasso and Generalizations. CRC Press, Boca Raton.

Jacobucci, R., Grimm, K. J., and McArdle, J. J. (2016). Regularized Structural EquationModeling. Structural Equation Modeling, 23(4):555–566.

MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., and Sheets, V. (2002). Acomparison of methods to test mediation and other intervening variable effects.Psychological methods, 7(1):83–104.

Preacher, K. J. and Hayes, A. F. (2008). Asymptotic and resampling strategies forassessing and comparing indirect effects in multiple mediator models. BehaviorResearch Methods, 40(3):879–891.

Serang, S., Jacobucci, R., Brimhall, K. C., and Grimm, K. J. (2017). Exploratory MediationAnalysis via Regularization. Structural Equation Modeling, 24(5):733–744.

VanderWeele, T. J. (2015). Explanation in Causal Inference: Methods for Mediation andInteraction. Oxford University Press, New York, 1st edition.

22

Page 24: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

questions

Page 25: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

simulation results

Suppression

Method Power (M1) Power (M2)Full SEM 1.00 0.99Filter 0.99 0.13XMed 1.00 0.99CMF 1.00 0.91

24

Page 26: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

simulation results

Noise (α paths)

Method Power FPR PPVFull SEM 0.20 0.11 0.11Filter 0.27 0.09 0.17XMed 0.67 0.34 0.12CMF 0.17 0.06 0.17

25

Page 27: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

simulation results

Noise (β paths)

Method Power FPR PPVFull SEM 0.08 0.01 0.32Filter 0.44 0.02 0.58XMed 0.49 0.12 0.22CMF 0.41 0.02 0.58

26

Page 28: Exploratory Mediation Analysis with Many Potential Mediators€¦ · Jacobuccietal.(2016):WecannowpenaliseSEMparameters Fregsem= FML+ P( ) Serangetal.(2017):Wecanusethistoselectmediators!Putalasso

simulation results

High-dimensional data

Method Power (M1) Power (M2) FPR PPVFull SEM NA NA NA NAFilter 0.91 0.07 2.4e-3 0.30XMed NA NA NA NACMF 0.82 0.06 1.8e-3 0.32

27