     • date post

11-Apr-2018
• Category

## Documents

• view

219

0

Embed Size (px)

### Transcript of An Extended Mathematical Programming Framework Extended Mathematical Programming Framework ......

• An Extended Mathematical Programming Framework

Michael C. Ferris

Computing with Uncertainty, IMA, October 21, 2010

Ferris (Univ. Wisconsin) EMP IMA, October 2010 1 / 35

• Optimal Power Flow

OPF(): miny energy dispatch cost (y , )s.t. conservation of power flow at nodes

Kirchoffs voltage law, and simple bound constraints

are (given) price bids, parametric optimization

Leader(i ): maxi ,y , firm i s profit (i , y , )s.t. 0 i i

y solves OPF(i , i )

Note that objective involves multiplier from OPF problem

Leader(i ): maxi ,y , firm i s profit (y , , )s.t. 0 i i

(y , ) solves KKT(OPF(i , i ))

This is an example of an MPCC since KKT form complementarityconstraints

Ferris (Univ. Wisconsin) EMP IMA, October 2010 2 / 35

• Optimal Power Flow

OPF(): miny energy dispatch cost (y , )s.t. conservation of power flow at nodes

Kirchoffs voltage law, and simple bound constraints

are (given) price bids, parametric optimization

Leader(i ): maxi ,y , firm i s profit (i , y , )s.t. 0 i i

y solves OPF(i , i )

Note that objective involves multiplier from OPF problem

Leader(i ): maxi ,y , firm i s profit (y , , )s.t. 0 i i

(y , ) solves KKT(OPF(i , i ))

This is an example of an MPCC since KKT form complementarityconstraints

Ferris (Univ. Wisconsin) EMP IMA, October 2010 2 / 35

• Optimal Power Flow

OPF(): miny energy dispatch cost (y , )s.t. conservation of power flow at nodes

Kirchoffs voltage law, and simple bound constraints

are (given) price bids, parametric optimization

Leader(i ): maxi ,y , firm i s profit (i , y , )s.t. 0 i i

y solves OPF(i , i )

Note that objective involves multiplier from OPF problem

Leader(i ): maxi ,y , firm i s profit (y , , )s.t. 0 i i

(y , ) solves KKT(OPF(i , i ))

This is an example of an MPCC since KKT form complementarityconstraints

Ferris (Univ. Wisconsin) EMP IMA, October 2010 2 / 35

• Multi-player EPEC and security constraints

(1, 2, . . . , m) is an equilibrium if

(Nonlinear) Nash Equilibrium where each player solves an MPCC

MPCC is hard (lacks a constraint qualification)

In practice, also require contingency (scenario) constraints imposed inthe OPF problem

Model involves: complementarity, hierarchy, interacting agents, riskmeasures

How to convey and exploit such model structure

Ferris (Univ. Wisconsin) EMP IMA, October 2010 3 / 35

• Multi-player EPEC and security constraints

(1, 2, . . . , m) is an equilibrium if

(Nonlinear) Nash Equilibrium where each player solves an MPCC

MPCC is hard (lacks a constraint qualification)

In practice, also require contingency (scenario) constraints imposed inthe OPF problem

Model involves: complementarity, hierarchy, interacting agents, riskmeasures

How to convey and exploit such model structure

Ferris (Univ. Wisconsin) EMP IMA, October 2010 3 / 35

• Complementarity Problems via Graphs

T = NR+ = (R+ {0})

({0} R)

y T () (,y) T 0 y 0

By approximating (smoothing) graph can generate interior pointalgorithms for example y = , y , > 0

F (x) NRn+(x) (x ,F (x)) Tn 0 x F (x) 0

Ferris (Univ. Wisconsin) EMP IMA, October 2010 4 / 35

• Complementarity Systems (DVI)

dxdt (t) = f (x(t), (t))

y(t) = h(x(t), (t))

0 y(t) (t) 0

Ferris (Univ. Wisconsin) EMP IMA, October 2010 5 / 35

• Complementarity Systems (DVI)

dxdt (t) = f (x(t), (t))

y(t) = h(x(t), (t))

0 y(t) (t) 0

Ferris (Univ. Wisconsin) EMP IMA, October 2010 5 / 35

• Complementarity Systems (DVI)

dxdt (t) = f (x(t), (t))

y(t) = h(x(t), (t))

((t),y(t)) T

Ferris (Univ. Wisconsin) EMP IMA, October 2010 6 / 35

• Operators and Graphs (X = [1, 1])

xi = 1,Fi (x) 0 or xi (1, 1),Fi (x) = 0 or xi = 1,Fi (x) 0

ComplementaritySystems

Ferris(Univ.Wisconsin)

EMP

NonsmoothSchool,June2010

2/42 Complementarity Systems

Ferris (Univ. Wisconsin) EMP Nonsmooth School, June 2010 2 / 42

Complementarity Systems

Ferris (Univ. Wisconsin) EMP Nonsmooth School, June 2010 2 / 42

T () T 1(y) (I + T )1(y) = PT (y)

PT (y) is the projection of y onto [`, u]

Ferris (Univ. Wisconsin) EMP IMA, October 2010 7 / 35

• Generalized Equations

Suppose T is a maximal monotone operator

0 F (z) + T (z) (GE )

Define PT = (I + T )1

If T is polyhedral (graph of T is a finite union of convex polyhedralsets) then PT is piecewise affine (continous, single-valued,non-expansive)

0 F (z) + T (z) z F (z) + I(z) + T (z) z F (z) (I + T )(z) PT (z F (z)) = z

Use in fixed point iterations (cf projected gradient methods)

Ferris (Univ. Wisconsin) EMP IMA, October 2010 8 / 35

• Splitting Methods

Suppose T is a maximal monotone operator

0 F (z) + T (z) (GE )

Can devise Newton methods (e.g. SQP) that treat F via calculus andT via convex analysisAlternatively, can split F (z) = A(z) + B(z) (and possibly T also) sowe solve solve (GE) by solving a sequence of problems involving just

T1(z) = A(z) and T2(z) = B(z) + T (z)

where each of these is simpler

Forward-Backward splitting:

zk+1 = (I + ckT2)1 (I ckT1)

(zk),

Ferris (Univ. Wisconsin) EMP IMA, October 2010 9 / 35

• Normal Map

Suppose T is a maximal monotone operator

0 F (z) + T (z) (GE )

Define PT = (I + T )1

0 F (z) + T (z) z F (z) + I(z) + T (z) z F (z) = y and y (I + T )(z) z F (z) = y and PT (y) = z PT (y) F (PT (y)) = y 0 = F (PT (y)) + y PT (y)

This is the so-called Normal Map Equation

Ferris (Univ. Wisconsin) EMP IMA, October 2010 10 / 35

• Normal manifold = {Fi + NFi}

Ferris (Univ. Wisconsin) EMP IMA, October 2010 11 / 35

• C = {z |Bz b},F (z) = Mz + q

Ferris (Univ. Wisconsin) EMP IMA, October 2010 12 / 35

• Cao/Ferris Path (Eaves)

Start in cell that has interior(face is an extreme point)

Move towards a zero ofaffine map in cell

Update direction when hitboundary (pivot)

Solves or determinesinfeasible if M iscopositive-plus on rec(C )

Solves 2-person bimatrixgames, 3-person games too,but these are nonlinear

Cao/Ferris Path (Eaves) Start in cell that has

interior (face is an extreme point)

Move towards a zero of affine map in cell

Update direction when hit boundary

Solves or determines infeasible if M is copositive-plus on rec(C)

Nails 2-person game

But algorithm has exponential complexity (von Stengel et al)

Ferris (Univ. Wisconsin) EMP IMA, October 2010 13 / 35

• Extensions and Computational Results

Embed AVI solver in a Newton Method - each Newton step solves anAVI

Compare performance of PathAVI with PATH on equivalent LCP

PATH the most widely used code for solving MCP

AVIs constructed to have solution with Mnn symmetric indefinite

PathAVI PATHSize (m,n) Resid Iter Resid Iter

(180, 60) 3 1014 193 0.9 10176(360, 120) 3 1014 1516 2.0 10594

2 - 10x speedup in Matlab using sparse LU instead of QR

2 - 10x speedup in C using sparse LU updates

Ferris (Univ. Wisconsin) EMP IMA, October 2010 14 / 35

• But who cares?

Why arent you using my *********** algorithm?(Michael Ferris, Boulder, CO, 1994)

Show me on a problem like mine

Must run on defaults

Must deal graciously with poorly specified cases

Must be usable from my environment (Matlab, R, GAMS, ...)

Must be able to model my problem easily

EMP provides annotations to an existing optimization model that conveynew model structures to a solver

Ferris (Univ. Wisconsin) EMP IMA, October 2010 15 / 35

• But who cares?

Why arent you using my *********** algorithm?(Michael Ferris, Boulder, CO, 1994)

Show me on a problem like mine

Must run on defaults

Must deal graciously with poorly specified cases

Must be usable from my environment (Matlab, R, GAMS, ...)

Must be able to model my problem easily

EMP provides annotations to an existing optimization model that conveynew model structures to a solver

Ferris (Univ. Wisconsin) EMP IMA, October 2010 15 / 35

• EMP(i): MPCC: complementarity constraints

minx ,s

f (x , s)

s.t. g(x , s) 0,0 s h(x , s) 0

g , h model engineering expertise: finite elements, etc

models complementarity, disjunctionsComplementarity constraints available in AIMMS, AMPL andGAMS

NLPEC: use the convert tool to automatically reformulate as aparameteric sequence of NLPs

Solution by repeated use of standard NLP softwareI Problems solvable, local solutions, hard

Ferris (Univ. Wisconsin) EMP IMA, October 2010 16 / 35

• EMP(i): MPCC: complementarity constraints

minx ,s

f (x , s)

s.t. g(x , s) 0,0 s h(x , s) 0

g , h model engineering expertise: finite elements, etc

models complementarity, disjunctionsComplementarity constraints available in AIMMS, AMPL andGAMS

NLPEC: use the convert tool to automatically reformulate as aparameteric sequence of NLPs

Solution by repeated use of standard NLP softwareI Problems solvable, local solutions, hard

Ferris (Univ. Wisconsin) EMP IMA, Octobe