Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed...

36
© Lockheed Martin Aeronautics Company $ 5 Σ BCWS Σ BCWP Time Now 7 1 2 3 4 6 8 9 10 A B SV c SV t Earned Schedule New analysis of schedule in Earned Value Management ASC/Industry Cost & Schedule Workshop 19-20 Sep 2006 Robert Handshuh, CPIM, PMP

Transcript of Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed...

Page 1: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company

$

5

Σ BCWS

Σ BCWP

Time Now

71 2 3 4 6 8 9 10

A

B

SVc

SVt

Earned ScheduleNew analysis of schedule inEarned Value Management

ASC/Industry Cost & Schedule Workshop 19-20 Sep 2006

Robert Handshuh, CPIM, PMP

Page 2: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 2

Agenda

•Background−Earned Value Management & Metrics − Strengths & Weaknesses

•What is Earned Schedule •Sample Calculations•Examples from LM Project Data•Summary / Questions

Universal Disclaimer

Page 3: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 3

Earned Value Management – History & Value

• Earned Value Management (EVM) − Formalized in the 1960s as C/SCSC− EVM becomes industry standard with ANSI/EIA 748 − EVM formulas remain the same

• The EVM Advantage − Enforces Project Management discipline − Predictive capability not just History−Cost Performance Index (CPI) Validated over many

projects

Page 4: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 4

BASIC EV METRICS

•CV= Cost Variance - How much was done minus how much was spent (BCWP-ACWP)

•SV= Schedule Variance – What got done minus what was planned (BCWP-BCWS)

•CPI= Cost Performance Index – How much was done divided by how much was spent (BCWP / ACWP) “Bang for the buck”

•SPI= Schedule Performance Index – How much was done divided by how much was planned (BCWP / BCWS) “Time is money”

Page 5: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 5

EV Metrics Validated

CPI Validated • The DoD study in 1977 proved with as little as 15% of

the program completed, the Cost Performance Index (CPI) accurately predicted future cost performance.− DoD study of 400 programs, CPI did not significantly change

after 15% complete, Updated study, by Quentin Fleming in 1998, included over 700 programs and showed the same result

What about SPI ?• Studies have shown Schedule Performance Index

(SPI) starts losing predictive relevance in the later stages of the program− Professional Management Associates – EAC Calculations to

Project Life Cycle 2004

Page 6: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 6

Quirks of Schedule Variance

• Most people think of schedules in time units.− Is the project ahead or behind in days, weeks or months

• Schedule Variance is usually stated in $.−A dollar schedule variance is difficult translate to time

for many managers.

• Schedule Variance returns to “0” at the end of a project, SPI returns to “1”.− Perfect performance –When it was only (?) months late

Page 7: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 7

SPI & SV Magical Correction

1.0004000400015

0.97-1253875400014

0.95-2003800400013

0.93-2753725400012

0.92-3253575390011

0.92-3003350365010

0.92-275307533509

0.90-285266529508

0.90-240226025007

0.92-170183020006

0.91-140136015005

0.91-9096010504

0.92-506006503

0.93-253253502

0.98-2981001

SPISVΣ BCWPΣ BCWSMonth

Page 8: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 8

If NOTHING was done for the next 6 months SPI would still equal 0.90 (rounded)($231,611 / $258,305)

Once 80% complete, monthly gains only have marginal effect on ΣSPI. Smoothing effect is increased by lower monthly budgets typicallyestablished in the final phase program

If the project had ΣBCWP of $231,611 in month 43 then SPI = 0.90 ($231,611 / $257,345)

$(000)

Example – ΣSPI(c)

.90$231,611$258,305$ 64 48

.90$231,611$258,241$ 3347

.90$231,611$258,208$ 1946

.90$231,611$258,190$ 21945

.90$231,611$257,971$ 62744

.90$231,611$257,345$2,08543

SPI(c)Σ BCWPΣ BCWSMonthly BCWSPeriod

Page 9: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 9

SPIc Historical Smoothing

$

5

Σ BCWS

71 2 3 4 6 8 9 10

Slope of the curve isDiminishing. BCWS is lesseach month while time is constant

Even at perfect SPIc (1.0)each monthly gain is asmaller and smaller fraction of total budget

More dramatic effect on large dollar programs

12 3

Page 10: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 10

Earned Schedule

• Earned Schedule (ES)− Proposed in 2003 by Walter Lipke−New formulas for Schedule Variance and Schedule

Performance Index based on time− Validation currently in progress

• Earned Schedule Advantages− Expressed in time units −Does not revert back to 1.0 at the end of a project− Predictive capability

Page 11: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 11

Earned Schedule – It’s About Time

• Earned Schedule is done by projecting BCWP on to BCWS and then measuring the time units−Better understanding of project status−Closer relation to CV and CPI metrics

• Earned Schedule does not return to 1.0 −Usable through out project life cycle−Historical reference for future projects− Predictive capability under research & evaluation

• Earned Schedule is based on Σ BCWP and Σ BCWS − EVM data points you are already collecting−No new software; No Salesman will call

Page 12: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 12

Earned Schedule : How it Works

The cumulative value of ES is found by using BCWP to identify in which increment of BCWS the cost value occurs. – Lipke

7 months gone by, but the project only has “Earned Schedule” to Month 5Which SV “Answers the mail?” $ behind or 2 months behind schedule?

$

5

Σ BCWS

Σ BCWP

Time Now

71 2 3 4 6 8 9 10

A

B

SVt

SVc

Page 13: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 13

Earned Schedule : How it Works

The cumulative value of ES is found by using BCWP to identify in which increment of BCWS the cost value occurs. – Lipke

7 months gone by, but now project has “Earned Schedule” to Month 9As a program manager how would define this project? $ or 2 mo. ahead

$

5

Σ BCWS

Σ BCWP

Time Now

71 2 3 4 6 8 9 10

SVt

SVc

Page 14: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 14

Earned Schedule - The New Math

Earned Schedule Suggested Acronyms

Earned Schedule = ES (Similar to EV Cost)

Schedule Variance (time) = SVt (Similar to CV)

Schedule Performance Index (time) = SPIt (Similar to CPI)

Actual Time = AT (Latest Status Date)

Planned Duration = PD (Project Duration)

Independent Estimate at Compete, Time = IEACt (Similar to IEAC)

Page 15: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 15

Earned Schedule - The New Math

Earned Schedule Formulas

Schedule Variance (time) = Earned Schedule - Actual Time(ES – AT = SVt)

Schedule Performance Index (time) = Earned Schedule ÷ Actual Time (ES ÷ AT = SPIt)

Independent Time Estimate at Compete (time) = Planned Duration ÷ Schedule Performance Index (time) (PD ÷ SPIt = IEACt)

Earned Schedule = Whole months completed were Σ BCWP ≥ Σ BCWS + fractional month completed= Month (X) + [(Σ BCWPt– Σ BCWSx) ÷ (Σ BCWSy – Σ BCWSx)] (X = whole month earned; Y = month following X; T = Actual TIme)

Page 16: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 16

Don’t Panic – It’s not that hard!

Earned Schedule =

Whole months completed were Σ BCWP ≥ Σ BCWS + fractional month completed

= Month (X) + [(Σ BCWPt– Σ BCWSx) ÷ (Σ BCWSy – Σ BCWSx)]

x = whole month earnedy = month following Xt = Actual Time (Time Now)

Page 17: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 17

Calculating ES -Extrapolation Between the points - (Time Now - Month 7)

• Find X - BCWP to BCWS• 2260 ≥ 2000 X = 6• BCWPt – BCWSx = • (2260 - 2000)• BCWSy – BCWSx = • (2500 - 2000)• ES = 6 + (2260 – 2000) ÷ (2500-2000) • ES = 6 + (260 ÷ 500) = 6.52• We are in month 7 but only Earned 6.52 months of

Schedule

Month (X) + [(Σ BCWPt– Σ BCWSx) ÷ (Σ BCWSy – Σ BCWSx)]x = whole month earned; y = month following x; t = Actual Time (Time Now)

Page 18: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 18

Completing the ES Analysis(Time Now - Month 7)

• Schedule Variance (time) = Earned Schedule - Actual Time(ES – AT = SVt) = 6.52 – 7 = - .48 Months Behind

• Schedule Performance Index (time) = Earned Schedule ÷Actual Time

(ES ÷ AT = SPIt) = 6.52 ÷ 7 = .93 Earning Schedule at 93% efficiency (in months)

• Independent Time Estimate at Compete = Planned Duration ÷ Schedule Performance Index (time) (PD ÷ SPIt = IEACt) = 12 ÷ .93 = 12.90 Time to Complete

Page 19: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 19

Filling in the rest of the data -

0.80-3.001.000400015

0.78-3.100.97-125387514

0.82-2.400.95-200380013

0.86-1.700.93-27537254000120.89-1.250.92-32535753900110.90-1.000.92-30033503650100.92-0.690.92-275307533509

0.92-0.630.90-2852665295080.93-0.480.90-2402260250070.94-0.340.92-1701830200060.94-0.310.91-1401360150050.94-0.230.91-90960105040.94-0.170.92-5060065030.95-0.100.93-2532535020.98-0.020.98-2981001

SPItSVtSPIcSVcΣ BCWPΣ BCWSMonth

Page 20: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 20

SPIcost vs. SPItime Graphically

0.75

0.80

0.85

0.90

0.95

1.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

80% Complete

SPIc SPIt

{Notional Data from Slide 19}

Page 21: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 21

ES – EZ Method

• Do ES by hand? (Who has time?)• Use a spreadsheet

Spreadsheet developed by Walter Lipke, available on the Internet

Page 22: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 22

Earned Schedule as EVM Analytical Tool

• Earned Schedule – Validation Checks− SPI(t) Does not revert back to 1.0 like SPI(c)− Independent Time Estimate At Complete (ITEAC) based

on SPI(t) may be used to estimate time to complete

• Earned Schedule applied to three unique programs− Evaluate SPI(t) vs SPI(c)− Evaluate ITEAC vs Completion dates

Page 23: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 23

ES in the “Real World” Example 1

• The Project −Reporting 99.9% complete as of July 2005

• ~ $260 million dollar contract (CPIF)−Original 48 month duration− Planned End Date - Dec 2004−Actual Completion July 2005 - 7 month Slip

• Earned Schedule Calculations−Data points for the last 34 months − SPIc and SPIt− IEACt (PD ÷ SPIt)

Page 24: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 24

0.750

0.800

0.850

0.900

0.950

1.000

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33

SPIc SPIt Linear (SPIt)

ES SPIc vs. SPIt Tracking

80% Complete

Planned Complete

Page 25: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 25

ES for Schedule Completion Independent Time Estimate At Complete (ITEAC)

45

50

55

60

65

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33

ECD ITEAC Linear (ITEAC)

IEACt = (PD ÷ SPIt)

Plan Completion 48 Months

ActualCompletion55 Months

Page 26: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 26

ES in the “Real World” Example 2

• The Project −Reporting 100% complete as of March 05

• ~ $4.60 million dollar contract− 39 month duration− Planned End Date - Dec 2004−Completion - Mar 05 (3 month Slip)

• Earned Schedule Calculations− SPIc and SPIt− ITEAC (Planned Duration ÷ SPIt)

Page 27: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 27

0.700

0.800

0.900

1.000

1.100

1.200

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41

SPI(c) SPI(t) Linear (SPI(t))

ES SPIc vs. SPIt Tracking

80% Complete

Planned Complete

Page 28: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 28

ES for Schedule Completion Independent Time Estimate At Complete (ITEAC)

35

40

45

50

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41

ITEAC Linear (ITEAC)

Planned Duration 39 mo

ActualDuration 42 mo

IEACt = (PD ÷ SPIt)

Duration

Page 29: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 29

ES in the “Real World” Example 3

• The Project− Software Development − 6 months into 14 month project − Project needs new baseline, projecting 6 month

slip • Program Manager comment -

− EVM did not provide early warning of projected slip

−New Planned End Date – Month 23

• Earned Schedule Calculations− SPIc and SPIt− ITEAC (Planned Duration ÷ SPIt)

Page 30: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 30

Total Program

0.5

0.6

0.7

0.8

0.9

1

Mar Apr May Jun Jul AugSPIcEarned Schedule (SPIt)Linear (Earned Schedule (SPIt))

SPI

Time (Months)

Page 31: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 31

Program Excluding LOE

0.5

0.6

0.7

0.8

0.9

1

Mar Apr May Jun Jul AugSPIEarned Schedule (SPIt)Linear (Earned Schedule (SPIt))

SPI

Time (Months)

Page 32: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 32

ES Independent Time Estimate At CompleteCalculated on 14 month planned duration

• Total Program• 14 ÷ Average ES

(SPItime) • 14 ÷ .79 = 17.7 months

(3.7 month Slip)

• Program w/o LOE• 14 ÷ Average ES

(SPItime) • 14 ÷ .737 = 19 months

(5 month Slip)

ES - ITEAC

Page 33: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 33

Observation - ES on actual projects

•ES is based on incremental gains against BCWS−Observing incremental schedule gains with

SPT(t) will lead to more volatility of data points like monthly CPI

−Reacts faster to schedule issues than SPIc−Potential for Duration forecasting−May require several months data to establish

actual trend−Trend lines may be used to smooth data−Check and balance for current metrics

Page 34: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 34

ES Summary -

• New & Emerging Concept−Academic Research and Proof of Concept

• Air Force Studying Concept• PMI Australia and Belgium (Academic Studies)• Boeing in Seattle on the 787 DreamLiner• UK MoD on Nimrod and Type 47 Destroyer Projects

• ES requires a firm baseline / sound EVM practices – ES will not cure -− PMF (Performance Measurement Flexline)− EV “Gaming”

• Non Critical Completions; Front Loading−Does not replace Critical Path Schedule Analysis

Page 35: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 35

ES Summary

• Moving Forward−Adoption of ES in EVM and PM Practice− Education and Training − Incorporation of ES formulas in EVM / PM

software−Used in conjunction with current validated

metrics for project measurement and analysis

• Bottom Line –−Appears to be a better way to analyze EVMS

schedule performance− First new concept in Earned Value theory &

practice since C/SCSC established in the ’60’s

Page 36: Earned Schedule - New analysis of schedule in EVM Schedule - New analysis of... · © Lockheed Martin Aeronautics Company $ 5 ΣBCWS ΣBCWP Time Now 1 23 4 6 8 9 107 A B SV c SV t

© Lockheed Martin Aeronautics Company 36

Learn More ? ES Web Site

www.earnedschedule.com

Questions ?