Lessons Learned in Project Metrics

[Pages:13]Leading Answers Inc. - Lessons Learned in Metrics

Lessons Learned in Project Metrics:

Are Your Metrics Dumb or Smart?

February 16th, 2010 Software QA Discussion Group

Mike Griffiths, PMP Leading Answers Inc.



My Background

? Project Manager and Trainer

? >20 years IT experience on utilities, defense, & finance ? 8 years PMO Agile-to-Traditional Integration

? Agile Project Management

? Helped create Agile method DSDM in 1994 ? 16 years agile project experience (DSDM, XP, Scrum, FDD) ? Board director of Agile Alliance and APLN ? Author, trainer, and presenter Agile Conference 2001-9

? Traditional Project Management

? PMP, PRINCE2 certifications ? PMBOK v3 contributor and reviewer ? Trainer for PMI SeminarsWorld 2005-2010 ? Presenter PMI Global Congress 2004-2009

Copyright ? 2010 Mike Griffiths. All Rights Reserved



1

Leading Answers Inc. - Lessons Learned in Metrics

6) Smart Metric examples

? 1 ?2 ?3 ?4 ?5

5) Leading vs. Lagging Metrics

4) Measuring Up

Agenda

1) Measurement Troubles

2) The Hawthorne Effect

3) "Design Factory" Metrics

Metrics are like fire...

Copyright ? 2010 Mike Griffiths. All Rights Reserved



2

Leading Answers Inc. - Lessons Learned in Metrics

Measurement

Not all observations are useful:

? The sun rises up in the sky in the morning and then falls down again at night ? Planets revolve around the earth ? Stars come out at night ? Heavier objects fall faster than lighter objects

"There are so many possible measures in a software process that some random

selection of metrics will not likely turn up something of value" ? Watts Humphrey Not all useful things are easily observable:

? Spouse's mood ? Sponsor Confidence ? Team Commitment

"Not everything that can be counted counts, and not everything that counts can be counted" ? Albert Einstein.

The Hawthorne Effect

You will influence what you measure... Copyright ? 2010 Mike Griffiths. All Rights Reserved



3

Leading Answers Inc. - Lessons Learned in Metrics

Design Factory Metrics

Metrics Should be: 1. Simple, self-generating 2. Relevant to the end-goal 3. Ideally, leading, future-focused

Traditional Metrics Examined

Desirable Characteristics:

The Hawthorne Effect is positive Simple, self generating Relevant to the end-goal Leading, future-focused

Traditional Metrics:

? Lines of Code Written ? poor, does not reward simplification, leads to code bloat

? Function Points Delivered ? poor, effort to generate, not relevant to the end-goal of project

? Hours Worked ? poor, leads to long hours, burn-out, defects, consumed budgets

Copyright ? 2010 Mike Griffiths. All Rights Reserved



4

Leading Answers Inc. - Lessons Learned in Metrics

Smarter Project Metrics

Since you will influence what you measure...

Choose Smarter Metrics:

? Features Accepted ? Sponsor Confidence ? User Satisfaction ? Defect Cycle Times

Smarter Metrics

? Features Accepted

Scope (points)

IPS Project Progress

Spend

3000

2500

Not Started

2000

In Progress

Accepted

SAccocpeeptBeduilt 1500

1000

500

0 1/10/06 1/12/06 1/2/07 1/4/07 1/6/07 1/8/07 1/10/07 1/12/07 1/2/08 1/4/08 1/6/08 1/8/08 1/10/08 1/12/08 1/2/09 1/4/09 1/6/09 1/8/09 1/10/09 1/12/09

Copyright ? 2010 Mike Griffiths. All Rights Reserved



5

Leading Answers Inc. - Lessons Learned in Metrics

Smarter Metrics

? Features Accepted

Features

450 400 350 300 250 200 150 100

50 0 Jan Feb Mar Apr May Jun Jul Time

NNoottSStatartretded IInnPPrrooggrersess CAocmceppletteedd

Aug

Feature Based Reporting

Example 2: Parking lot Diagrams

Feature Set Status: Not Started Work in Progress Completed Attention (i.e. behind)

Percentage Complete: Percentage Complete Bar

Target Completion Month: Not Complete Complete

FB Enter Order

Details (15)

24%

Mar 2010

Chief Programmers Initials Feature Set Name Number of Features in the Feature Set

The Feature Set called Enter Order Details has 15 features and is currently 24% complete. It is due to be completed by March 2010

Copyright ? 2010 Mike Griffiths. All Rights Reserved



6

Leading Answers Inc. - Lessons Learned in Metrics

Feature Based Reporting

CM

Create New Order (5)

100%

Jan 2010

Order Processing

DH

LF

Capture

Customer Details (9)

Enter Order Details (15)

75% Feb 2010

24%

Mar 2010

Customer Management

SW

Create New Customer

(8)

AW

Amend Customer

Details (6)

SW

Archive Customer

(4)

55%

20%

Mar 2010

Feb 2010

Feb 2010

RS

Process Payment

(11)

Apr 2010

Inventory Management

NC

KB

Stock

Search (6)

Item Details

(12)

95%

Jan 2010

75%

Feb 2010

Smarter Metrics

User Satisfaction

Copyright ? 2010 Mike Griffiths. All Rights Reserved



7

Leading Answers Inc. - Lessons Learned in Metrics

Smarter Metrics

? Sponsor Confidence

Smarter Metrics

? Defect Cycle Time

Copyright ? 2010 Mike Griffiths. All Rights Reserved



8

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download