An objective way to evaluate project managers

1 comment | 5I like it!
September 26, 2008, 11:41 AM —  CIO.com — 

Project managers are ultimately responsible for making sure projects are completed on time, on budget and with the features and functionality specified by the project's stakeholders. So one would presume that project managers' performance would be evaluated based on those same criteria. It sounds obvious, right?

In fact, it's not always the case that project managers are evaluated on the basis of whether their projects are completed on time, on budget or with the required functionality.

At EDS, for example, project managers are reviewed based on subjective criteria, such as their communication skills, passion for achieving business results and business ethics, according to Jed Zaitz, a senior project manager with EDS's Medicaid Management Information Systems Group. Zaitz says objective, measurable criteria, such as whether a project manager's projects are completed on time or on budget, are not factored into performance appraisals for project managers at EDS because in many cases those metrics aren't available.
But Zaitz wants that to change.

"Project managers, unlike business analysts, testers or developers, have responsibility for project delivery, and they should be measured on their success or failure. That should at least be factored into the appraisal," he says. "To ignore objective metrics makes no sense."

Objective Metrics Are Key to Company Success

Zaitz, who earned his PMP (project management professional) certification from the Project Management Institute, believes objective metrics can help improve project managers' project delivery rates. If, during performance reviews, project managers find out exactly where their performance is falling short, their managers can talk with them about ways to improve their performance.

"Improvement of one or two percent in a project manager's performance would add huge numbers to the bottom line of a company," says Zaitz, who's worked for EDS for 32 years. "Even a small improvement would have very significant results."

Zaitz developed a methodology for evaluating project managers' performance about nine months ago, while he was managing a team of 15 project managers who completed five to six projects each year. The methodology is based on the traditional definition of a successful project: one that comes in on time, on budget and with few defects.

Zaitz's Performance Review Methodology

Here's how Zaitz's performance review process works: Project managers earn 100 points for completing a project. But if the project isn't completed on time, the project manager gets points docked from his score-say two points for every week the project is late.

Similarly, if the project comes in over budget or is implemented with defects, the project manager loses points-such as a half a point for each defect found within 60 days of the project going live or a half a point for each one percent the project went over budget.

Project size is also taken into consideration. Zaitz measures the size of each project according to its number of function points.

Zaitz notes that organizations can subtract more or fewer points from a project manager's score depending on which elements of project success (e.g. time, budget and quality) they wish to emphasize. For instance, if an organization prizes speed over quality, and if a project manager misses the go-live date, the project manager could be docked five points for each week the project was late instead of two.

Though Zaitz's methodology is focused on objective metrics, it takes into consideration stretch goals, such as early delivery of projects and technical productivity (getting more done with fewer resources or for less money), and soft skills. For example, if project managers complete their projects ahead of time or under budget, they can earn bonus points (especially if quality is not compromised.)

EDS hasn't adopted Zaitz's methodology, but the senior project manager says one group within the company plans to pilot it. He adds that rolling out the methodology throughout the company, which was recently acquired by HP, will require a significant cultural change. But the reward may be greater than the risk.

Says Zaitz: "For an organization like EDS, which probably has 1,000 project managers, it's very important to know its true top performers because if a new project comes up that's very challenging for a very important customer, you want to pick the right person to work on it."

If you're interested in learning more about Zaitz's methodology (he's written a white paper on it), you can contact him at jed.zaitz@eds.com.

» posted by ITworld staff

CIO.com

I like it!
Comments

"...if a new project comes

"...if a new project comes up that's very challenging for a very important customer, you want to pick the right person to work on it."

This flies in the face of conventional wisdom, which says that when new work comes up the only skill that matters is availability... ;-)
| reply
Free books

Build your tech library with our book giveaways.

Windows PowerShell 2.0 Unleashed
By Tyson Kopczynski, Pete Handley, Marco Shaw; Published by Sams

Windows PowerShell Unleashed will not only give you deep mastery over PowerShell but also a greater understanding of the features being introduced in PowerShell 2.0–and show you how to use it to solve your challenges in your production environment. Enter now!

 

Ubuntu Server Administration
By Michael Jang; Published by McGraw-Hill Osborne Media

Realize a dynamic, stable, and secure Ubuntu Server environment with expert guidance, tips, and techniques from a Linux professional. Ubuntu Server Administration covers every facet of system management -- from users and file systems to performance tuning and troubleshooting. Enter now!

Featured Sponsor

AISO founders envisioned a Web hosting company that was environmentally friendly. While the company employed energy-efficient innovations like solar panels, its infrastructure produced unacceptable power and cooling requirements. Find out how AISO leveraged AMD technology to overcome their challenge in this case study white paper.

In this whitepaper, Scalar explores the opportunity to change the landscape with respect to mission critical databases built around Oracle. Leveraging technologies such as Linux, high-end commodity processing power and Oracle RAC technology to architect, design, build and maintain database infrastructure that delivers maximum availability, reliability and performance at a fraction of traditional cost.

On a typical day, weather.com, the Web site for The Weather Channel in Atlanta, serves up between 15 million and 20 million page views. But in September 2004, when back-to-back hurricanes ransacked Florida, the peak traffic on one day more than tripled: over 70 million page views by more than 7 million unique visitors. Read the full success story now.

More Resources