“If you don’t measure something, you can’t change it. The process of leadership is one of painting a vision, then saying how you’re going to get there, and then measuring whether you’re actually getting there. Otherwise, you risk only talking about great things but not accomplishing them.” Mitt Romney
Continual improvement is a prerequisite for any organization’s success. A continual improvement process, also often called a continuous improvement process (abbreviated as CIP or CI), is an ongoing effort to improve products, services, or processes. These efforts can seek “incremental” improvement over time or “breakthrough” improvement all at once. Delivery (customer valued) processes are constantly evaluated and improved in the light of their efficiency, effectiveness and flexibility (Wiki).
Gauging whether there is incremental improvement and setting up mechanisms to track and measure these improvements is the difficult part and this is where Metrics come in. I am passionate about metrics and have written about my favourite performance management metrics in business, sales and human resources earlier. In this guest post, Kavita Verma draws upon her PMO experiences to list the most effective project management metrics that can be used by project managers to determine the success of their projects.
‘Metric’ is defined as “Standard of measurement by which efficiency, progress, performance, productivity, quality of a deliverable, process, project or product can be assessed”. Metrics help in building predictability, improving organization’s decision making ability, and lay out what is working and what is not working within the organization and help guide the management focus in the right directions.
Project management metrics enable Project managers to:
- Assess status of ongoing project in terms of schedule, cost and profitability.
- Foresee any potential risks.
- Nail down the problems much before they become severe.
- Keep a check on project profitability.
- Assess productivity of team.
- Assess quality of work products to be delivered.
There can be different project management metrics defined based on complexity and nature of project. However, following five performance metric groups cover all the important aspects of a project to measure during execution:
Project Management Metrics #1: Schedule and Effort/Cost Variance
The goal of this metric is to measure the performance as well as progress of the project against signed baselines. This metric is very important and is the base for profitability of project. The EVM (Earned Value Management) concept, as defined by PMI standard PMBOK, is the commonly used method to track this metric. It integrates project scope, cost and schedule measures to help the PM to assess and measure project performance and progress. The principles of EVM can be applied to all projects, in any industry. Under this method, at any given point in time, project performance to date is used to extrapolate the expected costs and duration at project completion. This technique uses past performance (i.e. actuals) to more accurately forecast future performance. EVM develops and monitors three key dimensions of each work package:
Planned Value (PV): How much you planned to spend for the work you planned to do i.e. it is the authorized budget assigned to the work to be accomplished for an activity or work breakdown structure component. Total PV is also known as Budget at Completion (BAC). PV at any stage = (Planned % Complete) X (BAC)
Earned Value (EV): Earned value is the value of work performed expressed in terms of the approved budget assigned to that work for an activity or work breakdown structure component. It is the authorized work that has been completed, against the authorized budget for such completed work i.e. EV is ‘how much you planned to spend for the work you actually did’. Earned Value is also known as the Budgeted Cost of Work Performed (BCWP).
Actual cost (AC): Actual cost is the total cost actually incurred and recorded in accomplishing work performed for an activity or work breakdown structure component. It is the total cost incurred in accomplishing the work that the EV measured. I.e. how much you spent for the work you actually did. Actual Cost is also known as the Actual Cost of Work Performed (ACWP).
Using these three variables project Schedule variance and Cost variance metrics can be derived which shows if the project is running over or under budget; project is running behind or ahead of schedule, as follows:
Schedule Variance (SV) is the measure of schedule performance of the project. It is the difference of Earned value and the planned value i.e. SV = EV – PV
- Positive result means that you are ahead of schedule.
- Negative result means that you are behind schedule.
Cost Variance (CV) is the measure of cost performance on the project. It is equal to earned value (EV) minus actual costs (AC). Any negative CV is often non-recoverable to the project.
CV = EV – AC
- Positive result means that you are under budget.
- Negative result means that you are over budget.
Since EVM method allows PM to extrapolate the expected costs and duration at project completion based on project performance to date, PM can develop a forecast for the estimate at completion (EAC) which may differ from the budget at completion (BAC) based on project performance. Forecasting of EAC involves making estimates or prediction of conditions and events in the project’s future based on information and knowledge available at the time of forecasting. EAC is typically based on actual cost (AC) incurred for work completed, plus an estimate to complete (ETC) the remaining work. I.e. EAC = AC + ETC.
Based on this PM can also derive another metric, Variance at completion (VAC) = BAC – EAC
Project Management Metrics #2 – Productivity: Resource Utilization
The objective of this metric is to measure productivity of resources involved in project and let PM assess over or under-utilization cases.
Utilization% = Total Effort spent by resource/Total Budgeted Effort for the resource
Budgeted effort is the planned billable work of resource. Any over-utilization and under-utilization indicated by this metric has an impact on the project’s profitability. It is important for the PM to track this metric very closely and find out the reason for deviations and the action items to bring back resource utilization to optimal level. Delayed projects, increased ramp up activities, less work provided by customer, unplanned vacations, less competent resources can impact this metric. To get better control over this metric, robust time reporting systems should be available in the organization. Using this, PM can analyze effort distribution across different project phases/activities. For e.g. Effort distribution can tell PM that how much effort is being spent on defect resolution, customer support or design activities. PM can take corrective actions based on this, if required. For instance, if the resource is complaining that customer support is taking considerable time but the effort distribution shows it otherwise, PM can see where the corrections are needed on what resource is doing. Effort distribution from time reporting systems can also tell the areas of improvement for better estimations/planning for the next project.
Project Management Metrics #3: Change requests to Scope of work
Signed Scope baseline with customer forms the baseline for the entire project planning and development. Any change to signed scope should happen in controlled manner. So here comes another important metric for PM to track i.e. the number of change requests coming from customer for the already signed scope of work. Each and every change request, once approved by internal change control board (CCB), requires update to Scope baseline which in turn has a cascade impact on cost baselines and schedule baselines and resource plans. Uncontrolled change requests often result in project scope creep and further impact negatively on the project cost/schedule, which is the worst thing to happen for any project. PM should never allow such scope creep. Based on the magnitude of the variance from original scope baseline, CCB should decide whether to accept or reject the change request and this decision should be communicated back to customer. In case of acceptance of change request, the impact on project cost and schedule should be clearly communicated in written form to customer and a written agreement from customer secured on those from customer before proceeding.
Project Management Metrics #4: Quality and Customer Satisfaction
Throughout the execution of project, Quality Assurance should always be on the radar of project manager. Quality here is defined as the number of severe, medium or low defects delivered through the lifetime of the project. It indicates the health of the deliverable to the end user and drives the Customer Satisfaction. PM needs to define, based on project type, what severe, low and medium means. Quality should be reported throughout the life of the project; the later defects are caught, the more impact they will have on the project. Under quality metrics, following are the key ones to track:
Defect density = Total number of defects found/ Measure of size.
For e.g. in case of software projects this can be: how many defects are found in 1KLOC (Kilo line of code). In general, size measure can be considered as planned effort like ‘person day total planned effort’.
Number of days since the defect is open and not fixed. It can also be inferred as the time customer has been waiting for their issues to get resolved,
Defect resolution rate = Total number of defects resolved/ Total effort spent
Rate of closing the open defects over a period of time. If the rate of resolution is not in line with the defects being opened over a particular time, this indicates to the PM a situation of concern.
Number of defects reported by customer
PM should keep this as a separate metric to differentiate from the defects reported out of internal testing and the defects reported by end user i.e. Customer. Customer satisfaction depends a lot on the quality of deliverable provided and on how fast defects raised by customer are resolved.
As said above, the later defects are caught, the more impact they will have on the project, it is worth to mention here about Pareto’s principle i.e. 80/20 principle, which PM can use to categorize causes of defects and late time entry relationship. As per this law 80% of the problems are due to 20% of the causes. PM can concentrate on these 20% causes impacting the project most.
Project Management Metrics #5: Gross Margin
Gross Margin (as I wrote in my earlier post on key performance metrics) is the mother of all metrics and the quickest way to determine if your business in on track or not and acts as an early warning system to put in place margin improvement initiatives. Ultimate goal of project execution is to bring revenue to organization with the approved gross margin. Gross margin (GM) is basically the difference of total revenue and the total cost spent on project i.e. profit.
When a project is started, certain GM levels for the project are approved by project sponsor. This approved GM value is generally based on project scope definition, duration, a forecast of resources: onsite, offshore and organization’s investment analysis. Project PNL (Profit and Loss) statement gives a way to PM for tracking his/her projects GM metric at any point of time. For this, PNL statements and forecasts should be current documents i.e. changes in project parameters need to be reflected quickly in this statement to keep the PM informed about any potential risks to project profitability. All the above four project management performance metrics impact this metric, if not handled in controlled manner. A good organizational level PNL tool rather than manual excel sheets reduces the overhead on PM here.
While working with all of these metrics, following points should be very clear in the project manager’s mind:
- What to measure
- How to measure
- How to gather data to measure and represent
- How to analyze gathered data and what actions to be defined based on that
- How to show improved effectiveness of metrics by using improved numbers ‘before’ and ‘after’
In my view these five project management performance metrics are critical metrics to be tracked while taking charge and during execution of a project. The continued analysis of these metrics provides additional insights into what is working and what is not, allowing the PM to make appropriate improvements. These metrics also help in building up historical data for similar kind of projects so that in future, better project planning can be done. Success story of project can be then built up based on the effectiveness of defined metrics by showing the improved numbers “before” and “after”. This ensures that the effort spent by team in collection and measurement of data for these metrics is leading to continuous improvements and not just an overhead activity.
In summary, metrics improve decision making ability by providing the foundation and rationale for the decision by making explicit what is usually implicit in the decision-making process.
So what are your experiences when it comes to project management performance metrics and tracking? What are some of the other project management metrics you have been tracking? We would love to hear and learn from you.
Love Performance Metrics ? Here are some more posts that may be useful for you:
Five Performance Metrics Key to Successful Business Operations – Business Management
Five Human Resource Metrics that link People to Business Strategy – Business Operations Performance Metrics
Five Metrics that can help Maximize Revenue and Cash Flow Potential from existing Business – Business Operations Performance Management
Business Operations Performance Metrics: Gross Margin – Five Steps to Improve your Margin
Business Operations Performance Metrics: Cash Flow – Five Steps to Improve your DSO
Five Sales Performance Metrics Key to Successful Business Operations
References: www.PMI.org : PMBOK 4th Ed.
Today’s guest post is from Kavita Verma, PMP who is the Director – Global Program Office at a leading IT services company. She is a dynamic and outcome-oriented Program Manager with a fulfilling career spanning over 10 years of extensive industry experience in full software life cycle of requirements definition, architecture, design, prototyping, product implementation, integration and testing of Embedded Mobile Application and Platform Middleware.
Pic Courtesy : http://www.flickr.com/photos/ebonysweden/10120374843/
[…] "If you don't measure something, you can't change it. The process of leadership is one of painting a vision, then saying how you're going to get there, and then measuring whether you're actually ge… […]
[…] We start today with a guest post from Kavita Verma at blogbysuchitra, in which she shares her Five Project Management Performance Metrics Key to Successful Project Execution – Operational … Next we head to learning people.co.uk, where you can find Your Mini IT Project Management […]
[…] Five Project Management Performance Metrics Key to Successful Project Execution – Operational Exc… […]
Can i know what type of tool you use this for measuring performance. Is it possible via excel? if you have any template, if possible could you share it?
Your help would be highly appreciated
very helpful…thank you
[…] Source: Five Project Management Performance Metrics key to Successful Project Execution – Operational Exce… […]
More considerations for the successful project management.
for measuring the performance of project managers are there any different methods or we can just relate the same methods of measuring the projects performance??
Thanks for dropping by and commenting. Thing to remember while deciding the parameters of performance for a project manager, is that you are dealing with a human being and not just a project 🙂 So, apart from number-based (metrics) targets, there has to be targets for the softer aspects as well – team leadership, learning, initiative, etc. this post-http://obolinx.com/resources/2013/09/five-key-considerations-for-successful-project-management-operational-excellence/ -can give you a few more ideas.
Very helpful topic. Do you have excel templates that can be used for live data.
Once again thanks sharing for the information.
Hope you are still following posts on this thread. We have a project at work to show executive management team how the organization is performing on project management. The idea is to summarize all projects in the organization and tell them if the teams working on projects are efficient or not. Are projects being completed timely, how often due dates are revised, are projects on track, where should they focus their attention (who do they need to hammer on). If I had to summarize efficiency in one chart, what would be the best metric to use to show that efficiency?
Thanks for dropping by. For exec management presentations on projects, if I had to choose one metric to show the status of projects – it would definitely be gross margin – planned vs actual for the project. This metric would show the impact – positive or negative – of everything that you have mentioned (timely completion, team efficiency, multiple base-lining of project plan, etc.). Along with these two number, you can give a quick summary explanation in an additional column (reasons for dip/increase) citing the problem area or efficiency area as the case may be. And don’t forget to use colour coding (red, amber, orange) as well for a quick visual status. Does that make sense to you ?
Thanks for reading and appreciating. Unfortunately, I do not have readymade excel templates to share with you. But, I believe quite a few project management sites offer these for free or on subscription. Perhaps try a Google search ?
[…] Five Project Management metrics key to successful project execution – operational excellence […]
Good day! This is my first visit to your blog! We are
a team of volunteers and starting a new initiative in a community in the same niche.
Your blog provided us useful information to work on. You have done a marvellous job!
cialis online pharmacy
kamagra 100 mg on line
buy cialis cheaper online: cheap generic cialis buy cialis online in canada
buy cialis cheaper online
ivermectin ebay: stromectol cvs – stromectol price
doxycycline online: doxycycline hyclate 100 mg – doxycycline 100mg online
buy doxycycline online 270 tabs: doxycycline for sale – doxycycline tetracycline
where can u buy cialis: buy cheap cialis uk can i buy cialis online
where can u buy cialis: cialis 5mg tablet buy cialis online at lowest price
buy cialis 36 hour online: buy cialis online best price buy cialis doctor
canadian pharmacy cialis 20mg: buy cialis online best price buy cialis online europe
cialis without presciption in usa: cialis 20mg for sale cialis original for sale
ordering cialis online australia – buy cialis without perscription find cheap cialis online
cialis for daily use – buy cialis drug cialis original for sale
buy cialis ebay – buy cialis united kingdom cialis sale 20mg
buy cialis 36 hour online – buy cialis online generic original cialis low price
monthly cost of cialis without insurance: cialis 5mg tablet where can u buy cialis
cialis 20mg usa: cialis soft tablet cialis without presciption in usa
priligy plus viagra
kamagra en espana
worldwide pharmacy kamagra
buying lasix online
india online pharmacy isotretinoin
safest place to buy clomid in the uk
buy clomid online no prescription uk
buy accutane 40 mg online
viagra dapoxetine reviews
does viagra help premature ejaculation
fastest way to get clomid pct
antabuse without prescription
antabuse online pay with paypal
cialis 40 mg
buy cialis online prescription
generic cialis 5mg
cialis cost per pill
canadian generic cialis online
viagra 100mg price
sildenafil price comparison
can i buy antabuse over the counter
viagra 25 mg
generic sildenafil cost
ivermectin cream uk
prescription cialis online pharmacy
generic viagra soft tabs uk
hydroxychloroquine sulfate buy
megalis 20 tablet for female
buy cialis tablets australia
ivermectin 3 mg
where do i get viagra
sildenafil over the counter usa
cipro 500 mg
prednisone 2.5 tablet
where can i get albendazole
stromectol 3 mg tablet
female viagra pills buy in india
benicar hct coupons
retino 0.05 gel
cialis over the counter south africa
ivermectin where to buy
dexamethasone 1 mg tablet
how to get ivermectin
tadalafil tablets in india
generic sildenafil usa
viagra in mexico cost
generic cialis professional
viagra 100mg online
best viagra brand
cialis generic online uk
tadalafil uk prescription
tadalafil 20mg canada
how much is disulfiram cost
viagra usa over the counter
where can i buy seroquel
50 mg viagra for sale
generic cialis tadalafil 20mg
how to buy cialis over the counter
can you buy cialis online from canada
how to get ivermectin
order viagra 100mg
viagra gel for sale uk
stromectol pill price
40 mg paxil
stromectol 3mg tablets
cheap female viagra online
zestoretic 10 12.5 mg
buy generic viagra from canada
viagra australia pharmacy
lowest price viagra uk
cialis one a day
online viagra cheap
purchasing viagra in mexico
over the counter viagra in canada
cheap viagra 50mg