RSP - Publishing Support

Individual metrics are not 'good' or 'bad' but you need to ensure they are appropriate to the question you are trying to answer.  It is all dependent on what, who and how you are trying to measure, as well as the time frame under consideration.  

As well as selecting appropriate measures, using metrics responsibility involves having an awareness of the impact that measuring may have on behaviour. Metrics can be gamed in various ways and behaviour which would be desirable can end up being viewed as just 'compliance'.  

Key things to consider are the discipline and the size/structure of the entity under evaluation. Think about: 

• Who are you evaluating? (individual, group, institution...) 

• Why are you evaluating? 

• Do you need to evaluate at all? 

There are lots of reasons why we might want to measure. These include: 

1. To analyse - understand where we are  

2. To advocate - promote an entity be that an individual or the institution as a whole 

3. To be accountable - set targets and ensure goals are met 

4. To acclaim - compare one entity to another 

5. To adapt - promote a change/incentivise 

6. To allocate - rewarding successes 

The table below, created by Lizzie Gadd (2019), provides an indication of what level of caution should be applied when using metrics in different contexts, i.e. how much care we should take with any analysis and the weight of any results. It can be used as a starting point to consider 'how' and 'why' we are measuring and check that the indicator(s) used are appropriate to what you are seeking to measure. 

When assessing individuals or small groups using metrics, the impact is likely to be much greater than when assessing larger entities where measuring is likely to have little affect. Consequently, care must be taken in terms of selecting the metrics used and how the outcomes are interpreted.  

A change in behaviour requires more than measuring. As the saying goes 'you can't fatten a pig by weighing it'.  In order for appraisal to be valuable, it is important to ensure you are using appropriate metrics to enable useful analysis which will then lead to action.  Understanding, capability, opportunity and motivation are essential in developing benchmarks and measurements that lead to positive change. 

Follow the links below to more information on metrics: 

• Types of metrics (options) 

• Sources of metrics 

• Considerations when using metrics 

• Evaluating your use of metrics 

• Available training on metrics 

• Test your knowledge quiz