Evaluating problem-structuring methods: developing an approach to show the value and effectiveness of PSMs

Abstract

This paper discusses the challenges associated with the evaluation of problem-structuring methods (PSMs). PSMs are seen as complex interventions that seek wide-level change and action at many levels including individual and system. There is now a widespread acceptance that the traditional evaluation approaches are inappropriate for the evaluation of PSMs. The difficulty is compounded when PSMs are used in multi-agency settings. The paper proposes that evaluation, while pragmatic and situated, must be a theory-based exercise. Part of the challenge is to provide a narrative of the intervention as well as an agreed assessment.

Keywords:

• problem structuring methods
• evaluation
• soft OR

Acknowledgements

I thank John Mingers and Katie Germer for their comments on an earlier version of this paper. In addition, I also thank Jonathan Rosenhead and Mike Cushman for the interesting discussions following a presentation of some of the ideas discussed in this paper.