The effect of benchmarked performance measures and strategic analysis on auditors' risk assessments and mental models

As the audit environment becomes more demanding and complex, so does the set of analytical tools available to an auditor. The purpose of this paper is to examine the effect of two complex audit technologies commonly used by auditors, benchmarking of performance measures and strategic analysis, on the risk judgments of auditors carrying out the initial planning of an audit. We conduct an experiment that utilizes a Balanced Scorecard for organizing and evaluating analytical evidence about the performance of business units within a large client. Our first principal finding is that external benchmarking can cause an auditor to focus on performance measures that are unique to a business unit and disregard performance measures that are common to multiple business units but not benchmarked. However, our second finding is that an in-depth strategic analysis completed prior to assessing a client's business risk or risk of material misstatement allows an auditor to incorporate more information from performance measures in risk assessments regardless of whether the performance measures are benchmarked. Strategic analysis facilitates a more balanced and accurate assessment of the risks across the business units being evaluated. We also provide evidence that the latter result occurs because in-depth strategic analysis allows auditors to develop a more complete mental model of a client, which has been a long time belief of advocates of business risk audit methodologies and consistent with current and emerging auditing standards on risk assessment.