1. Main points

  • Revisions to estimates published in the annual Blue Book 2020 were relatively modest in comparison to previous years, and revisions up to three years after the first published estimate are not statistically significant.

  • Revisions are typically larger around turning points, but this might be more pronounced because of the challenges in compiling their National Accounts over the course of the pandemic.

Back to table of contents

2. Overview of revisions

There is a trade-off between the timeliness and accuracy of estimates of gross domestic product (GDP). As additional information becomes available, we have a more complete picture of economic activity in that period. This production cycle can take up to three years and leads to revisions. The annual Blue Book process is also when major methodological improvements are introduced.

To assess revision performance, we can estimate:

  • the mean revision (MR), which shows whether there is a systematic tendency for initial estimates to be revised upwards or downwards

  • the mean absolute revision (MAR), which measures the absolute size of revisions so that upward revisions are not offset by downward revisions of the same magnitude

  • the mean square revision (MSR), which incorporates the degree of bias and the variance of the revision, as large revisions are treated more seriously than small revisions

This article analyses the revisions in Blue Book 2020. It then looks at initial revisions to UK GDP compared with those in other countries in 2020.

Back to table of contents

3. Revisions in Blue Book 2020

Figure 1 shows the revisions to volume estimates of gross domestic product (GDP) in recent Blue Books. Revisions to Blue Book 2020 were relatively modest with a mean absolute revision (MAR) of 0.08 percentage points compared with an average of 0.11 percentage points over this entire period.

Figure 2 shows there is a zero mean revision (MR) at T+3 months, implying that there is no tendency for the first estimate to be revised up or down. The MR is a little higher when comparing the first published estimate with later ones. The initial revisions (T+3 months) and those that tend to reflect the incorporation of annual benchmarks and balancing in a supply and use framework (T+24 months and T+36 months) are not statistically significant (Table 1). This is not the case for those revisions in the more mature estimates. Since these methodological changes cannot be anticipated at the time of the first estimate, these revisions are a less accurate reflection of the quality of early estimates.

Figure 2 shows that it is more likely that there will be a higher frequency of offsetting revisions in the first two years, relative to the subsequent revisions. This highlights why a low MR can be a misleading signal of quality. While the MR is largely similar at T+3 months and T+24 months, there is a more marked increase in the MAR.

Figure 3 shows that the quality of early estimates has improved over time, which likely reflects cyclical and structural factors. There have been improvements to the measurement of GDP as well as a lower degree of volatility in the UK economy. Figure 4 shows that the earlier periods were inherently more volatile for the UK economy relative to the most recent periods, which has also coincided with there being lower revisions of late - although this excludes the coronavirus (COVID-19) experience for 2020 onwards. There have also been improvements in how we record GDP estimates, which is likely to be another explanation for the lower mean square revision (MSR) in these years.

Back to table of contents

4. Revisions in the coronavirus (COVID-19) pandemic

Previous analysis shows revisions have typically been larger around turning points, which might be more pronounced because of the challenges for National Statistical Institutes (NSI) in compiling their National Accounts over the course of the pandemic. In the UK, we have had to review continually how we measure non-market output while we have initially relied on forecasts in estimating the Coronavirus Job Retention Scheme (CJRS) and the Self-Employment Income Support Scheme (SEISS) subsidies. These higher uncertainties have been inevitable but have led to larger revisions in our early estimates.

Given the revisions policies of NSIs, it is unclear when these revisions may be reflected in later estimates of gross domestic product (GDP), so these international comparisons are only indicative at this stage. Furthermore, traditional indicators of revisions do not consider the point estimate of GDP itself. Given the record quarterly changes in GDP, revisions might be larger for this period.

There are no "final" estimates yet, so we compare the first estimate with more mature estimates available as a proxy of this uncertainty. It should be noted that the most recent vintage of GDP here does not necessarily correspond to the latest published GDP estimates. We show specific vintages at three monthly intervals.

Figure 5 shows that the contraction in UK GDP in Quarter 1 (January to March) 2020 has been revised down over time. Italy experienced a similar profile of revisions over time, while Germany and Canada had slight upward revisions over time. For the US, France and Japan, GDP estimates for the first quarter are broadly unrevised.

For Quarter 2 (April to June) 2020, the UK initially estimated that GDP fell by 20.4%, which has been revised up in the latest published figures to a 19.5% contraction (Figure 6). Canada and the US have similarly experienced upward revisions, while Italy and Japan have revised down their initial estimates.

There has been a range of estimates for the peak-to-trough falls in GDP in the first half of 2020. Figure 7 shows the latest estimates as well as the maximum and minimum estimates over the revision period. In the UK, the cumulative fall was initially estimated to be 22.1% but is now estimated to be 21.8% - a relatively small revision given the speed and magnitude of the coronavirus (COVID-19) impact. Only Italy and Japan have revised down their estimate for the first half of the year.

Back to table of contents

5. Glossary

Gross domestic product (GDP)

A measure of the economic activity produced by a country or region. There are three approaches used to measure GDP:

  • the output approach
  • the expenditure approach
  • the income approach

A more detailed glossary is available.

Back to table of contents

6. Future developments

Revisions are typically larger around turning points. It has been particularly challenging for National Statistical Institutes to compile gross domestic product (GDP) estimates over the course of the pandemic, given the heightened levels of statistical uncertainty.

As more information becomes available over time, this might lead to higher levels of revisions in more mature estimates, which might also impact upon international comparisons. We will communicate such revisions as part of our future engagement to improve wider understanding of the effects of the coronavirus (COVID-19) pandemic. 

Revisions in this article relate to data published in the UK National Accounts, The Blue Book: 2020.

More detailed information on the compilation of the latest national accounts, including quality and reliability issues, is available in the background notes.

Back to table of contents

Contact details for this Article

Sumit Dey-Chowdhury, Samar Kazranian, Eugenia Merayo and Andrew Walton
gdp@ons.gov.uk
Telephone: +44 (0)1633 455284