TECHNICAL NOTE 2 DATA QUALITY
RELIABILITY
1 The estimates in this release are based on information obtained from a sample survey (EAS) and from administrative data collected by the ATO. Any collection of data can be affected by factors that affect the reliability of the resulting statistics, regardless of the methodology used. These factors result in non-sampling error. In addition to non-sampling error, sample surveys are also subject to inaccuracies that arise from the fact that a sample was selected rather than conducting a census. This type of error is called sampling error.
Sampling error
2 The majority of data contained in this publication have been obtained from a sample of businesses. As such, these data are subject to sampling variability; that is, they may differ from the figures that would have been produced if the data had been obtained from all businesses in the population. One measure of the likely difference is given by the standard error, which indicates the extent to which an estimate might have varied by chance because the data were obtained from only a sample of units. There are about two chances in three that a sample estimate will differ by less than one standard error from the figure that would have been obtained if all units had been included in the collection, and about nineteen chances in twenty that the difference will be less than two standard errors.
3 Sampling variability can also be measured by the relative standard error (RSE), which is obtained by expressing the standard error as a percentage of the estimate to which it refers. The RSE is a useful measure in that it provides an immediate indication of the percentage errors likely to have occurred due to the effects of random sampling, and this avoids the need to refer also to the size of the estimate. Selected data item RSEs at the industry division level for Australia are shown in the table overleaf. Detailed relative standard errors can be made available on request.
4 To illustrate, the estimate of total income for Transport, postal and warehousing in 2009-10 was $131,775m. The RSE of this estimate is shown as 1.0%, giving a standard error of approximately $1,318m. Therefore, there are two chances in three that, if all units had been included in the survey, a figure in the range of $130,457m to $133,093m would have been obtained, and nineteen chances in twenty (i.e., a confidence interval of 95%) that the figure would have been within the range of $129,140m to $134,411m.
5 The size of the RSE may be a misleading indicator of the reliability of some of the estimates for (a) operating profit before tax, (b) earnings before interest, tax, depreciation and amortisation and (c) industry value added. It is possible for an estimate legitimately to include positive and negative values, reflecting the financial performance of individual businesses. In this case, the aggregated estimate can be small relative to the contribution of individual businesses, resulting in a standard error which is large relative to the estimate.
Relative standard errors |
|
| | Sales and service income | Total income | Wages and salaries | Total expenses | Industry value added |
| | % | % | % | % | % |
|
2009-10 | | | | | |
| Agriculture, forestry and fishing | 2.6 | 3.2 | 2.6 | 2.5 | 4.5 |
| Mining | 0.4 | 0.5 | 1.4 | 0.9 | 0.9 |
| Manufacturing | 0.4 | 0.5 | 0.6 | 0.4 | 1.0 |
| Electricity, gas, water and waste services | 0.4 | 0.4 | 0.5 | 0.5 | 0.7 |
| Construction | 1.8 | 1.8 | 2.0 | 2.0 | 3.3 |
| Wholesale trade | 2.4 | 2.3 | 2.7 | 2.4 | 2.7 |
| Retail trade | 1.6 | 1.6 | 1.8 | 1.7 | 2.9 |
| Accommodation and food services | 1.6 | 1.7 | 2.1 | 1.8 | 2.3 |
| Transport, postal and warehousing | 1.1 | 1.0 | 1.2 | 1.1 | 1.8 |
| Information media and telecommunications | 0.8 | 0.8 | 1.1 | 0.9 | 0.9 |
| Rental, hiring and real estate services | 2.3 | 2.3 | 2.9 | 3.0 | 2.7 |
| Professional, scientific and technical services | 2.3 | 2.2 | 1.9 | 2.6 | 2.7 |
| Administrative and support services | 2.4 | 5.1 | 2.0 | 2.9 | 2.3 |
| Public administration and safety | 3.7 | 3.6 | 2.5 | 3.7 | 2.8 |
| Education and training (private) | 6.2 | 2.9 | 1.4 | 2.1 | 2.4 |
| Health care and social assistance (private) | 1.3 | 1.0 | 1.6 | 1.2 | 1.3 |
| Arts and recreation services | 1.4 | 1.6 | 2.9 | 1.9 | 2.9 |
| Other services | 2.4 | 2.6 | 2.3 | 2.1 | 3.7 |
| Total selected industries(a) | 0.5 | 0.5 | 0.5 | 0.6 | 0.6 |
|
(a) Excludes Division K Financial and insurance services. See the Glossary for the full definition. |
Non-sampling error
6 Error other than that due to sampling may occur in any type of collection, whether a full census or a sample, and is referred to as non-sampling error. All data presented in this publication are subject to non-sampling error. Non-sampling error can arise from inadequacies in available sources from which the population frame was compiled, imperfections in reporting by providers, errors made in collection such as in recording and coding data and errors made in processing data. It also occurs when information cannot be obtained from all businesses selected. The imprecision due to non-sampling variability cannot be quantified and should not be confused with sampling variability, which is measured by the standard error.
7 Although it is not possible to quantify non-sampling error, every effort is made to reduce it to a minimum. Collection forms are designed to be easy to complete and assist businesses to report accurately. Efficient and effective operating procedures and systems are used to compile the statistics. The ABS compares data from different ABS (and non-ABS) sources relating to the one industry, to ensure consistency and coherence.
8 Differences in accounting policy and practices across businesses and industries can also lead to some inconsistencies in the data used to compile the estimates. Although much of the accounting process is subject to standards, there remains a great deal of flexibility available to individual businesses in the accounting policies and practices that they adopt.
9 The above limitations are not meant to imply that analysis based on these data should be avoided, only that the limitations should be borne in mind when interpreting the data presented in this publication. This publication presents a wide range of data that can be used to analyse business and industry performance. It is important that any analysis be based upon the range of data presented rather than focusing on one variable.
REFERENCE PERIOD
10 Where businesses were unable to supply data for the 12 months ended 30 June, an accounting period for which data can be provided is used for data other than those relating to employment.
11 Estimates of financial data in some industries, such as
Mining and
Manufacturing, are heavily impacted by fluctuating commodity prices. In these industries the reporting by businesses for an accounting period that is not for the period ended 30 June, can result in different estimates compared with what they would have been, had the businesses reported for an accounting period ended 30 June.
12 In the second half of 2011, the ABS will release an information paper on the impact that businesses reporting for accounting periods other than those ended 30 June, has on the estimates presented in this release.
QUALITY INDICATORS
13 In the 2009-10 survey of
Australian industry, there was an 88.3% response rate from all businesses that were surveyed and found to be operating during the reference period. Data were imputed for the remaining 11.7% of operating businesses. This imputation contributed 8.1% to the estimate of sales and service income for
Total selected industries.