3101.0 - Australian Demographic Statistics, Jun 2013 Quality Declaration 
ARCHIVED ISSUE Released at 11:30 AM (CANBERRA TIME) 17/12/2013   
   Page tools: Print Print Page Print all pages in this productPrint All

FEATURE ARTICLE 2: FURTHER IMPROVEMENTS TO NET OVERSEAS MIGRATION ESTIMATION, DEC 2013


1. Introduction
2. Background
3. Improving the quality of input data used in estimating NOM - (NOM improvements 2013)
4. Results of improvements made to preliminary NOM estimation
5. Improved quality of characteristics available with final NOM data
6. Changes to revision timetables for NOM
7. Future Directions
8. Appendices


1. INTRODUCTION

Each year, there are more than 30 million overseas arrivals and departures (OAD) crossing Australia's borders, but only about 1% of these movements end up part of net overseas migration (NOM) estimates. Given the historical variability of NOM and that it currently accounts for well over half of Australia's population growth, accuracy in its measurement is critically important in determining accurate quarterly estimates of the resident population (ERP) for Australia and each of the States and Territories.

In 2007, to better measure the changes in traveller behaviour and more accurately capture and measure temporary migration, the ABS introduced improved methods for calculating NOM. This was referred to as the '12/16 month rule' method. The first model that was implemented for the new' 12/16 month rule' produced relatively large revisions between preliminary and final NOM estimates. Therefore, in 2010, the ABS introduced improvements based on a one year ago model. In addition, there was a change from an annual revision cycle for publishing final NOM, to a six monthly revision cycle. For further information see the Information Paper: Improving Net Overseas Migration Estimation, Mar 2010 (cat. no. 3412.0.55.001)

The 2010 changes to the preliminary methodology contributed to a significant improvement in the estimation of preliminary NOM. The main changes included utilising the benefits of processing an additional quarter of overseas arrivals and departures (OAD) input data; shifting from a two year ago model to a one year ago model; and reducing the pool of travellers using the model.

Over time, these improvements have consistently performed better than the previous 'two year ago' model. For 2006-07 there was a 55% improvement in preliminary NOM from the two year ago model to the one year ago model, for 2007-08 a 49% improvement, 2008-09 (94%), 2009-10 (71%) and 2010-11 (84%).

Despite the improvements made in 2010, the ABS continued to explore avenues to further improve the measurement of NOM. In 2013, the ABS made improvements to the quality of the input data used. This in turn improved the quality of NOM statistics and decreased the disparity between the preliminary and final estimates of NOM.

The purpose of this feature article is to provide an overview of additional changes undertaken in 2013 to further improve the quality and supply of final and preliminary NOM statistics (i.e. NOM improvements 2013). These include:

  • improving the quality of input data used in estimating NOM due to a rebuild of the OAD system;
  • improvements made to preliminary NOM estimation thereby improving quarterly preliminary ERP;
  • improvements to the quality of various characteristics available from the final NOM data collection, in particular country of birth data; and
  • a change to the revision cycle for publishing final NOM from a six monthly to a quarterly revision cycle.

The article will conclude with a discussion of the potential for further improvements.

Estimates of both ERP and NOM for Australia and each of the States and Territories are published quarterly in Australian Demographic Statistics (cat. no. 3101.0). The improvements outlined for preliminary NOM in this article will be introduced from the June 2013 issue of Australian Demographic Statistics (cat. no. 3101.0), due for release on 17 December 2013. Changes made to final NOM, from September quarter 2006 onwards, were released in the December 2012 issue of Australian Demographic Statistics (cat. no. 3101.0) on 20 June 2013.
2. BACKGROUND

Conceptually, the term NOM is based on an international travellers' duration of stay being in or out of Australia for 12 months or more. With the introduction of the '12/16 month rule' method for estimating NOM, this 12 months does not have to be continuous and is measured over a 16 month reference period. For example, whether a traveller is in or out of the population is determined by their exact duration of stay in, or away, from Australia over the subsequent 16 months after arrival or departure. The 'duration of stay' is a key component in the successful measurement of NOM.

To estimate preliminary NOM, before these 16 months become available, the ABS has a propensity model that uses migration adjustments derived from final NOM one year earlier. The migration adjustments are applied to travellers with similar characteristics and are grouped according to the following variables:
  • initial category of travel - this is directly linked to an individuals initial duration of stay whereby long-term is based on a duration of stay being one year or more and short-term being less than one year - for more detail refer to the Glossary;
  • age;
  • country of citizenship; and
  • State or Territory of usual/intended residence.

The overseas arrivals and departures (OAD) data is the main input data used in the estimation of NOM. Prior to a rebuild of the OAD system by the ABS, as noted later in this article, the old processing system automatically set any missing duration of stay to a short-term movement. It therefore had a deflationary impact on the long-term categories of travel. This directly impacted on the quality of the initial category of travel, which is used within the propensity model for preliminary NOM estimation as noted in the first dot point above.

Source of overseas migration data

The ABS statistics on overseas migration are calculated using administrative data collected and compiled by the Department of Immigration and Border Protection (DIBP). At present, the main source of data on overseas migration is incoming and outgoing passenger cards, matched with data from passports and visa permits. Information from these three data sources are collected, compiled and matched together by DIBP and stored with movement records on their Travel and Immigration Processing System (TRIPS). Each month these matched OAD records are supplied to the ABS and then processed within the OAD system.

Quarterly NOM estimates are sourced from this processed monthly OAD matched data and then combined with monthly extracts of unmatched OAD records. Unmatched OAD records are those where an inward/outward movement has been recorded by DIBP within the TRIPS system, but the data has not been able to be matched with either an equivalent passenger card, passport or visa permit.
3. IMPROVING THE QUALITY OF INPUT DATA USED IN ESTIMATING NOM - (NOM IMPROVEMENTS 2013)

Rebuild of the OAD system

In 2013, the ABS completed a rebuild of the OAD system (ROADS). The primary aim of this project was to improve the quality of OAD data, given its importance as the main data used to estimate NOM. The new system was thoroughly tested by processing over ten years of data. This time frame allowed for the complete re-processing of the NOM time series to incorporate the improvements and a thorough assessment of any changes to NOM estimation. It also allowed for new final NOM estimates for the 2006-2011 period to be produced and incorporated into the final rebasing of Australia's population estimates which was released in Australian Demographic Statistics, December Quarter 2012 (cat. no. 3101.0) on 20 June 2013. In addition, from 2006 onwards the ERP by country of birth series will also be updated with this improved data, which will become available with the release of Migration Australia, 2011-12 and 2012-13 (cat. no. 3412.0) on 18 December 2013.

Detailed information on the changes and improvements made with the complete rebuild of the OAD system (ROADS), and the new OAD data time series from July 2004, will be made available with the release of Overseas Arrivals and Departures, Australia, January 2014 (cat. no. 3401.0) scheduled for 11 March 2014.

Improved Imputations

Through the process of the rebuild, all derivations, logical edits and imputations have been re-designed based on the best information, practices and methodology available at the time. All imputations within the rebuilt OAD system use a hot deck imputation method. For hot deck imputations, if a record has missing responses (called a recipient), then it receives those of another record (called a donor) which has a full set of responses before the imputation process began. The recipient record keeps all of its original responses and only has the missing responses imputed, thereby keeping as much of the collected information for that record as possible.

The idea behind this imputation is to use a set of characteristics that make the donor and recipient records as similar as possible. The characteristics used within the rebuilt OAD system vary between the different imputations. A combination of different characteristics were tested for each of the imputations to ascertain which would give better results. The characteristics used include age, country of citizenship, country of stay, direction of traveller, initial category of travel, passenger card box type, reason for journey and sampled or non-sampled data.

There are a number of imputations undertaken that specifically improve the quality of variables that flow through to the data used in NOM processing. They include country of stay, duration of stay, initial category of travel, passenger card box type, reason for journey and a specific one for the country of birth of New Zealand citizens (the latter of which is summarised in Appendix 1). Improving the initial category of travel imputation, in particular, has provided specific changes to the input data used within the NOM propensity model, which in turn has improved preliminary NOM estimation.
4. RESULTS OF IMPROVEMENTS MADE TO PRELIMINARY NOM ESTIMATION

The rebuild of the OAD system has improved the quality of matched OAD data. This OAD data is the main data used in the estimation of NOM. The improvements in this input data have therefore also provided improvements in the preliminary NOM estimates.

As shown in the table below, the previous OAD input data produced a difference between preliminary and final NOM of 24,935 persons in 2006-07. When the new OAD input was used, the difference was 21,118, an improvement of 15%. For the 23 quarters tested, only 4 quarters (June 2009, June 2010, December 2010 and March 2012) did not show an improvement to preliminary NOM. At the annual level, 2010-11 was the only year that did not show an improvement to preliminary NOM. Although there are fluctuations from quarter to quarter and for each of the States and Territories (see Graph 1), there is a consistent improvement over time.

Table 1, Comparing versions of preliminary NOM 'old input data'(a) - & 'new input data'(b): Australia - 2006 to 2012

Preliminary NOM (old data)
Preliminary NOM (new data)
Final NOM (old data)
Final NOM (new data)
Diff btw Preliminary NOM (old data) & Final
Diff btw Preliminary NOM (new data) & Final
Improvements made using Preliminary NOM (new data)
Ref Year
no.
no.
no.
no.
no.
%
no.
%
no.
%

2006-07
207 889
211 678
232 824
232 796
24 935
10.7
21 118
9.1
3 817
15.3
2007-08
244 806
249 089
277 332
277 338
32 526
11.7
28 249
10.2
4 277
13.1
2008-09
298 924
299 922
299 864
299 866
940
0.3
-56
-
884
94.0
2009-10
215 576
212 316
196 056
196 058
-19 520
-10.0
-16 258
-8.3
3 262
16.7
2010-11
170 279
169 182
180 358
180 372
10 079
5.6
11 190
6.2
-1 111
-11.0
2011-12(c)
161 686
162 348
178 238
178 234
16 552
9.3
15 886
8.9
666
4.0

- nil or rounded to zero (including null cells)
(a) The major input for calculating NOM is matched Overseas Arrivals and Departures (OAD) data. Old input data refers to the matched OAD data used for estimating NOM prior to the rebuild of the OAD system (ROADS).
(b) New input data refers to the matched OAD data used for estimating NOM from the rebuilt OAD system (ROADS).
(c) Only based on first 3 quarters. June quarter for 2012 is not yet available.


Analysis of the changes resulting from using new OAD data for processing preliminary NOM, compared with using the old OAD data, show a reasonably consistent improvement for each of the States and Territories over time. Any positive number reflects an improvement on the previous preliminary NOM estimate, whereas a negative number indicates the reverse (Graph 1). Therefore, for Victoria there is an improvement each year in preliminary NOM from using the new OAD input data. For Queensland, the Northern Territory and the ACT there was an improvement in 5 of the 6 years tested. For NSW, Western Australia and Tasmania there was improvement in 4 of the 6 years tested. Although there were fluctuations for South Australia from year to year there was still a net improvement over the whole time period.

Graph 1 - Annual changes to preliminary NOM estimates - by State, based on a comparison between using old & new OAD input data (a)
Graph: Graph 1 - Annual changes to preliminary NOM estimates—by State(a), based on a comparison between using old & new OAD input data

5. IMPROVED QUALITY OF CHARACTERISTICS AVAILABLE FROM FINAL NOM DATA

As mentioned earlier, there are a number of imputations undertaken that improve the quality of variables which flow through to the input data for NOM processing. Not only has this improved the data used for estimating NOM, but also the analytical dataset called the Travellers' Characteristics Database. Therefore, there are improvements to the quality of the following variables: country of birth, country of stay, initial category of travel and reason for journey.

A special imputation in the rebuilt OAD system to improve the quality of country of birth of New Zealand citizens, has flowed through to NOM data and thereby the Travellers' Characteristics Database as well as the ERP by country of birth series from 2006 onwards. The table below shows changes to NOM for the top 10 countries of birth for New Zealand citizens over the intercensal period 2006 to 2011. It compares the previous NOM (which uses old OAD input data) with the improved NOM (which uses new OAD input data). It clearly shows the old method had been imputing the New Zealand born too high at 91.9% of all New Zealand citizens who had contributed to NOM during this period. For information on the new imputation for country of birth of New Zealand citizens see Appendix 1.

Table 2, Comparing versions of final NOM for NZ citizens by country of birth - Australia - Intercensal period 2006 to 2011

Country of Birth of NZ citizens
Final NOM (old input data)(a)
Final NOM (new input data)(b)
Difference btw old & new NOM data
RANKING (new NOM)
no.
%
no.
%
no.

1 New Zealand
142 124
91.9
117 860
76.3
-24 264
2 Samoa
1 047
0.7
4 938
3.2
3 891
3 UK, CI & IOM(c)
1 231
0.8
4 648
3.0
3 417
4 India
913
0.6
3 614
2.3
2 701
5 South Africa
1 243
0.8
3 403
2.2
2 160
6 China
821
0.5
1 913
1.2
1 092
7 Philippines
639
0.4
1 767
1.1
1 128
8 Fiji
619
0.4
1 705
1.1
1 086
9 Cook Islands
488
0.3
1 508
1.0
1 020
10 Zimbabwe
161
0.1
1 001
0.6
840
Sub-total All non NZ born
12 465
8.1
36 512
23.7
24 047
Total NZ citizens(d)
154 589
100.0
154 372
100.0
-217

(a) Old input data refers to the matched OAD data used for estimating NOM prior to the rebuild of the OAD system (ROADS).
(b) New input data refers to the matched OAD data used for estimating NOM from the new rebuilt OAD system (ROADS).
(c) United Kingdom, Channel Islands and Isle of Man.
(d) Total of all NZ Citizens contributing to NOM for the intercensal period 2006 to 2011.


An additional comparison between NOM estimates and Census data also highlights the improvements made to the country of birth data. For more information see Appendix 2: Comparison of recent migrants in NOM and Census data.

6. CHANGES TO REVISION TIMETABLES FOR NOM

The quarterly variability always experienced in Australia's population growth is predominately driven by changes in NOM. To help reduce the impact of possible large revisions to population estimates from only revising NOM estimates once every six months, as was the previous practice, the ABS has changed to a quarterly revision cycle. Consultation undertaken with major stakeholders prior to changing the revision cycle showed there was general support for this change.

The first quarterly revision cycle for publishing final NOM started with the March 2013 issue of Australian Demographic Statistics (cat. no. 3101.0), released on 26 September 2013.

7. FUTURE DIRECTIONS

The NOM improvements 2013, outlined in this feature article provide an update of some of the major work recently undertaken by the ABS to improve the estimation and quality of statistics on NOM.

Additional investigations are planned, which will likely result in further improvements. For example, extensive work has already been undertaken by the ABS to examine the groupings of travellers that are used by the propensity model for estimating preliminary NOM. With the improvements to the input OAD data used to estimate NOM, as noted in this article, and the longer time series of final NOM estimates that is now available, the ABS will revisit the propensity model and re-examine the cross-classifications used. Currently, groupings are made by the following variables: initial category of travel, age, country of citizenship and state or territory of usual/intended residence. The effectiveness of other variables such as direction of travel, country of birth, port code and visa class will be examined and other areas of research such as the use of time series analysis may be undertaken. However, their use for improving preliminary NOM estimation will depend on the feasibility of being able to implement them.

The ABS will continue to collaborate with DIBP on projects to identify and improve the quality of the administrative data within the Travel and Immigration Processing System (TRIPS).

ACKNOWLEDGMENTS

The ABS data referred to throughout this article is sourced exclusively from data provided by the Department of Immigration and Border Protection (DIBP) each month. Their continued cooperation and support is highly valued and appreciated; without it, the wide range of statistics available on overseas arrivals and departures, net overseas migration and the country of birth of Australian residents published by the ABS would not be available. All data received by the ABS is treated in strict confidence, as required by the Census and Statistics Act 1905.

8. APPENDICES

Two appendices titled 'Specific Imputation for Country of Birth of New Zealand Citizens' and 'Comparison of recent migrants in NOM and Census data' are available in the Information Paper: Further Improvements to Net Overseas Migration Estimation, Dec 2013 (cat. no. 3412.0.55.002) released on 17 December 2013.