Home → Publications → Reports → Research and public policy series → 60 → Appendix 1 : Methodology (in: Online credit card fraud against small businesses)
Online credit card fraud against small businesses
Kate Charlton and Natalie Taylor
ISBN 0 642 53846 8 ; ISSN 1326-6004
Canberra: Australian Institute of Criminology: 2004
(Research and public policy series, no. 60)
Download
- PDF print version : Appendix 1 (PDF 113kB)
- Download full report as a single file (PDF 583kB)
Appendix 1 : Methodology
Sampling process
The sampling technique involved a random sampling method, stratified by business type. Five samples (one for each of the five business types) were drawn from Australia On Disc 3 (the electronic version of the Yellow Pages telephone directories), using the appropriate ANZSIC (Australia and New Zealand Standard Industry Classification; see ABS 1993) code or category of retailer. From these five files, retailers were drawn at random until the target quotas of 200 businesses for each business type were met.4 The total number of completed interviews conducted was 1,078.
The survey was conducted by Roy Morgan Research, using computer-assisted telephone interviewing (CATI). Once businesses had been selected at random and contacted by telephone, they were asked two screening questions to ascertain whether they were 'out-of- scope' for the purposes of this study and should be screened out. These were (a) whether they were a retailer of the given business type, and (b) whether they employed fewer than 20 full-time personnel. The sample needed to include only retailers of the type in question, with fewer than 20 employees. However, only four per cent of businesses contacted were out of scope due to employee size, indicating that most businesses within the five business types are small businesses.
Figure A1-1: Flow chart of sample selection

Source: Roy Morgan Research, Online credit card fraud against small business: technical report (2003), unpublished
It should also be noted that since the survey was interested in online credit card fraud incidents, and it was important that the interviewee was familiar with the business' online trading practices and would know detailed information about each fraud incident, only those businesses which operated their own trading web site were classified in this study as trading online. This meant that some florists which used an external web site operated by an external company (examples include www.interflora.com.au and www.flowers.com.au) but did not operate their own separate trading web site were not classified in this report as being online (but were still interviewed). Forty-three per cent of the florists stated they accepted payments for goods sold through a web site operated by an external business. Figure A1-1 shows the original sample and outcomes to completed interviews.
Instrument
The questionnaire was administered over the telephone by a Roy Morgan trained interviewer, using the CATI technique. This was chosen as it was essential the questionnaire be interviewer-administered (the complexity and various filters and screens required computerised expertise). The telephone is both a convenient and anonymous medium for both the interviewer and interviewee.
The questionnaire incorporated a number of different sections, each of which was answered by retailers depending on whether they:
- currently traded online and had experienced fraud;
- currently traded online and had never experienced fraud;
- previously traded online; and
- never traded online.
The questionnaire is provided for reference in Appendix 2.
Piloting of survey
Prior to the survey going into the field, a pilot survey was undertaken to assess likely response rates, possible incidence rates of online trading and fraud, the utility of the questionnaire (its ability to attain useful responses), and whether retailers would have difficulty with certain questions. The pilot included 104 completed interviews (20 florists, booksellers and computer hardware retailers, 21 recorded music retailers and 23 toy and game retailers). Some minor alterations were made to the questionnaire based on the pilot phase. AIC ethics approval for the full research project was received on 18 March 2003 and the questionnaire was also approved by the Commonwealth Statistical Clearing House on 16 April 2003 after which data collection commenced.
Main data collection and response rates
Roy Morgan Research interviewers, with extensive training in social research surveys and procedures, conducted the interviews. Final data collection began on 15 May 2003 and continued until 6 June 2003. Ten interviewers worked concurrently, during as well as outside business hours (to suit the preferences of interviewees). Response rates varied little across business type, with an overall response rate for the entire sample of 62 per cent (business type response rates varied between 60% and 64%).
Sample demographics
Table A1-1 provides demographic details of the unweighted sample: the sex, size and location of businesses in each of the five types and across the entire sample. Sex varied across business type, with florists more likely to be female and computer retailers more likely to be male. Business size was largely micro, with 86 per cent of the whole sample employing fewer than five full-time staff.
Table A1-1 also provides details relating to the ARIA (accessibility/remoteness index of Australia) classification of the sample. ARIA classification is a measure of remoteness or accessibility which can be acquired from postcodes (University of Adelaide 1999) and indicates the degree to which a retailer is located in a centralised or urban area.
In this survey, remoteness was classified according to the following:
- highly accessible - an area with relatively unrestricted accessibility to a wide range of goods and services and opportunities for social interaction;
- accessible - some restrictions to accessibility of some goods, services and opportunities for social interaction; and
- remote - very restricted accessibility to goods, services and social interaction.
It is clear from the table that the vast majority (82%) of businesses were located in highly accessible areas (major towns or cities).
Weighting of data
Where data are reported in this paper which refer to the whole of Australia (for example, number of fraud incidents), the data have been weighted up to the population for greater representativeness (n=6,657). Weighted data were also used for some regression analyses (again, to ensure that the sample was representative of the distribution of the five business types across Australia), but so as not to inflate statistical significance, an effective sample size weighting was applied.
To weight up to the population, the data were weighted to represent the estimated total number of qualifying businesses nationally. The weighting process involved calculating the proportion of out-of-scope businesses (that is, 20 employees or more; or those not operating in the relevant industry) obtained from the sample contacted and applying this proportion to the number of businesses (post de-duplication) available from the sampling frame (Australia On Disc) for that business type.
Weighting was conducted independently within each business type, and the steps were as follows:
- Determine the total population of each business type, as available from the sampling frame post de-duplication.
- Subtract from that total the number of businesses known to be out-of-scope on the basis of their responses to the survey or the pilot.
- Calculate the proportion of the attempted sample that was identified as being out-of-scope. Apply this proportion to that part of the population that was not attempted. The resulting figure is the estimated out-of-scopes among the unattempted sample.
- Subtract the Step 3 result from the Step 2 result. The resultant figure is the estimated number of in-scope businesses within that business type.
- The weight for each business interviewed within each business type is the Step 4 figure divided by the number of complete, in-scope interviews for that business type.
Finally, to obtain the effective sample size (for tests of statistical significance) the weights calculated in the five steps above were adjusted according to the formula, 'original weight' x (sample size/population). Table A1-2 summarises the weighting steps for each stratum.
Table A1-3 provides a breakdown of the sample by the state/territory in which they were located at the time of interviewing and by business type. The table provides both weighted and unweighted data and demonstrates the differences between each. It is clear from the table that the location of retailers with respect to state reasonably reflects the populations in each (for example, New South Wales contributed the highest number of respondents, whereas the Northern Territory contributed the fewest). With regards to differences between the weighted and unweighted data, the weighting resulted in a significant increase in florists and computer retailers and a significant decrease in music retailers and toy and game retailers - this distribution more accurately reflects the population.
- 3 It is acknowledged that this sampling frame is not necessarily representative of every business that operates in each category, as the sampling frame is unlikely to include businesses which operate solely over the internet and/or are not registered on Australia On Disc. It was not possible to obtain a sampling frame for businesses operating solely on the internet. The findings are generalisable only to those businesses included in the sampling frame.
- 4 Although quotas of 200 per business type were set, 78 additional random interviews were conducted due to additional time permitting.
- Next section: Appendix 2: Online credit card fraud questionnaire
- Previous section: Section 8 : Conclusions
- Contents