Questionnaires in ecology: a review of past use and recommendations for best practice

• Published in: The Journal of applied ecology Vol. 42; no. 3; pp. 421 - 430
• Main Authors: White, P.C.L, Jennings, N.V, Renwick, A.R, Barker, N.H.L
• Format: Journal Article
• Language: English
• Published: Oxford Blackwell Science Ltd 01-06-2005; Blackwell Science; Blackwell Publishing Ltd
• Subjects: Agricultural management; Animal, plant and microbial ecology; Applied ecology; attitudes and opinions; Best practice; Biological and medical sciences; Conservation; Conservation biology; data analysis; Data collection; Ecology; Environmental conservation; Fundamental and applied biological sciences. Psychology; General aspects; Human ecology; interviews; literature reviews; Population ecology; Questionnaires; Response rates; Review; surveys; Wildlife management; conservation; Questionnaire; management; Ecology; Review; Sampling; participatory approach; interview; Environmental protection; opinion; policy
• ISSN: 0021-8901; 1365-2664
• DOI: 10.1111/j.1365-2664.2005.01032.x

1. Questionnaires, or social surveys, are used increasingly as a means of collecting data in ecology. We present a critical review of their use and give recommendations for good practice. 2. We searched for papers in which questionnaires were used in 57 ecological academic journals, published over the period 1991-2003 inclusive. This provided a total sample size of 168 questionnaires from 127 papers published in 22 academic journals. 3. Most questionnaires were carried out in North America and western Europe, and addressed species-level issues, principally focusing on mammals. The majority were concerned with impacts of species and/or their conservation, and just under half with human-wildlife interactions. 4. Postal survey was the method used most frequently to carry out the questionnaires, followed by in-person interviews. Some questionnaires were conducted by telephone, and none was web-based. 5. Most questionnaires were concerned with obtaining factual information or perceptions of facts. Ground-truthing (independent verification of the facts) was carried out in less than 10% of questionnaires. 6. The mean (± SE) sample size (number of respondents) per questionnaire was 1422 ± 261 and the average (± SE) response rate was 63 ± 3%. These figures varied widely depending on the methods used to conduct the questionnaire. 7. The analysis of data was mostly descriptive. Simple univariate methods were the most frequently used statistical tools, and data from a third of questionnaires were not subjected to any analysis beyond simple descriptions of the results. 8. Synthesis and applications. We provide recommendations for best practice in the future use of questionnaires in ecology, as follows: (i) the definition of the target population, any hypotheses to be tested and procedures for the selection of participants should be clearly documented; (ii) questionnaires should be piloted prior to their use; (iii) the sample size should be sufficient for the statistical analysis; (iv) the rationale for the choice of survey method should be clearly stated; (v) the number of non-respondents should be minimized; (vi) the question and answer format should be kept as simple as possible; (vii) the structure of the questionnaire and the data emerging from it should be unambiguously shown in any publication; (viii) bias arising from non-response should be quantified; (ix) the accuracy of data should be assessed by ground-truthing where relevant; (x) the analysis of potentially interrelated data should be done by means of modelling. Researchers should also consider whether alternative, interpretative methods, such as in-depth interviews or participatory approaches, may be more appropriate, for example where the focus is on elucidating motivations or perceptions rather than testing factual hypotheses.