{"content":[{"text":"were left black. As such, it has not been possible to draw any conclusions \n from the N/A box. \n The design of some of the questions could be improved upon. For \n example, Question 6 asks respondents for their membership status. \n However, survey monkey only allows respondents to select either \n ‘individual’, ‘group’ or ‘ally’ membership status, when these are not \n mutually exclusive categories, so the numbers of members in each \n category are likely to be underestimates. \n Qualitative questions are excellent for gleaning rich and detailed data, \n however, the wording of some could be improved and respondents have found \n them confusing (see Rachael McGill’s Survey Analysis for 2012). Concerns \n relating to specific questions have been discussed in sections 2 and 3 below. \n Although improving, the membership survey response rate is still poor (180 \n people), representing only a small fraction of NSUN members. This will \n inevitably be skewed by selection bias (eg. self-selection of participants) and \n is therefore low in external validity (affecting our ability to apply any findings \n across the membership more widely). Response bias (in this case the desire to \n provide an ‘acceptable’ or positive response) may also be an issue due to the \n lack of anonymity of responses, as respondents who wish to be included in the \n prize draw have to list their name and address. Therefore the surveys are not \n truly anonymous.","bbox":{"left":0.211863,"top":0.082222,"width":0.637529,"height":0.35177699999999995}},{"text":"•","bbox":{"left":0.181609,"top":0.116823,"width":0.009277000000000007,"height":0.01746099999999999}},{"text":"•","bbox":{"left":0.181609,"top":0.218056,"width":0.009277000000000007,"height":0.017461000000000004}},{"text":"•","bbox":{"left":0.181609,"top":0.284499,"width":0.009277000000000007,"height":0.017461000000000004}},{"text":"Due to the above issues, the data generated from the 2013 survey cannot be \n relied upon. It is therefore not possible to produce an effective or valid analysis \n of the results. Bearing this in mind, the results of the survey are tentatively \n discussed and reflected upon in Sections 2 and 3 of this document.","bbox":{"left":0.151351,"top":0.450111,"width":0.697275,"height":0.06688100000000002}},{"text":"In order to improve the overall reliability and validity of the survey for future \n years it needs to be extensively overhauled and redesigned.","bbox":{"left":0.151351,"top":0.533635,"width":0.696728,"height":0.03326700000000005}},{"text":"It may be helpful to consider these questions as part of this process:","bbox":{"left":0.151351,"top":0.583829,"width":0.581317,"height":0.016710000000000003}},{"text":"▪","bbox":{"left":0.191694,"top":0.617913,"width":0.009227999999999986,"height":0.015819000000000027}},{"text":"What are the aims of the membership survey? What do we want to find \n out? How will it be linked to NSUN’s evaluation framework? (The \n answers to these questions will help us to make decisions about the type of \n data we collect, the wording of questions, analysis etc.) \n Who is our target audience? (At the moment this is undefined and both \n NSUN members and some staff have participated in the survey.) \n How will it be rolled out? Where and when will the surveys be \n completed and distributed? \n How will the different forms of data (quantitative and qualitative) be \n analysed? (The analysis should be congruent with the overarching \n methodological framework and approach.) \n How will the data be used and how will it inform our future work? \n (Standardising the design, methods, and analysis of the survey will enable \n us to make more reliable comparisons over time.)","bbox":{"left":0.221948,"top":0.617182,"width":0.6274029999999999,"height":0.23398699999999995}},{"text":"▪","bbox":{"left":0.191694,"top":0.684653,"width":0.009227999999999986,"height":0.015819000000000027}},{"text":"▪","bbox":{"left":0.191694,"top":0.71829,"width":0.009227999999999986,"height":0.015819000000000027}},{"text":"▪","bbox":{"left":0.191694,"top":0.751643,"width":0.009227999999999986,"height":0.015819000000000027}},{"text":"▪","bbox":{"left":0.191694,"top":0.801837,"width":0.009227999999999986,"height":0.015819000000000027}}],"images_bbox":[],"images_bbox_not_text_overlap":[]}