Security Awareness Survey and Administration Tools - The first important lesson I learned as I embarked on a organization-wide culture change effort was “How will you ever know if you are successful unless you measure along the way?” This Security Awareness Survey is designed to measure perceptions. Why perceptions? It is our strong belief that perceptions drive behavior and behavior will get the results you need. So if you are trying to change behaviors, the first step is to measure current perceptions – then base your plan on what needs attention.
Metrics are a critical part of any culture change effort. A baseline is needed to determine where you are at the onset of your security awareness efforts. In many cases, the initial findings can help sell your reason why an awareness initiative is necessary.
To measure program effectiveness, it is recommended to follow-up with the same survey population and administer a second survey in approximately 9 to 12 months.
Other possible drivers for re-assessment include:
• Assessing the training program and training resources,
• Gaining insight into employees’ attitudes about the Security awareness program, resources and tools, and
• Measuring effects of a specific component of the Security Awareness program.
A comprehensive survey administrative guide is included, however, at a minimum, it is recommended to follow the following subtitle recommendations:
• Population Sample
• Quota Sample
• Determining the Correct Sample Size
• Facilitation of Survey
• Response Rates
2010 (COMPANY NAME) Melissa Guenther ADMINISTRATION OF SECURITY AWARENESS SURVEY [Type the abstract of the document here. The abstract is typically a short summary of the contents of the document. Type the abstract of the document here. The abstract is typically a short summary of the contents of the document.] ADMINISTRATION OF SURVEY Population Sample Given the size of (COMPANY NAME)’s population, random sampling of the workforce will be utilized to increase the even representation of results. To ensure a complete benchmark, quota sampling across the company’s workforce is recommended because it allows the examination of the makeup of the entire workforce population to ensure the necessary subgroups are included. Quota sample - a sample created by gathering a predefined number of participants from each of several predetermined categories. The selection process within each category may be random. (e.g., divide a Company Functional Area into groups of frontline and middle Management employees and randomly selecting twenty-five participants from each category.) Due to the differing environment of certain facilities, both regulatory and business process, it is not recommended to include some of them in this survey. Additionally, inclusion of the Union must also be decided. Sample size may depend on the resources available (time, money, staff) and how difficult it is to locate respondents. The table below provides a general guide for determining sample size. Based upon these guidelines, the recommended sample size for the survey is approximately xxx – xxx people. Recommended Sample Size Population Size Recommended Sample Size 50 44 75 63 100 80 150 108 200 132 300 168 400 196 500 217 1000 277 3000 340 5000 356 10000 369 From University of Texas at Austin Random Sample Overview If you are collecting data on a large group of people (called a "population"), you might want to minimize the impact that the survey will have on the group that you are surveying. It is often not necessary to survey the entire population. Instead, you can select a random sample of people from the population and survey just them. You can then draw conclusions about how the entire population would respond based on the responses from this randomly selected group of people. This is exactly what political pollsters do - they ask a group of people a list of questions and based on their results, they draw conclusions about the population as a whole with those often heard disclaimers of "plus or minus 5%." If you are simply looking at one large group of people as a whole, the process of determining a random sample is pretty straightforward. You will need to know how many people are in the entire group and how "accurate" you want your results to be. Anytime you survey a portion of a population, there will be some margin of error in the results, but when the margin of error is reduced to just a few percentage points, it often becomes of little concern. Survey Administration Rev 1 If your population consists of just a few hundred people, you might find that you need to survey almost all of them in order to achieve the level of accuracy that you desire. As the population size increases, the percentage of people needed to achieve a high level of accuracy decreases rapidly. In other words, to achieve the same level of accuracy: Larger population = Smaller percentage of people surveyed Smaller population = Larger percentage of people surveyed Determining the "Correct" Sample Size Determining the "correct" sample size requires 3 pieces of information 1. The size of your population 2. Your desired error level (e.g. 5%) 3. Your desired level of confidence (e.g. 95%) To calculate the number of people you will need to survey, click here. Facilitation of Survey Survey instructions will be clear, brief and will stress the importance of answering questions as the participant perceives things, not as they think they should be. A short introduction on the survey itself reminds participants the importance of completing it: “In order for (Company Name) to establish a benchmark and then measure and monitor conformance to best practice Security behavior, we have developed this awareness survey to gather information. The survey results also provide insight on items that we need to provide additional guidance, resources and/or training. Our goal is to develop and implement an appropriate approach to address any gaps and concerns identified.” It is recommended survey participants are assigned an identifier allowing for a re-assessment of the same population to gauge program effectiveness. This will provide a targeted comparison. The identifier can ensure confidentiality by asking participants to use a method such as the second letter of first name and last three digits of the employee ID. The survey will take approximately ten minutes for participants to complete. The proposed deadline for submitting completed surveys is (insert date here). A scrubbed summary of the results will be made available to participants who complete the survey. Response Rates High survey response rates help to ensure that survey results are representative of the population. Response rates will vary depending on how we administer your survey. We can maximize our response rate by doing the following: Request participation from respondents in advance (when possible) and provide information about the purpose of the survey, how the results will be used, and the terms of anonymity and confidentiality. Give respondents a sufficient amount of time to complete the survey. For online surveys, 7-10 days is sufficient. For inter-office mail surveys, postal time will need to be included. Choose the best vehicle for administering the survey – paper vs. electronic – based upon the participation population. Provide clear instructions on how to complete and submit the survey when it is administered. Design the survey so it is easy to read and follow. Survey Administration Rev 1 For mail or online surveys, send reminders during the survey period thanking the respondents who have completed the survey, while reminding others about the deadline for completing the survey. For online surveys, always provide a link to the survey and send a second reminder a day before closing the survey. Offer an incentive or a token of appreciation for participating. Benchmark The initial survey will be used as a performance measurement tool in conjunction with other project improvement initiatives. It is designed to provide a realistic guide for comparing employees’ perceptions and attitudes of (COMPANY NAME)’s Security Awareness program since perceptions are what drive behaviors. Consequently, this benchmark establishes a continuous process of measuring, analyzing, and comparing performance to an established standard or benchmark. Comparisons can be made against practices within the organization or to industry and/or government guidelines. The objective is to identify a benchmark for the best practices being used and to adopt them as the company’s guidelines of performance. The simplest approach to analyzing survey responses is to calculate response frequencies and percentages for each question and display them in a chart or graph. Ranked data in a chart will be displayed to focus attention on major factors or issues. Cross-tabulation of responses to examine the relationship between questions and use of computer software to analyze differences between or within groups will be considered depending on results of surveys. Interpreting Survey Data After you have collected an adequate number of responses to your survey, it's finally time to take a look at the data to see what they say. Gaining an accurate understanding of your survey results is the final step in the survey process (excluding any action you might take based on those results). What's your n? Before digging too far into your results, it's very important to be sure you have an adequate number of responses. Whether you are looking at results from "all respondents" or just a demographic slice, you need to be sure there are enough respondents to make the results statistically meaningful. How many respondents do you need? There is no hard and fast rule, but more is better. . In practical terms, realize that if you have a smaller number of respondents, you need much stronger results in order to draw conclusions from the numbers. If you have just 10 respondents and they all said "strongly disagree" then you can probably trust that, but if just 7 out of 10 said "strongly disagree" then you might want to collect more data to be sure there is a trend there. On the other hand,
Pages to are hidden for
"Security awareness Survey Admin"Please download to view full document