| Survey Methods | |
|
This report presents the results of an Occupant Satisfaction Survey. Occupant responses are collected via the Internet and recorded to a secure server database using SQL technology (SQL is a standardized query language used for requesting information from a database). To protect the confidentiality of participants, the online report contains only aggregated, anonymous results. The survey is comprised of a core survey and optional survey modules. Each organization using the survey has the option of employing the core survey or customizing the survey to include additional modules that support their information needs. The core survey includes modules for office layout, office furnishings, thermal comfort, air quality, lighting, acoustics, and building cleanliness and maintenance. Examples of optional modules include wayfinding, safety and security, and air diffusers. Core questions stay consistent from survey to survey to maintain data integrity for the purposes of benchmarking and trend analysis. The survey has been extensively tested and refined, and facility managers and designers to have evaluated the reporting format to determine the utility of various report designs. An established in-depth pre-testing method called cognitive interviewing was used by the Survey Research Center at the University of California, Berkeley to assess how well respondents were able to comprehend and accurately report answers to survey questions (Eisenhower, 2000). Cognitive interviews allow researchers to examine the thought processes that affect the quality of answers provided to survey questions. The primary technique used was the “concurrent think aloud” whereby respondents were asked to comment out loud about anything crossing their mind as they read, interpreted and answered each question. This technique was supplemented by paraphrasing (asking the respondents to put something in their own words) and systematic probing. Seven people participated in this testing. Results were used to refine the survey organization, question text, graphic design of the scales, and the process required to access the survey website. The time to completion has been monitored, and occupants have evaluated the length of each section of the survey. Approximate time to completion for the core survey is 5-12 minutes; time to completion varies depending on the number of branching questions and comments answered. This length of time has not been regarded as an impediment to completion in most (but not all) of the buildings surveyed to date. Surveys that include several customized modules in addition to the core survey have had completion times of up to 20 minutes. Organizations that choose to implement longer surveys are briefed regarding the potential negative effect that longer time to completion can have on response and completion rates. The survey implementation process typically begins with an email informing building occupants of the survey web site address, start date and end date. This email is drafted and sent either by CBE or the sponsoring agency. Subjects can open the survey at their convenience. After linking to the survey, respondents see a welcome screen informing them of the purpose of the survey. The welcome page also advises them of the amount of time it should take to complete the survey, and their rights as a research participant. Participation in the survey is voluntary and anonymous. Upon starting the survey, participants click through a series of questions asking them to evaluate their "satisfaction" with different aspects of their work environment. Satisfaction is rated on a 7-point scale ranging from "very satisfied" to "very dissatisfied" (see Figure 1). In most cases, respondents who indicate dissatisfaction (the lowest three points on the scale) with a particular aspect of their work environment are branched to a follow-up screen probing them for more information about the nature of their dissatisfaction. Respondents who indicate neutrality or satisfaction (the upper four points on the scale) move directly to the next survey topic. When applicable, respondents are also asked to assess the impact of environmental factors on their effectiveness in getting their job done.
Figure 1. Sample occupant satisfaction question (screen shot of web-based survey) A survey typically stays open for 1-2 weeks. The rate of participation is monitored; if it is going slowly, reminder emails may be sent. After the survey is closed, the data is cleaned. Responses of participants who answer less than 15 questions are removed from the final data set. Satisfaction ratings are tabulated for each point on the scale, and are also summarized into three bins: satisfied (top three points), neutral (middle point) and dissatisfied (bottom 3 points). This summary is particularly useful to managers that need to see a top-level overview of occupant feedback. Comments are also listed in totality for each question. For more information, please send us an e-mail or contact us at (510) 642-6574. |
|
|
|
|
|
|
|