I've lived in two different CCRCs (in different states) and have had experience with Resident Satisfaction Surveys in both places. The second of the two brought in a Holleran survey about 10 years ago. The first CCRC used a different national survey firm. Personally I was surprised a survey wasn't done right when our management was outsourced 8 years ago, or when we were sold 4 years ago, or when we merged with a larger organization 2 years ago. Those surveys could have provided "base line" stats to hopefully show comparative improvement when another survey was done down the line.
I also served on a Holleran Focus Group to get resident feedback on a new product they were considering. This group was to meet at a LeadingAge national convention, but COVID intervened, so it had to be done by Zoom. When there was some extra time, I asked a question about resident surveys in general, which I mention below in #3. My question at the time: in an anonymous survey, how are write-in comments presented to management? --- by individual survey or "batched" by subject matter? Answer at the time: the former. More on that below.
From what I've ascertained, these resident satisfaction surveys have followed this formula:
1) Standard, generic statements regarding CCRC life on a numerical scale, a la Strongly Disagree being "1" to Strongly Agree "5." Since these don't vary and have the survey company's "stock" language, an organization's results can numerically be compared against national results.
2) Then, there is a part of the survey with customized subjects that management chose to include in order to "pick up on" participants' opinions about situations/conditions unique to their community or corporation. For example, management may want to ask how people view the merger; or a CCRCs may want to determine how residents view their Portal; or if waiting for meal deliveries is about right, or if new move-in's are given adequate information to help them integrate into the community.
3) Then, space is often provided for a survey participant to provide their own write-in comments. Since our organization recently announced (finally!) a Holleran survey in late April or early May. I'm trying to find out if Holleran changed how they present the write-in comments, as I had asked in the above-mentioned Zoom meeting a few years ago. To me, presenting the write-ins individually can jeopardize anonymity, if that is important to the participant. For example, let's say that one particular apartment resident contends there should be more handicapped parking spaces, and mentions this every chance he gets. If he put that in his survey as a write-in, his survey could easily be identified, even though it is touted as anonymous. The answer I've gotten upon calling Holleran is that "it depends on the contract." Right now our organization's contract hasn't been finalized.
I can't tell you all the times a dinner conversation brought up a subject that someone feels strongly about. Say that someone wishes there were more outings to area museums. I'd say, "Did you write-in your opinion in the resident satisfaction survey?" Answer: "no, I didn't think of it." (Sigh)
I think all-in-all these surveys are better than nothing. Lots of people don't like to speak out in the town hall type of meeting. I'd like to think management pays attention.