Background <p>A high response rate is an often-used measure of survey quality. Research is mixed on the effectiveness of a “teaser message” to increase response rate, with at least one study showing a significantly &gt; 10% higher response rate with a teaser compared to control and others showing no significant differences.</p> Methods <p>As part of a larger study of care coordination, 6813 individuals were mailed a push-to-web survey invitation letter, half randomized to receive an envelope with the teaser “We need your help!” stamped on the outside of the envelope in red ink, and half without. A second mailing with a paper survey was sent to initial non-responders with the teaser condition carried through. Survey response rates were calculated using AAPOR Response Rate 6 and differences between teaser and control respondents were compared using Chi-square tests. Impact of teaser on response rate within patient subgroups was calculated using the same analytic approach applied to the overall sample.</p> Results <p>In total, 2795 individuals completed the survey (41% response rate). After the initial mailing containing the push-to-web invitation, the response rate was 13% for both the teaser and control groups (<i>p</i> = 0.73). After the second mailing, there were again no significant differences in response rate (teaser 34%, control 36%, <i>p</i> = 0.07). The response rate was lower among white (4% lower, <i>p</i> = 0.01), female (3% lower, <i>p</i> = 0.02), urban individuals (2% lower, <i>p</i> = 0.04), and those over age 65 (4% lower, <i>p</i> = 0.02) in the teaser group than control group.</p> Conclusions <p>While the existing literature is inconclusive and nuanced, our findings align with standard survey methods which recommend against using colored and catchy text on survey envelopes. Based on these findings, we do not recommend the use of an envelope teaser message.</p> Trial registration <p>All methods were reviewed and approved, with waiver of written consent, by the HealthPartners Institutional Review Board (#A19-119, 07/20/2022).</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Impact of envelope teaser on mail and web research survey response rates and representation

  • Jennifer M. Dinh,
  • Ella A. Chrenka,
  • Leif Solberg,
  • Julia A. Andersen,
  • Steven P. Dehmer,
  • Anna Bergdall,
  • Melissa Winger,
  • Clarence Jones,
  • Jeanette Y. Ziegenfuss

摘要

Background

A high response rate is an often-used measure of survey quality. Research is mixed on the effectiveness of a “teaser message” to increase response rate, with at least one study showing a significantly > 10% higher response rate with a teaser compared to control and others showing no significant differences.

Methods

As part of a larger study of care coordination, 6813 individuals were mailed a push-to-web survey invitation letter, half randomized to receive an envelope with the teaser “We need your help!” stamped on the outside of the envelope in red ink, and half without. A second mailing with a paper survey was sent to initial non-responders with the teaser condition carried through. Survey response rates were calculated using AAPOR Response Rate 6 and differences between teaser and control respondents were compared using Chi-square tests. Impact of teaser on response rate within patient subgroups was calculated using the same analytic approach applied to the overall sample.

Results

In total, 2795 individuals completed the survey (41% response rate). After the initial mailing containing the push-to-web invitation, the response rate was 13% for both the teaser and control groups (p = 0.73). After the second mailing, there were again no significant differences in response rate (teaser 34%, control 36%, p = 0.07). The response rate was lower among white (4% lower, p = 0.01), female (3% lower, p = 0.02), urban individuals (2% lower, p = 0.04), and those over age 65 (4% lower, p = 0.02) in the teaser group than control group.

Conclusions

While the existing literature is inconclusive and nuanced, our findings align with standard survey methods which recommend against using colored and catchy text on survey envelopes. Based on these findings, we do not recommend the use of an envelope teaser message.

Trial registration

All methods were reviewed and approved, with waiver of written consent, by the HealthPartners Institutional Review Board (#A19-119, 07/20/2022).