Table 1 Key informant interviews: important characteristics of reviews
From: Fit for purpose: perspectives on rapid reviews from end-user interviews
Element | Theme | Sample quotes [type of end-user] |
|---|---|---|
Methods | Important that sound methods are used in developing review | “..adherence to good standards of evidence evaluation is really critical, so that probably matters more to me than anything” [provider] |
Source | Trust review products from reliable sources | “If it came from a place that we trust then we would have more confidence in using it than if it was just arbitrarily out there from somebody who had done it once.” [guideline developer] “the source is always really important, knowing that someone is evaluating the evidence in a rigorous way, the way that we do and the way the evidence based practice centers do means a lot” [provider] |
Relationship between producer/user | Important to establish relationship with user up front | “… the quality that we've had in the reviews when they have that connection up front is significantly different…I think it also helps build trust in how the evidence is being done.” [guideline developer] “…I think it’s incredibly important for the guideline developers to be involved from day one.” [guideline developer] |
Clinical significance | Reviews should include considerations of clinical importance, not just statistical significance | “…ultimately, the clinical aspect is important. There is sometimes a gap between the statistical significance versus what’s clinically significant…” [guideline developer] |
Recency | Important that a report is recent. A gap search is sometimes done | ‘We’re usually hoping we find something within the last two to three years” [guideline developer] “We’re certainly willing to do the bridge look search to make sure that there hasn’t been something big that’s come up that might adjust the estimated treatment effects” [guideline developer] |
Key questions | The framing of the question can be the most important aspect of a review It is important that the key questions address what the end-user needs, including clinical outcomes and consideration of benefits and harms Narrowing the scope of the key questions can sometimes be problematic | “…the thing that I find most helpful in this approach to evidence always is the framing of the question” [provider] “…we want to make sure that the questions that were addressed are what the guideline developers interested in terms of just plain old clinical outcomes” [guideline developer] “When I’ve used some other Rapid Reviews, when they narrow the scope they probably at least half the time completely miss the mark of the question we want answered. Keeping it a little bit broader would be something that I would not sacrifice…” [payer] |