Results Summary and Professional Abstract
Peer review of PCORI-funded research helps make sure the report presents complete, balanced, and useful information about the research. It also assesses how the project addressed PCORI’s Methodology Standards. During peer review, experts read a draft report of the research and provide comments about the report. These experts may include a scientist focused on the research topic, a specialist in research methods, a patient or caregiver, and a healthcare professional. These reviewers cannot have conflicts of interest with the study.
The peer reviewers point out where the draft report may need revision. For example, they may suggest ways to improve descriptions of the conduct of the study or to clarify the connection between results and conclusions. Sometimes, awardees revise their draft reports twice or more to address all of the reviewers’ comments.
Peer reviewers commented and the researchers made changes or provided responses. Those comments and responses included the following:
- Reviewers asked that the report be revised so that emergency department (ED) visits were not described as “unnecessary,” which typically reflects the perception of the healthcare system and may reflect a lack of viable alternatives as seen by participants. The researchers observed that the program they developed was one option offered as a choice to participants, rather than imposed on participants. The researchers also reviewed the instances where they used the word “unnecessary” in the report and stated that in most cases they provided appropriate context for the word.
- Reviewers noted that an important consideration for the study was that participants receiving Acute Community Care Program (ACCP) services not only had fewer follow-up ED visits than participants seen initially in the ED, but that the ACCP service also took the place of the initial ED visit. The researchers stated that they used analytic methods to account for the lack of randomization between the ACCP and ED groups, which would not allow them to make conclusions regarding ACCP replacing an ED visit. The reviewers also pointed out that because the offering of ACCP services were from 6 pm to 2 am but that researchers measured time to subsequent ED visit or hospitalization in days, it is not clear whether the ED or hospitalization event actually occurred much later in the ACCP group since the time of day was not provided. The researchers stated that time of encounter was not reported for the ACCP visit or subsequent ED or hospitalization occurrence. Therefore, the researchers could not say how many hours after the ACCP encounter a patient might have an ED visit or be hospitalized. They acknowledged this limitation in their report, but also pointed out that any bias produced because of not having this information was against the ACCP intervention, leading to more conservative conclusions regarding the effectiveness of that intervention.
- The reviewers said that it would be good to know which conditions appear to be well treated by the ACCP tested in this study and which conditions led to emergency department visits and hospitalizations. The researchers explained that paramedics made notes about participants’ major conditions but did not use a coding system to describe them, and the researchers were not able to find any pattern for the kinds of conditions that had better or worse outcomes. The researchers suggested that as the ACCP becomes more established, data may be collected in a more systematic way.
- The reviewers asked how the researchers involved participants in the study as stakeholders. The researchers said they never considered involving the acutely ill individuals who received care as stakeholders in the study. Given concerns about burdening participants, the researchers did not expect that clinicians would have allowed access to acutely ill participants, and it would not have been possible to predict in advance who would develop urgent health problems and need help from paramedics. Two employees of the Disability Policy Consortium in Massachusetts served as stakeholders representing the community.
Conflict of Interest Disclosures
View the COI disclosure form.
Other Health Services Interventions
Training and Education Interventions
Individuals with Multiple Chronic/co-morbid Conditions
^This project was previously titled: Providing Emergency Services at Home to Patients Who Receive Medicare and Medicaid