HSR&D Home » Research » SDR 16-196 – HSR&D Study
Partnered Evidence Based Policy Research Center
Austin B. Frakt, PhD
VA Boston Healthcare System Jamaica Plain Campus, Jamaica Plain, MA
Funding Period: April 2016 - September 2017
The passage of the Evidence-Based Policy Commission Act of 2016 underscored the desire of Congress and the president to promote evidence-based policymaking through randomized program evaluations supported by enhanced data and methodological infrastructure. PEPReC evaluates, refines, and supports rigorous randomized designs that are targeted for maximum impact on access to care, quality, and value within the VHA. PEPReC currently supports three randomized program evaluations:
Veteran-Directed Home and Community-Based Services Program (VD-HCBS): VD-HCBS is a program in the Office of Geriatrics & Extended Care providing participant-directed home- and community-based services to Veterans at risk for nursing-home placement. It presents an opportunity to bring the VHA's spending closer to that of other payers and, in doing so, aligns VHA's budgetary needs with patient preferences. The evaluation is a large-scale, stepped-wedge, cluster-randomized trial of up to 77 VAMCs who do not currently have the VD-HCBS program. Over a period of 34 months, these VAMCs are being randomized to times to begin offering VD-HCBS. The evaluation aims to understand whether VD-HCBS reduces hospital admissions, emergency department admissions, nursing home admissions, and health care costs relative to usual care among veterans at risk for nursing home placement.
Risk Stratified Enhancements to Clinical Care: Targeting Care for Patients Identified through Predictive Modeling as being at High Risk for Suicide (REACH-VET): Reach-Vet, in collaboration with Office of Mental Health and Suicide Prevention (OMHSP), is closely linked with Secretary Shulkin's priority of reducing the level of suicides among Veterans. The intervention includes a dashboard (REACH-VET) that ranks the risk for suicide for each VHA patient. The underlying model predicts increases in suicide rates of up to 30-40 fold for the first three months after cases are identified and 16 fold over one year for the 0.1% of patients at the highest predicted risk. Among the patients in the top 0.1% of risk at each site, roll-out of the dashboard has been mandated. On-site coordinators assist providers with dashboard use, patient identification, and re-evaluation of treatment plans. Sites are evaluated on the percentage of patients for whom coordinators ask providers to re-evaluate care within 2 weeks of REACH-VET identification and on the percentage of patients for whom providers attempt outreach within 2 weeks of REACH-VET identification. At this time, PEPReC and partners are applying to NIMH for funding to implement a randomized evaluation of centralized caring letters, to be sent over a one year period, that include decision support, help with coping skills, and assistance navigating the healthcare system.
Predictive Model-Based Targeted Risk Mitigation for Patients Receiving VA Opioid Prescriptions Who Are at High Risk of Adverse Events (STORM): As of 2013, almost one in four VHA patients with prescriptions received an opioid medication. As is evident from national trends, patients receiving them are at higher risk of overdose, death, and other adverse outcomes. The STORM tool is a predictive model to estimate the risk of opioid-related outcomes for Veterans with prescriptions for opioid medication. STORM also displays and tracks use of recommended risk mitigation strategies. Over the past year, PEPReC has worked with OMHSP, the New England Veterans Engineering Resource Center (VERC), and research partners at the VA Pittsburgh Healthcare System to develop the VHA policy that would lead to STORM's implementation. The policy would require facilities to review high-risk cases identified by STORM and some, randomly selected, would receive facilitation if they failed to reach case review targets. Furthermore, the threshold for "high-risk" will be adjusted in a cluster-randomized stepped wedge design.
Objective 1. Identify and select for evaluation high-priority policies or practices in collaboration with VA operational partners and VA Office of Research and Development (ORD).
Objective 2. Develop methodologies to conduct randomized program evaluations of selected policies of interest, using secondary data analyses that measure patient level outcomes.
PEPReC has three cores:
-The Quantitative Methods Core promotes and maintains publication-quality research design standards while conducting quantitative analysis of administrative data related to selected randomized program evaluations.
-The Partnership Core facilitates research-operations relationships through ongoing communication with potential project partners; review, refinement and selection of partnered evaluations; and collaboration coordination with operations and research.
-The Dissemination and Education Core promotes knowledge of and appreciation for evidence-based policy as an approach to effective management and accountability and trains the next generation of evidence-based policy researchers.
Specific methods vary by project with the common theme of leveraging administrative data to identify most effective policies and practices and equalize access to promising programs and policies. PEPReC performs randomized evaluations; randomization and implementation of programs evaluated will be conducted by operational partners.
Designing and initiating randomized initiatives in a large, integrated delivery system presents many challenges, including:
-Stability of intervention financing
-Means of controlling and commitment to adhering to randomized rollout
-Degree of buy-in from key implementation staff
-Feasibility of managing multiple veto points for interventions that span several programs.
PEPReC applies randomized program evaluation methods and innovative data resources to evaluate and refine quality improvement initiatives in essential areas of Veterans Health Administration (VHA) care. PEPReC's mission is to evaluate, refine, and support rigorous operations and policy evaluations featuring national databases and randomized designs that are targeted for maximum impact on access to care, quality, and value within the VHA.
External Links for this Project
Dimensions for VADimensions for VA is a web-based tool available to VA staff that enables detailed searches of published research and research projects.
If you have VA-Intranet access, click here for more information vaww.hsrd.research.va.gov/dimensions/
VA staff not currently on the VA network can access Dimensions by registering for an account using their VA email address. Search Dimensions for this project
MeSH Terms: none