Showing posts with label Interop Metrics. Show all posts
Showing posts with label Interop Metrics. Show all posts

Thursday, May 12, 2016

ONC RFI Assessing Interoperability for MACRA - part 2 - ONC RFI

Here's a summary of the Request For Information from ONC. Much of what follows is loosely quoted from the RFI, a Request for Information regarding assessing interoperability for the Medicare Access and CHIP Reauthorization Act of 2015 (MACRA). Comments are due by 11:59pm ET on June 3, 2016.

MACRA and the ONC RFI both focus on measures of interoperability to be able to assess whether "widespread interoperability" has been achieved.

As background and on-going framework, the RFI makes frequent reference to the Shared Nationwide Interoperability Roadmap version 1.0.  

MACRA requires that the interoperability measures be established by July 1, 2016. This timeline effectively requires using metrics that are based on data which is currently being collected. Recognizing the limitations this time constraint creates, ONC also asks for comments about other metrics that might require more time to implement and would better measure the ambitious goal of widespread interoperability.

MACRA defines interoperability as the ability of two or more health information systems or components to:
  1. Exchange clinical and other information and
  2. Use the information that has been exchanged using common standards to provide access to longitudinal information for healthcare providers in order to facilitate coordinated care and improve patient outcomes.

The ONC RFI asks for comments in three areas:
  1. Measure population and key components of interoperability that should be measured
  2. Current data sources and potential metrics that address section 106(b)(1) of MACRA
  3. Other data sources and metrics ONC should consider with respect to section 106(b)(1) of MACRA or interoperability measurement more broadly

1. Measure population and key components of interoperability 

MACRA requires assessment of interoperability among meaningful EHR users and clinicians and health care providers with whom they exchange clinical and other information - their exchange partners. The exchange partners do not have to be meaningful EHR users themselves.

ONC is looking to measure interoperability across populations and settings beyond that required by MACRA, as they have previously laid out in the Interoperability Roadmap. In the RFI, they ask for comments on this broader measure population.

In keeping with the MACRA requirement, ONC further states that they are looking to measure not just exchange but use of information that has been exchanged.

ONC proposes a framework for use:
  • Sending
  • Receiving
  • Finding (Request or Query)
  • Integrating or Incorporating
  • Subsequent use of information from other providers

ONC is asking for comments to cover the following: 
  • Should the focus be limited to the MACRA requirements, Meaningful EHR users and their trading partners, or more broadly as laid out in the Interoperability Roadmap?
  • How should participants in the Merit-Based Incentive Payment System (MIPS) and Alternative Payment Models (APMs) be addressed?
  • Do the ONC components of sending, receiving, finding, integrating and using information meet the exchange and use requirements of MACRA?
  • Should the measurement be limited to certified EHR technology (C-EHR-T)? Measurement outside of C-EHR-T?

2. Available Data Sources and Potential Measures

ONC is looking at a combination of two perspectives
  1. By provider, based on the proportion of Meaningful EHR users exchanging information with other clinicians and subsequently using that information
  2. By transactions, based on the proportion of care transitions and encounters where information is electronically exchanged and used.

The data sources being considered include
[As an aside, ONC maintains a Health IT Dashboard across a variety of data sources.]

2.1 Measures based on national survey data

  • Strengths: The surveys measure exchange with outside providers. Multiple years of survey data are available.
  • Weaknesses: self-reported data subject to bias and interpretation. Do not cover all providers. Do not provide transaction-level data.

Survey measures under consideration include
  • Proportion of health care providers who are electronically sending, receiving, finding and integrating key health information
  • Proportion of health care providers who use the information they receive from outside providers for clinical decisions
  • Proportion of health care providers who electronically perform reconciliation of clinical information

The survey results may provide insight into enablers and barriers to interoperable exchange.

Questions about these survey measures:
  • Do the survey questions adequately address both exchange and use?
  • Could office-based physicians serve as adequate proxies for all Eligible Professions included in the EHR Incentive Program?
  • Do the surveys provide necessary information to determine why information may not be widely exchanged?

2.2 Measures based on the CMS Medicare and Medicaid EHR Incentive Program

The EHR Incentive Program is administered differently for Medicare and Medicaid. Provider-level data is collected by Medicare, but the states report Medicaid data as an aggregate. Changes in the data reported by the states would be required to get more granular, provider-level data.

The interoperability objective of the EHR Incentive Program has limited scope, simple ensuring that a summary of care is sent, but not what was done by the receiving provider.
ONC recognizes limitations in these data sets and is looking for comment on the strengths and weaknesses of these data sets as well as other data sets that could be sources for measuring interoperability.

EHR Incentive Program measures under consideration include
  • Proportion of transitions of care or referrals where a summary of care record was created and exchanged
  • Proportion of transitions or referrals and patient encounters in which the health care provider receives, requests or queries for an electronic summary of care document (beginning in 2017)
  • Proportion of transitions of care where medication reconciliation is performed
  • Proportion of transitions or referrals where the health care provider performs clinical information reconciliation for medications, medication allergies and problem lists (beginning in 2017).
ONC states that electronic reconciliation may include a combination of electronic and non-electronic information, but that it serves as a proxy for assessing electronic exchange.

Questions about the use of EHR Incentive Program include

  • Do the potential measures adequately measure exchange?
  • Do the reconciliation-based measures adequately measure use?
  • What alternative measures (for example, clinical quality measures) should ONC consider to assess use?
  • Can state Medicaid agencies share health care provider-level data with CMS similar to how Medicare collects the data? If not, what are the barriers? What are some alternatives?
  • These measures assess interoperability across encounters or transitions of care. Would it also be valuable to develop measures of interoperability across health care providers, even if limited to the Medicare EHR Incentive Program?

3. Other Data Sources and Measures

ONC is looking for additional potential data sources and measures. For example

  • Medicare Fee for Service claims data
  • Performance data from other programs
  • Performance data from the Merit-Based Incentive Payment System (MIPS)
  • Performance data from Alternative Payment Models (APMs)
  • Electronically generated data from C-EHR-T or other systems

Overarching Questions


  • Should ONC select measures from a single data source for consistency? Or leverage a variety of data sources? Would a combination of EHR Incentive Program and national survey data be appropriate? 
  • What, if any, other data sources and measures should ONC consider?
  • What measures might be provided by EHR vendors, Health Information Service Providers (HISPs), Health Information Exchange Organizations (HIEs, HIOs) or other organizations that enable exchange?
  • What information might be added by using measures based on Medicare Fee for Service claims?
  • Which are the highest priority measures to consider?
  • Address comments within the December 31, 2018 deadline for evaluating interoperability.
  • What might be useful for measuring interoperability more broadly?
  • How should ONC define "widespread"? What can be in quantifiable terms?

Monday, April 25, 2016

ONC RFI Assessing Interoperability for MACRA - part 1 - MACRA text

On April 8, 2016, The Office of the National Coordinator for Health Information Technology (ONC) issued a Request for Information (RFI) regarding assessing interoperability for the Medicare Access and CHIP Reauthorization Act of 2015 (MACRA). Comments are due by 11:59pm ET on June 3, 2016.

The MACRA legislation lays out a timeline for defining, assessing and acting on barriers to widespread interoperability.
July 1, 2016: Establish metrics for widespread interoperability
December 31, 2018: Determine if widespread interoperability has been achieved
December 31, 2019: Identify barriers to widespread interoperability and recommend actions to address 

Here's the relevant section of MACRA.  

Medicare Access and CHIP Reauthorization Act of 2015

SEC. 106. REDUCING ADMINISTRATIVE BURDEN AND OTHER PROVISIONS.

(b) PROMOTING  INTEROPERABILITY OF  ELECTRONIC HEALTH RECORD  SYSTEMS

(1) RECOMMENDATIONS FOR ACHIEVING WIDESPREAD EHR INTEROPERABILITY

  1. OBJECTIVE .—As a consequence of a significant Federal investment in the implementation of health information technology through the Medicare and Medicaid EHR incentive programs, Congress declares it a national objective to achieve widespread exchange of health information through interoperable certified EHR technology nationwide by December 31, 2018.
  2. DEFINITIONS .—In this paragraph:
(i) WIDESPREAD INTEROPERABILITY .—The term ‘‘widespread interoperability’’ means interoperability between certified EHR technology systems employed by meaningful EHR users under the Medicare and Medicaid EHR incentive programs and other clinicians and health care providers on a nationwide basis.
(ii) INTEROPERABILITY .—The term ‘‘interoperability’’ means the ability of two or more health information systems or components to exchange clinical and other information and to use the information that has been exchanged using common standards as to provide access to longitudinal information for health care providers in order to facilitate coordinated care and improved patient outcomes.
  1. ESTABLISHMENT OF METRICS .—Not later than July 1, 2016, and in consultation with stakeholders, the Secretary shall establish metrics to be used to determine if and to the extent that the objective described in subparagraph (A) has been achieved.
  2. RECOMMENDATIONS IF OBJECTIVE NOT ACHIEVED .— If the Secretary of Health and Human Services determines that the objective described in subparagraph (A) has not been achieved by December 31, 2018, then the Secretary shall submit to Congress a report, by not later than December 31, 2019, that identifies barriers to such objective and recommends actions that the Federal Government can take to achieve such objective. Such recommended actions may include recommendations—
(i) to adjust payments for not being meaningful EHR users under the Medicare EHR incentive programs; and

(ii) for criteria for decertifying certified EHR technology products.