Skip Navigation Bar

National Information Center on Health Services Research and Health Care Technology (NICHSR)

Serving the Information Needs of the Health Services Research Community

Email Updates
Please enter your email address in the box below for updates:
  

Brown ArrowEvaluation Resources for Assessing HIT Systems and HIT Implementation, Adoption and Use

With the large investments required for health IT projects, stakeholders are increasingly demanding to know what the actual value of these projects has been, or will be. Evaluations allow us to determine whether or not what one has set out to accomplish has been accomplished, and to help us to understand what has worked in a given project and what has not. Lessons that emerge from evaluations help to guide both your team, as well as others, in their approach to projects in the future. Evaluations must therefore be an integral part of any health IT project. (AHRQ Health IT Evaluation Toolkit)

The diversity and complexity of health IT projects poses challenges for those seeking to evaluate particular projects and those interested in assessing broader population impact. While support for such evaluations can be found in ongoing health service research projects (explore the database Health Services Research Projects in Progress, as well in the proliferation of Toolkits from diverse public and non-profit sources (see below), there is also an increasing literature assessing evaluation techniques and approaches appropriate for health IT interventions, particularly those related to implementation of the requirements for "Meaningful Use." This literature can be found using PubMed search strategies, such as those at http://www.nlm.nih.gov/healthit/meaningful_use.html.

Search Queries Using NLM Resources: HIT Assessment

News: Evaluation Resources for Assessing HIT Systems and HIT Implementation

Datasets

  • EHR Products Used for Meaningful Use Attestation - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This dataset combines meaningful use attestations from the Medicare EHR Incentive Program and certified health IT product data from the ONC Certified Health IT Product List to identify the unique vendors, products, and product types of each certified health IT product used to attest to meaningful use. The dataset also includes important provider-specific data, related to the provider's participation and status in the program, unique provider identifiers, and other characteristics unique to each provider, like geography and provider type.

  • EHR Products Used for Meaningful Use Attestation Public Use File - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    These data provide meaningful use attestations from the Medicare EHR Incentive Program, linked to the ONC Certified Health IT Product List (CHPL). The data show which certified products were used for meaningful use attestations over the life of the program, thus far.

Tools, and Worksheets

  • 2015 Edition Test Method - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    The test procedures offer guidance to Accredited Testing Laboratories as they conduct Health IT module testing in the ONC Health IT Certification Program.

  • Behavioral Health - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    A set of tools and website delineating the integration of health care in the area of behavioral health

  • C-CDA R2.1 Scorecard - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This scorecard allows scoring of Consolidated Clinical Document Architecture documents.

  • Cert Guidance for Ineligible Providers - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    These guides and tools were developed to provide technical support and EHR implementation assistance to primary care providers.

  • Health IT Data Summaries - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    A web-based app which permits the creation of custom summaries of the latest national and state health IT data and statistics.

  • Health IT Literacy Guide - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    This guide provides strategies, and other resources for the development of technical standards and aspects of accessible health IT design,

  • Health IT Patient Satisfaction Survey - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This survey tool is intended to aid providers and health IT implementers assess the impact of health information technology adoption to inform quality improvement initiatives. The results will provide an understanding of how patients are responding to EHR use in the office.

  • Health IT Playbook - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This tool is designed for health care providers, practice staff, hospital administrators and others who are implementing a HIT system. Included are chapters on patient engagement, electronic health records, population and public health, privacy and security, patient safety, and value based care.

  • Health IT Summaries Web-App - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Web application allows users to create a custom summary of the latest national and state health IT data and statistics.

  • Health IT Survey Compendium - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    This database is a resource of health IT surveys that may be used in the evaluation of health IT projects.

  • Health Information Exchange (HIE) Toolkit - (Healthcare Information Management Systems Society (HIMSS) USA)  Details

    Using white papers, case studies, and business models this toolkit provides basic information health information exchange.

  • How to Implement EHRs - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This is a step-by-step overview of the tasks necessary to implement an EHR system.

  • Implementation Resources - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    A series of tools, webinars, reports, and training modules designed to assist in the EHR process.

  • Interoperability Proving Ground - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    The IPG is an open platform designed to allow providers to share interoperability projects.

  • ONC HIT Curriculum Overview - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Registration is required to utilize this free curriculum. Included in the course are Working with Health IT Systems, Configuring Electronic Health Records, and Planning, Management and Leadership for Health IT.

  • ONC One Click Scorecard - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    One Click Scorecard allows providers to evaluate the quality of clinical summary documents (C-CDAs) received, or created, by their system.

  • Standards Implementation & Testing Environment - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    A centralized collection of testing tools and resources designed to assist health IT developers/users fully evaluate specific technical standards and maximize the potential of their health IT implementations. SITE is organized in a collection of sandboxes that provide test tools, sample data, collaboration resources, and useful links.

  • State Health IT Policy Levers Compendium - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    The Compendium contains 32 policy levers (such as Credentialing Policies or State-level legal protections) and 300 examples of how states use these levers to promote health IT and advance interoperability.

  • State Innovation Model Resource Center - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This Resource Center provides financial and technical support to states to design and test innovative, state-based multi-payer health care delivery and payment system reform

  • eCQI Resource Center - (Centers for Medicare & Medicaid Services (CMS), Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This resource provide a centralized location for news, information, tools and standards related to electronic clinical quality improvement and electronic clinical quality measures

Guidelines, Publications, Other

  • 2017 Interoperability Standards Advisory images/pdf.gif icon - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This document represents the model by which ONC will coordinate the identification, assessment, and public awareness of interoperability standards and implementation specifications that can be used by the healthcare industry to address specific interoperability needs.

  • Change Management in EHR Implementation - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This primer is intended to aid implementers with Change Management for EHR Implementation. Change management is the basic foundation underlying all phases of the EHR implementation lifecycle and helps achieve EHR Meaningful Use and practice transformation

  • Evaluation of the Regional Extension Center Program: Final Report (2016) images/pdf.gif icon - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    This report provides an overview of methods and findings about Regional Extension Center implementation and impact. The REC provided support for 100,000 providers working in small primary care practices, practices with a large proportion of patients with Medicaid or without insurance, community health centers, rural health clinics, and critical access hospitals.

  • HealthIT Dashboard - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    The Dashboard provides quick access to federal policies, programs, and research activities related to health IT.

  • Interoperability Standards Advisory (ISA) - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    The ISA is a coordinated online catalog platform of standards and implementation specifications that are available for use by the health IT industry to meet interoperability needs.

  • Next Steps to Encourage Adoption of Data Standards for Clinical Registries - (Pew Charitable Trusts USA)  Details

    This fact sheet provides an overview of four issues that need to be addressed to facilitate adoption of data standards and potential solutions: ineffective coordination between stewards, data standards that do not meet needs of registries, expense of data standard adoption and maintenance, and lack of support from the federal government.

  • Report to Congress: Challenges and Barriers to Interoperability (2015) images/pdf.gif icon - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    A series of recommendations from the Clinical, Technical, Organizational and Financial Barriers to Interoperability Task Force to the Congress. Financial, policy and business barriers to interoperability are discussed.

  • Telehealth Resource Guide (2016) - (Association of State and Territorial Health Officials (ASTHO))  Details

    This guide is a resource for state and territorial health officials to enhance their telehealth efforts.

Frameworks

Legislation, Regulations

  • Standards and Certification Regulations - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    The final rule creates a regulatory framework for ONC's direct review of health information technology (health IT) certified under the Program, including, when necessary, requiring the correction of non-conformities found in health IT certified under the Program and suspending and terminating certifications issued to Complete EHRs and Health IT Modules. The final rule also sets forth processes for ONC to authorize and oversee accredited testing laboratories under the Program. In addition, it includes provisions for expanded public availability of certified health IT surveillance results

Grants, Funding, and Fellowships

  • PA-17-009 Use of Technology to Enhance Patient Outcomes and Prevent Illness (R21) - (National Institutes of Health (NIH), HHS)  Details

    Grant seeks clinical research focused on the development and utilization of technologies that can help address patient outcomes. Relevant areas of technology include remote healthcare delivery to patients via telehealth, robotics to enhance medication adherence, on-site (e.g., clinical or home setting) care delivery, mobile heath to increase access and adherence, web-based decision support tools, and others.

  • Health Information Technology (IT) to Improve Health Care Quality and Outcomes (R21) - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    This FOA issued by AHRQ invites grant applications for funding to conduct exploratory and developmental research grants (R21) for projects in the early and conceptual stages of development that will contribute to the evidence base of how health information technology (IT) improves health care quality and outcomes.

  • Patient Matching Algorithm Challenge - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    The goal of the Patient Matching Algorithm Challenge is to bring about greater transparency and data on the performance of existing patient matching algorithms, spur the adoption of performance metrics for patient data matching algorithm vendors, and positively impact other aspects of patient matching such as deduplication and linking to clinical data. Participants will be provided a data set and will have their answers evaluated and scored against a master key.

  • Market Transparency Project for Health IT Interoperability Services - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Funding to improve transparency in the current market by funding the development of an independent, open, online resource (e.g., an interactive website containing crowdsourced and voluntarily submitted data), whose design features and functionality is to be guided by market research to be performed by the recipient on costs frequently associated with health IT interoperability services.

  • Mobile Monitoring of Cognitive Change (U2C) - (National Institutes of Health (NIH), HHS)  Details

    Funding to design and implement research infrastructure that will enable the monitoring of cognitive abilities and age, state, context, or health condition-related changes in cognitive abilities on mobile devices.

  • Certified Health IT Surveillance Capacity and Infrastructure Improvement Cooperative Agreement Program - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Funding to improve the surveillance capacity and infrastructure that exists for health IT certified under the Program. Through this FOA, recipients are expected to improve and expand the in-the-field surveillance capacity and infrastructure for health IT certified under the Program, with a particular focus on capabilities that are directly related to interoperability.

  • Telehealth Center of Excellence - (Health Resources and Services Administration (HRSA))  Details

    Funding to support a program to examine the efficacy of telehealth[1] services in rural and urban areas. The Telehealth Center of Excellence will be located in a public academic medical center that: Has a successful telehealth program with a high annual volume of telehealth visits; Has an established reimbursement structure that allows telehealth services to be financially self-sustaining; and Has established programs that provide telehealth services in medically underserved areas with high chronic disease prevalence and high poverty rates.

Meetings, Conferences, Webinars

Upcoming Meetings

  • 2017 ONC Annual Meeting - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    November 30 - December 1, 2017, Washington, DC.

  • WEDI Fall Conference 2018 - (Workgroup for Electronic Data Interchange (WEDI))  Details

    October 15-17, 2017 Arlington, VA. The Workgroup for Electronic Data Interchange (WEDI) is the leading authority on the use of Health IT to improve healthcare information exchange in order to enhance the quality of care, improve efficiency and to reduce costs of the American healthcare system.

Past Meetings

  • "You Never Want to Go Back": The Promise of Health IT - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Transcript and slides of a keynote address given by Dr. Washington to the Association of Health Care Journalists' (AHCJ) Journalism Workshop on Health Information Technology.

Webinars

  • Access to Capital - Rural Hospital - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    To prepare rural hospital for the questions they will face when applying for a loan, this webinar explains the evaluation process commercial banks use to make a decision on a loan.

  • Interoperability in Action Day: Advancing Interoperable Social Determinants of Health - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    July 26, 2017 12:00-4:00pm ET. This half-day webinar will highlight the current state of SDOH screening tools and their use in different alternative care and payment models, highlight current efforts to enable electronic capture and demonstrate available resources to create interoperable SDOH tools, concepts and data elements.

Organizations and Associations

  • AHRQ National Resource Center for Health Information Technology - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    AHRQ initiative containing information on programs that promote the use of health information technology. Central repository for research findings from projects developing, testing, and using health IT applications.

  • DATA - Data Across Sectors for Health - (Robert Wood Johnson Foundation (RWJF))  Details

    DASH is a national initiative to support multi-sector collaborations sharing data and information to improve the health of their communities.

  • Health IT Buzz - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    From the Office of the National Coordinator for Health Information Technology (ONC), this blog was created to answer questions about the nation's transition to electronic health records and to create a conversation about the challenges and successes health care providers, physicians, practices, and organizations are experiencing as they transition from paper to electronic health records.

  • Health IT Strategic Planning - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Included here are the Federal Health IT Strategic Plan 2015-2020, Patient Safety Action and Surveillance Plan, and the Report to Congress on Health IT Adoption and Exchange

  • Health Resources and Services Administration (HRSA) Details

    HRSA works to improve and extend life for people living with HIV/AIDS, provide primary health care to medically underserved people, serve women and children through state programs, and train a health workforce that is both diverse and motivated to work in underserved communities.

  • HealthIT.gov - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Resource to support the adoption of health information technology and the promotion of nationwide health information exchange to improve health care.

  • Healthcare Information and Management Systems Society (HIMSS) - (Healthcare Information and Management Systems Society)  Details

    The healthcare industry's membership organization exclusively focused on providing leadership for the optimal use of healthcare information technology (IT) and management systems for the betterment of healthcare.

  • IHE USA Details

    IHE USA is a part of the international group, and focuses on fostering consistent information standards.

  • Regional Extension Centers (RECs) - (Office of the National Coordinator for Health Information Technology, HHS (ONC))  Details

    Information is provided on the ONC's Regional Extension Centers, which serve as a support and resource centers to assist providers in EHR implementation and HealthIT needs