Skip Navigation Bar

National Information Center on Health Services Research and Health Care Technology (NICHSR)

Serving the Information Needs of the Health Services Research Community

Email Updates
Please enter your email address in the box below for updates:
  

Brown ArrowEvaluation Resources for Assessing HIT Systems and HIT Implementation, Adoption and Use

With the large investments required for health IT projects, stakeholders are increasingly demanding to know what the actual value of these projects has been, or will be. Evaluations allow us to determine whether or not what one has set out to accomplish has been accomplished, and to help us to understand what has worked in a given project and what has not. Lessons that emerge from evaluations help to guide both your team, as well as others, in their approach to projects in the future. Evaluations must therefore be an integral part of any health IT project. (AHRQ Health IT Evaluation Toolkit)

The diversity and complexity of health IT projects poses challenges for those seeking to evaluate particular projects and those interested in assessing broader population impact. While support for such evaluations can be found in ongoing health service research projects (explore the database Health Services Research Projects in Progress, as well in the proliferation of Toolkits from diverse public and non-profit sources (see below), there is also an increasing literature assessing evaluation techniques and approaches appropriate for health IT interventions, particularly those related to implementation of the requirements for "Meaningful Use." This literature can be found using PubMed search strategies, such as those at http://www.nlm.nih.gov/healthit/meaningful_use.html.

Search Queries Using NLM Resources: HIT Assessment

News: Evaluation Resources for Assessing HIT Systems and HIT Implementation

  • NIH awards to test ways to store, access, share, and compute on biomedical data in the cloud--07-NOV-2017 - (National Institutes of Health (NIH), HHS)  Details

    Twelve awards totaling $9 million in Fiscal Year 2017 will launch a NIH Data Commons Pilot Phase. A data commons is a shared virtual space where scientists can work with the digital objects of biomedical research, such as data and analytical tools. The NIH Data Commons will be implemented in a four-year pilot phase to explore the feasibility and best practices for making digital objects available through collaborative platforms.

  • Top 10 Health Technology Hazards for 2018--06-NOV-2017 - (ECRI Institute USA)  Details

    ​​Ransomware and other cybersecurity threats, endoscope reprocessing failures, and contamination of bed and stretcher support surfaces-these are just a few of the potential danger areas that ECRI identified in their Top 10 Health Technology Hazards for 2018 list. Download of the full brief requires free registration.

Datasets

  • EHR Products Used for Meaningful Use Attestation - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This dataset combines meaningful use attestations from the Medicare EHR Incentive Program and certified health IT product data from the ONC Certified Health IT Product List to identify the unique vendors, products, and product types of each certified health IT product used to attest to meaningful use. The dataset also includes important provider-specific data, related to the provider's participation and status in the program, unique provider identifiers, and other characteristics unique to each provider, like geography and provider type.

  • EHR Products Used for Meaningful Use Attestation Public Use File - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    These data provide meaningful use attestations from the Medicare EHR Incentive Program, linked to the ONC Certified Health IT Product List (CHPL). The data show which certified products were used for meaningful use attestations over the life of the program, thus far.

Tools, and Worksheets

  • 2015 Edition Test Method - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    The test procedures offer guidance to Accredited Testing Laboratories as they conduct Health IT module testing in the ONC Health IT Certification Program.

  • Behavioral Health - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    A set of tools and website delineating the integration of health care in the area of behavioral health

  • C-CDA R2.1 Scorecard - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This scorecard allows scoring of Consolidated Clinical Document Architecture documents.

  • Cert Guidance for Ineligible Providers - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    These guides and tools were developed to provide technical support and EHR implementation assistance to primary care providers.

  • Health IT Data Summaries - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    A web-based app which permits the creation of custom summaries of the latest national and state health IT data and statistics.

  • Health IT Literacy Guide - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    This guide provides strategies, and other resources for the development of technical standards and aspects of accessible health IT design,

  • Health IT Patient Satisfaction Survey - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This survey tool is intended to aid providers and health IT implementers assess the impact of health information technology adoption to inform quality improvement initiatives. The results will provide an understanding of how patients are responding to EHR use in the office.

  • Health IT Playbook - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This tool is designed for health care providers, practice staff, hospital administrators and others who are implementing a HIT system. Included are chapters on patient engagement, electronic health records, population and public health, privacy and security, patient safety, and value based care.

  • Health IT Survey Compendium - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    This database is a resource of health IT surveys that may be used in the evaluation of health IT projects.

  • Health Information Exchange (HIE) Toolkit - (Healthcare Information and Management Systems Society (HIMSS))  Details

    Using white papers, case studies, and business models this toolkit provides basic information health information exchange.

  • Health Information Technology and Health Data Standards at NLM - (National Library of Medicine (NLM), NIH USA)  Details

    Describes the National Library of Medicine's (NLM) role in the development of health information technology (HIT) and data standards. Also provides links to additional federal resources in the areas of HIT and data standards.

  • How to Implement EHRs - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This is a step-by-step overview of the tasks necessary to implement an EHR system.

  • Implementation Resources - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    A series of tools, webinars, reports, and training modules designed to assist in the EHR process.

  • Interoperability Proving Ground - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    The IPG is an open platform designed to allow providers to share interoperability projects.

  • ONC HIT Curriculum Overview - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    Registration is required to utilize this free curriculum. Included in the course are Working with Health IT Systems, Configuring Electronic Health Records, and Planning, Management and Leadership for Health IT.

  • ONC One Click Scorecard - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    One Click Scorecard allows providers to evaluate the quality of clinical summary documents (C-CDAs) received, or created, by their system.

  • Standards Implementation & Testing Environment - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    A centralized collection of testing tools and resources designed to assist health IT developers/users fully evaluate specific technical standards and maximize the potential of their health IT implementations. SITE is organized in a collection of sandboxes that provide test tools, sample data, collaboration resources, and useful links.

  • State Health IT Policy Levers Compendium - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    The Compendium contains 32 policy levers (such as Credentialing Policies or State-level legal protections) and 300 examples of how states use these levers to promote health IT and advance interoperability.

  • State Innovation Model Resource Center - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This Resource Center provides financial and technical support to states to design and test innovative, state-based multi-payer health care delivery and payment system reform

  • eCQI Resource Center - (Centers for Medicare & Medicaid Services (CMS), HHS, Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This resource provide a centralized location for news, information, tools and standards related to electronic clinical quality improvement and electronic clinical quality measures

Guidelines, Publications, Other

  • 2017 Interoperability Standards Advisory images/pdf.gif icon - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This document represents the model by which ONC will coordinate the identification, assessment, and public awareness of interoperability standards and implementation specifications that can be used by the healthcare industry to address specific interoperability needs.

  • Change Management in EHR Implementation - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This primer is intended to aid implementers with Change Management for EHR Implementation. Change management is the basic foundation underlying all phases of the EHR implementation lifecycle and helps achieve EHR Meaningful Use and practice transformation

  • Evaluation of the Regional Extension Center Program: Final Report (2016) images/pdf.gif icon - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    This report provides an overview of methods and findings about Regional Extension Center implementation and impact. The REC provided support for 100,000 providers working in small primary care practices, practices with a large proportion of patients with Medicaid or without insurance, community health centers, rural health clinics, and critical access hospitals.

  • HealthIT Dashboard - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    The Dashboard provides quick access to federal policies, programs, and research activities related to health IT.

  • Interoperability Standards Advisory (ISA) - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    The ISA is a coordinated online catalog platform of standards and implementation specifications that are available for use by the health IT industry to meet interoperability needs.

  • Next Steps to Encourage Adoption of Data Standards for Clinical Registries - (Pew Charitable Trusts USA)  Details

    This fact sheet provides an overview of four issues that need to be addressed to facilitate adoption of data standards and potential solutions: ineffective coordination between stewards, data standards that do not meet needs of registries, expense of data standard adoption and maintenance, and lack of support from the federal government.

  • Optimizing Strategies for Clinical Decision Support - (National Academy of Medicine (NAM))  Details

    Report identifies the need for a continuously learning health system driven by the seamless and rapid generation, processing, and practical application of the best available evidence for clinical decision-making, and lays out a series of actionable collaborative next steps to optimize strategies for adoption and use of clinical decision support.

  • Report to Congress: Challenges and Barriers to Interoperability (2015) images/pdf.gif icon - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    A series of recommendations from the Clinical, Technical, Organizational and Financial Barriers to Interoperability Task Force to the Congress. Financial, policy and business barriers to interoperability are discussed.

  • Telehealth Resource Guide (2016) - (Association of State and Territorial Health Officials (ASTHO))  Details

    This guide is a resource for state and territorial health officials to enhance their telehealth efforts.

Frameworks

  • Creating a Framework to Support Measure Development for Telehealth (August 2017) - (National Quality Forum (NQF) USA)  Details

    A multi-stakeholder committee (the Telehealth Committee) was convened to recommend various methods to measure the use of telehealth as a means of providing care. This report and the conceptual framework herein serve as the foundation for future efforts to advance quality measurement for telehealth. By identifying some of the highest-priority areas for measurement, this report may support the development of measures that incorporate into a telehealth environment as part of an iterative development process.

Legislation, Regulations

  • Standards and Certification Regulations - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    The final rule creates a regulatory framework for ONC's direct review of health information technology (health IT) certified under the Program, including, when necessary, requiring the correction of non-conformities found in health IT certified under the Program and suspending and terminating certifications issued to Complete EHRs and Health IT Modules. The final rule also sets forth processes for ONC to authorize and oversee accredited testing laboratories under the Program. In addition, it includes provisions for expanded public availability of certified health IT surveillance results

Grants, Funding, and Fellowships

  • PA-17-009 Use of Technology to Enhance Patient Outcomes and Prevent Illness (R21) - (National Institutes of Health (NIH), HHS)  Details

    Grant seeks clinical research focused on the development and utilization of technologies that can help address patient outcomes. Relevant areas of technology include remote healthcare delivery to patients via telehealth, robotics to enhance medication adherence, on-site (e.g., clinical or home setting) care delivery, mobile heath to increase access and adherence, web-based decision support tools, and others.

  • Health Information Technology (IT) to Improve Health Care Quality and Outcomes (R21) - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    This FOA issued by AHRQ invites grant applications for funding to conduct exploratory and developmental research grants (R21) for projects in the early and conceptual stages of development that will contribute to the evidence base of how health information technology (IT) improves health care quality and outcomes.

  • Challenge Competition: Improving Remote Monitoring of Pregnancy - (Health Resources and Services Administration (HRSA), HHS)  Details

    HRSA's Maternal and Child Health Bureau (MCHB) announces a prize competition to support the development and testing of low-cost, scalable technology-based innovations to improve the ability of prenatal care providers to monitor the health and wellbeing of pregnant women remotely, especially women who live in rural and medically-underserved areas who have limited access to on-site prenatal care.

  • Secure API Server Showdown Challenge - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    The Secure API Server Showdown Challenge invites interested stakeholders to build a secure, Health Level 7 (HL7®) Fast Healthcare Interoperability Resources (FHIR®) server using current industry technical standards, best practices, and recently issued healthcare-specific implementation guide requirements

  • Use of Technology to Enhance Patient Outcomes and Prevent Illness (R21 Clinical Trial Optional) - (National Institutes of Health (NIH), HHS)  Details

    Funding for clinical research focused on the development and utilization of technologies that can help address patient outcomes. Relevant areas of technology include remote healthcare delivery to patients via telehealth, robotics to enhance medication adherence, on-site care delivery, mobile heath to increase access and adherence, web-based decision support tools, and others.

Meetings, Conferences, Webinars

Upcoming Meetings

  • 2017 ONC Annual Meeting - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    November 30 - December 1, 2017, Washington, DC.

  • ECRI Institute's 24th Annual Conference - (ECRI Institute USA)  Details

    November 28-29, 2017; Washington, DC. "Workflow, Workarounds, and Overworked Health Systems: Innovations and Challenges for Quality, Safety, and Technology," ECRI Institute's 24th Annual Conference, strengthens the emerging national dialog on practice efficiency and institutional culture and their effects on care.

  • HiMSS18 - (Healthcare Information and Management Systems Society (HIMSS))  Details

    March 5-9, 2018; Las Vegas, NV.

  • HTAi 2018 - (Health Technology Assessment International (HTAi) CANADA)  Details

    June 1-5, 2018 Vancouver, BC.

Past Meetings

Webinars

  • Access to Capital - Rural Hospital - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    To prepare rural hospital for the questions they will face when applying for a loan, this webinar explains the evaluation process commercial banks use to make a decision on a loan.

Organizations and Associations

  • AHRQ National Resource Center for Health Information Technology - (Agency for Healthcare Research and Quality (AHRQ), HHS)  Details

    AHRQ initiative containing information on programs that promote the use of health information technology. Central repository for research findings from projects developing, testing, and using health IT applications.

  • DATA - Data Across Sectors for Health - (Robert Wood Johnson Foundation (RWJF))  Details

    DASH is a national initiative to support multi-sector collaborations sharing data and information to improve the health of their communities.

  • Health IT Buzz - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    From the Office of the National Coordinator for Health Information Technology (ONC), this blog was created to answer questions about the nation's transition to electronic health records and to create a conversation about the challenges and successes health care providers, physicians, practices, and organizations are experiencing as they transition from paper to electronic health records.

  • Health IT Strategic Planning - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    Included here are the Federal Health IT Strategic Plan 2015-2020, Patient Safety Action and Surveillance Plan, and the Report to Congress on Health IT Adoption and Exchange

  • Health Resources and Services Administration (HRSA) Details

    HRSA works to improve and extend life for people living with HIV/AIDS, provide primary health care to medically underserved people, serve women and children through state programs, and train a health workforce that is both diverse and motivated to work in underserved communities.

  • HealthIT.gov - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    Resource to support the adoption of health information technology and the promotion of nationwide health information exchange to improve health care.

  • Healthcare Information and Management Systems Society (HIMSS) - (Healthcare Information and Management Systems Society (HIMSS))  Details

    The healthcare industry's membership organization exclusively focused on providing leadership for the optimal use of healthcare information technology (IT) and management systems for the betterment of healthcare.

  • IHE USA Details

    IHE USA is a part of the international group, and focuses on fostering consistent information standards.

  • Regional Extension Centers (RECs) - (Office of the National Coordinator for Health Information Technology (ONC), HHS)  Details

    Information is provided on the ONC's Regional Extension Centers, which serve as a support and resource centers to assist providers in EHR implementation and HealthIT needs