Order information is critical to perform the appropriate examination1 and interpretation.1- 3 Of 58 paper radiograph requisitions, 1 study found that 91% lacked appropriate indications, 10% were not in the medical records, 20% were without indications, 34% had inadequate/incomplete information, and 27% contained different information than in the medical records.4 Another study of 150 inpatient paper orders for chest radiographs found that 29% were missing current indications and 31% were missing appropriate indications.5 The large volume of diagnostic radiologic examinations performed annually (approximately 599 million in 2006 for the United States), the potential cost of incomplete and repeated examinations and the potential for decreased quality of care motivated an investigation of the improvements afforded by computerized physician order entry (CPOE).

METHODS

Until spring 2008, our inpatient practice was paper based and clerks entered radiologic examination orders. After implementation of CPOE, indications were required in 2 free-text fields (signs and symptoms and presumed diagnoses) with review and approval by the attending physician.

Order indications were assessed 2 months prior to, 1 month immediately after, and 3 to 4 months after implementation of CPOE. We assigned medical abbreviations a low score because of their nonuniqueness and the ease of making a typographical error. Other classifications included the following: incomplete (blank fields or terms such as routine or doctor's orders without additional information); inadequate (either field contained prior surgery status, line or intubation checks, and the other contained terms such as per protocol or routine); nonapplicable (indication not relevant to the anatomic site, eg, radiograph abdomen with “change in mental status”); reasonable (sufficient information); or, excellent (relevant or valid reason).

Data were retrospectively collected from all inpatients, 18 years or older, with radiologic examination orders during January, May, or August 2008. This study was approved by The Cleveland Clinic institutional review board and granted a waiver of informed consent.

RESULTS

The frequency of “reasonable” or “excellent” indications was calculated. The time before or after CPOE implementation, hospital unit, specialty of the ordering health care provider, and imaging modality were evaluated along with 2-way interactions with order month. Clinical significance was considered with the doubling of the percentage of complete and meaningful indications; P ≤ .05 was considered statistically significant. Logistic regression analysis assessed the outcome variable as a function of CPOE intervention. Test times were the predictor variable. Generalized estimating equations were used to account for multiple studies per patient.

A total of 37 494 imaging orders from 6332 inpatients were investigated: 15 081 from January, 8734 from May, and 13 679 from August 2008 (Table). Not all units had CPOE implemented by May 1; hence, the number of orders is smaller in May. A reduction in hospital census likely contributed to the 8% decrease in the number of inpatient radiologic examination orders for August compared with January. All units had CPOE implemented for at least 3 full months as of August 1. A statistically significant increase from 6.4% (965 of 15 081 orders) to 21.6% (2955 of 13 679 orders) in “reasonable” and “excellent” quality indications between January and August resulted from CPOE implementation (overall, P < .001) for all levels of patient care units, imaging modalities, and provider specialties (eTables1–4). While statistically significant and in agreement with other studies,1,3,6 the overall level of 22% was unacceptably low.

COMMENT

Computerized physician order entry can be implemented using free-text fields, discrete diagnoses, discrete signs and symptoms, and order decision support.6 This unsatisfactory result is attributed to the free-text fields. While obvious in hindsight, discrete fields based on clinical terminology such as SnoMed CT (International Health Terminology Standards Development Organization) should automatically eliminate the “incomplete” and “medical abbreviations” categories by providing more complete documentation (eg, SOB, shortness of breath; SBO, small-bowel obstruction). Depending on the discrete selections available, “inadequate” (“status-post”) and “nonapplicable” reasons can remain as causes of poor-quality indications. Once discrete fields are available, order validation (appropriateness assessment) can be performed and should result in only relevant and valid indications. Order decision support software6 using evidence-based guidelines, such as provided by the American College of Radiology or American College of Cardiology, along with physician-to-physician communication for nonstandard orders, may be one solution to achieve improved communication and patient care.

Poor radiologic examination order indications are analogous to poor patient hand-offs and include performance of incorrect or incomplete examinations, overlooking patient-specific issues, general examination interpretations (not addressing clinical question), safety and compliance issues, billing delays, and rejections.2,5,6 Computerized physician order entry significantly and clinically improved the quality and information content of indications. Despite this improvement, 78% of orders continued to have inadequate, incomplete, or nonapplicable indications. We believe the required text fields and restricting ordering privileges to licensed health care providers directly contributed to improvements in order quality. However these free-text fields (implementation choice) failed to communicate adequate information. Implementation of discrete signs and symptoms, tracking health care provider ordering patterns, and educational programs targeted at improved documentation of patient indications should further improve order quality. In spite of these efforts, work-arounds are possible using any system; “gaming” order validation and appropriateness assessment systems is possible. With the pivotal role radiologic examinations play in health care decision making,1- 3 improving the quality of order indications for radiologic examinations should improve the quality of patient care.

Correspondence

The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians.
The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with
the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.

Indicate what change(s) you will implement in your practice, if any, based on this CME course.

Your quiz results:

The filled radio buttons indicate your responses. The preferred responses are highlighted

For CME Course:
A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes

Indicate what changes(s) you will implement in your practice, if any, based on this
CME course.

Instructions

Thank you for submitting a comment on this article. It will be reviewed by JAMA Internal Medicine editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.

Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.

* = Required Field

Comment Author(s)* (if multiple authors, separate
names by comma)

Example: John Doe

Affiliation & Institution*

Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.

This feature is provided as a courtesy. By using it you agree that that you are requesting the material solely for personal, non-commercial use, and that it is subject to the AMA's Terms of Use. The information provided in order to email this article will not be shared, sold, traded, exchanged, or rented. Please refer to The JAMA Network's Privacy Policy for additional information.

Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.

What is this ?

Article rental gives users the ability to access the full text of an article and its supplementary content for 24 hours.
Access to the PDF is only available via article purchase.