Background

Routine follow-up following uncomplicated surgery is being delivered by telephone in some settings. Telephone consultations may be preferable to patients and improve outpatient resource use. We aimed to compare the effectiveness of telephone consultations with face to face follow-up consultations, in patients discharged from hospital following surgery.

Methods

Seven electronic databases (including Medline, Embase and PsycINFO) were searched from inception to July 2011. Comparative studies of any design in which routine follow-up via telephone was compared with face to face consultation in patients discharged from hospital after surgery were included. Study selection, data extraction and quality appraisal were performed independently by two reviewers with consensus reached by discussion and involvement of a third reviewer where necessary.

Results

Conclusions

There has been very little comparative evaluation of different methods of routine follow-up care in patients discharged from hospital following surgery. Further work is needed to establish a role for telephone consultation in this patient group.

Rising costs and increasing demand for specialist services have increased interest in maximising the efficiency of managing specialist outpatient departments [1–8]. In this context, telephone follow-up consultations for various medical and surgical patient populations have been suggested as a means of improving the use of outpatient resources [9–12].

Providing routine follow-up by telephone may be considered preferable in situations where patients have to travel from rural areas, and for those whose health or social conditions make hospital visits difficult [13]. Telephone consultations may also allow valuable outpatient clinic time to be occupied by those patients who have a more severe or complex conditions. This form of follow-up might also help improve compliance with scheduled follow-ups, avert the need for health care professionals to provide home visits, and prevent unnecessary return visits to the emergency department [3, 14].

However, it is also possible that telephone follow-up consultations may become an additional burden to the outpatient department, instead of reducing staff workloads with clinicians wary of missing or being unable to confirm important clinical signs or other disease conditions [9, 15, 16].

Anecdotal evidence suggests that surgical teams are routinely replacing face to face follow-up consultations with those made by telephone in some patient groups, where the intention is to discharge the patient from surgical specialist care. To date, there has been no synthesis of the evidence for the direct comparison between face to face follow-up consultations and those made by telephone in the context of surgical follow up care.

We therefore performed a systematic review to assess the effectiveness and, if possible, the cost effectiveness of telephone consultation as a method for routine follow-up consultations in secondary care for those patients who have undergone a surgical procedure, in comparison to (or as a replacement for) conducting follow-up appointments face to face.

The systematic review was conducted following the general principles published by the NHS Centre for Reviews and Dissemination (CRD) [17]. A pre-defined protocol was developed following consultation with topic and methods experts and is available from the PenCLAHRC website [http://clahrc-peninsula.nihr.ac.uk/est-projects.php].

Literature search and eligibility criteria

The search strategy was developed after consultation with clinical experts (RF, CG, BV) and examination of key papers. The search strategy for PsycINFO is shown below; the search was adapted to run in other databases. Studies were identified by searching the following electronic databases: Medline, Embase and PsycINFO (all via Ovid); AMED and CINAHL (both via NHS Evidence); and the Cochrane Library; and the Social Sciences Citation Index (in the Web of Science). These databases were searched from inception until July 2011. No search filters were applied. Due to resource constraints, only articles published in English were included. Reference lists of included papers were checked for further potentially relevant citations. The search was updated in June 2012.

Search strategy for PsycINFO (OVID)

Database: psycINFO <1806 to July Week 2 2012>

Search strategy:

1.

exp surgery/ (33266)

2.

exp Outpatients/ (4582)

3.

exp telephone systems/ (2253)

4.

exp clinics/ (4514)

5.

exp Aftercare/ (912)

6.

exp Hospital Discharge/ (2135)

7.

4 or 5 or 6 (7437)

8.

1 or 2 (37824)

9.

3 and 7 and 8 (4)

10.

&#x2009;(surger* or surgi* or hospital* or outpatient* or operat*).tw. (225907)

11.

&#x2009;(secondary adj care).tw. (476)

12.

&#x2009;10 or 11 (226244)

13.

&#x2009;(tele* or phone* or call? or calling).tw. (81736)

14.

&#x2009;(appointment* or consult* or clinic* or $discharge or review* or followup or aftercare).tw. (662394)

15.

&#x2009;(follow adj up).tw. (63368)

16.

&#x2009;14 or 15 (698170)

17.

&#x2009;(tele* or phone* or call? or calling).ti. (16117)

18.

&#x2009;((tele* or phone* or call? or calling) adj5 (appointment* or consult* or clinic* or $discharge or review* or followup or aftercare)).tw. (2301)

19.

&#x2009;17 and 18 (881)

20.

&#x2009;14 and 17 (2600)

21.

&#x2009;19 or 20 (2600)

22.

&#x2009;12 and 21 (409)

Studies were included if they compared the effects of telephone with face to face follow up consultations in patients who had undergone a surgical procedure in secondary care. Patients included in the studies had to be assessed as fit by their health care providers to be discharged to home and to receive a follow-up appointment in the surgical outpatient clinic. The telephone follow-up consultations needed to be planned and initiated by health care professionals and could be provided live or pre-recorded (or be automated). We excluded consultations in only text form. No limits on reported outcomes were imposed. Any study reporting comparative data was included irrespective of study design.

Study selection

Three authors (AA/JTC and RW) independently screened the titles and abstracts and applied the inclusion and exclusion criteria in a standardised and blinded manner. Duplicates were identified and discrepancies were reconciled through discussion. The full text of articles that were assessed as potentially meeting the inclusion criteria at this stage were retrieved and underwent the same process. Disagreements were arbitrated and resolved by discussion with others in the team (JTC and KS).

Data extraction

Data extraction was performed using a piloted data extraction form by one reviewer (AA/JTC or RW) and checked by a second (AA or RW). Disagreements were reconciled through discussion.

The following data were extracted for each study: 1) characteristics of the article (including author, title and year of the publication); 2) characteristics of the study participants (including mean age, underlying medical or surgical condition, the type surgical procedure performed, and inclusion and exclusion criteria); 3) characteristics of the study (such as the study design, sampling assumptions, whether the sample was derived randomly, the method of randomisation to intervention allocations, method of concealment, and method of blinding); 4) description of the intervention (who provided the telephone follow-up consultation, how soon after surgery it was carried out, and its duration); 5) descriptions of the comparator (including whether it was a face to face follow-up consultation, when it was provided, and duration); and 6) type of outcomes reported (including the variables reported, the values of the results, the standard deviations, and any statistical tests of association). The data extraction template is available from the authors on request.

Assessment of quality and risk of bias

Risk of bias was assessed using the principles published by the NHS Centre for Reviews and Dissemination [17], and the Cochrane Handbook of Systematic Reviews for Interventions [18]. One reviewer applied the criteria (AA/JTC or RW) which were checked by a second reviewer (AA/JTC or RW). Disagreements were resolved by discussion.

Data synthesis

Due to the heterogeneity of the study designs, the population and outcome measures reported in them, and the risk of bias identified, no formal statistical synthesis was performed. The results of the included studies were tabulated and evaluated in a narrative manner.

Study selection

A total of 4813 articles were identified by the initial search. Of these, 2,994 were unique (non duplicate) citations. The search was re-run in June 2012 and identified a further 298 unique references. Title and abstract screening resulted in the exclusion of 3213 citations. The full text of the remaining 79 articles was retrieved for further assessment. Seventy-five papers were excluded; three articles were duplicates, 10 were non empirical works, 33 did not include a comparator or the comparator was not face to face consultation in the outpatient department, in seven papers the intervention did not meet the inclusion criteria for the review and two papers were published in languages other than English. In 20 studies, the follow-up consultations were not provided directly following or in relation to surgery. One additional study was identified through hand searching. Five papers (four studies) were included in the review [19–23]. The process of study selection is summarised in Figure 1.

Figure 1

Process of study selection.

Characteristics of included studies

Two publications were concerned with post-operative care following dental work in maxillofacial surgery departments in the US; one a retrospective audit of patient records during a time period in which both telephone consultation and traditional outpatient follow-up strategies were in use [22] and the other an RCT in which patients were randomised to either method of follow-up [21]. One paper reports prospective data collected in a non-randomised trial on the post-operative experience following cataract surgery [23]. The other two publications report the findings of a single study in people undergoing nasal septal surgery in an otorhinolaryngology department in the UK [19, 20]. The data for those undergoing telephone consultation follow-up in this study was collected prospectively and compared with historical records of patients seen traditionally in the outpatient department. In all studies the telephone consultation was standardised by the use of a proforma or questionnaire and was conducted at the same time point as the comparative clinic appointment. The characteristics of the included studies are summarised in Table 1. Sample size ranged from 48 in the RCT [21] to 364 in the retrospective audit of patient notes [22]; no sample size estimations were reported. Overall, the methodological quality of the included studies was poor with a moderate to high risk of bias for all results. Although described as a randomised trial, Sittitavornwong and colleagues [21] did not report any details of the process of randomisation or allocation concealment and the reporting of the results is very unclear. It is not clear how individuals were allocated to telephone or face to face follow-up in the studies by Susarla and colleagues [22] and Mandal and colleagues [23]. Retrospective sampling of patients over different time periods may subject the results to confounding influences which are not fully evident or reported. The methodological quality of each study is summarised in Table 2.

Was there a clearly defined point in time when the intervention occurred?

Yes

Yes

Yes

No

Are the interventions of interest clearly described?

Yes

No

Yes

Yes

Are possible confounders clearly described?

Partial

Partial

Partial

No

Are the main findings of the study clearly described?

Yes

Yes

Yes

Yes

Are estimates of the random variability in the data provided?

Yes

Yes

Yes

No

Are all adverse events that may be a consequence of the intervention reported?

Unclear

Unclear

Unclear

Unclear

Are the characteristics of patients lost to follow-up described?

NA

Yes

NA

No

Were losses of patients to follow up accounted for?

NA

Yes

NA

No

Are the actual probability values reported for the main outcomes?

Yes

No

Yes

No

Were attempts made to blind outcome assessors to the intervention?

NA

No

NA

NA

Were the groups recruited from the same population?

No

Yes

Yes

Yes

Were the groups recruited over the same period of time?

No

Yes

Yes

Unclear

Was a representative sample of the population approached?

Yes

Yes

Unclear

Unclear

Was the intervention unlikely to affect data collection?

Yes

Yes

Yes

Yes

Was there reliable compliance with the intervention?

Partial

Yes

NA

Yes

Were the main outcome measures used valid and reliable?

Yes

Yes

Yes

No

Was the study free from selective outcome reporting?

Unclear

Unclear

Unclear

Unclear

Were baseline characteristics similar between groups?

Unclear

Unclear

Unclear

Unclear

Patient satisfaction outcomes

Patient satisfaction has been measured in a number of ways across these four studies, precluding a simple summary of the findings. However, the results seem to suggest that patients were happy to receive routine follow-up care by telephone and in some cases showed a preference for this method. It is possible that the method used to administer the questionnaires e.g. face to face or over the telephone might have influenced the results; we were unable to look at this in detail due to the small number of included studies. In the study by Uppal and colleagues [19], a modified version of a validated outpatient satisfaction questionnaire was used; the language was modified slightly so that the same questionnaire could be used with both groups of patients. Patients were asked to respond on a five-point Likert scale (ranging from strongly agree to strongly disagree). The questions addressed issues such as whether the individual conducting the review was courteous and helpful and whether they listened to the patient. A total score was calculated for each patient and the results indicate that patient satisfaction was greater with nurse-led telephone follow-up than with conventional outpatient follow-up (mean difference in scores 0.39; 95% CI 0.17 to 0.61; p = 0.001). Mandal and colleagues [23] used a non-validated questionnaire designed to assess the acceptability of telephone review as a post-operative assessment technique. The questions focussed on reassurance, comprehension and satisfaction with the service provided. There was no statistically significant difference in the proportion of patients saying that they were ‘very reassured’ or ‘reassured’ in the telephone review group compared with the eye infirmary clinic (although the difference between telephone review and review in the home visit group was significant). There were no significant differences in the level of understanding of post-operative materials between groups, nor in the assessment of the length of follow-up with all groups having a good level of comprehension and feeling that the length of the review was ‘just right’. Although patients were asked which method of follow-up they preferred, their responses were not independent of their allocated group. More than 90% of patients in the home visit group indicated a preference for a home visit and more than 70% of the telephone group said that they preferred telephone follow-up. Sittitavornwong and colleagues [21] report that 73% (35 of 48 patients) preferred telephone follow-up and 27% (13 of 48) preferred clinic follow-up. These results are difficult to interpret since they provide information on the proportion of the total number of patients in the study (n = 48) reporting these preferences, rather than the proportion per randomised group. Susarla and colleagues asked patients if they were satisfied with the telephone post-operative follow-up compared with a clinic visit and the answer was recorded as ‘yes’ or ‘no’ [22].

Costs

Two studies report costs [20, 23]. Uppal and colleagues in 2004 estimate the direct and indirect health care related costs of telephone follow-up consultations at £50 per patient, compared to £106.11 for those conducted face to face [20]. A simple cost calculation in the paper by Mandal and colleagues estimates the cost of a telephone review at between £1 and £2; it is not clear which costs have been included in these calculations and there is no information provided about the cost of an outpatient appointment in the eye infirmary (the estimated cost of a home visit was £8.50) [23].

Frequency of complications

The data provided by Sittitavornwong and colleagues is difficult to interpret since they provide information on the proportion of the total number of patients in the study experiencing complications rather than the number per randomised group [21] (Table 3). In the study by Susarla and colleagues [22], there were significantly more complications in the group receiving telephone review. However, when the results were adjusted to account for differences in the two groups, no statistically significant difference was seen.

Despite conducting a widespread search for possible data in a variety of sources we were unable to identify any good quality comparative evidence for the use of telephone consultations in place of face to face outpatient appointments after surgery. Although from a limited pool of surgical modalities, data from all four studies suggests that patients were happy to receive routine follow-up care by telephone and in most instances showed some preference to this method compared with an appointment in the outpatient department.

However, the methodological quality of all the identified studies was poor with a moderate to high risk of bias for all the results. In addition, the studies were small, patient satisfaction was measured in a variety of ways and there is little information available on long-term outcomes. The limitations of the included studies have consequences for any sensible extrapolation of the results to other clinical situations.

This research question arose following discussion with surgeons in our local hospital who are routinely replacing face to face outpatient appointments with telephone calls following some surgical procedures. In an environment of increasing cost and demand and a need for ever greater efficiency, it is disappointing that we were able to identify so little comparative research.

In this review, we have taken considerable steps to identify all relevant published and unpublished papers by searching seven electronic databases and hand searching the reference lists of all included papers and many others identified during the search. Although we were only able to include papers published in the English language due to resource constraint, which may have resulted in the omission of some evidence, our searches were not limited to English only and did not identify a significant body of literature in other languages. Very few studies have compared the methods of care and as far as we are aware, this is the first systematic review to specifically address the effectiveness and acceptability of telephone consultation in place of face to face outpatient appointments in patients following uncomplicated surgery.

The authors of a Cochrane Review of telephone consultations in the three months following discharge from hospital identified 33 papers in which telephone follow-up consultations had been evaluated following a wide range of treatments in many patient groups, using a range of comparators and using a variety of outcome measures [24]. In most cases there was no statistically significant difference between telephone and control groups and no meta-analysis was possible. None of the studies identified adverse effects of telephone follow-up. Our review takes a more focused approach than the previous work, addressing explicitly the use of telephone follow up after surgery and compared this with face-to-face hospital based appointments (not home visits). None of the studies included in our review were identified in the Cochrane Review. Furthermore, we have looked at complications related to the surgical operation as this goes to the issue of whether telephone consultations in this context are safe – a necessary pre-requisite for their implementation as routine practice.

Post-surgical consultations may be used for the exchange of a variety of different kinds of information e.g. education, identification of complications, reassurance, management of pain and symptoms. Moreover, the aim for consultations, in most cases, will be discharge from specialist care. It is therefore necessary that the consultation takes careful account of all possible harms and patient concerns. Telephone consultation have been studied in only a small number of conditions and, while they appear to be an innovative use of health service resources, uncertainty remains about their effects and whether these are consistent in different conditions.

There is therefore a need for good quality prospective and, crucially, comparative evaluations of telephone consultations with outpatient appointments in post-surgical care which seek to collect information on all aspects of care. Whilst telephone consultations might be more convenient for patients, there is no indication from the published literature whether this type of after-care has any impact on the frequency of adverse events.

There has been very little comparative evaluation of different methods of routine follow-up care in patients discharged from hospital following surgery. Further rigorous work is needed to establish a role for telephone consultation in this patient group as a replacement for face to face follow up in hospital outpatient departments.

Funding

This systematic review is an independent research project funded by National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care for the South West (PenCLAHRC). The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health.

Acknowledgments

The authors are grateful to Professor Robert Freeman (Plymouth Hospitals NHS Trust and University of Plymouth) for useful discussions during the development of the protocol.

Authors' original submitted files for images

Below are the links to the authors’ original submitted files for images.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

JTC was substantially involved in the conception and design of this review as well as data analysis and interpretation. JTC was also involved in writing and revising the manuscript and has approved this final version. AA was substantially involved in the conception and design of this review as well as data analysis and interpretation. AA was also involved in writing the manuscript and has approved this final version. RW was substantially involved in the conception and design of this review as well as data analysis and interpretation. RW was also involved in revising the manuscript and has approved this final version. AB was substantially involved in running the literature searches, managing the databases and retrieving articles. AB was also involved in revising the manuscript and has approved this final version. BV was substantially involved in the conception and design of this review. BV was also involved in revising the manuscript and has approved this final version. CG was involved in the conception and design of this review and was also involved in revising the manuscript and has approved this final version. KS was substantially involved in the conception and design of this review as well as its interpretation. KS was also involved in revising the manuscript and has approved this final version. All authors read and approved the final manuscript.

Pre-publication history

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.