Course in Basic Surgical Skills

Material and Method

The BSS course was advertised on the website of the Norwegian Medical Association, and the applicants were given a place on the course on a first-come first-served basis. Participants on four consecutive courses, organised by Oslo University Hospital, Ullevål during the years 2009 – 11, were invited to take part in the study. They were sent written information about the study in advance, and verbally consented to participate on the first day of the course. The participants were sent pre-course copies of the course handbook and DVD produced by the RCS (in English-language versions) as well as study information (6).

All the instructors had completed an instructors’ course, and were informed about the study and trained to use the evaluation tools.

The participants were tested on the same three practical exercises immediately before and after the course. The learning outcome was defined as the difference between the score after and before the course. The exercises were:

The exercises were selected on the basis of performability and because they represent fundamental principles of surgery. Exercises 1 and 2 were scored using the Objective Structured Assessment of Technical Skills (OSATS) (7, 8). The OSATS instrument has reported high reliability and validity, and consists of checklists and a Global Rating Scale (GRS) (2, 7). The checklists are task-specific with a point-by-point description of the steps in each procedure. Using the GRS, participants are scored for their general skills such as tissue handling, economy of movement, choice and handling of surgical instruments, and knowledge and performance of the procedure. The maximum score for Exercises 1 and 2 was 42 and 39 points respectively. In Exercise 3, the participants were assessed on the time needed to pass each obstacle (see appendix).

The participants scored their own pre- and post-course skills for the 14 skills taught, on a 5-point Likert scale, where 1 represents no skills and 5 represents excellent skills (9). To analyse possible correlation between previous experience and the degree of improvement, the results were calculated for three groups, stratified according to length of previous experience: 0 – 6 months, 6 – 12 months, and > 12 months, respectively. The results were then compared.

Results

A total of 57 out of 65 course participants (88 %) consented to take part in the study. The participants were surgical trainees with surgical experience varying from 1 to 40 months, with an average of 13 months.

The self-evaluated competence for the 14 skills taught was better on all points after course completion (Fig 1). Overall, the participants performed better on the three practical tests after completing the course (Table 1). There was no correlation between the length of surgical experience for the three practical tests and the learning outcomes (p = 0.9).

Figure 1  Self-evaluation form pre- and post-course for the 14 taught skills, with average pre- and post-course score (based on a 5-point Likert scale, where 1 means no skills and 5 indicates excellent skills)

Table 1  

undefined

Discussion

Assessed on the basis of the scores, the course participants improved their technical skills by taking the BSS course. Somewhat surprisingly, there was no correlation between the improvement and the participants’ surgical experience. We expected participants with less experience to have better learning outcomes from a course in basic surgical skills than participants with more experience.

Participants’ self-evaluated competence increased after course completion, as demonstrated in earlier studies (9, 10). The increase was felt to be lowest for the skills «Use of diathermy» and «Assistance performance», which were only taught theoretically (Fig 1). This may indicate that practical teaching should supplement theoretical teaching of technical skills.

Evaluating basic laparoscopic skills only in terms of the time needed to pass each obstacle clearly has its limitations. Our findings are, however, in accordance with the results of studies in which a number of variables were examined (11, 12). Studies have shown that simulator training is better than traditional textbook teaching, and that skills acquired on a simulator are transferable to the operating theatre (11, 13 – 18).

Successful surgical treatment of the patient requires the operator to maintain their practical skills. Several studies demonstrate that regular training is needed to maintain the level of skills (10, 12, 19). In our study, we measured skills immediately after the course, and the results provide no indication of long-term skills retention. It would have been desirable to have a control group as well, to examine skills retention in greater detail, but that was not practically possible. The study also had a limited number of participants, which may have affected the results.

Conclusion

The participants’ skills in three basic surgical techniques were significantly better after completing the BSS course. The length of surgical experience does not appear to influence the learning outcomes. The study indicates that the BSS course brings a relevant learning resource to surgical specialisation in Norway.