AIM: This study set out to test the face validity of prioritized criteria of consultation competence in general practice as contained in the Leicester assessment package. METHOD: A questionnaire was sent to a geographically stratified random sample of 100 members of the United Kingdom Association of Course Organisers to seek their views on the categories, components and weightings contained in the Leicester assessment package and to determine the proportion of respondents who rejected or suggested a new category, component or weighting or reallocated components to other categories or amended weightings. Their views were sought on a six-point scale (strongly approve, approve, tend to approve, tend to disapprove, disapprove and strongly disapprove). RESULTS: There was a 73% response rate. Of the respondents 99% either strongly approved or approved of the overall set of categories of consultation competence. Only two respondents (3%) expressed any disapproval of individual categories. Thirty five of the 39 suggested components of consultation competence were supported by more than 80% of respondents. There was minimal support for excluding any categories or components of consultation competence, for moving any components to different categories or for the inclusion of new categories or components. Eighty eight per cent of respondents were in favour of the need to identify priorities between any agreed categories of consultation competence and 79% expressed approval of the suggested weightings. Although 42% of respondents indicated a wish for some alteration in weightings, the mean values for all consultation categories suggested by all respondents were almost identical to the original weightings in the Leicester package. CONCLUSION: The face validity of the categories and components of consultation competence contained in the Leicester assessment package has been established, and the suggested weightings of consultation categories have been validated. Consequently, the criteria contained in the Leicester package can be adopted with confidence as measures against which performance can be judged in formative or summative assessment of consultation performance in general practice.
AIM: This study set out to test the face validity of prioritized criteria of consultation competence in general practice as contained in the Leicester assessment package. METHOD: A questionnaire was sent to a geographically stratified random sample of 100 members of the United Kingdom Association of Course Organisers to seek their views on the categories, components and weightings contained in the Leicester assessment package and to determine the proportion of respondents who rejected or suggested a new category, component or weighting or reallocated components to other categories or amended weightings. Their views were sought on a six-point scale (strongly approve, approve, tend to approve, tend to disapprove, disapprove and strongly disapprove). RESULTS: There was a 73% response rate. Of the respondents 99% either strongly approved or approved of the overall set of categories of consultation competence. Only two respondents (3%) expressed any disapproval of individual categories. Thirty five of the 39 suggested components of consultation competence were supported by more than 80% of respondents. There was minimal support for excluding any categories or components of consultation competence, for moving any components to different categories or for the inclusion of new categories or components. Eighty eight per cent of respondents were in favour of the need to identify priorities between any agreed categories of consultation competence and 79% expressed approval of the suggested weightings. Although 42% of respondents indicated a wish for some alteration in weightings, the mean values for all consultation categories suggested by all respondents were almost identical to the original weightings in the Leicester package. CONCLUSION: The face validity of the categories and components of consultation competence contained in the Leicester assessment package has been established, and the suggested weightings of consultation categories have been validated. Consequently, the criteria contained in the Leicester package can be adopted with confidence as measures against which performance can be judged in formative or summative assessment of consultation performance in general practice.
Authors: Moyez Jiwa; Robert K McKinley; Katrina Spilsbury; Hayley Arnet; Marthe Smith Journal: BMC Med Res Methodol Date: 2009-07-17 Impact factor: 4.615