OBJECTIVE: This study investigated the reliability and validity of a phone-administered fidelity assessment instrument based on the Dartmouth Assertive Community Treatment Scale (DACTS). METHODS: An experienced rater paired with a research assistant without fidelity assessment experience or a consultant familiar with the treatment site conducted phone-based assessments of 23 teams providing assertive community treatment in Indiana. Using the DACTS, consultants conducted on-site evaluations of the programs. RESULTS: The pairs of phone raters revealed high levels of consistency [intraclass correlation coefficient (ICC)=.92] and consensus (mean absolute difference of .07). Phone and on-site assessment showed strong agreement (ICC=.87) and consensus (mean absolute difference of .07) and agreed within .1 scale point, or 2% of the scoring range, for 83% of sites and within .15 scale point for 91% of sites. Results were unaffected by the expertise level of the rater. CONCLUSIONS: Phone-based assessment could help agencies monitor faithful implementation of evidence-based practices.
OBJECTIVE: This study investigated the reliability and validity of a phone-administered fidelity assessment instrument based on the Dartmouth Assertive Community Treatment Scale (DACTS). METHODS: An experienced rater paired with a research assistant without fidelity assessment experience or a consultant familiar with the treatment site conducted phone-based assessments of 23 teams providing assertive community treatment in Indiana. Using the DACTS, consultants conducted on-site evaluations of the programs. RESULTS: The pairs of phone raters revealed high levels of consistency [intraclass correlation coefficient (ICC)=.92] and consensus (mean absolute difference of .07). Phone and on-site assessment showed strong agreement (ICC=.87) and consensus (mean absolute difference of .07) and agreed within .1 scale point, or 2% of the scoring range, for 83% of sites and within .15 scale point for 91% of sites. Results were unaffected by the expertise level of the rater. CONCLUSIONS: Phone-based assessment could help agencies monitor faithful implementation of evidence-based practices.
Authors: R E Drake; S M Essock; A Shaner; K B Carey; K Minkoff; L Kola; D Lynde; F C Osher; R E Clark; L Rickards Journal: Psychiatr Serv Date: 2001-04 Impact factor: 3.084
Authors: S D Phillips; B J Burns; E R Edgar; K T Mueser; K W Linkins; R A Rosenheck; R E Drake; E C McDonel Herr Journal: Psychiatr Serv Date: 2001-06 Impact factor: 3.084
Authors: Gregory J McHugo; Robert E Drake; Rob Whitley; Gary R Bond; Kikuko Campbell; Charles A Rapp; Howard H Goldman; Wilma J Lutz; Molly T Finnerty Journal: Psychiatr Serv Date: 2007-10 Impact factor: 3.084
Authors: Anthony D Mancini; Lorna L Moser; Rob Whitley; Gregory J McHugo; Gary R Bond; Molly T Finnerty; Barbara J Burns Journal: Psychiatr Serv Date: 2009-02 Impact factor: 3.084
Authors: Je Sung You; Yoo Seok Park; Hyun Soo Chung; Hye Sun Lee; Youngseon Joo; Jong Woo Park; Sung Phil Chung; Shin Ho Lee; Hahn Shick Lee Journal: Yonsei Med J Date: 2014-09 Impact factor: 2.759