Evaluation of a Desktop Sharing Program for Healthcare Educational Videoconferences

A pilot study of Continuing Medical Education videoconferences augmented by desktop sharing B. Purdy, RN, MN (C) S. McGonigle, RN, MScN Dan Allard BSc Lisa Ferraro BSc B. Laurie-Shaw, MScN P.G. Rossos, M.D., F.R.C.P. (C) University Health Network Telehealth Program, & Ontario Telemedicine Network, Toronto, Ontario B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Study Drivers: • Consumer expectations change – High definition broadcasting – Authors presentation preparation mirrors work for in-person events – Increasing demand for complex images B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Underlying Assumptions – Challenges • Network Issues – Purchase New Hardware – Upgrade Existing system – Integrate different proprietary systems? B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Meeting the challenge Creating a bridge between legacy technology and the full integrated high definition network of the future B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Study Context – GI Journal Club Study / Year 1994 Control Regimen Cisplat 100 mg.m2 IV; cyclo 600 mg/m2 Q 3 weeks x 6 Cisplat 100 mg/m2 IV Cyclo 600 mg/m2 IV Q 3 weeks x 6 Experimental Regimen Cisplat 200 mg/m2 IP; etoposide 350 mg/m2 IP Q 4 weeks x 6 Cisplat100 mg/m2 IP Cyclo 600 mg/m2 IV Q 3 weeks x 6 Eligible patients Stage IIC-IV GOG 104 1996 Stage III, < 2 cm residual Detailed Tables and graphs Pathology Images Radiographic Images B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 • Option - Desktop Sharing augmented videoconferencing B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Videoconference image Desktop Sharing image Desktop Sharing image B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Option - Desktop Sharing augmented videoconferencing • Pilot study proposed: Evaluate the use of desktop sharing as an augmentation to existing GI Journal educational videoconferences B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Desktop Sharing Selection • Application Selection – Affordable • Minimal resources – Functionality • High definition images to work in tandem with existing videoconferencing units. • Minimal Set up B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Research Questions Does desktop sharing to supplement live multi-point medical education videoconferences enhance the participants’ experience? 2) Is the desktop sharing application reliable in supplementing live multi-point medical education videoconferences? 1) B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Sample Target group selection – existing videoconference users dependent upon high resolution slide images Convenience Sample – Weekly physician Journal Club Rounds between three sites (n=15) B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Methodology • Self report questionnaires – Event participants – Videoconference operators • • Post event administration x 10 events Simultaneous Videoconference – 384Kbps – virtual private network B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Videoconference image Desktop Sharing B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Results – Desktop Presentation Transmission Quality Desktop Sharing - Quality Measures Percentage Respondents 100 90 80 70 60 50 40 30 20 10 0 91 93.5 99.2% connectivity 16.4% ≤ 2 Breakdowns 23.1 14.1% ≤ 2 Distortions 15.7 Synchronicity Very Good or Excellent Breakdowns Breakdowns < 2 mins Distorted images B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Result – Perceived Effectiveness Dimension Question 6. Please select the statement that best describes your experience at the session today 120 75.9% 100 Frequency 80 60 40 20 0 BETTER THAN THE TRADITIONAL VIDEOCONFERENCE FORMAT WORSE THAN THE TRADITIONAL VIDEOCONFERENCE FORMAT NO DIFFERENCE FOUND 20.3% 3.8% Host site participants Statement B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Results Acceptability (Participant) – 97% recommended Bridgit™ augmented videoconference over nonaugmented events. Acceptability (Technical Support Staff) – 96.7% recommended Bridgit™ augmented videoconference over non-augmented events. B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Results - Qualitative Participants: Theme analysis included primarily positive feedback. – Overall presentation quality – Slide quality – Synchronicity B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Results- Qualitative Technical Support Staff: – – – – – More audience engagement Less site variability (no camera toggling required) Synchronicity slide quality overall quality and videoconference suggestions B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Results – Cost • Desktop Sharing – More than 60 applications available • Wide Cost range - freeware and beyond • Applications available to suit most users? B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Study Limitations • • • • • Circumstantially limited design No randomization employed Small sample size Self-reporting bias Further studies recommended B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Discussion • • • • • • • • Prolong useful life of legacy technologies Easy to use Low start up cost – projector and laptop Ongoing costs – monthly licenses or server purchase Facilitates worldwide collaboration Enables large continuous dual images Toggle free presentations Presenter preparatory work is simplified B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Conclusions • UHN has expanded the use of Desktop Sharing to many other rounds • Further growth is anticipated as consumer response to desktop sharing is generally enthusiastic. • Other web based applications will be evaluated to meet increasing consumer expectations. B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007 Questions B. Purdy, S. McGonigle, L. Ferraro, D. Allard, B. LaurieShaw, P.G. Rossos ATA Concurrent Session May 2007