Concepts and Expectation of the Role and Value of Feedback in Taiwanese Post-Graduate-Year 1 Trainees’ E-Portfolio: Developing a Theoretical Understanding Using a Realist Evaluation Methodology.

Feedback is an essential component of the teaching and learning process. Portfolios in medical education are not only tools for assessment of performance, but also as tools to stimulate learning from experience. Feedback in e-portfolio should be able to encourage self-reflection, raise self-awareness and help learner plan for future learning and practice. The theoretical framework of feedback in Western medical education has been established. However, the mechanism, including cultural influence, in feedback via e-portfolio system of Taiwan has not yet been evaluated. Research Aims This research programme aims to understand the mechanisms through which feedback via e-portfolios work, along with understanding of the outcomes they produce in order to develop the process of feedback via e-portfolios locally at CGMH, nationally across Taiwan and internationally through a process of theory development. Hypothesis of research: We assume that the feedback in e-portfolio works according to the hypotheses of outcomes affected by mechanism and contextual factors. We will apply realist evaluation methodology to prove the hypotheses. Materials and methods: There will be 4 phases in the research project within 3 years. Phase 1 will be literature searches and theorization of feedback via e-portfolio systems with stakeholders and educators developing the e-portfolio. Phase 2 will be qualitative aspect comprising interviews with clinical teachers and PGY trainees gathering about information and concepts. Within the interview, the theory developed will be examined and refined. From the data collected, we will begin to develop questionnaires for the quantitative study of the next phase. On phase 3, questionnaires will be developed and e-portfolio will be re-fined according to the interview results and refined theory. On phase 4, the questionnaire will be applied to all clinical teachers and PGY trainees for further evaluation of validity and reliability. Joint research with other medical centers using e-portfolio will be arranged to apply the questionnaire. Further developments and refinements of the e-portfolio with the multiple site questionnaire result. In the first 3 phases, study setting will be at Chang Gung Memorial Hospital (CGMH) Linkou Branch. Participants will be drawn from clinical teachers in our workplace who participate in the PGY training and PGY trainees. In the last phase of research, the setting will be multiple sites with medical centers using e-portfolios. The questionnaire will be on internet so that clinical teachers and trainees from other medical centers will be jointed freely. Expected results: From this research, we will develop the theory about the mechanism of feedback and e-portfolio. A questionnaire for evaluation of feedback in e-portfolio which could be applied nationally, or even worldwide will be developed through this project.

Project ID:PF10507-1963
External Project ID:MOST105-2511-S182-015