Research article
Open Access

BOGGLE Your Brain: An Online Forum for Obstetrics and Gynaecology Graduate Medical Education in a Tertiary Maternity Hospital

Caoimhe O' Sullivan[1], Sarah Janssens[1], Kym Warhurst[1]

Institution: 1. Mater Mothers' Hospital Brisbane
Corresponding Author: Dr Caoimhe O' Sullivan ([email protected])
Categories: Teaching and Learning, Technology, Postgraduate (including Speciality Training), Clinical Skills, Research in Health Professions Education
Published Date: 28/05/2019

Abstract

Social media platforms are increasingly used in Medical Education to facilitate collaboration, interaction and discussion.  In the area of graduate medical education (GME), platforms such as Twitter, Podcasts, blogs, You-tube, Skype and Wikis’ have been utilised. Outcomes relating to knowledge acquisition, professionalism and the effect of social media profiles on recruitment have been reported (Sterling et al., 2017).  In this paper we describe the use of Yammer (Microsoft) to host an online forum for trainees in Obstetrics and Gynaecology to facilitate the delivery of their educational program at a tertiary teaching hospital. 

Keywords: Graduate medical education; GME; Postgraduate education; Continuing Professional Development; CPD; Social Media; Online forum; Online platform; Obstetrics; Gynaecology

Introduction

Social Media can be defined as “websites and applications which enable users to create and share content, or to participate in social networking” (OEDOnline, 2018). In recent years, there has been a significant increase in social media usage by medical professionals; for personal use, Graduate Medical Education (GME), patient interaction and  education, professional networking, and  employment opportunities (Roberts et al., 2015). This growth is likely to continue, with concurrent increases in access to smartphones, increasing numbers of “apps” and computer software, and widespread internet availability. 

 

Various social media platforms have been utilised to date in medical education, including Twitter, Youtube, podcasts and Facebook (Pander et al., 2014).  A key benefit of social media use in GME is the ability to share educational material easily and quickly without geographical or organisational barriers. Social media also provides a useful platform for discussion and debate related to clinical cases, new research and guidelines, in a way which also provides a written archive of discussion allowing users to re-visit at a future date.  Use of social media platforms for education can be tailored to align with learning science, as they have the ability to facilitate spaced learning, interleaving, retrieval practice and social learning (Van Hoof and Doyle, 2018). As an example, new Twitter-based journal clubs such as #NephJC are increasing in popularity, and are reaching an ever  wider audience over time (Topf et al., 2017)(Roberts et al., 2015). 

 

The potential risks of using social platforms in medical education have also been described. Unprofessional behaviour, breach of doctor-patient confidentiality, and the sharing of patient-identifying information are areas of significant medico-legal and ethical concern (Gholami-Kordkheili, Wild and Strech, 2013). Accessibility beyond  work hours via smartphones introduces the potential for burn out, if these activities are interpreted as “intrusion” into personal time (Abuhadra, Majhail and Nazha, 2017). 

 

Research into the use of social media in GME has mainly consisted of qualitative analysis of the inclusion of social media platforms in ongoing graduate medical education, with what appear to be generally positive outcomes and satisfaction amongst users (Curran et al., 2017)  (Sterling et al., 2017)(Cartledge, Miller and Phillips, 2013). However, there continues to be a gap in the literature for quantitative analysis of the impact that social media usage can have.

 

The aim of this paper is to describe the implementation and membership of a social media based educational group for GME using Yammer (Microsoft) in a tertiary maternity hospital, and to quantify usage since inception. 

Methods

Setting

The Mater Mothers’ Hospital is a tertiary level combined public, private maternity hospital in Brisbane, Australia, delivering approximately 10 000 babies a year.  The hospital employs 12 resident medical officers (RMO’s) (8 rotational junior house officers, 4 senior house officers) and the registrar workforce consists of 19 full time equivalents across a spectrum of training levels from principal house officers to senior registrars. Prior to the introduction of social media for education, educational announcements and materials were hosted on a hospital intranet page accessible only from hospital computers. 

 

Development and use of Yammer Group - BOGGLE

The Yammer group was named “BOGGLE”: “Bridge to Obstetrics and Gynaecology Group Learning Environment”. Yammer was preferred over other platforms as it afforded a level of control and privacy compared to Facebook or the “Twittersphere”, which was appropriate to a clinical department. This platform allowed for discussion within our team and more broadly within the hospital without the risks of comment or criticism from external parties, or inappropriate posts ‘going viral’ should the rules of use not be followed. 

 

All Obstetrics and Gynaecology trainees and consultant staff in the department of Obstetrics and Gynaecology were enrolled as members in May 2016.  The group was “OPEN” meaning that anyone within the organisation was able to contribute/view posts.  BOGGLE could be accessed from hospital, home computers via the web and on mobile devices (tablets and smartphones) via the Yammer app. 

 

Rules were established outlining the requirements of BOGGLE engagement:  Educational content only (not a platform for operational matters) and it was made clear that no patient details or identifying information were to be posted.

 

Posts could be anything educational but generally came under three broad categories: advertising educational events, sharing of educational materials (e.g. slides or summaries from educational sessions, links to interesting papers or podcasts) and asking and answering clinical questions.  It was encouraged during the week that clinical encounters without clear answers would produce a “clinical question” to be answered by the trainee who was tagged in the post.  This was made possible by the availability of the smartphone app.  The addition of a “#” (or tag) grouped topics to make them easily searchable.  For example, when clinical questions were posed, “#cq2016” was applied so that at fortnightly education forums, answers could be reviewed and shared. The “topic” would then be converted to “#cqa2016” with an additional tag applied to denote the subject matter (e.g. #endometriosis) so that topics of interest could be retrieved and reviewed for use when required. 

 

Three O&G consultant staff and two senior registrars served as administrators and informal moderators. BOGGLE clinical questions/answers and general posts were reviewed at O&G education sessions, generally on a fortnightly basis. The ‘rules of engagement’ were revisited periodically, and the group encouraged to call out any posts or information that were thought to breach the rules. A process of peer mediation occurred, and an administrator would edit or remove any content if deemed to be inappropriate.

 

In February 2017, the group was migrated from an “internal” group to an “external” group to enable engagement with approved Visiting Medical Officers who could otherwise not join due to lack of a hospital email address. 

 

Analysis of engagement

The “group insights” function of Yammer was used to download group engagement data.  During the one-month period of phasing out BOGGLE 2016 and introducing the BOGGLE external group, the sum of engagement in both groups was calculated.

BOGGLE administrators were asked about any inappropriate or unprofessional posts that required editing or intervention over the study period. 

Results/Analysis

The period of analysis was approximately 24 months between 16thMay 2015 and 19thJune 2018.  

 

Activity

During the study period there were 1641 messages posted, 3624 “likes” and 21568 messages were read.

BOGGLE activity increased significantly over the studied period.  Mean daily active people increased from 14.25 in May 2015 to 49.79 in June 2018 (p= 0.002), and mean daily “likes” also rose significantly from 0.25 to 10.63 (p=0.031). Mean daily posts increased non-significantly from 0.56- 2.05 (p=0.191).

 

Figure 1 demonstrates activity by weekday.  Highest activity occurred on Thursdays and lowest on Sundays, however, weekend activity rates were just over half of the activity that occurred on weekdays.

 

Figure 1: Weekly Patterns of Boggle Usage

 

Who was using Boggle 

There were 184 members in June 2018, however, individual membership numbers could not be tracked over time to understand growth.

 

Activity of ‘member’ vs “non-member” groups could only be analysed from January 2017. This indicated that the vast majority of activity, posts and likes were all carried out by BOGGLE members. A small number of “reads” (median 9 reads per day) were by non-members.

 

Professional role of members is outlined in Table 1.  Non O&G medical staff members were from related clinical departments including neonatology, ICU, ED, Anaesthetics and obstetric medicine. 

 

Table 1: Professional Role of BOGGLE Members

Medical Staff

O&G

Non- O&G

RMO

14

1

Registrar / PHO

41

10

Consultant / VMO

31

14

General Practitioner

2

1

Midwifery Staff

Midwifery clinical

28

Midwifery management/education

9

Other Staff

Administrative

6

Other 

19

Unknown 

8

 

Administrators reported that on two occasions, posts or comments were edited due to information that had the potential to identify a patient; however, no specific patient names or identifying data were posted. No professionally inappropriate posts were observed. 

Discussion

The Yammer group BOGGLE provided a highly engaging platform for education and sharing that reached beyond the initial intended target of O&G trainees, with over 20 000 posts read over a 2-year period. 

 

Activity 

For each post there were, on average, 2 likes and 13 reads, indicating a number of users are passively engaged only.  This data suggests an element of legitimate peripheral participation (LPP) occurring within the organisation. LPP was originally proposed as a concept by Lave and Wenger in 1991, and is an important aspect of learning for inexperienced or novice members of a “community of practice” (Lave and Wenger, 1991). Its use both in online learning environments, and within medical education has previously been documented in the literature (Burgess and Nestel, 2014)(Zagal and Bruckman, 2010)(Yong Park, 2015). Typically, it describes how inexperienced community members initially commence with straightforward, non-integral group tasks or activities, through which they gain knowledge and expertise, often overseen or guided by more expert group members. The reading of group messages and “liking” of posts can therefore be interpreted as non-critical actions within the BOGGLE community, through which junior members may experience educational benefit and value. 

 

Daily activity was highest on weekdays, with most activity on Thursdays and Fridays. This temporal relationship of BOGGLE activity to face to face departmental Friday education suggests that BOGGLE appears to add an extra dimension to already-existing teaching sessions, rather than as a purely separate educational resource. Such “combined” learning is often referred to as “blended” learning - referring to a combination of two or more separate teaching methods (e.g. online learning and didactic teaching or simulation training). Blended learning has been demonstrated as beneficial due to increased learner satisfaction and engagement with the educational topics involved, flexible access to educational material, and in increasing the self-confidence of learners in applying evidence-based-medicine to clinical scenarios (Dragan et al., 2013; Stockwell et al., 2015; Stetson, Saxena and Harleman, 2017).

 

High weekday activity is in contrast to other studies documenting social media activity trends, although these studies describe social media platforms not specifically related to education or employment (Rizwan et al., 2018)(Guo et al., 2009).  However, it is in line with a study conducted by Seidel et al in 2017, which assessed trends in the use of a Facebook Group for “Breast Imaging Radiologists” – a special interest social media group with a significant emphasis on clinical practice and education, but also including “socially-oriented” topics relating to networking, and personal posts (Seidel et al., 2018). While it was not possible to determine if BOGGLE activity was occurring by staff on shift, it seems more likely that weekend activity was happening in non-rostered time as clinical loads on weekends are unlikely to allow for educational activities.  The spontaneous occurrence of the tag “#fridaynightBOGGLE” suggests some members were pleased to announce activity after work hours completion. Given concerns raised in previous studies regarding the risk of burnout associated with “intrusion” into personal time and work-life balance when social media is utilised in GME, (Shanafelt, Boone and Tan, 2012; Schrijver, 2016; Abuhadra, Majhail and Nazha, 2017)further analysis may be required to ensure that BOGGLE is not contributing to such burnout. 

 

Users 

There is little analysis of speciality and professional role in the literature relating to social media platforms or groups for GME. However, there is some evidence that specialty-specific educational materials are accessed by physicians and other health care workers whose primary interest may not be in the specialty on which the social media platform is based (Desai et al., 2013; Oliphantet al., 2015). In this study, BOGGLE membership indicated a reach far beyond the original target audience of O&G consultants and trainees. The number of departments involved suggested that BOGGLE was of interest and benefit to a much wider section of the healthcare community than initially considered.  The social media platform may be well placed to provide educational opportunities for interested healthcare providers outside the specialty of O&G, who may be unable to attend regular face-to-face O&G departmental teaching due to work scheduling conflicts. The array of departments and professions involved in the BOGGLE group also gives potential for “multidisciplinary” discussions and educational opportunities by enabling a connection between consultants and trainees in different fields, who may otherwise never interact. 

 

The relatively low number of RMO members was noted compared to the large numbers rotating through the department on a regular basis (up to 40 each year).  RMOs were not actively recruited to the BOGGLE group during the initial 12-18 months but are now encouraged to join if interested in Obstetrics and Gynaecology. Further investigation behind the reasons for the lower level of engagement within this group may lead to strategies to improve junior doctor participation in departmental education. 

 

Risks 

With only two episodes of inappropriate posting amongst over 1600 posts this represents an extremely high level of professionalism within the BOGGLE group. Previous studies on use of social media by clinicians have demonstrated rates of “unprofessional posts” of 3% on platforms such as Twitter, with up to 0.7% of posts potentially causing a risk to patient confidentiality (Chretien, Azar and Kind, 2011; VonMuhlen and Ohno-Machado, 2012). While humour was noted to be used on occasion, it was encouraging to note that there were no instances of bullying, harassment or trolling as is sometimes known to occur in other social media groups and on other platforms. 

 

Limitations

Potential areas of weakness in this study include the inability to examine individual members’ activity with the Yammer analytics available or assess volumes of particular tags. Therefore, we are unable to identify popular topics or any “superusers” and inactive members.  Additionally, BOGGLE does not update profiles to indicate that an employee has changed role or is no longer employed in the institution.  Due to the high turnover of training registrars (>80%) it is estimated that several members are no longer active, despite the ability to continue to be engaged in BOGGLE via their membership. While separate analysis of this group was not possible administrators note that many ex-employees have indicated that they continue to view BOGGLE posts, but were noted to rarely post messages or “like”.  Non-members who used BOGGLE were not able to be identified at the analytics level.

Conclusion

BOGGLE provided a highly engaging platform for education that reached far beyond the original target audience.  Further analysis of post content and individual activity may provide more insight into the utility of Yammer as a platform for education in this context.

 

Take Home Messages

  • This online forum provided a highly engaging platform for continuing medical education amongst members
  • The forum was unexpectedly popular amongst nonO&G specialists
  • It has been possible to maintain an extremely high level of professionalism on the forum, with regard to patient confidentiality and interaction with other colleagues
  • Weekly trends in use of this social media platform correlate with fortnightly faceto-face departmental teaching, and could demonstrate “blended learning” within the O&G department in question
  • Use of this and similar online forums need to be investigated further in order to assess their contribution to burnout amongst members

 

Notes On Contributors

Dr Caoimhe O' Sullivan is a Resident Medical Officer in Obstetrics and Gynaecology at the Mater Mothers' Hospital Brisbane.

Dr Sarah Janssens is a Staff Specialist in Obstetrics and Gynaecology at the Mater Mothers’ hospital, Australia’s largest maternity hospital.  Sarah is the also Clinical Simulation Director at Mater, overseeing the Simulation Fellowship program with fellows from a range of clinical specialties and professions.  In addition to her work at Mater, Sarah also is Chair of the RANZCOG Simulation Training Advisory Group. ORCID number; https://orcid.org/0000-0003-1433-5031

Dr Kym Warhurst is a Staff Specialist in Obstetrics and Gynaecology and Deputy Director of the Obstetrics and Gynaecology Department at the Mater Mothers’ Hospital in Brisbane, Australia.

ORCID number; https://orcid.org/0000-0003-2584-7446

Acknowledgements

With thanks to the Mater Mothers Hospital Obstetrics and Gynaecology Department.

Bibliography/References

Abuhadra, N., Majhail, N. and Nazha, A. (2017) 'Impact of social media for the hematologist/oncologist', Semin Hematol, 54(4), p. 4. https://doi.org/10.1053/j.seminhematol.2017.07.003

 

Burgess, A. and Nestel, D. (2014) 'Facilitating the development of professional identity through peer assisted learning in medical education', Advances in Medical Education and Practice, 5, p. 3. https://doi.org/10.2147/AMEP.S72653

 

Cartledge, P., Miller, M. and Phillips, B. (2013) 'The use of social-networking sites in medical education', Med Teach, 35(10), p. 10.https://doi.org/10.3109/0142159X.2013.804909

 

Chretien, K., Azar, J. and Kind, T. (2011) 'Physicians on Twitter', JAMA, 305(6), pp. 566–568. https://doi.org/10.1001/jama.2011.68

 

Curran, V., Matthews, L., Fleet, L., Simmons, K., et al. (2017) 'A Review of Digital, Social, and Mobile Technologies in Health Professional Education', J Contin Educ Health Prof, 37(3). https://doi.org/10.1097/CEH.0000000000000168

 

Desai, T., Sanghani, V., Fang, X., Christiano, C., et al. (2013) 'Assessing a nephrology-focused YouTube channel’s potential to educate health care providers', Journal of Nephrology, 26(1), pp. 81-85. 

 

Dragan, I., Hart, W., Fiddes, P., Misso, M., et al. (2013) 'Adopting a blended learning approach to teaching evidence based medicine: a mixed methods study', BMC Medical Education, 13, p. 169. https://doi.org/10.1186/1472-6920-13-169

 

Gholami-Kordkheili, F., Wild, V. and Strech, D. (2013) 'The impact of social media on medical professionalism: a systematic qualitative review of challenges and opportunities.', J Med Internet Res, 15(8). https://doi.org/10.2196/jmir.2708

 

Guo, L., Tan, E., Chen, S., Zhang, X., et al. (2009) The 15th ACM SIGKDD international conference on Knowledge discovery and data mining. Paris, France. Available at: https://dl-acm-org.ezproxy.library.uq.edu.au/citation.cfm?id=1557019.

 

Lave, J. and Wenger, E. (1991) Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511815355

 

OEDOnline (2018) “social, adj. and n.” (Accessed: 9/7/2018).

 

Oliphant, R., Blackhall, V., Moug, S., Finn, P., et al. (2015) 'Early Experience of a Virtual Journal Club', The Clinical Teacher, 12(6), pp. 389-393. https://doi.org/10.1111/tct.12357

 

Pander, T., Pinilla, S., Dimitriadis, K. and Fischer, M. (2014) 'The use of Facebook in medical education--a literature review', GMS Z Med Ausbild, 31(3). https://doi.org/10.3205/zma000925

 

Rizwan, M., Wan, W., Cervantes, O. and Gwiazdzinski, L. (2018) 'Using Location-Based Social Media Data to Observe Check-In Behavior and Gender Difference: Bringing Weibo Data into Play', ISPRS Int. J. Geo-Inf., 7(5), p. 196. https://doi.org/10.3390/ijgi7050196

 

Roberts, M., Perera, M., Lawrentschuk, N., Romanic, D., et al. (2015) 'Globalization of continuing professional development by journal clubs via microblogging: a systematic review', J Med Internet Res, 17(4). https://doi.org/10.2196/jmir.4194

 

Schrijver, I. (2016) 'Pathology in the Medical Profession?: Taking the Pulse of Physician Wellness and Burnout', Archives of Pathology and Laboratory Medicine, 140(9), pp. 976-983. https://doi.org/10.5858/arpa.2015-0524-RA

 

Seidel, R., Jalilvand, B., Kunjummen, D., Gilliland, L., et al. (2018) 'Radiologists and Social Media: Do Not Forget About Facebook', Journal of the American College of Radiology, 15(1), pp. 224-228. https://doi.org/10.1016/j.jacr.2017.09.013

 

Shanafelt, T., Boone, S. and Tan, L. (2012) 'Burnout and Satisfaction with Work-Life Balance Among US Physicians Relative to the General US Population', Archives of Internal Medicine, 172(18), pp. 1377-1385. https://doi.org/10.1001/archinternmed.2012.3199

 

Sterling, M., Leung, P., Wright, D. and Bishop, T. (2017) 'The Use of Social Media in Graduate Medical Education: A Systematic Review', Acad Med, 92(7). https://doi.org/10.1097/ACM.0000000000001617

 

Stetson, G., Saxena, V. and Harleman, E. (2017) 'Flipping the Script - A Controlled Trial of A Flipped Classroom And Blended-Learning Module in Graduate Medical Education', Journal of General Internal Medicine, 32(Supplement 2), pp. 83-808. https://doi.org/10.1007/s11606-017-4028-8

 

Stockwell, B., Stockwell, M., Cennamo, M. and Jiang, E. (2015) 'BLended Learning Improves Science Education', Cell, 162(5), pp. 933-936. https://doi.org/10.1016/j.cell.2015.08.009

 

Topf, J., Sparks, M., Phelan, P., Shah, N., et al. (2017) 'The Evolution of the Journal Club: From Osler to Twitter', Am J Kidney Dis, 69(6), p. 9. https://doi.org/10.1053/j.ajkd.2016.12.012

 

Van Hoof, T. and Doyle, T. (2018) 'Learning Science as a potential new source of understanding and improvement for continuing education and continuing professional development', Medical Teacherhttps://doi.org/10.1080/0142159X.2018.1425546

 

VonMuhlen, M. and Ohno-Machado, L. (2012) 'Reviewing social media use by clinicians', Journal of the American Medical Informatics Association, 19(5), pp. 777-781. https://doi.org/10.1136/amiajnl-2012-000990

 

Yong Park, J. (2015) 'Student interactivity and teacher participation: an application of legitimate peripheral participation in higher education online learning environments', Technology, Pedagogy and Education, 24(3), pp. 389-406. https://doi.org/10.1080/1475939X.2014.935743

 

Zagal, J. and Bruckman, A. (2010) 'Designing Online Environments for Expert/Novice Collaboration: Wikis to Support Legitimate Peripheral Participation', Convergence, 16(4), pp. 451-470. https://doi.org/10.1177%2F1354856510375141

Appendices

None.

Declarations

There are no conflicts of interest.
This has been published under Creative Commons "CC BY-SA 4.0" (https://creativecommons.org/licenses/by-sa/4.0/)

Ethics Statement

Mater Misericordiae Ltd Human Research Ethics Committee (EC00332) issued an exemption for this project (Project ID 49367) after receipt of ethics application, stating"this project does not meet the NHMRC National Statement on Ethical Conduct in Human Research 2007 (updated 2018) definition of research and is compliant with the NHMRC guidance Ethical Considerations in Quality Assurance and Evaluation Activities 2014. As such... HREC review is not required".

External Funding

This article has not had any External Funding

Reviews

Please Login or Register an Account before submitting a Review

Ken Masters - (23/08/2019) Panel Member Icon
/
The paper deals with the use of Yammer as an online forum for Obstetrics and Gynaecology graduate medical education in a tertiary maternity hospital.

While the exercise is commendable, there are some issues that need to be addressed:

• As this is a research article, the Abstract should be re-written in the structured format.
• It probably would have been better to introduce legitimate peripheral participation (LPP) in the Introduction, and then, in the Methods, mention that the results would be discussed in light of LPP. Otherwise, introducing it in the Discussion for the first time is rather jarring.
• I think the major problem, though, is that results are far too thin – in fact, the most important data and important results (the messages) are not presented. While the authors have reported reasonably well on the broad statistics, there is very little sense of what was actually written by the participants, and so the reader cannot get a sense of the value of the online interactions. The authors really do need to perform some sort of constant comparison theming of the messages in order for the important data to emerge. Only when these themes are presented as formally described qualitative data, can the reader have a sense of what was achieved. (While I understand that the aim of the paper was to “quantify usage since inception”, if this is the aim of the research, then the authors have limited it to such a tiny aim, that the overall value of the research study is severely limited).
• In the discussion, there is a very brief mention of the link between Thursday and Friday figures to face-to-face education interventions, but these f2f sessions have not been mentioned before. It would be a good idea to mention them as part of the context in the Introduction.
• In this light, it should be remembered that blended learning (as the term suggests) is more than merely online and f2f learning occurring at the same time, and the two activities really do have to be connected. In the data analysis, the authors have not reported on the content of the messages enough for the reader to have a sense of the actual connection between the online material and the f2f material, and so the reference to blended learning may not be appropriate. The authors can rectify this by supplying a little more information about the online content, and so establish the connection. (In fact, if the authors performed the qualitative analysis as indicated above, then they would be more easily be able to do this).

Minor: A few small typo-type errors, e.g. “Podcasts (should be a small “p”), You-tube” and “Wikis’”, “This data suggests” should be “These data suggest”

Overall, then, the exercise was useful, but the authors need to analyse, and report on, the most important data – the actual content of the messages.
Possible Conflict of Interest:

For Transparency: I am an Associate Editor of MedEdPublish

Debra Kiegaldie - (30/06/2019) Panel Member Icon
/
The background clearly describes the nature and utility of a professional social media platform for medical education including the major drivers, challenges and risks. I think the concept is valuable as a way of providing education and support to busy clinicians. The project is well designed and has good links to theory. I note the high uptake of midwives in this social media forum. This might be worth noting as there is not explicit recognition of this in the reporting apart from the table. Yammer has the potential to provide an excellent forum for interprofessional collaboration and learning.
It would also be useful to do a small study to find out how people felt about using Yammer and what they gained from the experience.
I recommend this study.