Write-up and dissemination of undergraduate and postgraduate research at the University of Rwanda: a cross-sectional study

Write-up and dissemination of undergraduate and postgraduate research at the University of Rwanda: a cross-sectional study

Christian Nsanzabaganwa¹, Hubert Habineza¹, Naphtal Nyirimanzi^1,2, Christian Umuhoza^1,3, Katie Cartledge¹, Craig Conard^2,4, Peter Cartledge^3,4,&

 

¹College of Medicine and Health Sciences (CMHS), University of Rwanda, Kigali, Rwanda, ²Department of Pediatrics, Univerisity Teaching Hospital of Butare, Butare, Rwanda, ³Department of Pediatrics, University Teaching Hospital of Kigali, Kigali, Rwanda, ⁴School of Medicine, Yale University (New Haven, USA), Rwanda Human Resources for Health (HRH) Program, Kigali, Rwanda

 

 

^&Corresponding author
Peter Cartledge, Medicine, Yale University (New Haven, USA), Rwanda Human Resources for Health (HRH) Program, Kigali, Rwanda

 

 

 

 

Research is vital in different avenues of health development and care delivery whilst also playing an essential role in the academic advancement of the researcher [1-3]. Research is defined as "critical and exhaustive investigation or experimentation, having for its aim the discovery of new facts and their correct interpretation, the revision of accepted conclusions, theories, or laws in the light of newly discovered facts, or the practical application of such new or revised conclusions, theories, or laws" [4]. It should, therefore, be part of the educational culture in medical training programs [5]. There are benefits to both medical students and residents, who shall be referred to as 'students' in this article. It is now evident that engaging students in research may lead to increased participation in research after completion of training [6, 7]. However, due to the burdens of patient care, students are frequently too busy to find sufficient time for research activities [8, 9]. Scholarly research activity programs are essential components of the modern undergraduate (UG) and postgraduate (PG) medical curriculum [10]. Research encourages students to develop the necessary competencies for future research activities and enter academic careers as physician-scientists [11]. Undertaking research can help develop transferable skills such as communication skills, time management, medical statistics, academic writing, systematic thinking, critical appraisal skills, information technology (IT) skills and how to practice evidence-based medicine [3, 10]. In Rwanda, medical students and residents face various barriers to performing research, notably a lack of good mentorship and financial burdens; yet they have to undertake research in order to graduate from their training [5]. It is an aim of the University of Rwanda (UR) to improve the quality and quantity of their research output [12]. In 2014, thanks to intervention from the broader community, Rwanda was the most influential country for research in East Africa for published research output, with the UR being the second most influential University in East Africa [12].

 

Peer-reviewed published papers (control group) classically follow the IMRaD structure of Introduction, Methodology, Results and Discussion [13]. Undertaking a research dissertation is already a significant challenge to students. Therefore, progressing to the submission of the results in a peer-reviewed journal adds a new burden to the student's research journey and requires its own specific competencies. The language used in "writing-up for publication" can be foreign to the student and many students in this setting have had little opportunity or feedback in academic writing. One study in Rwanda demonstrated that students needed formal training to develop these skills in order to improve the scholarly output of the participants [14]. To compound this, many academic institutions ask students to submit research in the form of a "dissertation" which may have other idiosyncrasies which are not consistent with manuscripts in peer-reviewed journals and dissertations may have specific requirements related to the institution. Publication is defined as "copies of a work or document distributed to the public by sale, rental, lease, or lending" [4]. In this study, we define publication as being articles that have gone through peer-review by a medical journal. Encouraging students to publish dissertation work is important as the future synthesis of research, in systematic reviews, is compromised if journal publications represent a biased selection of research projects conducted [15]. Many research projects, however, go unreported with one study finding that only 46% of US NIH-funded trials were published in a peer-reviewed, Medline-indexed journal within 30-months of completion [16]. Furthermore, the research work represents not only the author but also the research institution, the funding body, and other researchers [17]. Submission for publication can equip the student in quality scientific writing, presentation skills and raising their knowledge and practice of scientific ethics [18]. Writing-up research in a concise manner is a fundamental step in the dissemination process. There is currently no data on the the conciseness of writing style of UG and PG research projects undertaken in Rwanda or on the number of these projects published in peer-review journals. Aims: this research project aimed to identify correlation between peer-reviewed published papers (control group) and undergraduate (UG) or postgraduate (PG) projects in Rwanda, and to identify what proportion of resident research projects have been published since 2012. We hypothesized that the word count of the IMRaD sections of UG and PG dissertations would be significantly longer than randomly identified peer-reviewed published research manuscripts from Rwanda.

 

 

Study design: a retrospective cross-sectional study of undergraduate (UG) and postgraduate (PG) dissertations (monographs) compared to similar peer-reviewed published papers (control group). Reporting of the current study is in accordance with the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) checklist [19].

 

Study setting and location of the population: The University of Rwanda (UR) is a singular, multi-campus institution established in 2013 from the merger of the nation's seven public Higher Learning Institutions (HLIs) into a single, public university with six self-governing colleges, of which the College of Medicine and Health Sciences (CMHS) is a part [12]. All final year medical students and MMed (master of medicine) pediatric residents at the UR are required to undertake a research project and write this as a research dissertation (monograph) as a condition of graduation [20].

 

Participants/subjects

 

Inclusion criteria: group 1: research projects of final year undergraduate (UG) medical students (interns) who graduated between 2016-2017 (n=190); group 2: research projects of pediatric postgraduate (PG) MMed residents who graduated between 2012-2017 (n=41); group 3 (control group): peer-reviewed published papers (n=22). Random research publications with the keyword "Rwanda" were opportunistically identified by searching the websites of the following peer-reviewed journals: Malawi Medical Journal (MMJ); East African medical journal (EAMJ); Pan-African medical Journal (PAMJ); Tropical Medicine International Health (TMIH); Journal of Tropical Pediatrics (JTP); Rwandan Medical Journal (RMJ); Paediatrics and International Child Health (PICH). These journals were chosen because of their relevance to our setting.

 

Exclusion criteria: dissertations only available in paper (hard) format.

 

Recruitment/enrolment of participants: recruitment (Group 1 and Group 2): dissertations performed at UR remain the copyright of UR [20] and therefore should be available. Therefore, dissertations were obtained from several sources: i. An email was sent to all previous students in groups 1 and 2 inviting them to send their completed dissertations; ii. We contacted UR faculty who had supervised students undertaking research asking them to send the dissertations of their students; iii. The UR main library at the School of Medicine was manually searched; iv. The pediatric department holds a database of all the pediatric PG graduates and research topics. Finally, the dissertations fulfilling criteria were selected and enrolled in the study.

 

Variables and outcomes: the primary outcomes were word counts of each of the IMRaD sections used in writing up dissertations. Secondary outcomes were details of the projects performed, namely; study methodology, site, retrospective/prospective and finally, using our database of pediatric PG graduates and topics (2012-2017, n=41) to identify whether the research projects were published in a peer-review journal. To identify whether articles had been published, we searched PubMed, Scopus and Google, alongside networking with local graduates and academic staff. We did not attempt to identify the proportion of UG projects published. Current academic regulation at the University of Rwanda requires that memories be limited to 300 words for the abstract and 15,000 words for the entire body of work (including appendixes, cover pages, references etc). The author instructions of the seven peer-reviewed journals were reviewed and the average maximum word count was 3,700 (3500-4000), excluding tables and references etc.

 

Power calculation: we recruited using convenience methods. However, a post-hoc power calculation was performed using G*power software. The primary outcome was a comparison of the total word count of the UG and PG dissertations with the control group (peer-reviewed published papers). Based on our results, the power calculation for independent t-tests (compared to peer-reviewed published papers) was 0.99 for PG dissertations and 0.30 for the UG dissertations compared to the control. Therefore, the UG arm of the study was underpowered to find if there were any significant difference between the groups.

 

Data collection and management: for all dissertations that were available in electronic form, we calculated the word counts of abstracts, introduction, methods, analysis, results, and discussion using the "word count" function in Microsoft Word, as well as manually counting the number of tables and figures of each paper. Statistical Package for the Social Sciences (SPSS) was employed for statistical analysis.

 

Statistical analysis: categorical variables were described using descriptive statistics and analyzed using Chi-squared. Continuous (scale) variables were described using means and standard deviations and analysed using Student's t-tests for independent variables.

 

Ethical considerations: no social, emotional, physical, legal, or financial ethical risks to participants were identified. Publishing in a peer-review journal is not a requirement of graduation therefore there is no implication on the authors. Memoirs remain the copyright of UR and therefore should be available for the furthering of scientific knowledge of the academic community. As dissertations remain the copyright of the UR, no consent was gained. The To ensure confidentiality, all information gathered was kept securely in a password-protected spreadsheet. Only the investigator of this project and the supervisors had access to the information kept in the database. research protocol was reviewed and approved by UR CMHS Institution Review Board (IRB) on the 27 July 2017 (Ref: 341/CMHS IRB/2017 and 340/CMHS IRB/2017).

 

Availability of data and materials: non-analyzed datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

 

 

Baseline data on dissertations performed: we were able to access 19/190 (10%) UG and 22/41 (54%) PG resident dissertations in electronic format for analysis of word counts (Figure 1). Five were available in hard-print format but were excluded as they were not suitable for word-count analysis on Microsoft Word. Twenty-two peer-reviewed published articles were found from MMJ (n=2), EAMJ (n= 3), PAMJ (n= 5), TMIH (n=3), JTP (n=1), RMJ (n=7), PICH (n=1). "Non-participants" were those dissertations that were not available despite the steps taken in the methodology.

 

Methodology of research employed: all the research undertaken by the UG and PG students was clinical research. Cross-sectional research was performed frequently in all three groups. UG students were much more likely to undertake retrospective research than their PG counterparts (Table 1).

 

Publishing of PG research projects: of the research dissertations of pediatric PG residents who graduated between 2012-2017 (n=41), we found evidence of four dissertations (10%) that had been published in peer-review journals.

 

The writing style (distribution of word counts in UG and PG research): data was extracted from digitally available dissertations (Table 2) and peer-reviewed published papers. No data-points were missing. The mean total word count (excluding abstract, tables, figures and references) for peer-reviewed published articles was 2959 words with a mean of 4 tables/figures. The mean total word count for PG dissertations was 5163 which was significantly larger (p<0.001) than the peer-reviewed published papers. Each section of the IMRaD structure, of PG dissertations, was significantly longer than those of peer-reviewed articles. Interestingly PG dissertations (77%) were more likely to present keywords than control group (46%). UG dissertations did not significantly differ from the control group (published papers) except for the number of tables and figures which were significantly larger (p<0.001). We observed that this large number of tables reflected students' tendency to copy and paste tables from SPSS rather than to consolidate data into summary, tables.

 

 

The primary objective of this study was to compare the weighting of word counts for each IMRaD section between postgraduate (PG), undergraduate (UG), and published projects in Rwanda. We found that PG student dissertations used significantly more words than the published papers. This could be contributing, with other factors, to the low publication output of the PG students' research activities. We found that only four (10%) PG pediatric research projects were published between 2012-2017. In Germany one study found that of 807 research projects approved by the IRB, 52% were published [21]. The authors of this study found that study design was not significantly associated with subsequent publication but that multi-center status, international collaboration, and a large sample size were positively associated with subsequent publication [21]. In our study, 73% of PG research projects were cross-sectional (Table 1). However, in the German study [21], it was found that study methodology did not affect the proportion which were published, therefore in our population the high number of cross-sectional studies should not be affecting the publication rate. In Holland (2010) it was found that 15% of 2973 undergraduate students had published a piece of literature during their studies [22]. In our study, we were unable to identify how many UG projects were published. There are numerous challenges to publishing research findings in setting such as Rwanda, namely; lack of skills to write-up, supervision, time, motivation/desire, choosing and identifying the right peer-reviewed journal, navigation of the submission process, English language, and "publishing language" [9]. This can then be followed by the disheartening rejection of a manuscript during the peer-review process. In addition, some journals require either submission, type editing and/or publication fees, which most students cannot afford in the resource-limited setting. These challenges are surmountable and findings from Rwanda have shown that confidence and skills in academic writing can improve through training and intervention [14]. Researchers in Rwanda should remain committed to disseminating the results of all researches they conduct. Many students and residents may lack the skills required to overcome the barriers in navigating the peer-review process and therefore supervisors should provide significant support in achieving this goal. Regarding the writing style, literature has already demonstrated that undertaking research helps students develop critical thinking and fosters development of skills in scholarly activities [7, 10, 23]. The PG students used significantly more words (mean 5163) in order to write-up their research compared to the peer-reviewed articles (control group) (mean 2959, p<0.001). This could reflect a number of factors, namely the academic regulation dictated to them and the writing style of their predecessors.

 

All PG sections of the IMRAD were significantly longer in PG dissertations compared to peer-reviewed articles (control group). We were unable to find any published articles from other institutions regarding this subject. We are postulating that one possible explanation for low rates of research dissemination in our population is that dissertations are not concise and therefore the final write-up is not an appropriate length for submission to a peer-reviewed journal. Dissertations involve a major educational element to the student's experience. The dissertation is submitted solely by the student as part of their assessment with supervisors giving "guidance" rather than tight editing. For publication, however, multiple authors in clear collaboration, according to a clearly defined journal format, edit the text. These skills of writing concisely also need to be learnt by students and they also need guidance in order to be able to do so. Being able to write in a concise, academic, publishable style, is an additional skill and should not weaken, but rather strengthen, the dissertation required for graduation. The primary focus of students is to undertake a piece of work as a requirement of their studies. Publication is a secondary opportunity that some students will exploit and it is not a requirement for graduation. Research authors publish for personal and altruistic reasons that are both valid. Personal reasons include increasing their personal academic profile, for personal development, to better understand a topic, to build their reputation and for career advancement. Altruistic reasons include raising awareness of the topic and research, to disseminate findings, and ultimately improve quality of care for patients. Regarding the ethics of non-publication; research is dependent on the willingness of participants to expose themselves to the risks involved [24]. The ethical justification for these risks is that society will eventually benefit from the knowledge gained from the study. Researchers therefore have an ethical responsibility to report the results of research involving human subjects [25]. The Declaration of Helsinki (2014) states that; "researchers, authors, sponsors, editors, and publishers all have ethical obligations concerning the publication and dissemination of the results of research" [26]. Is there therefore an ethical challenge that students may undertake research for their own personal benefit (i.e. learning skills, graduation etc) without following-up to publish the results for the benefit of society and the scientific community? Both are important and need to be considered when implementing research activities into curricula. Likewise, institutions may have an ethical duty to ensure that students are given the skills to publish, in order to maximise the benefits to the scientific community. Medical students and residents have busy clinical duties, and when research is undertaken as a condition of graduation, it often occurs towards the end of studies. This makes returning to a dissertation at a later date to prepare it for submission less likely. Therefore, writing-up the dissertation in a publishable "manuscript" format, concisely, ready for journal submission could not only teach the student new writing skills but also increase the likelihood of the results being disseminated.

 

 

This is the first study to assess the writing style of Rwandan medical students and pediatric residents. The results should be used to strengthen research activities in Rwanda and further afield in the Sub-Saharan region so that dissemination of research findings will be increased.

 

Limitations:we accessed 10% and 54% of UG and PG dissertations respectively and therefore our results may not be wholly representative of the whole cohort. We opportunistically selected the control group and this could have been subject to bias. A potential source of bias and confounding was the change in official language in Rwanda in 2008 from French to English. This may have affected conciseness of writing style of graduates who were primarily educated in French but needed to write-up their dissertations in English. Many of the UG projects could be described as "service review" providing useful information to local departments. Therefore, these may not be suitable for publication, however, students gaining the skills to write-up in publication style would still benefit the student for a future life as clinician-researchers.

 

Implementation: writing concisely is a new skill for the students to learn and develops them for future academic and professional scientific writing. These results are particular to the academic regulations that students are given. Therefore, they need to be interpreted within the academic institution where this article is being read. If institutions, such as UR are committed to achieving their goals of increasing academic outputs then their doctors and specialists of the future need to be taught the necessary skills for concise academic writing. The findings of this study will not lead to an increase in the quality of published work. Rather it highlights the need to guide students to write within the expectations of peer-reviewed journals in order to increase the dissemination of the students' findings and increase the impact of the institution. A simple step would be to modify academic regulations so that student's write-up in "manuscript" form rather than "dissertation" format. If researchers can write-up a multi-center randomized-controlled trial within 3000 words then a student can and should be taught and supported to do the same for a dissertation. This might limit student to write-up more of their reflective experiences and supplementary data. However, there is no reason why this can't be presented within appendixes of a dissertation. Further changes would be to incorporate teaching on scientific writing skills for all students, develop faculty in order to improve the research capacity of the individual departments, and finally encourage ethics boards to ensure that research is disseminated.

 

 

The authors declare no competing interests.

 

 

The study was undertaken as the Undergraduate thesis of the Principle Investigator (Christian Nsanzabaganwa). Christian was supported and supervised by the three authors (Craig Conard, Katie Cartledge & Peter Cartledge). Hubert Habineza assisted the data-collection and analysis. Christian Nsanzabaganwa, Christian Umuhoza and Peter Cartledge undertook the analysis. Christian Nsanzabaganwa, Hubert Habineza, Peter Cartledge, Craig Conard, Naphtal Nyirimanzi, Christian Umuhoza and Katie Cartledge were the major contributors in writing the manuscript. All authors read and approved the final manuscript.

 

 

To the four UR faculty, UR library members and Members of the Pediatric Academic team at the University of Rwanda who provided their assistance in data collection.

 

 

Table 1: baseline data on dissertations and peer-reviewed articles

Table 2: distribution of text, figures and references for intern, resident and published papers

Figure 1: group recruitment

 

 

1. Ejaz K, Shamim MS, Shamim MS, Hussain SA. Involvement of Medical Students and Fresh Medical Graduates of Karachi, Pakistan in Research. J Pak Med Assoc. 2011; 61(2): 115-120. PubMed | Google Scholar


2. Memarpour M, Fard AP, Ghasemi R. Evaluation of attitude to, knowledge of and barriers toward research among medical science students. Asia Pac Fam Med. 2015; 14(1): 1. PubMed | Google Scholar


3. Shrestha A. The importance of doing research as a medical student. Kathmandu Univ Med J (KUMJ). 2007; 5(1): 138. PubMed | Google Scholar


4. National-Institutes-of-Health. MeSH (Medical Subject Headings). 2018. PubMed


5. Munabi IG, Katabira ET, Konde-Lule J. Early undergraduate research experience at Makerere University Faculty of Medicine: a tool for promoting medical research. Afr Health Sci. 2006; 6(3): 182-186. PubMed | Google Scholar


6. Smith M. Research in residency: do research curricula impact post-residency practice. Fam Med. 2005; 37(5): 322-327. PubMed | Google Scholar


7. Abramson EL, Naifeh MM, Stevenson MD, Todd C, Henry ED, Chiu Y-L et al. Research Training Among Pediatric Residency Programs. Acad Med. 2014; 89(12): 1674-1680. PubMed | Google Scholar


8. Vargas E, Becerril-Montekio V, Gonzalez-Block MÁ, Akweongo P, Hazel CNA, Cuembelo M de F et al. Mapping the use of research to support strategies tackling maternal and child health inequities: evidence from six countries in Africa and Latin America. Heal Res Policy Syst. 2016; 14: 1. PubMed | Google Scholar


9. Habineza H, Nsanzabaganwa C, Nyirimanzi M, Umuhoza C, Cartledge K, Conard C et al. Perceived attitudes of the importance and barriers to research amongst Rwandan interns and pediatric residents-a cross-sectional study. BMC Med Educ. 2019; 19(1): 4. PubMed | Google Scholar


10. Burgoyne LN, O'Flynn S, Boylan GB. Undergraduate medical research: the student perspective. Med Educ Online. 2010 Sep 10;15. PubMed | Google Scholar


11. Solomon SS, Tom SC, Pichert J, Wasserman D, Powers AC. Impact of Medical Student Research in the Development of Physician-Scientists. J Investig Med. 2003; 51(3): 149-156. PubMed | Google Scholar


12. Clarivate-Analytics. Overview of University of Rwanda Research Performance. 2014.


13. Hathaway H, Habineza H, Henry M, Byiringiro F, Michael H, Byiringiro F et al. RMJ research series-Writing-up methodology. Rwanda Med J. 2018; 74(4): 16-19. Google Scholar


14. Ewing H, Pyburn R, Asingizwe D, Asiimwe-Kateera BA, Njunwa K, Kim MJ. Facilitating health professional scholarship through a workshop series at the University of Rwanda. Rwanda Med J. 2017; 74(2): 1-5. Google Scholar


15. Schmucker C, Schell LK, Portalupi S, Oeller P, Cabrera L, Bassler D et al. Extent of Non-Publication in Cohorts of Studies Approved by Research Ethics Committees or Included in Trial Registries. PLoS One. 2014; 9(12): e114023. PubMed | Google Scholar


16. Ross JS, Tse T, Zarin DA, Xu H, Zhou L, Krumholz HM. Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ. 2012; 344: d7292. PubMed | Google Scholar


17. Kamat PV. Research Ethics. Symp Sci Publ ACS Natl Meet. 2006; (March): 49.


18. Ullrich N, Botelho CA, Hibberd P, Bernstein HH. Research during pediatric residency: predictors and resident-determined influences. Acad Med. 2003; 78(12): 1253-1258. PubMed | Google Scholar


19. Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med. 2007; 4(10): 1623-1627. PubMed | Google Scholar


20. University of Rwanda. Framework & Regulations for Higher Degrees by Coursework & Thesis (revised July 2015). 2015.


21. Blümle A, Meerpohl JJ, Schumacher M, Von Elm E. Fate of clinical research studies after ethical approval-follow-up of study protocols until publication. PLoS One. 2014 Feb 19; 9(2): e87184. PubMed | Google Scholar


22. Van Eyk HJ, Hooiveld MHW, Van Leeuwen TN, Van Der Wurff BLJ, De Craen AJM, Dekker FW. Scientific output of Dutch medical students. Med Teach. 2010; 32(3): 231-235. PubMed | Google Scholar


23. Trigwell K, Dunbar-Goddet H. The Research Experience of Postgraduate Research Students at the University of Oxford. Institute for the Advancement of the University Learning. 2005. Google Scholar


24. Jones CW, Handler L, Crowell KE, Keil LG, Weaver MA, Platts-Mills TF. Non-publication of large randomized clinical trials: cross sectional analysis. BMJ. 2013; 347: f6104. PubMed | Google Scholar


25. Alley AB, Seo J, Hong S-T. Reporting results of research involving human subjects: an ethical obligation. J Korean Med Sci. 2015; 30(6): 673-5. PubMed | Google Scholar


26. World Medical Association. WMA Declaration of Helsinki- ethical principles for medical research involving human subjects. 2001. Google Scholar