Kazan medical journalKazan medical journalКазанский медицинский журнал0368-48142587-9359Eco-Vector6328210.17816/KMJ2021-459Theoretical and clinical medicineТеоретическая и клиническая медицинаResearch ArticleImproving the Russian-language Wikipedia articles on medicines using new knowledge CochraneСовершенствование русскоязычных статей Википедии по лекарственным средствам с использованием новых знаний КокрейнPotapovA SПотаповАлександр Сергеевич
Russian Federation
Potapov0770@gmail.comAlexandrovaE GАлександроваЭльвира Григорьевна
Russian Federation
Potapov0770@gmail.comYudinaE VЮдинаЕкатерина Викторовна
Russian Federation
Potapov0770@gmail.comZiganshinaL EЗиганшинаЛилия Евгеньевна
Russian Federation
Potapov0770@gmail.comKazan Federal UniversityКазанский (Приволжский) федеральный университетRussian Medical Academy for Continuing Professional Education (RMANPO)Российская медицинская академия непрерывного профессионального образованияCity Children's Hospital № 1Городская детская больница №1Kazan State Medical UniversityКазанский государственный медицинский университет0808202110244594731203202129062021Copyright ©; 2021, Potapov A.S., Alexandrova E.G., Yudina E.V., Ziganshina L.E.Copyright ©; 2021, Потапов А.С., Александрова Э.Г., Юдина Е.В., Зиганшина Л.Е.2021Potapov A.S., Alexandrova E.G., Yudina E.V., Ziganshina L.E.Потапов А.С., Александрова Э.Г., Юдина Е.В., Зиганшина Л.Е.http://creativecommons.org/licenses/by-nc-sa/4.0https://kazanmedjournal.ru/kazanmedj/article/view/63282

Aim. To evaluate the effectiveness of the Cochrane Russia Initiative to improve the articles of the Russian-language Wikipedia by including information from Cochrane Systematic Reviews (CSR) to ensure the accuracy and impartiality of their content as an information basis for the quality use of medicines by doctors and the public.

Methods. Wikipedia articles on selected drugs were improved by introducing evidence from Cochrane Systematic Reviews — “Cochrenized”. A parallel open-label non-randomized controlled intervention study was conducted. We assigned 2 groups of drugs and Wikipedia articles about them: the intervention group (“Cochrenization”) and the control group (36 articles each). Control group articles were not edited. The change in the number of visits to Wikipedia pages for the year (2018–2019) was measured, the statistical significance of the differences was assessed by using the Wilcoxon signed-rank test.

Results. We edited 36 Wikipedia articles, including 13 articles on migraine treatment, 9 diabetes mellitus, 14 pain and inflammation articles. These articles constituted the intervention group. The control group consisted of articles on cardiovascular (11), gastrointestinal (14) and dermatological agents (11). We used the Cochrane Russia Initiative dashboard on Wikipedia to compare the number of article views before and after the intervention and Cochrane analytics on demand for translations of Cochrane systematic reviews summaries. After “Cochrenization”, the number of Wikipedia article views (2018–2019) increased in total/average article views for treatments: migraines by 18%/47%, pain and inflammation — 16%/43%, diabetes mellitus — 18%/0%. Analysis of Cochrane reports showed an increase in the number of views of Cochrane systematic reviews summaries on the Cochrane.org website in general by 9 times and from Russian-speaking browsers by 11 times. Improvement of medicine-related articles of the Russian-language Wikipedia by the introduction of information from Cochrane systematic reviews was accompanied by an increase in their demand in terms of the number of views in general by 34%, with a similar increase in control (without intervention) (p-value of the experimental group — 0.002, control — 0.000). The Wikipedia articles on medicines, which belonged to the Russian Vital and Essential Drugs List or the World Health Organization Model List of Essential Medicines, got more views.

Conclusion. The role of confounding factors justifies the feasibility of developing a methodology for studying the usefulness of improving Wikipedia articles, different from controlled trial research methodology; further inclusion of Cochrane knowledge into Wikipedia is needed.

Цель. Оценить эффективность Инициативы Кокрейн Россия по совершенствованию статей русскоязычной Википедии включением информации из Кокрейновских систематических обзоров для обеспечения точности и непредвзятости их содержания как информационной основы качественного использования лекарств врачами и населением.

Методы. Статьи Википедии по отобранным лекарствам мы совершенствовали введением доказательств из Кокрейновских систематических обзоров — «Кокрейнизировали». Провели параллельное открытое нерандомизированное контролируемое интервенционное исследование. Выделили две группы лекарств и статей Википедии о них: группа вмешательства («Кокрейнизация») и контрольная (по 36 статей). Статьи контрольной группы не редактировали. Оценили изменение числа посещений страниц Википедии за год (2018–2019), статистическую значимость различий оценивали по критерию Уилкоксона.

Результаты. Отредактировали 36 статей Википедии, из них статей по средствам для лечения мигрени — 13, сахарного диабета — 9, боли и воспаления — 14. Эти статьи составили группу вмешательства. Контрольную группу составили статьи по сердечно-сосудистым (11), желудочно-кишечным (14) и дерматологическим (11) средствам. Использовали информационную панель Инициативы Кокрейн Россия в Википедии для сравнения количества просмотров статей до и после вмешательства и аналитику Кокрейн по востребованности переводов резюме Кокрейновских систематических обзоров. После «Кокрейнизации» количество просмотров статей Википедии (2018–2019) увеличилось по общему числу/средним показателям просмотров статей на средства для лечения: мигрени — на 18%/47%, боли и воспаления — на 16%/43%, сахарного диабета — на 18%/0%. Анализ отчётов Кокрейн показал рост числа просмотров резюме Кокрейновских систематических обзоров на сайте cochrane.org в целом в 9 раз, с русскоязычных браузеров — в 11 раз. ¬Совершенствование лекарственных статей русскоязычной Википедии введением сведений из Кокрейновских систематических обзоров сопровождалось увеличением их востребованности по числу просмотров в целом на 34% при аналогичном увеличении в контроле (без вмешательства) (p-valve опытной группы — 0,002, контрольной — 0,000). Статьи на лекарства, включённые в Российский перечень жизненно необходимых и важнейших лекарственных препаратов или Модельный список основных лекарств Всемирной организации здравоохранения, получили больше просмотров.

Вывод. Роль вмешивающихся факторов обосновывает целесообразность разработки методологии изучения полезности совершенствования статей Википедии, отличной от методологии контролируемого исследования; необходимо дальнейшее включение знаний Кокрейн в Википедию.

CochraneCochrane LibraryWikipediaCochrane evidenceКокрейнКокрейновская библиотекаВикипедиядоказательства КокрейнCochrane: About us. Cochrane.org. https://www.cochrane.org/about-us (access date: 25.02.2020).Cochrane. Cochrane and Wikipedia: working together to improve access to health evidence. Cochrane.org. https://www.cochrane.org/news/cochrane-and-wikipedia-working-together-improve-access-health-evidence (access date: 10.03.2020).Fenley S. Navigation and visualisation tools usage in large internet and multimedia resources. In: Practical applications of intelligent systems. Berlin, Heidelberg: Springer. 2011; 97–104. DOI: 10.1007/978-3-642-25658-5_12.Gavali M.Y., Khismatrao D.S., Gavali Y.V., Patil K.B. Smartphone, the new learning aid amongst medical students. J. Clin. Diagn. Res.: JCDR. 2017; 11 (5): JC05. DOI: 10.7860/JCDR/2017/20948.9826.Lee K., Hoti K., Hughes J.D., Emmerton L. Dr ­Google is here to stay but health care professionals are still valued: an analysis of health care consumers’ internet navigation support preferences. J. Med. Intern. Res. 2017; 19 (6): e210. DOI: 10.2196/jmir.7489.Sandars J. Technology and the delivery of the curriculum of the future: opportunities and challenges. Med. Teacher. 2012; 34 (7): 534–538. DOI: 10.3109/0142159X.2012.671560.Del Fiol G., Workman T.E., Gorman P.N. Clinical questions raised by clinicians at the point of care: a systematic review. JAMA Intern. Med. 2014; 174 (5): 710–718. DOI: 10.1001/jamainternmed.2014.368.Ahamad A., Wallner P., Salenius S., Ross R., Fernandez E. Information needs expressed during patient-orien­ted oncology consultations: quantity, variation, and barriers. J. Cancer Education. 2019; 34 (3): 488–497. DOI: 10.1007/s13187-018-1329-5.Lim B.T., Butow P., Mills J., Miller A., Goldstein D. Information needs of the Chinese community affected by cancer: A systematic review. Psycho‐oncology. 2017; 26 (10): 1433–1443. DOI: 10.1002/pon.4347.Sullivan S. Google now handles at least 2 trillion searches per year. Search Engine Land 24. https://searchengineland.com/google-now-handles-2-999-trillion-searches-per-year-250247 (access date: 27.02.2020).Ramaswami P. A remedy for your health-related questions: health info in the knowledge graph. Google Official Blog. https://blog.google/products/search/health-info-knowledge-graph (access date: 15.03.2020).Richards L. Why Wikipedia is still visible across Google’s SERPs in 2018. Search Engine Watch. https://www.searchenginewatch.com/2018/11/13/why-wikipedia-is-still-visible-across-googles-serps-in-2018 (access date: 21.10.2020).Laurent M.R., Vickers T.J. Seeking health information online: does Wikipedia matter? J. Am. Med. Inform. Assoc. 2009; 16 (4): 471–479. DOI: 10.1197/jamia.M3059.Wikipedia. Wikipedia: About. Wikipedia.org. https://en.wikipedia.org/wiki/Wikipedia:About (access date: 13.03.2020).The top sites on the web. Alexa. http://www.alexa.com/topsites (access date: 15.04.2020).Heilman J.M., Kemmann E., Bonert M., Chatterjee A., Ragar B., Beards G.M., Iberri D.J., Harvey M., Thomas B., Stomp W., Martone M.F. Wikipedia: a key tool for global public health promotion. J. Med. Intern. Res. 2011; 13 (1): e14. DOI: 10.2196/jmir.1589.Masukume G., Kipersztok L., Das D., Shafee T., Laurent M.R., Heilman J.M. Medical journals and Wikipedia: a global health matter. Lancet Global Health. 2016; 4 (11): e791. DOI: 10.1016/S2214-109X(16)30254-6.Shafee T., Masukume G., Kipersztok L., Das D., Häggström M., Heilman J. Evolution of Wikipedia’s medi­cal content: past, present and future. J. Epidemiol. Comm. Health. 2017; 71 (11): 1122–1129. DOI: 10.1136/jech-2016-208601.Allahwala U.K., Nadkarni A., Sebaratnam D.F. Wikipedia use amongst medical students — new insights into the digital revolution. Med. Teacher. 2013; 35 (4): 337. DOI: 10.3109/0142159X.2012.737064.Kingsley K., Galbraith G.M., Herring M., Sto­wers E., Stewart T., Kingsley K.V. Why not just Google it? An assessment of information literacy skills in a biomedical science curriculum. BMC Med. Education. 2011; 11 (1): 1–8. DOI: 10.1186/1472-6920-11-17.Azzam A., Bresler D., Leon A., Maggio L., Whitaker E., Heilman J., Orlowitz J., Swisher V., Rasberry L., Otoide K., Trotter F. Why medical schools should embrace Wikipedia: final-year medical student contributions to Wikipedia articles for academic credit at one school. Acad. Med. 2017; 92 (2): 194. DOI: 10.1097/ACM.0000000000001381.Purdy E., Thoma B., Bednarczyk J., Migneault D., Sherbino J. The use of free online educational resources by Canadian emergency medicine residents and program directors. Canadian J. Emerg. Med. 2015; 17 (2): 101–106. DOI: 10.1017/cem.2014.73.Apollonio D.E., Broyde K., Azzam A., De Guia M., Heilman J., Brock T. Pharmacy students can improve ­access to quality medicines information by editing Wikipedia articles. BMC Med. Education. 2018; 18 (1): 1–8. DOI: 10.1186/s12909-018-1375-z.Haigh C.A. Wikipedia as an evidence source for nursing and healthcare students. Nurse Education Today. 2011; 31 (2): 135–139. DOI: 10.1016/j.nedt.2010.05.004.Meek J. Is Wikipedia suitable as a learning resource for nursing and healthcare students? HIV Nurs. 2016; 16: 65–66.Heilman J.M., West A.G. Wikipedia and medicine: quantifying readership, editors, and the significance of na­tural language. J. Med. Intern. Res. 2015; 17 (3): e62. DOI: 10.2196/jmir.4069.Egle J.P., Smeenge D.M., Kassem K.M., Mittal V.K. The Internet School of Medicine: use of electronic resour­ces by medical trainees and the reliability of those resources. J. Surg. Education. 2015; 72 (2): 316–320. DOI: 10.1016/j.jsurg.2014.08.005.Metcalfe D., Powell J. Should doctors spurn Wikipedia? J. Royal Soc. Med. 2011; 104 (12): 488–489. DOI: 10.1258/jrsm.2011.110227.Jemielniak D. Common knowledge? An ethnography of Wikipedia. Stanford University Press. 2014; 312 p. DOI: 10.11126/stanford/9780804789448.001.0001.Shachaf P. The paradox of expertise: is the Wikipedia Reference Desk as good as your library? J. of Docu­mentation. 2009; 65 (6): 977–996. DOI: 10.1108/00220410910998951.Frambach J.M., Driessen E.W., Chan L.C., van der Vleuten C.P. Rethinking the globalisation of problem‐based learning: how culture challenges self‐directed learning. Med. Education. 2012; 46 (8): 738–747. DOI: 10.1111/j.1365-2923.2012.04290.x.Callis K.L., Christ L.R., Resasco J., Armitage D.W., Ash J.D., Caughlin T.T., Clemmensen S.F., Copeland S.M., Fullman T.J., Lynch R.L., Olson C. Improving Wikipedia: educational opportunity and professional responsibility. Trends in Ecology & Evolution. 2009; 24 (4): 177–179. DOI: 10.1016/j.tree.2009.01.003.Bonfill X., Iberoamericano C.C. The Cochrane Collaboration turns 20. Med. Clin. 2014; 143 (5): 210–215. DOI: 10.1016/j.medcli.2014.02.003.Franco J.V., Arancibia M., Simancas-Racines D., Madrid E. Syntheses of biomedical information: narrative reviews, systematic reviews and emerging formats. Medwave. 2018; 18 (07): е7354. DOI: 10.5867/medwave.2018.07.7354.Cochrane Library. About the Cochrane Database of Systematic Reviews. https://www.cochranelibrary.com/cdsr/about-cdsr (access date: 23.07.2020).Chapman S. What are Cochrane reviews? Cochrane UK. http://www.evidentlycochrane.net/what-are-cochrane-reviews/ (access date: 07.06.2020).Wikipedia. “Foundations” white paper. Wikimedia. Meta-wiki. https://meta.wikimedia.org/wiki/Research:2030 (access date: 20.08.2020).Wikipedia. “Knowledge integrity” white paper. Wikimedia. Meta-wiki. https://meta.wikimedia.org/wiki/Research:2030 (access date: 20.08.2019).Wikipedia. “Knowledge gaps” white paper. Wikimedia. Meta-wiki. https://meta.wikimedia.org/wiki/Research:2030 (access date: 20.08.2020).Jemielniak D., Masukume G., Wilamowski M. The most influential medical journals according to Wikipedia: quantitative analysis. J. Med. Intern. Res. 2019; 21 (1): e11429. DOI: 10.2196/11429.Yang J., Ward J., Gharavi E., Dawson J., Alvarado R. Bi-directional relevance matching between medical corpora. In: 2019 Systems and Information Engineering Design Symposium (SIEDS). IEEE. 2019; 1–6. DOI: 10.1109/SIEDS.2019.8735639.Joorabchi A., Doherty C., Dawson J. “WP2Cochrane”, a tool linking Wikipedia to the Cochrane Library: Results of a bibliometric analysis evaluating article quality and importance. Health Inform. J. 2020; 26 (3): 1881–1897. DOI: 10.1177/1460458219892711.Cochrane community. Strategy to 2020. https://community.cochrane.org/organizational-info/resources/strategy-2020 (access date: 26.08.2020).The Order of the Government of the RF No. 2738-r, issued at December 10 2018 “List of vital and essential me­dicines for medical use for 2019”. http://docs.cntd.ru/document/551876844 (access date: 21.05.2020). (In Russ.)Перечень жизненно необходимых и важнейших лекарственных препаратов для медицинского применения на 2019 год. Распоряжение правительства РФ от 10 декабря 2018 г. №2738-р. http://docs.cntd.ru/document/551876844 (дата обращения: 21.05.2020).World Health Organization. World Health Organization model list of essential medicines: 21st list 2019. Geneva: World Health Organization. 2019; 60 p.Pharmaceutical market of Russia. October 2018. DSM grupp. https://dsm.ru/upload/iblock/cda/cdaff008612b2ae0fb4d02121da0f6e5.pdf (access date: 24.05.2020). (In Russ.)Фармацевтический рынок России. Октябрь 2018. ДСМ групп. https://dsm.ru/upload/iblock/cda/cdaff008612b2ae0fb4d02121da0f6e5.pdf (дата обращения: 24.05.2020).Bol'shoy spravochnik lekarstvennykh sredstv. (A large reference book of medicines.) Ed. by L.E. Ziganshina, V.K. Lepa­khin, V.I. Petrov, R.U. Khabriev. M.: ­GEOTAR-Media. 2012; 3344 р. (In Russ.)Большой справочник лекарственных средств. Под ред. Л.Е. Зиганшиной, В.К. Лепахина, В.И. Петрова, Р.У. Хабриева. М.: ГЭОТАР-Медиа. 2011; 3344 с.Wikipedia Pageviews analysis. Wikipedia Pageviews. www.tools.wmflabs.org/pageviews (access date: 12.02.2019).Order of the Government of the RF No. 2406-r, issued at October 12 2019 “List of vital and essential medicines for medi­cal use for 2020”. http://docs.cntd.ru/document/551876844 (access date: 22.05.2020). (In Russ.)Перечень жизненно необходимых и важнейших лекарственных препаратов для медицинского применения на 2020 год. Распоряжение правительства РФ от 12 октября 2019 г. №2406-р. http://docs.cntd.ru/document/551876844 (дата обращения: 22.05.2020).Zdravookhranenie v Rossii 2019. Statisticheskiy sbornik. (Healthcare in Russia 2019. Statistical compilation.) Ed. by I.N. Shapoval, S.Y. Nikitinа, L.I. Ageeva. M.: Rosstat. 2019; 170 р. (In Russ.)Здравоохранение в России 2019. Статистический сборник. Под ред. И.Н. Шаповала, С.Ю. Никитиной, Л.И. Агеевой. М.: Росстат. 2019; 170 с.Research: trends in the Russian pharmaceutical market. Adindex.ru. https://dsm.ru/upload/iblock/cda/cdaff008612b2ae0fb4d02121da0f6e5.pdf (access date: 24.02.2020). (In Russ.)Исследование: тренды российского фармацевтического рынка. Adindex.ru. https://adindex.ru/news/researches/2018/08/7/173269.phtml (дата обращения: 24.02.2020).Ziganshina L.E., Niyazov R.R. Unethical drug promotion by pharmaceutical industry as the main barrier to the rational use of me­dicines. Kazan Medical Journal. 2013; 94 (2): 240–244. (In Russ.) DOI: 10.17816/KMJ1596.Зиганшина Л.Е., Ниязов Р.Р. Неэтичное продвижение лекарств фармацевтической индустрией — основной барьер к их рациональному использованию. Казанский мед. ж. 2013; 94 (2): 240–244. DOI: 10.17816/KMJ1596.Othman N., Vitry A.I., Roughead E.E. Medicines information in medical journal advertising in Australia, Malaysia and the United States: A comparative cross-sectional study. Southern Med. Rev. 2010; 3 (1): 11–18. PMID: 23093878.Instructions for the use of the medicinal product for specialists. Approved by the Ministry of Health of the Republic of Belarus, order of December 10, 2012, No. 1444. Vidal — a reference book of medicines. https://www.vidal.by/poisk_preparatov/airtal.html (access date: 19.05.2020). (In Russ.)Инструкция по применению лекарственного средства для специалистов. Согласовано МЗ Рес­публики Беларусь, приказ от 10.12.2012, №1444. Видаль — справочник лекарственных средств. https://www.vidal.by/poisk_preparatov/airtal.html (дата обращения: 19.05.2020).Giles J. Internet encyclopaedias go head to head. Nature. 2005; 438: 900–901. DOI: 10.1038/438900a.