Figures
Abstract
Background
Both in the Commonwealth of Independent States (CIS) and in the European Union (EU2004), ample availability of up to date medical scientific literature is important for progress in medical science and for the education of the next generation of healthcare workers. The aim of this research is to assess if the use of online medical literature among academic teaching (AT) physicians is at the same level in the CIS as in the EU2004.
Methodology/Principal Findings
In the capital cities of the CIS and the EU2004 member states, AT physicians holding an academic position at least equivalent to an associate professor and performing the three classical tasks in academic medicine (teaching, research and patient care) were interviewed about their use of and familiarity with the Internet and 9 online literature services, including journals and bibliographical databases such as PubMed (Medline), The Cochrane Library and Web of Science. Library staff members were interviewed about the availability of these online literature services at their libraries. About 750 physicians and 40 library staff members were invited for participation. Eventually 124 AT physicians and 22 library staff members participated. Internet was everywhere available, but used daily by more AT physicians in the EU2004 (71% versus 48% in the CIS, P = .005). AT physicians in the EU2004 accessed a higher percentage of all articles online (74% versus 43% in the CIS, P<.001). PubMed (P<.001), The Cochrane Library (P<.001) and Web of Science (P<.003) were used more frequently in the EU2004. In the EU2004 more AT physicians were familiar with Open Access journals (89% versus 51% in the CIS, P<.001).
Citation: van der Voort CTM, Swenne CA, van der Hoorn-van Velthoven CAM, Belt JHJ (2012) Online Medical Literature Consultation Habits of Academic Teaching Physicians in the EU and CIS Countries: A Cross-Sectional Study. PLoS ONE 7(11): e44302. https://doi.org/10.1371/journal.pone.0044302
Editor: Chris Mavergames, The Cochrane Collaboration, Germany
Received: June 26, 2011; Accepted: August 6, 2012; Published: November 2, 2012
Copyright: © 2012 van der Voort et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors gratefully acknowledge financial support by the Jo Keur Fund, Leiden University Medical Center, as well as by the Faculty of Medicine, Leiden University Medical Center. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The importance of up to date medical scientific literature to improve healthcare, ensure progress in medical sciences and educate the next generation of healthcare workers, has long been established [1]–[8]. It can be said that up to date medical scientific literature should be available to every individual working in the healthcare sector of any country. The Internet, in combination with the digitization of medical scientific literature and the surge of Open Access journals, facilitates this goal greatly [9].
In the early 90's of the last century hardly any online medical literature was used in the Western world. Academic teaching (AT) physicians mainly relied on textbooks, hard copy journals and colleagues as sources of medical information [1]–[4], [10]–[12]. During the second half of the 90's the number of AT physicians using online medical literature rose [12]–[19]. The pace of this transition increased tremendously throughout the first decade of the 21st century [20]–[29]. Nowadays, online medical literature is used at a large scale within the Western world, including the European Union (in the following abbreviated as EU2004, which stands for all member states who joined before May 2004, excluding Luxembourg: Austria, Belgium, Denmark, Finland, France, Germany, Greece, Ireland, Italy, Portugal, Spain, Sweden, The Netherlands and United Kingdom) [29], [30]. In the last 15 years medical libraries in the EU2004 evolved in concordance with the digitization and replaced many of their hard copy journals with online journals [25], [26], [31], [32].
While the Internet facilities of healthcare systems within the member states of the EU2004 developed, the Commonwealth of Independent States (in the following abbreviated as CIS; comprising Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russia, Tajikistan, Ukraine and Uzbekistan) had to deal with the consequences of the partitioning of the Soviet Union. All member states experienced severe economical hardship, which resulted in enormous difficulties in many aspects. In the sphere of medicine these were exaggerated by the oversized and inefficient healthcare systems which the newly independent states inherited from the Soviet Union [33]–[47]. The effect on research is indicated by a lower amount of publications in the CIS [48]–[53]. With far reaching financial constraints in mind, it is reasonable to presume that institutions in the CIS did not improve their Internet facilities at the same rate as in the EU2004. This is indicated by a consistently lower percentage of internet users in CIS countries as opposed to EU2004 countries [54]. Hence the availability of online medical literature is likely to be less. Because of this and an assumed lower proficiency in the English language, one could expect that the use of online medical literature among AT physicians in the CIS is not as integrated into daily practise yet, as among AT physicians in the EU2004. This study assesses if the use and availability of online medical literature among AT physicians in the CIS is at the same level as in the EU2004.
Methods
Ethics Statement
As our study does not regard medical research on humans or animals, but rather is concerned with the logistics of medical literature consultation, it is not subject to the Declaration of Helsinki, and no approval by a medical ethics committee is required.
Sample
We aimed to interview at least five AT physicians in every participating capital city of both the 14 EU2004 and 10 CIS countries. AT physicians were considered eligible for participation if they 1) held an academic position at least equivalent to an associate professor and if they 2) performed the three classical tasks in academic medicine: teaching, research and patient care [55]. In order to be qualified as a researcher they had to be the author of a minimum of 20 scientific publications as well as take part in peer reviewing of medical scientific literature. We focused on this specific subgroup of AT physicians because these are the academic professors training the next generation of medical professionals. Therefore they are likely to have most impact on the future of medical practise in their countries.
Recruitment
From April 2009 till February 2010 the first author visited hospitals, medical faculties and medical libraries in all 24 included capital cities (Amsterdam, Astana, Athens, Baku, Berlin, Bishkek, Brussels, Chisinau, Copenhagen, Dublin, Dushanbe, Helsinki, Kiev, Lisbon, London, Madrid, Minsk, Moscow, Paris, Rome, Stockholm, Tashkent, Vienna and Yerevan) (Table 1). In order to enroll participants the interviewer tried to recruit a contact person in a medical library or at a medical faculty dean's office by e-mail prior to the visit. University hospital websites were scanned for e-mail addresses of AT physicians. These AT physicians were asked if they were or knew an eligible physician who would be willing to participate. If, in spite of these efforts, an insufficient amount of participants was recruited, the first author consulted deans or rectors at the medical faculty, personnel from medical libraries and actual participants for other potential participants during his visit. If this did not result in sufficient participants, more AT physicians were contacted post-hoc by e-mail. The group characteristics of participating AT physicians and librarians are listed in table 2 and 3 respectively. In the capital cities where all participating AT physicians worked at the same institution the library of that institution was selected, unless participants mentioned that another library was more important to them. Whenever participating AT physicians were located at different institutions, one or more libraries were selected based on directions from the contact person or participating AT physicians in that capital. Eventually per capital the most comprehensive library was used for analysis.
Procedure
A questionnaire (in the English or Russian language, whichever the participant preferred) containing 42 questions was presented to every participating physician (see Appendix 1). Answers to the questionnaires were obtained face to face or by correspondence, if the contact was made post-hoc. The questionnaires consisted of a mix of open and closed questions. Questions regarded the languages the participant was able to read and speak, the availability, use and speed of the Internet, the experience with the Internet, the use of online journals, the most frequently read online and hardcopy journals, the percentage of scientific articles read online, the familiarity with the concept of Open Access journals and the familiarity with and the use of certain online literature services, including bibliographical databases and journals (PubMed (Medline), Embase, Web of Science, The Cochrane Library, Public Library of Science (PLoS), BioMedCentral, British Medical Journal, Medscape, and HINARI Programme for Access to Health Research (HINARI)). We focused on these literature services because of their medically relevant content. HINARI was especially included because most CIS countries are eligible to free or affordable access. Participants was given the opportunity to mention others to avoid overlooking relevant online literature services beyond the above mentioned.
As there can be a discrepancy between the actual use and the availability of online literature services, an English or Russian questionnaire was presented to the staff of medical libraries as well (see Appendix 2). This questionnaire contained 38 questions concerning the library's staff members' level of education, the familiarity with and the availability of certain online literature services and their preferences for online literature services.
Statistical analysis
The AT physicians were compared according to the following factors: demographic characteristics, ability to read and speak English and Russian, whether the interview was conducted face to face or by correspondence, the percentage of articles accessed online, how often the participant used online journals, whether the participant was familiar with Open Access journals, where and how often the participant accessed the Internet, how the participant qualified the speed of the Internet, whether the participant considered himself experienced with personal computers and the Internet and whether the participant was familiar with and how often the participant accessed certain online literature services.
The library staff members were compared according to the following factors: demographic characteristics, whether the interview was conducted face to face or by correspondence and which online literature services were available at their institutions.
To compare the EU2004 with the CIS results, chi-square-tests and independent t-tests were conducted. If in a chi-square-test the cell count was less than 5 in at least 20% of the cells, a Mann-Whitney-test was conducted instead. A P-value less than .05 was considered significant.
Results
Demographic characteristics
Of the about 750 physicians and 40 library staff members who were initially invited, 124 AT physicians and 22 library staff members participated in our study (Table 1, 2 and 3). The aim to include at least five AT physicians per capital city was attained in 22 out of the 24 capitals. In Minsk and Paris the minimum requirements were not met, since insufficient AT physicians were available for participation during the first author's visit, and too few AT physicians responded to the request for participation by e-mail. As a consequence, no contributions from Minsk and Paris were incorporated in this study.
The Internet
All AT physicians (100%) had access to the Internet. More AT physicians in the EU2004 (71%) than their counterparts in the CIS (48%) used the Internet on a daily basis (P = .005) and reported to have their own computer at work (96% versus 63%, P<.001). The speed of the Internet was considered to be fast by more AT physicians in the EU2004 (84%) than in the CIS (50%, P<.001). AT physicians in the EU2004 turned out to have more experience with the Internet than their colleagues in the CIS (P<.001). In the EU2004 93% of the AT physicians answered to ‘definitely’ have experience with the Internet, while in the CIS 69% did so (Table 4). AT physicians in the EU2004 used online search engines like Google more often than their colleagues in the CIS (P = .02) (Figure 1).
Dotted line = EU2004, dashed line = CIS. EU2004 N = 70, CIS N = 54. a missing CIS N = 2. b percentage of articles accessed online as part of the articles read, missing CIS N = 1.
Journal readership
AT physicians in the CIS read on average 6.7 articles per week, while AT physicians in the EU2004 read 7.9 articles per week (P = .11) (Table 2). Online journals were consulted significantly less by AT physicians in the CIS compared with AT physicians in the EU2004 (P = .02). The AT physicians in the EU2004 estimated that on average they accessed 74% of all articles online. In the CIS the AT physicians estimated that of the articles read, they accessed 43% online (P<.001) (Figure 1). In the EU2004 56 out of 63 AT physicians (89%) were familiar with Open Access journals, in contrast to 22 out of 43 (51%) AT physicians in the CIS (P<.001).
Participants were asked to list the 4 journals they read online most. In the CIS 11 AT physicians (20%) stated not to read journals online. In the EU2004 6 AT physicians (9%) did not read journals online (P = .06). Among the AT physicians who read online journals, in the CIS 23 AT physicians (54%) listed journals published in English only, while 10 (23%) listed both English and Russian journals. Of the CIS AT physicians 10 (23%) exclusively listed journals published in Russian. Of the 63 AT physicians in the EU2004 who read online journals, all (100%) listed journals published in English (Figure 2).
Inner circle = CIS (N = 54), outer circle = EU2004 (N = 69).
In the CIS 4 AT physicians (7%) did not read hardcopy journals. In the EU2004 12 AT physicians (18%) did not (P = .1). From the AT physicians who did read hardcopy journals, one physician (2%) in the CIS exclusively read journals in a language other than English or Russian. In the EU2004 4 AT physicians (7%) exclusively read hardcopy journals in a language other than English or Russian. However both in the CIS and in the EU2004 these participants read English journals online. All of the other hardcopy journal reading physician (N = 63, 93%) in the EU2004 read journals published in English. In the CIS 8 (16%) exclusively listed journals published in English, while 19 (38%) mentioned both English and Russian jourals and 22 (44%) solely read Russian hardcopy journals (Figure 3).
Inner circle = CIS (N = 54), outer circle = EU2004 (N = 69).
Online literature services
In the EU2004 AT physicians were more familiar with certain online literature services (bibliographical databases and journals) than in the CIS (90% versus 72%, P = .01) (Table 4). A higher percentage of AT physicians in the EU2004 than in the CIS was familiar with PubMed, which lists Russian as well as English articles (100% versus 89%, P = .004). A higher percentage of AT physicians in the EU2004 was aware of The Cochrane Library (99% versus 57%, P<.001), PLoS (69% versus 46%, P = .01), Web of Science (77% versus 37%, P<.001) and EMBASE (70% versus 24%, P<.001) as well.
According to library staff members availability of online literature services widely varied. They were all aware that PubMed is freely accessible on the Internet. HINARI, an initiative of the World Health Organization aiming to make medical scientific journals available to health care workers in countries with a gross national income below 3500$ per capita [56] was only available at 2 out of 8 eligible CIS' libraries (25%). Web of Science was available at all of the 13 libraries in the EU2004 (100%), but at none of the libraries in the CIS (0%) (P<.001). The Cochrane Library (92% versus 33%, P = .004) and Embase (69% versus 0%, P = .002) were more available in the EU2004 as well. Despite it being a freely accessible service, Medscape was acknowledged to be available at 3 (33%) of the CIS' and none (0%) of the EU2004 libraries (P = .03) (Table 5 and 6) [57]. British Medical Journal provides free access to its articles to all CIS countries but Russia [58]. In 5 out of 8 (63%) eligible CIS libraries this was acknowledged (Table 5 and 6). PLoS and BioMedCentral, both exclusively providing freely accessible Open Access journals, were acknowledged to be available in 2 out of 9 (22%) libraries in the CIS. In the EU2004 respectively 69% and 77% of librarians acknowledged PLoS and BioMedCentral to be available (Table 5 and 6).
The library staff members were asked to choose their favourite literature service out of a list of 9 online literature services. From them 18 out of 22 (83%) preferred PubMed, stating that it was free and easy to use. PubMed (P<.001) and The Cochrane Library (P<.001) were used more often in the EU2004 than in the CIS. HINARI was the least known online literature service and used hardly ever by AT physicians in the CIS, that would qualify for this service (Figure 4).
Dotted line = EU2004, dashed line = CIS. EU2004 N = 70, CIS N = 54. a British Medical Journal, b Public Library of Science, c missing CIS N = 1, d Excerpta Medica Database, e World Health Organisation Program for Access to Health Research.
To assure that no frequently used online literature service was left out by our questionnaire all AT physicians were asked which services they used besides these 9. No other online literature services turned out to be of significance to the participants. Some Russian services were mentioned, but in all cases they were specialism specific and mentioned by one participant only.
Discussion
Main results
Every participant had access to the Internet. However, in the EU2004 the Internet is faster, used more frequently and a higher percentage of articles is accessed online (Figure 1, Table 4). This could be partly ascribed to the fact that in the CIS fewer AT physicians have their own computer at work (Table 4). Moreover, less online literature services are available for AT physicians in the CIS (Table 5 and 6). Hence, AT physicians in the CIS are less familiar with, and use more occasionally, online literature services than their colleagues in the EU2004 (Table 6, Figure 4). This is reflected by a lower readership of online journals among AT physicians in the CIS (Figure 1), despite a similar amount of articles read per week (Table 2). Both in the EU2004 and in the CIS online journals were mostly read in English, although 23% of AT physicians mentioned to read online Russian journals exclusively (Figure 2). The preferred language of hardcopy journals among AT physicians in the CIS was Russian, with only 16% mentioning English language journals exclusively (Figure 3).
Comparison with prior work
In the EU2004, the most often used online literature services are the databases: PubMed, which is ubiquitously available, The Cochrane Library, available in 12 out of 13 libraries, and Web of Science, which is available in all of the EU2004' libraries (Figure 4, Table 5 and 6). These figures are consistent with existing evidence from Cullen and Hider in New Zealand and Schilling in Colorado, who found PubMed to be the online literature service most often used. Cullen mentioned The Cochrane Library to rank third [20], [29], [59]. In the CIS, PubMed is followed by the online platform of the British Medical Journal, where this publisher made its journal freely available and which is reported to be available in 6 out of 9 medical libraries, and by Medscape, an information portal which is reported to be available in 3 out of 9 CIS' libraries (Figure 4, Table 5 and 6).
The lack of available online literature services in the CIS can partly be accredited to the lack of financial means. This is illustrated by above mentioned top 3's of online literature service usage. The one's which are used in the CIS, namely PubMed, the British Medical Journal and Medscape, can be used for free in these countries. In contrast, apart from PubMed, AT physicians in the EU2004 resort to paid services like the Cochrane Library and Web of Science (Figure 4). Interestingly Medscape was thought to be available only at 3 out of 9 CIS libraries and none of the 13 EU2004 libraries. Apparently institutions in the EU2004 do not pay attention to this free online literature service.
Based on the fact that only 2 (22%) of the libraries in the CIS recognized Open Access journal providers PLoS and BioMedCentral to be accessible, unawareness among library staff members of freely accessible online information sources appears to be an important factor as well. Yet, approximately half of the AT physicians in the CIS were familiar with these 2 services (Table 6). It seems that in some cases AT physicians are able to reach freely accessible online literature services better than library staff members. While the need for freely accessible online literature services is actually more profound in the CIS, AT physicians in the EU2004 are more familiar with the concept of Open Access Journals. In this same aspect it is remarkable that HINARI was only available at 2 out of 8 eligible CIS' libraries and hardly recognized by AT physicians in the CIS (Table 6).
Limitations
This study only focused on physicians in capital cities who 1) held an academic degree at least equivalent to associate professor, and 2) performed the three classical tasks in academic medicine: teaching, research and patient care. Hence this study can not be extrapolated to the majority of physicians practising in the CIS and the EU2004. The fact that only AT physicians working at institutions in capital cities were invited for participation may have influenced our results. It may be presumed that in the CIS funds are more likely to be invested in the capital cities [33]–[47]. Therefore the situation as outlined here, might be the best case scenario for many of the participating members of the CIS. As the participating physicians in the academic hospitals are teaching the next generation of physicians they are a very relevant group to focus on.
The results of this research project may have been influenced by several confounders. More active or better English speaking AT physicians may have been recommended by their colleagues, library staff members and deans more often, and may have been more willing to participate. AT physicians with a more active attitude or who have better English skills are more likely to use online literature services more frequently. This could have caused a selection bias. However, more active AT physicians may have had a tight time-schedule and therefore might have been less willing to participate. Participants may have been inclined to give more favourable answers, which could have influenced the outcome. The questionnaires were not validated. However, we have no reason to assume that the above mentioned confounders influenced a particular region more than the other.
Conclusions
The use of online medical literature (bibliographic databases, full text) is lower among AT physicians in the CIS compared to AT physicians in the EU2004. AT physicians in the EU2004 access a higher percentage of articles online, they use the Internet more frequently and they are more familiar with certain online literature services, including freely accessible ones such as Open Access journals. It is recommended that in the CIS internet facilities within medical institutions are improved, as well as the awareness and provision of services available at the medical libraries. Particularly awareness of freely available online bibliographic databases should be enhanced, especially, and in the case of HINARI exclusively, among AT physicians and library staff members in the CIS.
Acknowledgments
The authors would like to thank:
Ms. A. Davidyuk for translating the questionnaires into Russian.
Mr. G. Ocak for his expertise on statistical procedures.
Mr. J.W. Schoones for his advice on literature searching.
All participants and those who helped to find a sufficient number of participants.
EU: Members joined before May 2004 (excluding Luxembourg): Austria, Belgium, Denmark, Finland, France, Germany, Greece, Ireland, Italy, Portugal, Spain, Sweden, The Netherlands and United Kingdom
CIS: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russia, Tajikistan, Ukraine and Uzbekistan
Author Contributions
Conceived and designed the experiments: CAS CAMV JHJB CTMV. Performed the experiments: CTMV. Analyzed the data: CTMV. Wrote the paper: CTMV CAS CAMV JHJB.
References
- 1. Verhoeven AA, Boerma EJ, Meyboom-de Jong B (1995) Use of information sources by family physicians: a literature survey. Bull Med Libr Assoc 83 (1) 85–90 [Medline].
- 2. Smith R (1996) What clinical information do doctors need? BMJ 313 (7064) 1062–1068 [Medline].
- 3. Haug JD (1997) Physicians' preferences for information sources: a meta-analytic study. Bull Med Libr Assoc 85 (3) 223–32 [Medline].
- 4. Timpka T, Ekström M, Bjurulf P (1989) Information needs and information seeking behaviour in primary health care. Scand J Prim Health Care 7 (2) 105–109 [Medline].
- 5. Covell DG, Uman GC, Manning PR (1985) Information needs in office practice: are they being met? Ann Intern Med 103 (4) 596–599 [Medline].
- 6. Guindon GE, Lavis JN, Becerra-Posada F, Malek-Afzali H, Shi G, et al. (2010) Bridging the gaps between research, policy and practice in low- and middle-income countries: a survey of health care providers. CMAJ 182 (9) 350–61 [Medline].
- 7. Syed SB, Hyder AA, Bloom G, Sundaram S, Bhuiya A, et al. (2008) Exploring evidence-policy linkages in health research plans: A case study from six countries. Health Res Policy Syst 6: 4 [Medline].
- 8. Tugwell P, Sitthi-Amorn C, Hatcher-Roberts J, Neufeld V, Makara P, et al. (2006) Health Research Profile to assess the capacity of low and middle income countries for equity-oriented research. BMC Public Health 6: 151 [Medline].
- 9.
Annan KA (2000) We, the Peoples. New York: United Nations. 80 p.
- 10. Coumou HC, Meijman FJ (2006) How do primary care physicians seek answers to clinical questions? J Med Libr Assoc 94 (1) 55–60 [Medline].
- 11. Gruppen LD (1990) Physician information seeking: improving relevance through research. Bull Med Libr Assoc 78 (2) 165–172 [Medline].
- 12. Gorman PN, Ash J, Wykoff L (1994) Can primary care physicians' questions be answered using the medical journal literature? Bull Med Libr Assoc 82 (2) 140–146 [Medline].
- 13.
Owens I, Tomlin A (1998) PRISE Project Final Report. Oxford: Health Care Libraries Unit, Oxford Radcliffe Hospital; 1998.
- 14. Roscoe T (1998) Two surveys of Internet use in primary care. Health Info Internet 3: 2–3.
- 15. Roscoe T (2000) Primary Care information management: 5 years of progress 1995–2000. A personal view. Health Libr Rev 17 (4) 225–228 [Medline].
- 16. Moffat MO, Moffat KJ, Cano V (2001) General practitioners and the Internet - a questionnaire survey of Internet connectivity and use in Lothian. Health Bull (Edinb) 59 (2) 120–126 [Medline].
- 17. Davies K (2007) The information-seeking behaviour of doctors: a review of the evidence. Health Info Libr J 24 (2) 78–94 [Medline].
- 18. Wood FB, Wallingford KT, Siegel ER (1997) Transitioning to the Internet: results of a National Library of Medicine user survey. Bull Med Libr Assoc 85 (4) 331–340 [Medline].
- 19. Curtis KL, Weller AC, Hurd JM (1997) Information-seeking behavior of health sciences faculty: the impact of new information technologies. Bull Med Libr Assoc 85 (4) 402–410 [Medline].
- 20. Schilling LM, Steiner JF, Lundahl K, Anderson RJ (2005) Residents' patient-specific clinical questions: opportunities for evidence-based learning. Acad Med 80 (1) 51–56 [Medline].
- 21. Bennett NL, Casebeer LL, Kristofco RE, Strasser SM (2004) Physicians' Internet information-seeking behaviors. J Contin Educ Health Prof 24 (1) 31–38 [Medline].
- 22. Wilson P, Glanville J, Watt I (2003) Access to the online evidence base in general practice: a survey of the Northern and Yorkshire Region. Health Info Libr J 20 (3) 172–178 [Medline].
- 23. Lombardo SV, Condic KS (2001) Convenience or content: a study of undergraduate periodical use. Ref Serv Rev 29 (4) 327–338 .
- 24. Casebeer L, Bennett N, Kristofco R, Carillo , Centor R (2002) Physician Internet medical information seeking and on-line continuing education use patterns. J Contin Educ Health Prof 22 (1) 33–42 [Medline].
- 25. Shearer BS, Klatt C, Nagy SP (2009) Development of a new academic digital library: a study of usage data of a core medical electronic journal collection. J Med Libr Assoc 97 (2) 93–101 [Medline].
- 26. Wulff JL, Nixon ND (2004) Quality markers and use of electronic journal in an academic health sciences library. J Med Libr Assoc 92 (3) 315–322 [Medline].
- 27. Veness M, Rikard-Bell G, Ward J (2003) Views of Australian and New Zealand radiation oncologists and registrars about evidence-based medicine and their access to Internet-based sources of evidence. Australas Radiol 47 (4) 409–415 [Medline].
- 28. Wong K, Veness MJ (2005) Internet access, awareness and utilization of web-based evidence: a survey of Australian, New Zealand and Singaporean radiation oncology registrars. Asia Pac J Clin Oncol 1: 120–127 .
- 29. Hider PN, Griffin G, Walker M, Coughlan E (2009) The information-seeking behavior of clinical staff in a large health care organization. J Med Libr Assoc 97 (1) 47–50 [Medline].
- 30. Knowlton SA (2007) Continuing use of print-only information by researchers. J Med Libr Assoc 95 (1) 81–88 [Medline].
- 31.
NHS Executive (1998) Information for Health: an Information Strategy for the Modern NHS 1998–2005. Leeds: NHS Executive. 12 p.
- 32. Pearson D, Rossall H (2001) Developing a general practice library: a collaborative project between a GP and librarian. Health Info Libr J 18 (4) 192–202 [Medline].
- 33.
McKee M, Healy J, Falkingham J (2000) Health care in central Asia. Buckingham: World Health Organization. 239 p.
- 34.
Jakubowski E, Arnaudova A (2009) 10 health questions about the Caucasus and central Asia. Copenhagen: World Health Organization. 193 p.
- 35.
Health and Economic Development in South-Eastern Europe (2006) Paris: World Health Organization. 145 p.
- 36.
Ziglio E, Barbosa R, Charpak Y, Turner S (2003) Health systems confront poverty. Copenhagen: World Health Organization. 182 p.
- 37. Mikheev M, Shlyakhetsky N, Retnev V (2002) Occupational health in the Russian Federation. Occup Med 17 (3) 469–478 [Medline].
- 38.
Tragakes E, Lessof S (2003) Health care systems in transition: Russian Federation. Copenhagen: European Observatory on Health Systems and Policies. 212 p.
- 39.
Ahmedov M, Azimov R, Alimova V, Rechel B (2007) Uzbekistan: Health system review. Health Systems in Transition. Copenhagen: European Observatory on Health Systems and Policies. 210 p.
- 40.
Kulzhanov M, Rechel B (2007) Kazakhstan: Health system review. Health Systems in Transition. Copenhagen: European Observatory on Health Systems and Policies. 179 p.
- 41.
Rahminov R, Gedik G, Healy J (2000) Tajikistan: Health system review. Health systems in Transition. Copenhagen: European Observatory on Health Systems and Policies. 78 p.
- 42.
Meimanaliev A-S, Ibraimova A, Elebesov B, Rechel B (2005) Health care systems in transition: Kyrgyzstan. Copenhagen: European Observatory on Health Systems and Policies. 125 p.
- 43.
Lekhan V, Rudiy V, Nolte E (2004) Health care systems in transition: Ukraine. Copenhagen: European Observatory on Health Systems and Policies. 138 p.
- 44.
Richardson E, Boerma W, Malakhova I, Rusovich V, Fomenko A (2008) Belarus: Health system review. Health Systems in Transition. Copenhagen: European Observatory on Health Systems and Policies. 141 p.
- 45.
Atun R, Richardson E, Shishkin S, Kacevicius G, Ciocanu M (2008) Moldova: Health system review. Health Systems in Transition. Copenhagen: European Observatory on Health Systems and Policies. 163 p.
- 46.
Holley J, Akhundov O, Nolte E (2004) Health care systems in transition: Azerbaijan. Copenhagen: European Observatory on Health Systems and Policies. 84 p.
- 47.
Hakobyan T, Nazaretyan M, Makarova T, Aristakesyan M, Margaryants H (2006) Armenia: Health system review. Health Systems in Transition. Copenhagen: European Observatory on Health Systems and Policies. 202 p.
- 48. King DA (2004) The scientific impact of nations. Nature 430 (6997) 311–316 [Medline].
- 49. Rahman M, Fukui T (2003) Biomedical publication-global profile and trend. Public Health 117 (4) 274–280 [Medline].
- 50.
Adams J, King C (2010) Russia: Research and collaboration in the new geography of science. Leeds: Evidence. 12 p.
- 51. Kolbitsch C, Balogh D, Hauffe H, Löckinger A, Benzer A (1999) National publication output in medical research. Anästhesiol Intensivmed Notfallmed Schmerzther 34 (4) 214–217 [Medline].
- 52. Feigel'man M (2007) Save Russian science. Nature Physics 3: 138–139 .
- 53. Sobolev A, Severinov K, Kovalchuk M (2007) Russian science: what the scientists say. Nature 449 (7162) 528–530 [Medline].
- 54.
Gapminder World (2011) Internet users (per 100 people) in 24 countries. Available: www.bit.ly/oSaTZM.
- 55.
Wikipedia contributors. List of academic ranks. Available: http://en.wikipedia.org/wiki/List_of_academic_ranks. Archived at: http://www.webcitation.org/5tBHJXlxx
- 56.
World Health Organization. About HINARI. Available: http://www.who.int/hinari/about/en/. Archived at: http://www.webcitation.org/5tBGNjDuj
- 57.
Medscape. About Medscape from WebMD. Available: http://www.medscape.com/public/about. Archived at: http://www.webcitation.org/65mlPL6FI
- 58.
British Medical Journal Group. Countries with free access. Available: http://group.bmj.com/products/journals/countries-with-free-access. Archived at: http://www.webcitation.org/65mlpgBFz
- 59. Cullen RJ (2002) In search of evidence: family practitioners' use of the Internet for clinical information. J Med Libr Assoc 90 (4) 370–379 [Medline].