Investigating the Presence of Highly Cited Articles on Chronic Diseases in Scientific Social Network: Altmetrics Study

authors:

avatar Mohammad Esmaeilpour Bandboni ORCID 1 , avatar Fatemeh Ramezani-Pakpour-Langeroudi ORCID 2 , avatar SeyyedHamidReza FallahMortezaNejad ORCID 3 , avatar Aboozar Ramezani ORCID 4 , *

Guilan University of Medical Sciences, Rasht, Iran
Midwifery and Paramedicine, School of Nursing, Guilan University of Medical Sciences, Rasht, Iran
Student Research Committee, School of Paramedicine, Guilan University of Medical Sciences, Rasht, Iran
Department of Medical Library and Information, Students’ Scientific Research Center, Virtual School, Tehran University of Medical Sciences, Tehran, Iran

how to cite: Esmaeilpour Bandboni M, Ramezani-Pakpour-Langeroudi F , FallahMortezaNejad S, Ramezani A. Investigating the Presence of Highly Cited Articles on Chronic Diseases in Scientific Social Network: Altmetrics Study. Jundishapur J Chronic Dis Care. 2019;8(3):e90837. https://doi.org/10.5812/jjcdc.90837.

Abstract

Background:

The Clarivate Analytics Company defined the highly cited papers used to measure scientific performance. Altmetrics is a new indicator for evaluation of academic research, which evaluates the findings of research published on social networks.

Objectives:

This study aimed at evaluating the Altmetrics indicators of highly cited articles on chronic diseases in the two social networks of ResearchGate and Mendeley.

Methods:

This descriptive-cross sectional study was carried out using the scientometric method. The research data were collected during October 2018 by using Excel 2013 software. HistCiteTM and VOSviewer were used as scientometric software. Data were analyzed using SPSS version 19 through non-parametric statistical tests, such as Spearman and chi-square tests. The significance level was P < 0.05.

Results:

According to the findings, the coverage rate of highly cited articles on chronic diseases on ResearchGate is about 96.5%, which is better than Mendeley with 92.4%. There was a significant relationship between citation with presence in social networks of research gate and Mendeley (P < 0.05). Each paper indexed in ResearchGate has been read on average by 318.73 individuals. In comparison with that, every paper in Mendeley has been read by 185.76 people, respectively. There was a positive correlation between the number of citations in the Web of Science and “Read” rate of the papers in ResearchGate (0.207) and Mendeley (0.343) (P < 0.05).

Conclusions:

Altmetric indicators evaluated activities in social media space. Increasing the presence of chronic diseases papers in social networks can actively influence dissemination of knowledge.

1. Background

Long life is one of the achievements of the twenty-first century (1), and researchers and doctors can help improve the quality of life of the elderly with a global understanding of chronic diseases (2); by increasing life expectancy and elderly age, more people will experience chronic diseases. The European cardiovascular disease report shows that chronic illness causes 80% of all deaths (1). Chronic disease is a long-term disease that causes physical changes in the body and by limiting the function of the patient’s body, prolongs the course of treatment and makes it difficult to recover (1). If chronic disease is not controlled, it may lead to sleep disturbances, malnutrition, physical impairment, decreased function, cognitive impairment, decreased self-esteem, and increased stress with depression and anxiety (2). Controlling chronic diseases reduces social and economic costs, also, global evidence suggests that one of the highest costs in the community is to control chronic diseases. By controlling smoking, healthy diet, physical activity, and control of alcohol consumption, one can be safe against many chronic diseases (3). Chronic diseases are becoming more and more important day by day, and nowadays not only in developed countries, yet also in many developing countries, chronic diseases account for a huge part of health problems (4).

According World Health Report 2002, mortality, morbidity, and disability caused by major chronic diseases are almost 60% of all deaths and 43% of the global burden of disease. By 2020, their contributions is expected to rise to 73% of all deaths and 60% of the global burden of disease, respectively. Most of these deaths (79%) occur in developing countries. Four major chronic diseases, including cardiovascular diseases (CVD), cancer, chronic obstructive pulmonary disease (COPD), and type 2 diabetes, are related to preventable biological risk factors, such as high blood pressure, high blood cholesterol and overweight, unhealthy diet, physical inactivity, and smoking. To decrease the rate of major chronic diseases, these risk factors should be managed through integrate primary, secondary, and tertiary prevention approaches (5).

What the modern knowledge should pay attention to is not just prolonging life, yet it should be noted that the extra years of human life ultimately lead to calmness, and physical and mental health; and if such a situation is not met, scientific advances will be fruitless and dangerous for providing a long life (6). Hence, researchers and doctors will help improve quality of life through a comprehensive understanding of chronic diseases (2). People also get their health and medical information from a variety of sources, including doctors, nurses, family, colleagues, TVs, radios, newspapers, magazines, and the Internet (7). Nowadays, social networks are also considered to be important sources of medical information by many researchers. Furthermore, social networks have a positive impact on those, who are involved in health care careers (8).

Today, social networks are the easiest way to share articles, among millions of people around the world for free. Social networks provide a new space for communication between researchers and are the main tools for promoting knowledge (9). Application of these networks among scientific communities has increased, and some of these networks, such as ResearchGate and Mendeley, are widely used as tools for disseminating research results and sharing knowledge in various medical areas (9-11). Using the features of each of these social networks, the real-time impact of scientific works can be viewed, unlike citation impact that requires a lot of time to be calculated (12).

These papers are known as core works and are of high quality in the scientific field. Since 2010, a new level of article metrics has been introduced for the purpose of evaluating articles, known as altmetrics or article level metrics, which evaluates the impact of an article not only within the scope of articles published in scientific journals and conferences, yet also in a wide range of sources, regardless of the format of the publication. altmetrics do not merely consider citations, yet they include other impact factors, such as downloads, viewing articles, and mentioning in social media and news media. Contrary to the citation metrics, which are quite slow and time-consuming, altmetrics can evaluate scientific generations in a short period of time. Moreover, many scientific generations that are published outside the journals on the web can be evaluated via altmetrics (13). Social networks are one of the areas where the information on altmetrics can be extracted.

ResearchGate (RG) is a social network for researchers; ResearchGate social network is created for communication among researchers and facilitates sharing and access to scientific outputs, knowledge, and expertise. Over 80 million articles, nine million researchers, and one million answers to research questions and what is needed to advance research can be found in ResearchGate. Another feature of this network is RG score, which is dedicated to network members. This score makes the interaction between researchers evaluable and observable, which is an important issue in the research process (14). Calculation of RG score is based on four factors: (1) number of shared works, (2) investigator’s activity in asking questions, (3) answers to questions, and (4) followers (15).

Mendeley social network was published in 2007 and has provided a comprehensive tool for researchers through a combination of academic social networking and resource management tools (16). Mendeley is also a free citation management software that has many capabilities for managing, storing, citing, and sharing research works. Storage of scientific works in Mendeley is entitled as “Read” (17). The advantage that distinguishes Mendeley from other similar products is the ability to share research with other academic users. Mendeley provides the potential for both groups of students to save time and minimize rework, and thus, increase productivity and outcome of their works (18).

Various studies have been conducted on investigating the presence of researchers and their scientific generations in social networks (19-21), as well as sharing information and full text of articles in social networks (22-26) in Iran and all around the world; however, the importance of availability of highly cited articles on chronic diseases in social networks and their relationship with the amount of citations to scientific works has not been studied. The highly cited papers well-defined by Clarivate Analytics’ essential science indicators (ESI) have been widely used to measure the scientific performance of universities, scientists, research institutions, and countries. Clarivate Analytics Company sorts highly cited papers in 22 fields every ten years based on the highest impact. Finally, one percent of the top papers in each of the research areas are selected and presented as highly cited articles.

2. Objectives

The present research aimed at identifying the role of social networks, such as ResearchGate and Mendeley, in promoting the results of scientific research and their impacts on citation and scientific behaviors of researchers in the future. Therefore, investigation of the presence of articles in scientific social networks can be a starting point for introducing more and more of the capabilities of these networks and the impact that they will have on the visibility of the works and, consequently, on the increase of their citation. Given the new emergence of social networking topic in the scientific community, findings of this study can be helpful for researchers in this field and can complement the results of previous researches on the role and potential of scientific social network as a tool of information and communication media.

3. Methods

This was a descriptive-cross sectional study conducted using altmetrics and citation analysis. Table 1 indicates the social networking sites and the indicators assessed (Table 1). The Web of Science (WoS) database was used to extract highly cited papers and citations of each paper. This database is one of the largest databases with highly valid internationally-published articles, including thousands of sources of journals, patents, biology literatures from web resources, and other scientific resources, as well as search citations and display of highly cited articles. All the highly cited papers on chronic diseases in different languages published during the past ten years were searched via strategy published by the Peykari on the 14th of October 2018 (4).

The research population consists of 12457 papers in the field of chronic disease from 2008 to October 2018, and since the sample is highly cited papers, only 171 papers were extracted as highly cited papers. The information on each paper includes the title of the paper, year of the publication, the number of pages, type of publication, access to the paper, and the number of citations received in the form of an Excel file to be analyzed in the final stage.

Then, a map of the history of scientific production in this field and its growth and development were analyzed using VOSviewer, HistCiteTM, and descriptive statistics software of MS Excel. Data collection was analyzed by SPSS version 19, and the nonparametric Spearman and chi-square tests were used. In all testing, P value at the level of P < 0.05 was considered significant.

Table 1.

The Social Networks and the Indicators

Web PresentThe Indicator Used
WoSURL citations, citation, H-index, type of access, year of published
MendeleyURL citations, citations, readers
ResearchGateURL citation, RG score, publications, reads, citations, profile views

4. Results

The study indicates that there are 171 highly cited papers on chronic diseases by 2018 at WoS. Overall, 1440 authors contributed to the publication of these articles. Figure 1 is a visualization of their collaboration status. One hundred percent of the articles were published in English. The United States, United Kingdom, and Canada were ranked 62.6%, 20.5%, and 13.5%, respectively, in the highly cited papers. J Reedy with five papers, and Hansson GK and Libby P each with 1732 citations were the most prolific writer and most prestigious scholars in the field, respectively. These papers were published in 111 journals, with Lancet journal with 11 articles having the largest share of publication in this field. Harvard University with 20 papers is one of the most prominent pioneers in this field with the more frequent publication on chronic diseases in 2015. The published papers include 102 original research papers (59.46%), 60 review papers (35.08%), and nine (5.26%) papers on other types. By mapping chronic disease was shown; the trends in chronic disease research published in the web of science revealed that the first article was published 10 years prior to 2018 (Figure 1).

Visualization of bibliographic in 171 highly cited papers on chronic diseases by 2018 at WoS (colors are attributed to nodes by VOSviewer to highlight clusters)
Visualization of bibliographic in 171 highly cited papers on chronic diseases by 2018 at WoS (colors are attributed to nodes by VOSviewer to highlight clusters)

During the last 10 years, keywords were extracted from the publications, and clustered analysis tended to focus on people with cardiovascular disease, type-2 diabetes mellitus, blood pressure, and hypertension. Overall 165 highly cited papers (96.5%) were uploaded in ResearchGate and according to the findings of this study, six subjects (3.5%) were not found in ResearchGate. Read metric of papers in ResearchGate ranged from 0 to 4215, and the total number of papers was 54503 times with an average score of 318.73 ± 565.6. Generally, papers had 942 followers, and each paper had 5.51 ± 7.07 followers on average. Papers were published with 41 recommendations and each paper had 0.24 ± 0.61 recommendations on average. Overall, 158 (92.4%) papers were uploaded in Mendeley. Papers were read 31765 times and their “Read” ranged from 0 to 1400, which was lower than ResearchGate. In other words, each paper was read 185.76 ± 228.83 times on average (Table 2).

Table 2.

The Presence of Highly-Cited Chronic Diseases in Social Networks

ProfileFrequency, No. (%)
Mendeley (URL citation)158 (96.5)
ResearchGate (URL citation)165 (92.4)

The coverage rate of papers on the social network of ResearchGate was about 96.5%, which is better than Mendeley with 92.4%. Overall, 96% of papers were indexed in Research Gate and 94% of the indexed articles in Mendeley were read at least once (non-zero occurrence). Each paper indexed in ResearchGate has been read on average by 318.73 people. In comparison with that, every paper in Mendeley was read by 185.76 people (Table 3).

Table 3.

Mean and Standard Deviation of Indicators in Each Social Networking Site

Citation Database and Social Networks, IndicatorsMean ± SD
WoS
Citation213.74 ± 239.719
Pages of paper16 ± 10.83
ResearchGate
Citation231.17 ± 267.7
Followers5.51 ± 7.07
Reads318.73 ± 565.6
Recommendations0.24 ± 0.61
Views0.272 ± 0.904
Mendeley
Citations210.78 ± 267-96
Readers185.76 ± 228.83

Statistical analysis showed that there is a correlation of 0.207 between the amount of citation in the Web of Science and “Read” rate of the papers in ResearchGate (P < 0.05). No correlation was found between the amount of citation in the Web of Science and the rate of recommendations and followers of papers in ResearchGate (P < 0.05). There was a correlation of 0.343 between the number of citations in the Web of Science and “Read” rate of the papers in Mendeley (0.343) (P < 0.05). In both networks, the difference in mean citations between the two groups was measured by the t-test and no significant difference was observed (P < 0.01).

5. Discussion

These results provide some insights into the research articles in chronic diseases and similarly others studies (7, 8). The findings indicated that 171 papers in the field of chronic diseases are indexed in the Web of Science. There was an irregular growth in this field in the Web of Science and the highest number of publications was during 2015. However, the results of other studies also indicate an upward growth in the scientific generations of medical researchers in the recent years (1, 27).

The United States, Britain, and Canada have the largest share of papers in this area, respectively. On the other hand, Iran was ranked 28th in this field. The findings showed that “Lancet” has the highest number of papers in this field with 11 papers. Most of the works reviewed in the field of “chronic diseases” were original research papers. The results of review of the scientific generations of Iran University of Medical Sciences indicated that 63.2% of the papers were research papers. Meeting abstract and letter were ranked second and third, respectively (28). Overall, 74.6% of scientific generations of Shahrekord University of Medical Sciences were research papers (29). On the other hand, 72.4% of the scientific generations of researchers at Scopus citation base were research papers (20). In this way, it can be inferred that most scientific generations in the field of medical sciences are mostly oriented towards original studies.

According to the findings of this study, there were 165 highly cited papers in ResearchGate (96.5%). On the other hand, there were 158 highly cited papers (92.4%) in Mendeley. ResearchGate is one of the most popular academic social networks and has been the most used among scholars to carry out academic activities as a bridge between social media and scientific publications with the aim of making scientific researchers more visible on the web and to increase access to scientific publications. The results of this study are consistent with the reported results of Asnafi et al. and Ramezani-Pakpour-Langeroudi et al. regarding the presence of academic researchers in ResearchGate social network (24, 30). The findings of the above-mentioned study indicated that ResearchGate has the greatest use among scholars to carry out academic activities, while Haustein et al. indicated that the number of users is low in ResearchGate, so that only 21% of users used ResearchGate to share their scientific results and interact with other researchers (31).

Mendeley with 158 highly cited papers (92.4%) had the second rank, which is consistent with the reported results of Mas-Belda et al. (32). Their study also found that Mendeley was not widely known among cited scholars of European Institutions as a social network. These findings are consistent with the reported results of Thelwall and Wilson, Maflahi and Thelwall, and Li et al. In their studies, they compared the number of readers of papers in scientific journals (25, 33, 34). The results of the present study are consistent with the studies of Erfanmanesh, Ebrahimi et al., and Zahedi on the number of research papers in Mendeley in Iran. The results of their studies indicated that the number of times a paper was read by Mendeley could have the potential to measure the impact of scientific papers (17, 35, 36).

In the present study, there was a significant relationship between the citation rate of the Web of Science and the social network metrics of ResearchGate (number of citations and number of Reads). In other words, there was a positive relationship between the number of Reads and number of citations of this social network with the number of citations in Web of Science (P < 0.05), which is consistent with the reported results of Asnafi and Pakdaman, and Ramezani Pakpour et al. Moreover, there was a significant statistical relationship between the number of citations in Web of Science and metrics of Mendeley social network (number of citations and number of Reads). In other words, there was a positive relationship between the number of Reads and number of citations of this network with the number of citations in Web of Science (P < 0.05), which is consistent with the reported results of Thelwall and Wilson, Maflahi and Thelwall, Li et al., Erfanmanesh et al., and Ebrahimi et al. (25, 33, 35, 36).

5.1. Conclusions

Altmetric indicators can be used as complementary to other scientometric indicators for examining the impact of scientific productions, the performance of researchers and their visibility, and also can be predictive of citations that may receive articles in the future. Presence in scientific networks represents a culture of information sharing among researchers, which leads to collaboration in the production of knowledge. Researchers in the field of “chronic diseases”, sharing research findings in social networks, can contribute in increasing the citation rate to the papers, and to increase the scientific communication with other researchers. Therefore, it can be concluded that the more frequent the reading of articles on these two social networks, the more frequent citations of articles on the Web of Science were higher.

5.2. Limitations

Using Web of Science alone was a limitation and it is possible that some publications were missed. Nevertheless, key chronic disease journals do feature in the findings along with those from other disciplines available in the public domain. Also, the interpretation of highly cited papers, from cluster analysis of frequently occurring keywords and authorship in countries and universities, are limited because the interpretation of each cluster is not standardized and therefore prone to subjectivity.

References

  • 1.

    Lu Y, Li Z, Arthur D. Mapping publication status and exploring hotspots in a research field: Chronic disease self-management. J Adv Nurs. 2014;70(8):1837-44. [PubMed ID: 24438056]. https://doi.org/10.1111/jan.12344.

  • 2.

    Gold DT, Roberto KA. Correlates and consequences of chronic pain in older adults. Geriatr Nurs. 2000;21(5):270-3. [PubMed ID: 11035311]. https://doi.org/10.1067/mgn.2000.110838.

  • 3.

    Jones AC, Geneau R. Assessing research activity on priority interventions for non-communicable disease prevention in low- and middle-income countries: A bibliometric analysis. Glob Health Action. 2012;5:1-13. [PubMed ID: 22944364]. [PubMed Central ID: PMC3427597]. https://doi.org/10.3402/gha.v5i0.18847.

  • 4.

    Peykari N, Hashemi H, Asghari G, Ayazi M, Janbabaei G, Malekzadeh R, et al. Scientometric study on non-communicable diseases in Iran: A review article. Iran J Public Health. 2018;47(7):936-43. [PubMed ID: 30181990]. [PubMed Central ID: PMC6119576].

  • 5.

    World Health Organization. Integrated chronic disease prevention and control. 2016. Available from: https://www.who.int/chp/about/integrated_cd/en/.

  • 6.

    Esmaeili Shahmirzadi S, Shojaeizadeh D, Azam K, Salehi L, Tol A, Moradian Sorkhkolaei M. [The impact of chronic diseases on the quality of life among the elderly people in the east of Tehran ]. Payavard Salamat. 2012;6(3):225-35. Persian.

  • 7.

    Hoffman-Goetz L, Shannon C, Clarke JN. Chronic disease coverage in Canadian aboriginal newspapers. J Health Commun. 2003;8(5):475-88. [PubMed ID: 14530149]. https://doi.org/10.1080/10810730390233299.

  • 8.

    Mercado-Martinez FJ, Robles-Silva L, Moreno-Leal N, Franco-Almazan C. Inconsistent journalism: The coverage of chronic diseases in the Mexican press. J Health Commun. 2001;6(3):235-47. [PubMed ID: 11550591]. https://doi.org/10.1080/108107301752384424.

  • 9.

    Glanzel W, Gorraiz J. Usage metrics versus altmetrics: Confusing terminology? Scientometrics. 2014;102(3):2161-4. https://doi.org/10.1007/s11192-014-1472-7.

  • 10.

    Thelwall M, Kousha K. Academia.edu: Social network or academic network? J Assoc Inform Sci Tech. 2014;65(4):721-31. https://doi.org/10.1002/asi.23038.

  • 11.

    Ovadia S. ResearchGate and Academia.edu: Academic social networks. Behav Soc Sci Librarian. 2014;33(3):165-9. https://doi.org/10.1080/01639269.2014.934093.

  • 12.

    Zahedi Z, Costas R, Wouters P. How well developed are altmetrics? A cross-disciplinary analysis of the presence of "alternative metrics" in scientific publications. Scientometrics. 2014;101(2):1491-513. https://doi.org/10.1007/s11192-014-1264-0.

  • 13.

    Salajagheh M, Mohammadian S. [Altmetrics: A new way in scientometrics]. Nati Stud Librarian Inform Organ. 2015;26(1):71-84. Persian.

  • 14.

    Batooli Z. [ReseachGate features for researchers]. Electron J Iran Assoc Inform Manag (ISAIM). 2013;1(2):59-68. Persian.

  • 15.

    Jordan K. Exploring the ResearchGate score as an academic metric: Reflections and implications for practice. Quantifying and analysing scholarly communication on the web (ASCW'15). Oxford; 2015.

  • 16.

    Batooli Z. [Mendeley social network platform for communication and cooperation in scientific research]. Inform Soc. 2013;69(40). Persian.

  • 17.

    Zahedi Z. [Analyzing readerships of International Iranian publications in Mendeley: An altmetrics study]. First National Scientometrics Conference. Isfahan University, Isfahan, Iran. 2014. Persian.

  • 18.

    Zomoradiyan MJ, Jamali S. [Introducing management software references: Mendeley]. Media. 2012;3(2). Persian.

  • 19.

    Batooli Z, Nazari M. [The features of social research network for facilitating research activities from medical sciences researchers' perspective]. Payavard Salamat. 2014;8(4):316-31. Persian.

  • 20.

    Ramezani-Pakpour-Langeroudi F, Okhovati M, Esmaeilpour-Bandboni M, Ramezani A. [Status of the scientific output of researchers in the field of "Quran and health" in ResearchGate]. Quran Med. 2018;3(4):183-8. Persian.

  • 21.

    Ghazimirsaeed SJ, Papi A, Ramezani A, YektaKooshali MH, Ramezani-Pakpour-Langeroudi F. [Evaluation altmetric indicators of Iranian medical universities in academic social networks: ResearchGate and Academia.edu]. Q J Knowl Inform Manag. 2018;4(1):23-30. Persian.

  • 22.

    Scanfeld D, Scanfeld V, Larson EL. Dissemination of health information through social networks: Twitter and antibiotics. Am J Infect Control. 2010;38(3):182-8. [PubMed ID: 20347636]. [PubMed Central ID: PMC3601456]. https://doi.org/10.1016/j.ajic.2009.11.004.

  • 23.

    Nikkar M, Alijani R, Ghazizadeh H. [Investigation of the presence of surgery researchers in Researchgate scientific network: An altmetrics study]. Iran J Surg. 2017;25(2):76-82. Persian.

  • 24.

    Ramezani-Pakpour-Langeroudi F, Okhovati M, Talebian A. Do highly cited clinicians get more citations when being present at social networking sites? J Educ Health Promot. 2018;7:18. [PubMed ID: 29629379]. [PubMed Central ID: PMC5852979]. https://doi.org/10.4103/jehp.jehp_69_17.

  • 25.

    Thelwall M, Wilson P. Mendeley readership altmetrics for medical articles: An analysis of 45 fields. J Assoc Inform Sci Tech. 2016;67(8):1962-72. https://doi.org/10.1002/asi.23501.

  • 26.

    Esmaeilpour Bandboni M, Batooli Z, Ramezani A, Ranjbar Pirmousa Z, Ramezani-Pakpour-langeroudi F. [An assessment of altmetrics indicators on citation rate of articles affiliated by Guilan University of Medical Sciences]. Health Inform Manag. 2016;13(5):367-72. Persian.

  • 27.

    Mardani A, Mardani A, Moghadam H. [A survey of knowledge production of Iranian researchers on AIDS: Evidence from the Web of Science database]. J Health Admin. 2011;14(45):35-46. Persian.

  • 28.

    Hassanzadeh Esfahani HM, Gorji AA, Shokranehnanehkaran F, Valinejadi A. [Scientific products of Iran University of Medical Sciences' authors with co-authorship networks in Web of Science (WOS) database, up to 2007]. J Health Admin. 2009;11(34):59-67. Persian.

  • 29.

    Mobasheri M, Moradi M, Rafie S, Sharifi A. [Scientific output of Shahrekord University of Medical Sciences (Iran) in ISI database from 1993 to the end of 2011 according to scientometric indicators]. J Shahrekord Univ Med Sci. 2013;14(6):115-23. Persian.

  • 30.

    Asnafi AR, Pakdaman Naeini M, Moradi S, Ghazizadeh H. Study on activities of Payame Noor University (I.R.Iran) faculty members in Research Gate. International Conference on Webometrics, Informetrics and Scientometrics & 16th COLLNET Meeting. Delhi, India. 2015.

  • 31.

    Haustein S, Peters I, Bar-Ilan J, Priem J, Shema H, Terliesner J. Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics. 2014;101(2):1145-63. https://doi.org/10.1007/s11192-013-1221-3.

  • 32.

    Mas-Bleda A, Thelwall M, Kousha K, Aguillo IF. Do highly cited researchers successfully use the social web? Scientometrics. 2014;101(1):337-56. https://doi.org/10.1007/s11192-014-1345-0.

  • 33.

    Maflahi N, Thelwall M. When are readership counts as useful as citation counts? Scopus versus Mendeley for LIS journals. J Assoc Inform Sci Tech. 2016;67(1):191-9. https://doi.org/10.1002/asi.23369.

  • 34.

    Li X, Thelwall M, Giustini D. Validating online reference managers for scholarly impact measurement. Scientometrics. 2011;91(2):461-71. https://doi.org/10.1007/s11192-011-0580-x.

  • 35.

    Erfanmanesh M. [The presence of Iranian information science and library science articles in social media: An altmetric study]. Iran J Inform Process Manag. 2015;32(2):349-73. Persian.

  • 36.

    Ebrahimy S, Setareh F, Hossein Chari M. [Assessing the relationship between the alternative metrics of visibility and social bookmarking with citation index in PLOS Altmetrics]. Iran J Inform Process Manag. 2016;31(3):845-64. Persian.