Philippine E-Journals

Leading Change in Research Assessment: Integrating PlumX Metrics into Library Initiatives

Luis Ezra D. Cruz | Elizabeth B. Padilla

Discipline: library and information science

 

Abstract:

Background and Purpose In today’s dynamic landscape of scholarly communication, research impact is no longer confined to traditional metrics like citation counts. The rise of digital platforms has introduced alternative ways to assess the influence and reach of scholarly work. Altmetrics, or alternative metrics, represent a shift in how research impact is measured, incorporating diverse engagement indicators such as abstract views, downloads, social media interactions, and media coverage. This shift acknowledges that the value of research can extend far beyond academia, as it gains visibility and influence in public discourse and online platforms. One prominent tool that captures alternative metrics is PlumX metrics, which aggregates a wide range of metrics, including mentions, citations, downloads, social media interactions, and other forms of online engagement. PlumX metrics provide a holistic view of research influence by measuring various forms of engagement across both academic and non-academic channels. This paper examines the advantages of integrating PlumX metrics to evaluate the impact of research outputs, focusing specifically on materials hosted in the Animo Repository, the digital institutional repository of De La Salle University (DLSU). The repository hosts a wide array of scholarly outputs, including student research, faculty publications, journal articles, open educational resources, and conference proceedings. By leveraging the PlumX metrics available through the repository’s analytics dashboard, this study aims to provide a more comprehensive understanding of the impact and reach of DLSU’s research outputs in the digital sphere. Objectives The primary goal of this study is to explore how altmetrics can enhance the understanding of research impact within institutional repositories. Two specific objectives guide the research: (1) To determine the impact of DLSU research outputs hosted in the Animo Repository using altmetrics, specifically PlumX metrics, and (2) To identify and analyze general data of outputs in Animo Repository by comparing PlumX metrics with traditional research metrics, such as citation counts. By focusing on these objectives, the study seeks to uncover potential correlations, disparities, or shifts in research impact in the given time frame. Significance This study addresses a critical gap in applying Altmetrics to specific institutional contexts, such as DLSU’s Animo Repository. While existing research often explores altmetrics broadly, it typically overlooks their nuanced application within individual repositories. By focusing on PlumX Metrics, a type of altmetrics, this study enhances the understanding of how research impact is measured and perceived in the digital age. It provides valuable insights into the broader reach of research, capturing engagement beyond traditional academic metrics. The findings highlight how PlumX Metrics complement traditional metrics by revealing new dimensions of research influence. This research offers practical guidance for scholars, librarians, and institutions on optimizing research dissemination and outreach, ultimately improving engagement with diverse audiences, including the public, policymakers, and practitioners. As scholarly communication evolves digitally, integrating alternative metrics like PlumX provides an opportunity to adapt impact assessments and promote innovative research dissemination strategies. Methodology The study employs a quantitative content analysis approach to evaluate the online engagement, social media reach, and broader media coverage of research outputs hosted in the Animo Repository. The data was extracted using PlumX metrics from the repository’s analytics dashboard, which provides detailed insights into various engagement indicators. PlumX metrics are divided into several key categories: Usage (e.g., downloads, abstract views, and full-text views), Captures (e.g., bookmarks, saves, and reader counts), Mentions (e.g., blog mentions, news coverage, and references), and Social Media interactions (e.g., shares, likes, and tweets). The data collection period covers research outputs uploaded to the Animo Repository from October 2020, when the repository was launched, to April 2024. The study includes a broad range of research outputs, such as student theses, faculty publications, journal articles, open educational resources, and conference materials. Additionally, traditional research metrics were collected to allow for a comparative analysis with the alternative metrics provided by PlumX. This comparative approach aims to reveal how alternative metrics complement traditional citation-based measures of research impact. Results and Discussion The analysis of altmetrics data from available PlumX metrics for 40,156 research outputs in the Animo Repository reveals important insights into how DLSU’s research is consumed and engaged with. Usage metrics, which track views and downloads, are particularly high, indicating strong interest from a diverse audience. This suggests that the research outputs serve as practical resources for a wide range of users. In contrast, citation counts—while present—are notably lower than usage metrics, implying that the outputs may be more frequently used for practical applications rather than traditional scholarly discourse. Captures, which measure engagement through saves and bookmarks, show that the research outputs are highly valued within the research community. Mentions, including blog posts and news references, provide evidence of engagement beyond academic circles, although this remains less prominent compared to traditional academic citations. Social media interactions, particularly on platforms like Facebook and Twitter, demonstrate that the Animo Repository effectively fosters online engagement, with research outputs being widely shared and discussed across digital platforms. These findings underscore the role of alternative metrics in capturing dimensions of research impact that traditional metrics cannot fully encompass. Limitations While this study provides valuable insights into the impact of DLSU’s research outputs, several limitations must be acknowledged. First, the analysis is reliant on the accuracy and completeness of the data available in the Animo Repository and PlumX metrics. Any gaps or inaccuracies in the data could affect the findings. Second, altmetrics, like traditional metrics, are not immune to potential manipulation or gaming, and while efforts were made to account for this, such vulnerabilities remain. Finally, the study’s focus on a single institutional repository may limit the generalizability of the results to other institutions or disciplines. Originality This study offers a novel contribution to the understanding of research impact by focusing on altmetrics within a specific institutional repository. While previous research on altmetrics exists, this study uniquely combines quantitative content analysis with the detailed granularity provided by PlumX data, offering a nuanced understanding of how research hosted in the Animo Repository is engaged with by diverse audiences. By comparing PlumX metrics with traditional citation-based metrics, the study advances the discourse on alternative metrics and their role in the evolving landscape of scholarly communication.