Metrics, visibility, and language: challenges of open science in the evaluation of journals and researchers

Abstract

It analyzes contemporary transformations in scientific communication and research evaluation, with an emphasis on the interplay between the principles of Open Science, evaluation metrics (both traditional and alternative), internationalization demands, and the role of language technologies and policies within the context of Brazilian graduate education, particularly under the influence of CAPES. The objective is to critically discuss how these elements are interwoven, highlighting challenges and opportunities for Brazilian journals and researchers seeking to balance quality, international visibility, open access, and local relevance. The approach is theoretical-analytical, grounded in a critical review of the literature on Open Science, bibliometrics, altmetrics, multidimensional evaluation, language policies, and translation technologies, as well as the analysis of reference documents from organizations such as CAPES, UNESCO, DORA, and the Helsinki Initiative. The findings reveal tensions between the pressure for quantitative metrics and publishing in English, and the ideals of Open Science concerning epistemic inclusion, bibliodiversity, and social impact. The ambivalent role of language technologies is emphasized, as they expand the reach of scientific output but require careful editorial policies to avoid asymmetries. The article advocates for the adoption of more integrated evaluation models, sensitive to diverse contexts and impacts, alongside investments in infrastructure, training, and inclusive language policies. It concludes that building a fairer, more open, and socially engaged scientific ecosystem depends on coordinated actions among institutions, editors, evaluators, and researchers.