Abstract
Introduction: Open science is increasingly prominent in international science policy agendas, converging towards the understanding that its consolidation as an academic practice depends on the reformulation of the current research evaluation system. Objective: This study aims to identify and analyze to what extent and in what ways open science policies incorporate and address research evaluation. Methodology: A bibliographic and documentary research was carried out, based on the selection of open science policies from five countries - Finland, Slovenia, the Netherlands, France, and Colombia. Results: It was observed that countries with more comprehensive policies recognize the need to reformulate recognition and reward mechanisms to include open science components. Only the French policy presents more concrete indications of changes. Colombia's National Open Science Policy 2022-2031 sets goals and execution deadlines for the adoption of open science in research evaluation and classification of groups and researchers, based on the proposal to review its accreditation systems for programs and institutions. The plans of the Netherlands, Slovenia, and Finland also anticipate changes after examining the current instruments and criteria they adopt, whether by verifying the feasibility of using altmetric indicators (Netherlands), including new methods (Slovenia), or considering new and variable formats of publication (Finland). Conclusion: There is some limitation in moving from a supportive discursive policy towards open science to a policy with devices that imply concrete changes in the criteria and procedures used in evaluations.
References
ABADAL, E.; ANGLADA, L. Políticas de ciencia abierta en Europa. In: BORGES, M. M.; SANZ CASADO, E. (coord.). Sob a lente da Ciência Aberta: olhares de Portugal, Espanha e Brasil. Coimbra: Imprensa da Universidade, 2021. p. 45-66. Disponível em: https://doi.org/10.14195/978-989-26-2022-0 Acesso em: 22 jan. 2023.
AGREEMENT ON REFORMING RESEARCH ASSESSMENT. [S.l.:s.n.], 2022. Disponível em: https://coara.eu/app/uploads/2022/09/2022_07_19_rra_agreement_final.pdf Acesso em: 22 jan. 2023.
AKSNES, D. W.; LANGFELDT, L.; WOUTERS, P. Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories. SAGE Open, [S.l.], v. 9, n. 1, 2019. Disponível em: https://doi.org/10.1177/2158244019829575. Acesso em: 22 jan. 2023.
ALBAGLI, S. Ciência aberta em questão. In: ALBAGLI, S.; MACIEL, M. L.; ABDO, A. H. (Org.). Ciência aberta, questões abertas. Brasília: Ibict; Rio de Janeiro: Unirio, 2015.
ALBAGLI, S; CLINIO, A.; RAYCHTOCK, S. Ciência Aberta: correntes interpretativas e tipos de ação. Liinc em Revista, Rio de Janeiro, v.10, n.2, p. 434-450, nov. 2014. Disponível em: https://revista.ibict.br/liinc/article/view/3593 Acesso em: 14 abr. 2023.
ALBAGLI, S.; IWAMA, A. Y. Citizen science and the right to research: building local knowledge of climate change impacts. Humanities and Social Sciences Communications, v. 9, n. 39, 2022. Disponível em: https://doi.org/10.1057/s41599-022-01040-8 Acesso em: 14 abr. 2023.
ALBORNOZ, D. et al. Framing power: tracing key discourses in Open Science Policies. In: INTERNATIONAL CONFERENCE ON ELECTRONIC PUBLISHING, 22., Villeurbanne, 2018. [Proceeddings]… Villeurbanne, France: ELPUB, 15 jun. 2018.
APPEL, A. L; ALBAGLI, S. Acesso Aberto em questão: novas agendas e desafios. Informação & Sociedade: Estudos, João Pessoa, v. 29, n. 4, p. 187–208, 28 dez. 2019. DOI: https://doi.org/10.22478/ufpb.1809-4783.2019v29n4.50113.
ARAÚJO, C. A. Á. Bibliometria: evolução histórica e questões atuais. Em questão, Porto Alegre, v. 12, n. 1, p. 11-32, 2006.
BABINI, D.; ROVELLI, L. Tendencias recientes en las políticas científicas de ciencia abierta y acceso abierto en Iberoamérica. Ciudad Autónoma de Buenos Aires: CLACSO; Fundación Carolina, 2020.
BECERRIL-GARCÍA, A.; AGUADO-LÓPEZ, E. the end of a centralized open access project and the beginning of a community-based sustainable infrastructure for Latin America: Redalyc.org after Fifteen Years. In: CONNECTING THE KNOWLEDGE COMMONS — From Projects to Sustainable Infrastructure: The 22nd International Conference on Electronic Publishing – Revised Selected Papers, 22., Marseille, 2019. Proceeddings… Marseille: OpenEdition Press, 2019 (généré le 18 janvier 2023). Disponível em: https://doi.org/10.4000/books.oep.9003. Acesso em: 14 abr. 2023.
BEIGEL, F. La evaluación académica y el camino latinoamericano de la ciencia abierta.” In: BECERRIL-GARCÍA, A.; CÓRDOBA GONZÁLEZ, S. Conocimiento Abierto en América Latina: Trayectoria y Desafíos. [S.l.]: CLACSO, 2021. p. 229–54. Disponível em: https://doi.org/10.2307/j.ctv2v88f34.13. Acesso em: 22 jan. 2023.
BOUKACEM-ZEGHMOURI, C. Pourquoi les chercheurs ouvrent-ils leurs recherches? The Conversation, June 22, 2020. Disponível em: https://acesse.dev/Y20Hb Acesso em: 22 jan. 2023.
CAFÉ, L. C. et al. Análise de domínio de políticas institucionais de acesso aberto no Brasil. RDBCI: Revista Digital de Biblioteconomia e Ciência da Informação, Campinas, v. 20, 2022. DOI: https://doi.org/10.20396/rdbci.v20i00.8670092. Acesso em: 10 abr. 2023.
CHAN, L.; OKUNE, A.; SAMBULI, N. O que é ciência aberta e colaborativa e que papeis ela poderia desempenhar no desenvolvimento?. In: ALBAGLI, S.; MACIEL, M. L.; ABDO, A. (org). Ciência aberta, questões abertas. Brasília: IBICT, 2015. 312p. Disponível em: http:/livroaberto.ibict.br/ handle/1/1060. Acesso em: 3 abr. 2022.
CHAN, T. T.; MEIJER, I. The Netherlands’ Plan on Open Science: open science monitor case study. Brussels: Office of the European Union, Oct. 2018. [Research and Innovation]. Disponível em: https://op.europa.eu/en/publication-detail/-/publication/20d4026e-4478-11e9-a8ed-01aa75ed71a1 Acesso em: 30 jan. 2022.
CLINIO, A. Ciência Aberta na América Latina: duas perspectivas em disputa. Transinformação, Campinas, v. 31, 2019. Disponível em: https://doi.org/10.1590/238180889201931e190028 Acesso em: 14 abr. 2023.
COLOMBIA. Ministerio de Ciencia Tecnología e Innovación – Minciencias. Politica Nacional de Ciencia Abierta 2022-2031. Bogotá D.C: [s.n.], jul. 2022. Disponível em: https://minciencias.gov.co/pdf/pdfreader?url=https://minciencias.gov.co/sites/default/files/politica_nacional_de_ciencia_abierta_-2022_-_version_aprobada.pdf Acesso em: 22 jan. 2023.
CUEVA, J.; MÉNDEZ, E. Open Science and intellectual property rights. How can they better interact? State of the art and reflections. [Report of Study. EUROPEAN COMMISSION]. [S.l.: s.n.], 2022. Disponível em: https://op.europa.eu/en/publication-detail/-/publication/42d27e04-b715-11ec-b6f4-01aa75ed71a1/language-en Acesso em: 22 jan. 2023.
DAVYT, A.; VELHO, L. A avaliação da ciência e a revisão por pares: passado e presente: como será o futuro? História, ciências, saúde-Manguinhos, Rio de Janeiro, v. 7, n. 1, p. 93-116, mar./jun. 2000.
FECHER, B., FRIESIKE, S. Open Science: one term, five schools of thought. In: BARTLING, S., FRIESIKE, S. (ed.). Opening Science. Cham: Springer Open, 2014.
FINLAND. Ministry of Education and Culture. Department for Higher Education and Science Policy. Open science and research leads to surprising discoveries and creative insights Open science and research roadmap 2014–2017. Helsinki: [s.n.], 2014. [Reports of the Ministry of Education and Culture, Finland 2014:21]. Disponível em: https://julkaisut.valtioneuvosto.fi/bitstream/handle/10024/75210/okm21.pdf?sequence=1&isAllowed=y Acesso em: 30 jan. 2022.
FINLAND. Open Science Coordination in Finland. Federation of Finnish Learned Societies. Declaration for Open Science and Research (Finland) 2020-2025. Helsinki: TJNK; TSV, 2020. Disponível em: https://avointiede.fi/sites/default/files/2020-02/declaration2020_0.pdf Acesso em: 30 jan. 2022.
FINLAND. Open Science Coordination in Finland. Federation of Finnish Learned Societies. Open Research Data and Methods: National Policy and Executive Plan by the Higher Education and Research Community for 2021-2025. Helsinki: TJNK; TSV, 2021. [Responsible Research Series 7:2021. 3.v.] Disponível em: https://encr.pw/SIGUe Acesso em: 30 jan. 2022.
FOLEC/CLACSO. Diagnóstico y propuestas para una iniciativa regional. [S.l.]: FOLEC/CLACSO, 2020. [Elaborado por Fernanda Beigel]. (Serie Para una transformación de la Evaluación de la Ciencia en América Latina y el Caribe - FOLEC, CLACSO). Disponível em: https://www.clacso.org/en/folec/ Acesso em: 15 abr. 2023.
FRANCE. Ministère de L’Enseignement supérieur de la Recherche et de L’Innovation. Plan National pour la Science Ouverte. Paris: Open Science, 2018a. Disponível em:
https://encr.pw/lzQup Acesso em: 30 jan. 2022.
FRANCE. Pour une action publique transparente et collaborative: Plan d’action national pour la France: 2018-2020. Paris: Open Government Partnership, 2018b. Disponível em: https://www.etalab.gouv.fr/wp-content/uploads/2018/04/PlanOGP-FR-2018-2020-VF-FR.pdf Acesso em: 30 jan. 2022.
FRANCE. Ministère de l’Enseignement supérieur, de la Recherche et de l’Innovation. Deuxième Plan national pour la science ouverte: Généraliser la science ouverte en France 2021-2024. Paris: Open Science, 2021. Disponível em: https://encr.pw/PIVyH. Acesso em: 30 jan. 2022.
FRESSOLI, M.; ARZA, V. Los desafíos que enfrentan las prácticas de ciencia aberta. Teknokultura, Madrid, v. 15, n. 2, p. 429-448, 2018.
GARFIELD, E. The history and meaning of the journal impact factor. Jama, [S.l.], v. 295, n. 1, p. 90-93, 2006. DOI: DOI: https://doi.org/10.1001/jama.295.1.90. Acesso em: 15 abr. 2023.
GINGRAS, Y. Les dérives de l’évaluation de la recherche: du bon usage de la bibliométrie. Paris: Raisons d’agir, 2014, 122 p.
GUÉDON, J-C. El acceso abierto y la división entre ciencia “principal” y “periférica”. Crítica y Emancipación, Buenos Aires, ano 3, n. 6, p. 135-180, 2011. Disponível em: http://eprints.rclis.org/17570/1/CyE-6_Guedon-CLACSO.pdf Acesso em: 30 jan. 2022.
HELSINKI INITIATIVE. Helsinki Initiative on Multilingualism in Scholarly Communication. Helsinki: Federation of Finnish Learned Societies; Committee for Public Information, Finnish Association for Scholarly Publishing; Universities Norway & European Network for Research Evaluation in the Social Sciences and the Humanities, 2019. Disponível em: https://doi.org/10.6084/m9.figshare.7887059. Acesso em: 10 abr. 2023.
I40C. Initiative for Open Citations. [S.l.: s.n.]. 2018. [website]. Disponível em: https://i4oc.org/. Acesso em: 5 abr. 2023.
JORGE, V. de A. Implementando um repositório de dados no contexto da ciência aberta: a experiência da Fiocruz. In: ENCONTRO DA REDE BRASILEIRA DE REPOSITÓRIOS DIGITAIS, 1., 2022. Anais... [S. l.]: Fiocruz/Icict; IBICT, 2022. 33 p.
LARIVIÈRE, V.; SUGIMOTO, C. R. Mesurer la science. Montréal: Les Presses de l'Université de Montréal, 2018.
MÉNDEZ, E. Open science por defecto. La nueva normalidad para la investigación. Arbor, Madrid, v.197, n.799, a587, 2021. Disponível em: https://doi.org/10.3989/arbor.2021.799002 Acesso em: 10 abr. 2023.
MINGERS, J.; LEYDESDORFF, L. A review of theory and practice in scientometrics. European Journal of Operational Research, v. 246, n. 1, p. 1-19, 1 Oct. 2015. DOI: https://doi.org/10.1016/j.ejor.2015.04.002. Acesso em: 21 set. 2020.
MUGNAINI, R.; JANNUZZI, P. M.; QUONIAM, L. Indicadores bibliométricos da produção científica brasileira: uma análise a partir da base Pascal. Ciência da informação, Brasília, v. 33, n. 2, p. 123-131, 2004.
NETHERLANDS. Dutch Ministry of Education, Culture and Science. National plan open science. [S.l.:s.n.], 9 febr. 2017. Disponível em: https://www.dtls.nl/2017/02/09/national-plan-open-science-presented/. Acesso em: 30 jan. 2022.
O’CARROLL et al. Evaluation of research careers fully acknowledging Open Science practices: Rewards, incentives and/or recognition for researchers practicing Open Science. Publications Office, Luxembourg, 2017. Disponível em: https://data.europa.eu/doi/10.2777/75255 Acesso em: 30 jan. 2022.
OCDE. Making Open Science a Reality. OECD Science, Technology and Industry Policy Papers, Paris, n. 25, 15 oct. 2015. 108 p. DOI: https://doi.org/10.1787/5jrs2f963zs1-en
RODRIGUES, E. A necessária e difícil reforma da avaliação da investigação. In: REFORMA da avaliação. [Preprint de Capítulo do Livro] [S.l.: s.n.], 2022. Disponível em: https://encr.pw/0iX7Q. Acesso em: 22 jan. 2023.
SALATINO, M.; LÓPEZ RUIZ, O. El fetichismo de la indexación: una crítica latinoamericana a los regímenes de evaluación de la ciencia mundial. Revista Iberoamericana de Ciencia, Tecnología y Sociedad —CTS, [S.l.], v. 16, n. 46, p. 73-100, 2021. Disponível em: https://l1nq.com/1fuIR. Acesso em: 30 jan. 2022.
SÁNCHEZ-TARRAGÓ, N. Acceso abierto en Latinoamérica: desafiando la geopolítica del conocimiento. Revista Cubana de Información en Ciencias de la Salud, Habana, Habana, v. 26, n. 4, ago. 2015. Disponível em: https://acesse.dev/VITBU. Acesso em: 22 jan. 2023.
SANTOS, P. X.; ALMEIDA, B. A.; HENNING, P. (org.). Livro Verde - Ciência aberta e dados abertos: mapeamento e análise de políticas, infraestruturas e estratégias em perspectiva nacional e internacional. Rio de Janeiro: Fiocruz, 2017. 140 p.
SLOVENIA. Government of the Republic of Slovenia. National Strategy of Open Access to Scientific Publications and Research Data in Slovenia 2015-2020. Liubliana: [S.n.], 3 Sept. 2015. Number: 60300-5/2015/5. Disponível em: https://l1nq.com/3AHdC. Acesso em: 22 jan. 2023.
SLOVENIJE. Vlada Republike Slovenije. Akcijski Načrt Izvedbe Nacionalne Strategije Odprtega Dostopa do Znanstvenih Objav in Raziskovalnih Podatkov v Sloveniji 2015‒2020. Liubliana: [S.l.], 24 maj. 2017. Številka [número]: 60300-5/2015/10. Disponível em: https://l1nq.com/dscl0. Acesso em: 30 jan. 2022.
SPARC. An Analysis of Open Science Policies in Europe, v.7. [Report]. [S.l.]: SPARC EUROPE; DCC, Apr. 2021. 43 p. Disponível em: https://zenodo.org/record/4725817#.YfaYxurMIdU Acesso em: 30 jan. 2022.
UNESCO. Recommandation de l’UNESCO sur une science ouverte. Paris: UNESCO, 2021. Disponível em: https://unesdoc.unesco.org/ark:/48223/pf0000379949_fre
VELHO, L. Conceitos de ciência e a política científica, tecnológica e de inovação. Sociologias, Porto Alegre, v. 13, n. 26, p. 128-153, jan./abr. 2011.
VESSURI, H.; GUÉDON, J.-C.; CETTO, A. M. M. Excellence or quality? Impact of the current competition regime on science and scientific publishing in Latin America and its implications for development. Current Sociology, London, v. 62, n. 5, p. 647-665, 2014. DOI:10.1177/0011392113512839
VOMMARO, P.; ROVELLI, L. Desafíos a la evaluación de la investigación orientada a la movilización del conocimiento en transición hacia la ciencia abierta: un análisis a partir del caso de los Grupos de Trabajo del Consejo Latinoamericano de Ciencias Sociales. Analecta Política, Medellín, v. 12, n. 23, p. 1-18, 2022, Disponível em: http://dx.doi.org/10.18566/apolit.v12n23.a02 . Acesso em: 10 abr. 2023.
VSNU; KNAW; NWO; ZONMW. Room for everyone’s talent: towards a new balance in the recognition and rewards for academics. [S.l.: s.n.], 2019. Disponível em: https://acesse.dev/prlLe. Acesso em: 10 abr. 2023.
PLAN S. Why Plan S. Strasburg: Science Connect, 4 set. 2018. Disponível em: https://www.coalition-s.org/why-plan-s/ Acesso em: 22 jan. 2023.
REDHEAD, C. OASPA e a Iniciativa para Citações Abertas. Blog PPEC, [S.l.], v. 9, n. 1, set. 2019. Disponível em: https://periodicos.sbu.unicamp.br/blog/index.php/2019/09/19/oaspa/ Acesso em: 22 jan. 2023.
WOUTERS, P. The citation: from culture to infrastructure. In: CRONIN, B.; SUGIMOTO, C. R. (ed.). Beyond bibliometrics: harnessing multidimensional indicators of scholarly impact. Cambridge: MIT Press, 2014. p. 47-66. Cap. 3.
![Creative Commons License](http://i.creativecommons.org/l/by/4.0/88x31.png)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2023 Tatiane Pacanaro Trinca, Sarita Albagli