RESEARCH ASSESSMENT

Research assessment models and practices impact research quality and cultures, determine research funding priorities, and by extension, the career trajectories of individual researchers, and significantly influence researchers’ well-being. At the societal level, how we assess, evaluate, and reward research has implications for scientific advancement, the integrity of the evidence-base that several high-level decision-making, including policymaking, is based on, as well as public trust in science. Current approaches, however, rely too heavily on bibliometrics, such as impact factor and the h-index, often overlooking the wide range of skills and contributions that support a thriving research ecosystem. While such metrics serve a purpose and were developed as ‘objective’ measures to combat previous practices of patronage, their preponderance in research evaluation fosters a harmful ‘publish or perish’ culture that undermines research quality.

ALLEA supports the shift away from this over-reliance on quantitative indicators towards more holistic, equitable, and qualitative research assessment models that not only improve the quality of research, but are key to fair and inclusive research cultures. ALLEA became an early signatory of the Agreement on Reforming Research Assessment (ARRA), published in July 2022, and is part of the associated Coalition for Advancing Research Assessment (CoARA). 

ALLEA Contact 

Maria Ronald
Project Manager (CoARA)
ronald@allea.org

Related Activities

Coalition for Advancing Research Assessment

Based on 10 high-level commitments, the ‘Agreement on Reforming Research Assessment’ establishes a common direction for research assessment reform. ALLEA contributed to the drafting of the Agreement and is a member of the global Coalition for Advancing Research Assessment (CoARA).

CoARA Boost

CoARA Boost is a Horizon Europe-funded project designed to bring research assessment beyond its current simplistic reliance on journal-based quantitative indicators and quantity over quality. The project seeks to undertake comprehensive reform aligned with the principles and commitments set forth by the European Coalition for Advancing Research Assessment (CoARA).  

The European Code of Conduct for Research Integrity

There is no “one-size-fits-all” solution for research assessment, and the emphasis on researchers taking responsibility for developing criteria and procedures in their communities aligns well with the core concept of self-regulation set out in the European Code of Conduct for Research Integrity.

The Future of
Peer Review

Peer review is an essential pillar of research assessment. Together with the GYA (the Global Young Academy), and STM (the International Association of Scientific, Technical and Medical Publishers), ALLEA has been exploring challenges and possible ways forward as part of a workshop series on ‘The Future of Peer Review in Scholarly Communications’ and a follow-up webinar on ‘Inclusion, Diversity, Equity and Accessibility (IDEA) in Scholarly Peer Review’.

Related Events

CoARA Boost Kick-Off Meeting

CoARA Boost is a Horizon Europe-funded project designed to bring research assessment beyond its simplistic reliance on quantitative indicators.

Related News

ALLEA Working Group on the ERA Meets at the Royal Danish Academy of Sciences and Letters

On 11 October 2024, the ALLEA Working Group (WG) on the European Research Area (ERA) convened at the Royal Danish Academy of Sciences and Letters in Copenhagen.

ALLEA Participates in EU-Funded Project to Support Reforms in Research Assessment 

In October 2023, a consortium of European research stakeholder organisations embarked on a Horizon Europe-funded project in order to bring research assessment beyond its simplistic reliance on quantitative indicators.

Call for Contributions: Open Consultation on Innovative Outputs in the Humanities

The ALLEA Working Group E-Humanities has launched an open consultation concerning draft recommendations on recognising digital scholarly outputs in the humanities.

Reflections on the ALLEA-GYA-STM webinar on “Inclusion, Diversity, Equity and Accessibility in Scholarly Peer Review”

On 17 November, ALLEA, the Global Young Academy and STM convened a moderated panel discussion about “Inclusion, Diversity, Equity and Accessibility (IDEA) in Scholarly Peer Review". The full recording, as well as a short event report, are now available online. 

Reforming Research Assessment: ALLEA Announces Further Support to Its Academies

ALLEA signed today the European Agreement on Reforming Research Assessment and announced in a new statement to further support its Member Academies with developing assessment criteria.

Building an ERA that Fosters Freedom and Excellence

In a new statement, ALLEA sets priorities for building a new European Research Area (ERA) and for implementing the Policy Action Points developed in the ERA Transition Forum.

European Science Organisations Reach Agreement on Reforming Research Assessment

Following a six-month co-creational process involving more than 350 European organisations from over 40 countries, an Agreement on Reforming Research Assessment has been reached and made public today. ALLEA has contributed to the Agreement as part of a core group of 20 research organisations that supported the drafting team throughout the process.

ALLEA Welcomes Council Conclusions on Research Assessment and Open Science

ALLEA welcomes the adoption of the Conclusions on Research Assessment and Implementation of Open Science by the Council of the European Union on 10 June. At the same time, ALLEA continues to stress that it matters how we open knowledge, as the push for Open Access publishing has also paved the way for various unethical publishing practices.

Transforming Science: Pathways Towards Sustainability and Trustworthiness

The ALLEA symposium ‘Transforming Science: Pathways Towards Sustainability and Trustworthiness’ brought together leading scientists, policymakers and research managers in Brussels to discuss the transformations the scientific system must address to be ready for future crisis after the Covid-19 pandemic.

ALLEA Joins the European Commission Coalition on Research Assessment Reform

ALLEA has joined the European Commission’s core group working on reforming research assessment. The group will support the drafting of an agreement led by the European University Association, Science Europe and the European Commission on key issues and timelines for implementing changes.

ALLEA-GYA Event Report on Research Assessment Published

ALLEA and the Global Young Academy (GYA) have published a report covering the key takeaways of their webinar ‘Research Assessments that Promote Scholarly Progress and Reinforce the Contract with Society’. The event brought together science and policy stakeholders to rethink current research assessment models.

Shaping the Future of Peer Review

ALLEA, the Global Young Academy (GYA), and STM (International Association of Scientific, Technical and Medical Publishers) published today the summary of a series of cross-sectoral workshops on the future of peer review in an open, digital world.

Related Publications