ALLEA Participates in EU-Funded Project to Support Reforms in Research Assessment 

/in , , /by

Research assessment has the aim of making well-informed decisions about funding, hiring, and promotion, and remains a core pillar of our research system. However, while current assessment practices provide an important means to support the advancement of knowledge and recognise and reward excellence, they rely heavily on quantitative approaches rather than qualitative evaluation. Likewise, they often fail to acknowledge the diversity of the research outputs and skills that are needed for a thriving research ecosystem. 

In October 2023, a consortium of European research stakeholder organisations embarked on a Horizon Europe-funded project in order to bring research assessment beyond its simplistic reliance on quantitative indicators. The three-year-long project has a budget of €5 million and aims to enact a systemic reform of research assessment following the principles and commitments agreed upon by the Coalition for Advancing Research Assessment (CoARA). ALLEA has been actively involved in the drafting of this European agreement, and was one of the early signatories and members of the coalition.  

The “CoARA Boost” project is led by the European Science Foundation (ESF), and includes, alongside ALLEA, leading European network organisations for (early career) researchers, research funders, and universities committed to promoting change. The key objectives of the CoARA Boost Project are to i) strengthen CoARA’s operational capacity, ii) catalyse knowledge development, policy evolution, and institutional change in research assessment, iii) facilitate the collection and exchange of information, and iv) widen the Coalition’s membership in Europe and beyond. 

The consortium will convene for a kick-off meeting in Brussels on 7-8 December 2023 to delve into the specifics of the collaboration, which will play a pivotal role in advancing CoARA’s mission. 

ALLEA approaches the topic of research assessment through its various working groups and task forces. A complete overview of these activities can be found here.

Call for Contributions: Open Consultation on Innovative Outputs in the Humanities

/in , , , /by

Working with digital outputs in the humanities? Consider contributing to the ALLEA Working Group E-Humanities draft recommendations by 26 July 2023.

The ALLEA Working Group E-Humanities has launched an open consultation concerning draft recommendations on recognising digital scholarly outputs in the humanities. The goal is to gather broad feedback from active humanities researchers and institutions in order to tailor the recommendations to the community’s needs.

A link to the draft recommendations and instructions for contributing is available here: https://bit.ly/ALLEAehumanities

 

Open Consultation

The consultation is open to all researchers and practitioners working in disciplines within the humanities, policymakers, and representatives of all public and private organisations active in the field. We are particularly keen to hear from humanities researchers in ALLEA member academies. The consultation is open until 26 July 2023.

 

Practicalities

1. Suggest changes or leave comments in the document.

2. Types of feedback

  • clarification – let us know whether any parts of the text are unclear and need clarification or elaboration.
  • omissions – highlight issues we might have overlooked.
  • further reading – suggest resources worth recommending to readers.

3. Recognition. All contributors will be listed in the final report. Please ensure that your comments are properly signed with your name. If you wish to remain anonymous, use private browsing.

4. Contact. Should you have any questions, feel free to contact the WG Chair, Dr Maciej Maryl, directly (maciej.maryl@ibl.waw.pl).

Please note that the final draft will be additionally proofread for language.

 

On the report

This report proposes recommendations regarding recognition, evaluation, and assessment of innovative scholarly outputs in the humanities.

First, the report focuses on the cross-cutting issues pertinent to digital practices in the humanities, such as (1) linking studies with underlying data, (2) open-ended outputs, (3) collaboration and authorship, (4) training and competence building, and (5) reviewing and evaluating. Next, it discusses particular case studies of innovative outputs where these cross-cutting issues manifest themselves, i.e. (a) digital scholarly editions, (b) extended publications, (c) databases and datasets, infographics, (d) code, (e) blogs, and (f) podcasts.  Finally, the conclusion provides some general remarks on recognising and evaluating digital practices in the humanities.

 

About the ALLEA Working Group E-Humanities

The ALLEA Working Group E-Humanities, composed of experts from across European academies, is committed to identifying and raising awareness for priorities and concerns of the humanities, paying particular attention to current and emerging developments in digital practices. Currently, the Open Science agenda figures highly in research policy and research funder requirements, and is driving changes in research practice. To address this agenda, and facilitate the adoption of Open Science across the humanities, the working group has turned its attention to supporting humanities researchers in their research data management practices.

More information on the ALLEA Working Group E-Humanities and its members can be found here: https://allea.org/e-humanities/

Reflections on the ALLEA-GYA-STM webinar on “Inclusion, Diversity, Equity and Accessibility in Scholarly Peer Review”

/in , , /by

Download the event report here

On 17 November, ALLEA, the European Federation of Academies of Sciences and Humanities, the Global Young Academy, and STM (International Association of Scientific, Technical and Medical Publishers) convened a moderated panel discussion about “Inclusion, Diversity, Equity and Accessibility (IDEA) in Scholarly Peer Review” with four distinguished panelists from the global research and publishers’ communities. The full recording, as well as a short event report that summarizes the main themes that emerged during the discussion, are now available online. 

The scholarly peer review system currently does not accurately represent the research community as a whole: women, researchers from the Global South, early career researchers, and non-native English speakers are all among those under-represented. In addition, researchers not affiliated with the traditional well-established institutions often experience a disadvantage when their work is submitted for peer review. Together, these biases directly affect individuals’ career progression and are likely to impact the quality of research outputs and diversification of the research system in general. 

The aim of this webinar was to create more awareness of this topic, discuss existing barriers and gather input for possible solutions to overcome the challenge. To set the scene for an informed discussion, the moderator introduced the topic, followed by short opening statements in which each panellist outlined the barriers and possible solutions from their viewpoint. The audience had the opportunity to actively contribute to the discussion by sharing their views via different polls and asking questions to the panellists. 

The three organisations have now published a short event report, which summarizes the main themes that emerged during the discussions and identifies areas that can represent a path forward.

The programme for the webinar, detailed information on the speakers, and the complete recording, can be found here. 

 

Watch the full webinar

Reforming Research Assessment: ALLEA Announces Further Support to Its Academies

/in , , /by

ALLEA signed today the European Agreement on Reforming Research Assessment and announced in a new statement to further support its Member Academies with developing assessment criteria based on principles of quality, integrity, diversity, and openness. Read the ALLEA Statement here.

The European Agreement was published on 20 July, following a six-month collaborative process involving more than 350 European organisations, and opened for signature to organisations from across the world during the recent European Research and Innovation Days. The Agreement includes the principles, commitments and timeframe for reforms and lays out the framework for a Coalition of organisations willing to work together in implementing the changes.

ALLEA first contributed to the Agreement as part of a core group of 20 research organisations and reemphasizes today its commitment to a more diverse and inclusive academic system by publicly signing the agreement, joining the Coalition, and announcing in a new statement its support to its Member Academies.

ALLEA President Antonio Loprieno says “Rewarding and promoting excellence is a core value of academies. This Agreement is an important step forward towards the equitable and objective assessment of both early career researchers and established researchers, which is of utmost importance in a very highly competitive research landscape.”

ALLEA is committed to using the momentum to explore, jointly with its Member Academies, what can be done to further develop the selection criteria and procedures for academy fellows in line with our shared overarching European values. ALLEA will therefore establish a dedicated task force with the aim to collect, exchange and promote best practices for admitting new Academy fellows, and to contribute to a meaningful cultural change of the research assessment system.

Read the ALLEA Statement here

Building an ERA that Fosters Freedom and Excellence

/in , , /by

In a new statement, ALLEA sets priorities for building a new European Research Area (ERA) and for implementing the Policy Action Points developed in the ERA Transition Forum.

In 2021, ALLEA was invited by the European Commission to be part of developing a new European Research Area (ERA) that supports the free circulation of researchers and knowledge, joint and more efficient use of research infrastructure, excellence, attractive careers, equal opportunities, and cooperation between research and innovation actors across Europe. With the ALLEA Statement for an ERA of Freedom and Excellence published today, the European Academies of Sciences and Humanities reflect on the 20 ERA Policy Agenda Action Points developed in the consultations of the ERA Transition Forum, which brings together delegates from the European Commission, Member States, Associated Countries, and Stakeholder Organisations.

The statement has been prepared by the ALLEA Working Group on the ERA, and it welcomes this initiative for a new ERA that reflects the European Academies’ vision for borderless and universal science as a global public good that transcends national and disciplinary boundaries. The statement strongly emphasises the need to enable scientific cooperation, particularly in times of multiple crises. This cooperation should take place in a robust and empowering institutional setting and should be based on good research practices. Accordingly, a strong ERA should be built on the principles of academic freedom, integrity and ethics, excellence, trustworthiness, inclusiveness, openness, sustainability, collaboration, mobility, equality, diversity, equity, as well as thinking and acting globally.

Highlighting these priorities and thereby commenting on various ERA Policy Agenda Action Points, the authors specifically stress the need for safeguarding academic freedom: “This includes advocating clear and unanimous support for Higher Education Institutions and Research Performing Organisations facing threats to academic freedom through political circumstances, such as internal or external oppression, or war.”

Other priorities for the ERA Policy Agenda highlighted in the statement are:

  • A continuous focus on scientific excellence as a guiding principle for research assessment as well as funding.
  • A need for fundamental research to sustain a genuinely world class science base in Europe in the long term.
  • An emphasis on establishing truly interdisciplinary partnerships and a recognition of the importance of interdisciplinary and international research collaborations.
  • An awareness of the growing importance and complexity of science-society and science-policy relations and how science relies on trust and trustworthiness.
  • Capacity building and improved accessibility to existing research infrastructure in the EU-13 countries.

Read the full statement for more information on how to implement an effective ERA beneficial for all Europeans.

European Science Organisations Reach Agreement on Reforming Research Assessment

/in , , , , /by

Following a six-month collaborative process involving more than 350 European organisations from over 40 countries, an Agreement on Reforming Research Assessment has been reached and made public today. ALLEA has contributed to the Agreement as part of a core group of 20 research organisations that supported the drafting team throughout the process.

The Agreement summarises a shared vision on how to reform assessment practices for researchers, research projects and research performing organisations, with overarching principles founded on quality, impact, diversity, inclusiveness, and collaboration.

The envisioned reforms are centred around the following four core commitments:

  1. Recognise the diversity of contributions to, and careers in, research in accordance with the needs and nature of the research
  2. Base research assessment primarily on qualitative evaluation for which peer review is central, supported by responsible use of quantitative indicators
  3. Abandon inappropriate uses in research assessment of journal- and publication-based metrics, in particular inappropriate uses of Journal Impact Factor (JIF) and h-index
  4. Avoid the use of rankings of research organisations in research assessment

Several additional supporting commitments aim to enable the move towards new research assessment criteria, tools and processes, and to facilitate mutual learning, communicate progress and ensure that new approaches are evidence informed. The Agreement further includes anticipated timeframes for implementing the reforms and evaluating progress and describes the operational structures for a coalition of organisations devoted to working together to implement the changes.

Next Steps

The collection of signatures to join the Coalition supporting the Agreement will be launched on 28 September 2022 at the EU Research and Innovation Days. A General Assembly of Coalition members will further decide on the governance of the Coalition, the strategy guiding the operations and activities of the Coalition as a whole, its annual work-plan and budget. The first General Assembly is expected to take place towards the end of this year.

As a European umbrella organisation of academies of sciences and humanities, ALLEA was able to provide an interdisciplinary perspective based on shared European academic values. ALLEA contributed to the Agreement through its Permanent Working Group on Science & Ethics and the Working Group European Research Area. Previously, ALLEA had also worked with the Global Young Academy on recommendations on the topic.

In a parallel endeavour, the Council of the European Union has recently adopted its Conclusions on Research Assessment and Implementation of Open Science. ALLEA welcomes the principles set out in the Conclusions for designing novel approaches to research assessment and emphasises that there is no “one-size-fits-all” format: any reforms should be driven by researchers taking responsibility for improving research assessment in their communities, following the core concept of self-regulation set out in the European Code of Conduct for Research Integrity. (Read ALLEA’s full response here)

More information

  • The complete Agreement for Reforming Research Assessment can be found here, as well as an overview of frequently asked questions regarding the Agreement and the Coalition.
  • Further information on the drafting process and the actors involved can be found here.

ALLEA Welcomes Council Conclusions on Research Assessment and Open Science

/in , , , , , , /by

ALLEA welcomes the adoption of the Conclusions on Research Assessment and Implementation of Open Science by the Council of the European Union on 10 June. See ALLEA’s full response here.

The Conclusions are in agreement with points that ALLEA has made over the years, in particular on the necessity of appropriately implementing and rewarding open science practices and the development of research assessment criteria that follow principles of excellence, research integrity and trustworthy science.

At the same time, ALLEA continues to stress that it matters how we open knowledge, as the push for Open Access publishing has also paved the way for various unethical publishing practices. The inappropriate use of journal- and publication-based metrics in funding, hiring and promotion decisions has been one of the obstacles in the transition to a more open science, and furthermore fails to recognize and reward the diverse set of competencies, activities, and outputs needed for our research ecosystem to flourish.

ALLEA therefore welcomes the principles set out in the Conclusion for designing novel approaches to research assessment, with particular weight on recognizing (1) the critical role for peer review in research assessment and (2) the importance of integrity and ethics in developing criteria focused on quality and impact. 

ALLEA underscores that the described reforms are urgently needed and require concerted efforts from the international academic community, supported by infrastructures for exchanging best practices as well as the necessary financial resources to implement these. 

Read ALLEA’s full response

Transforming Science: Pathways Towards Sustainability and Trustworthiness

/in , /by

The ALLEA symposium ‘Transforming Science: Pathways Towards Sustainability and Trustworthiness’ brought together leading scientists, policymakers and research managers in Brussels to discuss the transformations the scientific system must address to be ready for future crisis after the Covid-19 pandemic.

The event took place on 11-12 May, hosted by the Royal Academy of Sciences, Letters and Arts of Belgium and the Royal Flemish Academy of Belgium for Science and the Arts at the Academy Palace, in the heart of the Belgian capital. The symposium was part of the annual meeting of ALLEA member academies, more than 50 academies from about 40 countries in Europe.

In two days of keynotes and panel discussions, more than 400 online and in-person participants joined four sessions addressing 3 main themes: Science-Policy Relations in an Age of Complexity, Transforming Research Cultures and Towards Climate Sustainability in the Academic System.

Speakers included political representatives such as Mariya Gabriel, European Commissioner for Innovation, Research, Culture, Education and Youth, and Thomas Dermine, Belgian Secretary for Economic Recovery and Strategic Investment with responsibility for Science Policy. Marion Koopmans, Director of the WHO Collaborating Centre for Emerging Infectious Diseases at Erasmus MC, delivered the scientific keynote.

All videos and photos of the event are available on the media room.

11 May | Opening Session

Speakers
  • Prof Didier Viviers
    Permanent Secretary of the Royal Academy of Sciences, Letters and Fine Arts of Belgium (ARB)
  • Prof Antonio Loprieno
    President of ALLEA
  • Thomas Dermine
    Belgian State Secretary for Scientific Policy, Recovery Program and Strategic Investments
  • Mariya Gabriel
    European Commissioner for Innovation, Research, Culture, Education and Youth

 

11 May | Keynote ‘Building the Ship while Sailing: The Challenges of Scientific Advice during an Emerging Crisis’

Keynote

Prof Marion Koopmans
Director of the WHO Collaborating Centre for Emerging Infectious Diseases at Erasmus MC

 

12 May | Session 1: Science-Policy Relations in Times of Complexity

Keynote
Prof Christiane Woopen, Professor at Center for Life Ethics, University Bonn
Being Caught between All Stools? Sciences and Policy Advice

Presentations

  • Prof Michael Bang Petersen, Professor at Aarhus University
    Using Social Science to Uphold Trust during a Crisis: Lessons from the COVID-19 Pandemic
  • Prof Tina Comes, Professor at Delft University of Technology & Maastricht University
    Science under pressure. Transforming crises
  • Prof Eric Lambin, Member of the European Commission’s Group of Chief Scientific Advisors.
    Engaged scholarship, system thinking, and partnerships
12 May | Session 2: Transforming Research Cultures

Keynote

Prof Maria Leptin, President of the European Research Council
Science communication for an age without gatekeepers

Discussion panel

  • Prof Maria Leptin, President of the European Research Council
  • Prof Antonio Loprieno, President of ALLEA
  • Dr Marc Schiltz, President of Science Europe
  • Dr Magdalena Skipper, Editor In Chief of Nature
  • Prof Andrea Pető, Professor at Central European University

ALLEA Joins the European Commission Coalition on Research Assessment Reform

/in , , , , , , /by

ALLEA has joined the European Commission’s core group working on reforming research assessment. The group will support the drafting of an agreement led by the European University Association, Science Europe and the European Commission on key issues and timelines for implementing changes.

The coalition is composed by funding organisations, research performing organisations, national/regional assessment authorities or agencies, associations of research funders, of research performers, of researchers, as well as learned societies and other relevant organisations.

ALLEA is represented by Deborah Oughton, member of the ALLEA Permanent Group Science and Ethics and representative of the Norwegian Academy of Science and Letters. She is a Professor at the Environmental Sciences and Natural Resource Management Faculty of the Norwegian University of Life Sciences.

Towards a Research Assessment Reform

In 2021, the European Commission published the scoping report ‘Towards a reform of the research assessment system’. The publication presents the findings from a consultation with European research stakeholders and identifies the goals that should be pursued with a reform of research assessment. The report proposes a coordinated approach based on principles and actions that could be agreed upon by a coalition of research funding and research performing organisations committed to implement changes.

Research assessment reform is one of the topics ALLEA has worked jointly with its Member Academies and partners in recent years. In July 2021, ALLEA and the Global Young Academy (GYA) published a report covering the key takeaways of their webinar ‘Research Assessments that Promote Scholarly Progress and Reinforce the Contract with Society’. The event brought together science and policy stakeholders to rethink current research assessment models.

The key areas for research assessment identified by the stakeholders were how to strike a balance between funding of research to advance scientific progress and public accountability, how to assess the societal relevance of research and who defines the criteria, and how research assessment should be done.

In 2020, ALLEA, the Global Young Academy and STM (International Association of Scientific, Technical and Medical Publishers) organised a series of workshops about the future of peer review in scholarly communications. A short summary report is available here.

ALLEA-GYA Event Report on Research Assessment Published

/in , , /by

ALLEA and the Global Young Academy (GYA) have published a report covering the key takeaways of their webinar ‘Research Assessments that Promote Scholarly Progress and Reinforce the Contract with Society’. The event brought together science and policy stakeholders to rethink current research assessment models.

The report tackles three main questions debated by presenter Ellen Hazelkorn (BH Associates) and discussants Kostas Glinos (European Commission), Michael Hill (DORA Steering Committee), and Martin Dominik (Global Young Academy):

  • How can we strike a balance between funding of research to advance scientific progress in itself on the one hand, and public accountability in terms of societally relevant research on the other when assessing research?
  • How can the societal relevance of research best be assessed and who defines the criteria?
  • How should research assessment be done?

Among other messages, the report underlines that:

  • All research that significantly adds to the scholarly record holds the potential of being translated into concrete value for society sooner or later, although not necessarily by those who originally carried out that research.
  • Societal accountability covers a wide sphere of impact, hence there is a need to include researchers from the social sciences and people with expertise on social impact, as well as co-expertise between researchers and lay-people.
  • Meaningful assessments will need to respect and be tailored to a specific context, provide an answer to a concrete question, and meet the aim of the assessment.

The report is based on a webinar held on 25 November 2020 and moderated by Roger Pfister (Swiss Academies of Arts and Sciences). The video can be watched on ALLEA’s YouTube channel. The work was led by the ALLEA Permanent Working Group Science and Ethics.

This project is part of a strategic partnership between ALLEA and the GYA, which seeks to strengthen cross-border collaboration between researchers from different age groups, disciplines and career stages. Building on and further consolidating existing forms of cooperation, both organisations aimed to analyse and rethink current research assessment models, as well as scientific publication and peer-review practices.

Download Event Report