Evaluation criteria for this grant are described in Annex D of the Horizon Europe Work Programme General Annexes, which covers aspects such as excellence, impact, and quality and efficiency of implementation. Based on the topic description, key elements for scoring will include:
Contribution to Core Objectives
- Scientific knowledge advancement: The extent to which the proposal contributes to increased scientific knowledge on assessment tools, methods, their potential biases, limitations, and corresponding solutions.
- Reform methods: The degree to which the proposal advances scientific knowledge on effective methods for reforming research assessment practices.
- Evidence generation: The robustness and relevance of evidence generated to support the practical implementation of the commitments outlined in the 'Agreement on Reforming Research Assessment'.
Project Quality & Methodology
- Comprehensive scope: Proposals must address all three required parts of the scope: (1) review of existing literature and evidence on research assessment, (2) identification of knowledge gaps and prioritisation of further research areas, and (3) implementation of research activities in these prioritised areas.
- Scientific rigor: Emphasis on solid scientific evidence and rigorous methodology to evaluate the validity and robustness of assessment practices and proposed reforms.
- Methodological depth: Consideration of diverse methodologies, including best practices in qualitative assessment, approaches to reduce bias in peer review, lessons from narrative CV pilots, appropriate uses of metrics, and indicators for new assessment frameworks.
- SSH integration: Quality of integration and involvement of Social Sciences and Humanities (SSH) disciplines and experts to produce meaningful societal effects.
Impact & Dissemination
- Expected impact: The potential of the project to lead to more responsible assessment of researchers, research projects, and organisations, resulting in improved quality, performance, and overall impact of research.
- Open Science: Commitment to providing open access to all relevant project results as early as possible.
- Accessibility and Inclusion: Demonstrated efforts to ensure that project results are accessible and relevant to diverse and underrepresented groups, and that proposed assessment methods promote diversity and inclusion, addressing systemic biases like gender biases.
- Strategic Synergies: Plans for close cooperation, knowledge sharing, and developing synergies with key initiatives such as CoARA, CoARA Boost, DORA, and other relevant stakeholders.
Grants8