EVALUATION CRITERIA
Reviewers will provide an
Overall Impact Score based on the likelihood for the project to exert a sustained, powerful influence on the research field, considering the following scored criteria:
Scored Review Criteria
- Significance:
- Does the project address an important problem or a critical barrier to progress?
- Is prior research supporting the proposed project rigorous?
- How will successful completion improve scientific knowledge, technical capability, or clinical practice?
- How will it change concepts, methods, technologies, treatments, services, or interventions that drive the field?
- Potential to transform understanding within the field.
- For unconventional hypotheses, how does it challenge or create a standard paradigm?
- Investigator(s):
- Are PD(s)/PI(s), collaborators, and other researchers well suited to the project?
- Does the proposed research represent a change in research direction for all PD(s)/PI(s)?
- For collaborative/multi-PD/PI projects, do investigators have complementary and integrated expertise?
- Are leadership, governance, and organizational structures appropriate?
- Do selected collaborators enhance feasibility for the new research direction?
- Innovation:
- Does the application challenge and seek to shift current research or clinical practice paradigms?
- Does it utilize novel theoretical concepts, approaches, methodologies, instrumentation, or interventions?
- Is the novelty specific to one field or broad?
- Is a refinement, improvement, or new application of concepts/approaches proposed?
- Importance of clearly stating what makes the project unique and innovative beyond just a new direction for the PD/PI(s).
- Approach:
- Given no preliminary data, is there a robust conceptual framework, premise, logical approach, and/or justification?
- Are the overall strategy, methodology, and analyses well-reasoned and appropriate?
- Are there plans to address weaknesses in the rigor of prior research?
- Are strategies presented to ensure a robust and unbiased approach (e.g., addressing biological variables like sex)?
- Are potential problems, alternative strategies, and benchmarks for success presented?
- For higher-risk approaches, explanation of potential benefits/rewards offsetting risks.
- Description of collaborators' roles and contributions for areas outside ESI's expertise.
- Environment:
- Will the scientific environment contribute to success?
- Are institutional support, equipment, and physical resources adequate?
- Will the project benefit from unique features (e.g., subject populations, collaborative arrangements)?
Additional Review Criteria (Not Scored, but Considered):
- Protections for Human Subjects: Evaluation of justifications for involvement, protection against risks, benefits, knowledge gained, and data/safety monitoring (if applicable).
- Inclusion: Evaluation of plans for inclusion/exclusion of individuals based on sex, race, ethnicity, and age (including children/older adults), justified by scientific goals.
- Vertebrate Animals: Evaluation of proposed procedures, species justification, and methods to limit discomfort.
- Biohazards: Assessment of potential hazards and proposed protections.
- Resource Sharing Plans: Reasonableness of sharing plans or rationale for not sharing.
- Authentication of Key Biological and/or Chemical Resources: Plans for identifying and ensuring validity of resources.