Skip to content

Commit 35dd2fd

Browse files
committed
Minor edit
1 parent bc35a50 commit 35dd2fd

File tree

1 file changed

+1
-1
lines changed
  • indicator_templates/quarto/2_academic_impact

1 file changed

+1
-1
lines changed

indicator_templates/quarto/2_academic_impact/quality.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,6 @@ Quality is a very complicated concept, and in the context of academic work, is v
3131

3232
For the most traditional academic output, a scholarly publication, such a manual assessment is typically provided through peer review [@bornmann_scientific_2011]. Peer review is much discussed in science studies, and there are discussions about its reliability [@cole_chance_1981] and its biases [@lee_bias_2013], but also about its positive effects [@goodman_manuscript_1994] and complementaries [@goyal_causal_2024].
3333

34-
Quality is typically considered to be a multidimensional concept [@aksnes2019], composed of various other concepts. For instance, in peer review of manuscripts submitted to journals, it is common to assess the novelty and the rigour of the manuscript. Yet even if quality is considered a multidimensional concept, in practice, quality is sometimes still considered to be a unidimensional. For example, in the [UK REF](https://www.ref.ac.uk/) research articles are assigned a number of stars, varying from "recognised nationally" (1 star) to "world-leading" (4 stars).
34+
Quality is typically considered to be a multidimensional concept [@aksnes2019], composed of various other concepts. For instance, in peer review of manuscripts submitted to journals, it is common to assess the novelty and the rigour of the manuscript. Yet even if quality is considered a multidimensional concept, in practice, quality is sometimes still considered to be unidimensional. For example, in the [UK REF](https://www.ref.ac.uk/) research articles are assigned a number of stars, varying from "recognised nationally" (1 star) to "world-leading" (4 stars).
3535

3636
In the context of exercises such as the UK REF there have also been discussions about the possibility to use citations as a proxy for quality. Indeed, there are substantial correlations between peer review results and citations, but this depends on the level of aggregation. At the individual paper level the correlation is typically low, yet at higher levels, such as institutional, the correlations are substantially higher [@traag_metrics_2023]. Overall, as summarised in the reputable "Metrics Tide" report [@wilsdon_metric_2015, viii], "Metrics should support, not supplant, expert judgement.", and this is particularly relevant at the individual paper level.

0 commit comments

Comments
 (0)