Skip to content

Commit 07e0ef3

Browse files
vtraagvtraag
authored
Merge pull request #69 from vtraag/rename
Rename indicator handbook to impact indicator handbook
2 parents 7696893 + 3bc87a4 commit 07e0ef3

File tree

4 files changed

+29
-30
lines changed

4 files changed

+29
-30
lines changed

‎.github/workflows/build_deploy_athenarc.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ on:
55
branches: [main]
66
workflow_dispatch:
77

8-
name: Render indicator handbook
8+
name: Render impact indicator handbook
99

1010
jobs:
1111

‎README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Introduction
22

3-
This repository contains the source files in Quarto for the PathOS indicator handbook available from https://handbook.pathos-project.eu/. Quarto is a file format that can be used to write technical documents, including support for equations, citations, cross-references and code. Extensive documentation about the file format is available from https://quarto.org/docs/guide/.
3+
This repository contains the source files in Quarto for the PathOS impact indicator handbook available from https://handbook.pathos-project.eu/. Quarto is a file format that can be used to write technical documents, including support for equations, citations, cross-references and code. Extensive documentation about the file format is available from https://quarto.org/docs/guide/.
44

55
Each indicator is available from a particular indicator template, which are stored in the directory `indicator_template/quarto`. There are various subdirectories, corresponding with the various parts of the website: (1) Open Science indicators; (2) Academic impact; (3) Economic impact; (4) Societal impact; (5) Reproducibility. In each directory, there are various `.qmd` files, which contain the specific chapters describing a particular indicator.
66

‎_quarto.yml‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ execute:
77
freeze: true
88

99
website:
10-
title: Open Science Indicator Handbook
10+
title: Open Science Impact Indicator Handbook
1111
reader-mode: true
1212

1313
site-url: https://handbook.pathos-project.eu/
@@ -144,7 +144,7 @@ editor: visual
144144

145145
license:
146146
text: >
147-
Open Science Indicator Handbook © 2024 by PathOS is licensed under CC BY 4.0
147+
Open Science Impact Indicator Handbook © 2024 by PathOS is licensed under CC BY 4.0
148148
type: open-access
149149
url: https://creativecommons.org/licenses/by/4.0/
150150

@@ -191,7 +191,7 @@ citation:
191191
orcid: 0000-0001-8249-1752
192192
- name: T. Willemse
193193
orcid: 0000-0002-3778-8247
194-
title: PathOS - D2.1 - D2.2 - Open Science Indicator Handbook
194+
title: PathOS - D2.1 - D2.2 - Open Science Impact Indicator Handbook
195195
container-title: Zenodo
196196
issued: 2023
197197
doi: 10.5281/zenodo.8305626

‎index.qmd‎

Lines changed: 24 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -1,40 +1,39 @@
1-
# Open Science Indicator Handbook {.unnumbered}
1+
# Open Science Impact Indicator Handbook {.unnumbered}
22

3-
This is the Open Science Indicator Handbook by PathOS. In this handbook we cover various indicators measuring various aspects around Open Science itself, their academic, societal and economic impacts, and reproducibility.
3+
This is the Open Science Impact Indicator Handbook by PathOS. In this handbook we cover various indicators measuring various aspects around Open Science itself, their academic, societal and economic impacts, and reproducibility.
44

5-
## Executive summary
5+
## Executive summary
66

77
In the PathOS project we take a causal perspective on studying Open Science. This necessitates making a distinction between impact itself, and the effect of Open Science on impact. For instance, we could very well see an Open Source research tool being used frequently by industry. In that sense, the Open Source research tool can be said to have a type of economic impact. However, it could very well be that the research tool would have been similarly used by industry had it been released as closed software under a commercial licence. We are interested in the difference between its actual impact under the Open Science principles and its counterfactual impact under a closed principle. That is, we are interested in the *causal* effect of Open Science on the impact of the science.
88

99
Causal inference is not straightforward. We have included an introductory chapter on causality in science studies to explain some of the challenges around causal inference in Open Science. At the same time, this chapter also divulges the possibilities for inferring causality from observational data. Sometimes, we will learn that it will be impossible to correctly identify a certain causal effect. Although this limits our possible conclusions, we believe it is better to be clear about the impossibility of identifying a causal effect in some cases than to pretend we did identify some causal effect.
1010

11-
The challenge of causal inference also clarifies that we cannot provide straightforward indicators of effects of Open Science. There are many aspects of Open Science, including Open Access, Open Data and Open Code, but also elements such as Citizen Science, Open Science infrastructure, policies and training. At the same time, there are many different types of impacts in each domain of academia, society and economy. This leads to a combinatorial number of possible effects. For each such an effect it necessitates to carefully reason about its causal inference, and what other factors should be controlled for, or should not be controlled for. This is a daunting task, which goes well beyond our capacities. For that reason, the indicator handbook provides guidance on how to operationalise various indicators in order to facilitate studies on the effect of Open Science. We hope this is useful to the research community, and that we together face the challenges of causal inference in Open Science studies.
11+
The challenge of causal inference also clarifies that we cannot provide straightforward indicators of effects of Open Science. There are many aspects of Open Science, including Open Access, Open Data and Open Code, but also elements such as Citizen Science, Open Science infrastructure, policies and training. At the same time, there are many different types of impacts in each domain of academia, society and economy. This leads to a combinatorial number of possible effects. For each such an effect it necessitates to carefully reason about its causal inference, and what other factors should be controlled for, or should not be controlled for. This is a daunting task, which goes well beyond our capacities. For that reason, the impact indicator handbook provides guidance on how to operationalise various indicators in order to facilitate studies on the effect of Open Science. We hope this is useful to the research community, and that we together face the challenges of causal inference in Open Science studies.
1212

13-
Finally, not all indicators wil be equally well-developed. Some indicators, like citation impact, are already long established and studied in scientometrics. Other indicators, such as on data usage or reproducibility are much more recent. Such indicators may be under active development, or may actually not be worked on at all yet. We still include such indicators in this handbook if we have identified this indicator to be vital for studying the causal effect of Open Science. This indicator handbook should therefore not only be seen as an inventory of what is possible today, but also what we believe is necessary tomorrow.
13+
Finally, not all indicators wil be equally well-developed. Some indicators, like citation impact, are already long established and studied in scientometrics. Other indicators, such as on data usage or reproducibility are much more recent. Such indicators may be under active development, or may actually not be worked on at all yet. We still include such indicators in this handbook if we have identified this indicator to be vital for studying the causal effect of Open Science. This impact indicator handbook should therefore not only be seen as an inventory of what is possible today, but also what we believe is necessary tomorrow.
1414

15-
We hope this handbook will be a central hub to keep track of Open Science related indicators. Within the PathOS project the indicator handbook will remain in continuous development until january 2025. We hope to be able to contribute to keeping the indicator handbook up-to-date also afterwards. The handbook is open to community contributions. Together we may create a central resource that is useful to all.
15+
We hope this handbook will be a central hub to keep track of Open Science related indicators. Within the PathOS project the impact indicator handbook will remain in continuous development until january 2025. We hope to be able to contribute to keeping the impact indicator handbook up-to-date also afterwards. The handbook is open to community contributions. Together we may create a central resource that is useful to all.
1616

1717
## Abbreviations
1818

19-
| Abbreviation | Description | Explanation |
20-
|--------------|------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
21-
| APC | Article Processing Charge | Fee sometimes charged for publishing articles. |
22-
| API | Application programming interface | Interface allowing to make use of certain service or program |
23-
| DMP | Data Management Plan | Document describing how data will be managed |
24-
| DOI | Digital Object Identifier | A DOI is a digital identifier of an object, any object --- physical, digital, or abstract. Core element of academic infrastructure. |
25-
| EOSC | European Open Science Cloud | An initiative aimed at developing an infrastructure to provide users with services promoting Open Science practices. |
26-
| EU | European Union | Supranational political union consisting of member states that are located primarily in Europe |
27-
| FAIR | Findability, Accessibility, Interoperability and Reusability | Principles for academic data management |
28-
| NCI | Normalised Citation Impact | Citation impact that is normalised for field differences |
29-
| IPR | Intellectual Property Rights | Rights to intangible creations of the human mind. |
30-
| NLP | Natural Language Processing | Computer techniques and algorithm to automatically process and analyse natural language |
31-
| OA | Open Access | Principles and practices around distributing research outputs, free from any barriers. |
32-
| OS | Open Science | Practices and principles for making science more open in various ways |
33-
| OSF | Open Science Framework | Platform to support and enable collaboration |
34-
| REST API | Representational state transfer API | Type of API often used for web services |
35-
| UNESCO | United Nations Educational, Scientific and Cultural Organization | Specialized agency of the United Nations (UN) aimed at promoting world peace and security through international cooperation in education, sciences, culture, communication and information. |
19+
| Abbreviation | Description | Explanation |
20+
|--------------|--------------|---------------------------------------------|
21+
| APC | Article Processing Charge | Fee sometimes charged for publishing articles. |
22+
| API | Application programming interface | Interface allowing to make use of certain service or program |
23+
| DMP | Data Management Plan | Document describing how data will be managed |
24+
| DOI | Digital Object Identifier | A DOI is a digital identifier of an object, any object --- physical, digital, or abstract. Core element of academic infrastructure. |
25+
| EOSC | European Open Science Cloud | An initiative aimed at developing an infrastructure to provide users with services promoting Open Science practices. |
26+
| EU | European Union | Supranational political union consisting of member states that are located primarily in Europe |
27+
| FAIR | Findability, Accessibility, Interoperability and Reusability | Principles for academic data management |
28+
| NCI | Normalised Citation Impact | Citation impact that is normalised for field differences |
29+
| IPR | Intellectual Property Rights | Rights to intangible creations of the human mind. |
30+
| NLP | Natural Language Processing | Computer techniques and algorithm to automatically process and analyse natural language |
31+
| OA | Open Access | Principles and practices around distributing research outputs, free from any barriers. |
32+
| OS | Open Science | Practices and principles for making science more open in various ways |
33+
| OSF | Open Science Framework | Platform to support and enable collaboration |
34+
| REST API | Representational state transfer API | Type of API often used for web services |
35+
| UNESCO | United Nations Educational, Scientific and Cultural Organization | Specialized agency of the United Nations (UN) aimed at promoting world peace and security through international cooperation in education, sciences, culture, communication and information. |
3636

3737
## Acknowledgements {.unnumbered}
3838

39-
This project has received funding from the European Union’s Horizon Europe framework programme under grant agreement No. 101058728. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the European Research Executive Agency. Neither the European Union nor the European Research Executive Agency can be held responsible for them.
40-
39+
This project has received funding from the European Union’s Horizon Europe framework programme under grant agreement No. 101058728. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the European Research Executive Agency. Neither the European Union nor the European Research Executive Agency can be held responsible for them.

0 commit comments

Comments
 (0)