Skip to content
Merged
Changes from 36 commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
58b46f0
Update fair.md
anenadic Sep 18, 2024
a1b420c
Update fair.md
anenadic Sep 18, 2024
3122ad2
Update fair.md
anenadic Sep 18, 2024
ab37e42
Update fair.md
anenadic Sep 18, 2024
ddc9591
Update fair.md
anenadic Sep 18, 2024
68d0a83
Update fair.md
anenadic Sep 18, 2024
060d386
Update fair.md
anenadic Sep 18, 2024
d15bede
Update fair.md
anenadic Sep 18, 2024
9592315
Update fair.md
anenadic Sep 18, 2024
fe517f0
Update fair.md
anenadic Sep 18, 2024
cf706fc
Update fair.md
anenadic Sep 18, 2024
89f546e
Update fair.md
anenadic Sep 18, 2024
83f9a2e
Update fair.md
anenadic Sep 18, 2024
c8921d3
Update fair.md
anenadic Sep 18, 2024
592200f
Update fair.md
anenadic Sep 18, 2024
b083432
Update fair.md
anenadic Sep 18, 2024
4e967fb
Update fair.md
anenadic Sep 18, 2024
e2af672
Update fair.md
anenadic Sep 18, 2024
77be2d7
Update fair.md
anenadic Sep 18, 2024
3f6d81e
Update fair.md
anenadic Sep 18, 2024
1007885
Update fair.md
anenadic Sep 19, 2024
2514f3a
Update fair.md
anenadic Sep 19, 2024
dc47220
Update fair.md
anenadic Sep 19, 2024
89f6df7
Update fair.md
anenadic Sep 19, 2024
cd0c75a
Update fair.md
anenadic Sep 19, 2024
61f69c7
Update fair.md
anenadic Sep 19, 2024
cdb0e4f
Update fair.md
anenadic Sep 19, 2024
61c26e3
Update fair.md
anenadic Sep 19, 2024
19fcf4f
Update fair.md
anenadic Sep 19, 2024
6e76ea7
Update fair.md
anenadic Sep 19, 2024
0d08626
Update fair.md
anenadic Sep 19, 2024
16f09cf
Update fair.md
anenadic Sep 19, 2024
05a5a3d
Update fair.md
anenadic Sep 19, 2024
2db9ae5
Update fair.md
anenadic Sep 19, 2024
356d13e
Update fair.md
anenadic Sep 19, 2024
5f235e9
Typos and some additions
lauportell Sep 27, 2024
765375f
Added tools for FAIR RS assessment
anenadic Oct 1, 2024
bbf15ea
Update fair.md
anenadic Oct 9, 2024
92e98a8
Update fair.md
anenadic Oct 9, 2024
88db083
Reworks the FAIR RS page
anenadic Oct 14, 2024
9da7ca3
Merge branch 'main' into anenadic-fair-rs
anenadic Oct 14, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
168 changes: 166 additions & 2 deletions pages/rs_quality/fair.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,169 @@
---
title: FAIR
title: FAIR Research Software
---

Tools and good enough practices for improving RS FAIRness

## FAIR Research Software

FAIR stands for Findable, Accessible, Interoperable, and Reusable and comprises a set of principles designed to
increase the visibility and usefulness of your research to others.
The FAIR data principles, first published [in 2016][fair-data-principles], are widely known and applied today.
Similar [FAIR principles for software][fair-principles-research-software] have now been defined too. In general, they mean:

- **Findable** - software and its associated metadata must be easy to discover by humans and machines.
- **Accessible** - in order to reuse software, the software and its metadata must be retrievable by standard protocols, free and legally usable.
- **Interoperable** - when interacting with other software it must be done by exchanging data and/or metadata through
standardised protocols and application programming interfaces (APIs).
- **Reusable** - software should be usable (can be executed) and reusable
(can be understood, modified, built upon, or incorporated into other software).

Each of the above principles can be achieved by a number of practices listed below.
This is not an exact science, and by all means the list below is not exhaustive,
but any of the practices that you employ in your research software workflow will bring you
closer to the gold standard of fully reproducible research.

### Findable
- Create a description of your software to make it discoverable by search engines and other search tools
Comment thread
anenadic marked this conversation as resolved.
- Place your software in a public software repository (and ideally register it in a [general-purpose or domain-specific software registry][software-registries])
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should recommend firs trying to register your tool in a community registry (domain-specific, such as bio-tools or ASCL), and if such community registry does not exist, then register it in a general purpose one.

- Use a unique and persistent identifier (DOI) for your software (e.g. by depositing your code on [Zenodo][zenodo]),
Comment thread
anenadic marked this conversation as resolved.
which is also useful for citations - note that depositing your data/code on GitHub and similar software repositories
may not be enough as they may change their open access model or disappear completely in the future, so archiving your code means it stands a better chance at being preserved

### Accessible
- Make sure people can freely, legally and easily get a copy your software
Comment thread
anenadic marked this conversation as resolved.
Outdated
- Structure your code using common patterns and use coding conventions to make your code readable and understandable by people (once they obtain a copy of it), and thereby more accessible
Comment thread
anenadic marked this conversation as resolved.
Outdated
Comment thread
anenadic marked this conversation as resolved.
Outdated
- The code and its description has to available even when the software is not longer in use. This include previous versions of the software.

### Interoperable
- Explain the functionality of your software and protocols for interaction with it
- Use standard formats for inputs and outputs
- Communicate with other software and tools via standard protocols and APIs
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would add here the bit about CodeMeta too (interoperable software metadata)


### Reusable
- Document your software (including its functionality, and how to install and run it) to make it more understandable by others who may wish to reuse or extend it
- Follow best practices for software development (including structuring your code in reusable functions with a single functionality
that can be built on top of, coding conventions, code readability and verifying its correctness)
- Test your software and make sure it works on different platforms/operating systems to make it more reusable
- Give a licence to your software clearly stating how it can be reused
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should link to the page talking about licenses no?

- State how to cite your software, so people can give you credit when they reuse it
Comment thread
anenadic marked this conversation as resolved.
- Include a contributor policy so that others can contribute to your code and credit for contributions is provided

## Tools and practices for FAIR research software development
Comment thread
anenadic marked this conversation as resolved.

There are various tools and practices that support the development of FAIR research software, contributing to each of the four FAIR principles.
These tools and practices work together, as no single tool or practice will fully address one principle, but can
contribute to multiple principles simultaneously.

It is important to note that simply using these tools, without following good practice and guidance on how best to align
their usage with the FAIR principles, is not enough to produce FAIR software.
In addition, FAIR is not a [software quality metric](https://everse.software/RSQKit/rs_quality) even though it can improve software quality in several aspects -
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would say is a quality metric, but not the only quality metric, no?

software may be FAIR, but still not very good in terms of its functionality.

### Development environments

Virtual and integrated development environments (IDEs), such as VS Code or PyCharm, help with running, testing, and debugging code.
Virtual environments further enable us to share our working environments with others, making it easier to access, reuse and extend our code.
IDEs often provide integrations with other tools, e.g. version control and command line terminals, enabling you to do many tasks from a single environment,
saving time in switching between different tools.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Which principle does this help? Maybe adopting community practices?


### Command line terminals

Command line terminals (e.g. Bash, GitBash) enable us to run and test our code without graphical user interfaces (GUI) afforded to us by IDEs -
this is sometimes needed for accessing and running our code remotely on servers and high-performance systems without a GUI provision, where time,
memory and processing power are expensive or in high demand.

Version control systems are typically provided as command line tools, making them often only accessible from command line terminals to enter commands and access
remote version control servers to backing up and sharing our work.

Finally, command line tools are interoperable software that use standard protocols for passing parameters, inputs and outputs via the command line terminal.
This makes it easier to integrate with other tools, allowing us to chain command line tools and build up complex and reproducible workflows and analysis pipelines
using several programs in different steps.
If we write our software in a way which provides such an interoperable command line interface - we will be able to integrate it with other command line tools to
automate and speed up our work.

### Standard input/output formats and communication protocols

Using standard data exchange, input and output formats and communication protocols helps create interoperable software that can more readily integrate
with other tools into more complex pipelines - increasing its interoperability and reusability.

### Version control tools

Version control means knowing what changes were made to your code, when and by whom - promoting code ownership, responsibility and credit.
When combined with software sharing and collaborative platforms such as GitHub or GitLab, it facilitates code publication, sharing and findability,
teamwork and discussions about software and design decisions, provides backup facilities for your code and speeds up
collaboration on shared code by allowing edits by more than one person at a time.

### Code testing

Testing ensures that your code is correct and does what it is set out to do.
When you write code you often feel very confident that it is perfect, but when writing bigger codes or code that is meant to do complex operations
it is very hard to consider all possible edge cases or notice every single typing mistake.
Testing also gives other people confidence in your code as they can see an example of how it is meant to run and be assured that it does work
correctly on their machine - helping with code understanding and reusability.

### Coding conventions

Following coding conventions and guides for your programming language that is agreed upon by the community and other programmers
are important practices to ensure that others find it easy to read your code, reuse or extend it in their own examples and applications.

### Software- and project- level documentation

Documentation comes in many forms - from **software-level documentation** including descriptive names of variables and functions and
additional comments that explain lines of your code, to **project-level documentation** (including README, LICENCE, CITATION, CONTRIBUTING, etc. files)
that help to discover it, explain the legal terms of reusing it, describe its functionality and how to install, run and contribute to it,
to whole websites full of documentation with function definitions, usage examples, tutorials and guides.
You many not need as much documentation as a large commercial software product, but making your code reusable relies on other people being able to understand
what your code does and how to use it.

### Software repositories and registries

Having somewhere to share your code is fundamental to making it findable and accessible.
Your institution might have a code repository, your research field may have a practice of sharing code via a specific website, archive or journal,
or your version control system might include an online component that makes sharing different versions of your code easy.
You should check the rules or guidelines of your institution, grant or domain on publishing code, as well as any licenses of the code your software depends on or reuses.

Some examples of commonly used software repositories and registries include:

- general-purporse software repositories - [GitHub][github] and [GitLab][gitlab]
- programming language-specific software repositories - [PyPi][pypi] (for Python) and [CRAN][cran] (for R)
- software registries - [BioTools][biotools] (for biosciences) and [Awesome Research Software Registries][awesome-rs-registries], providing a list of research software registries (by country, organisation, domain and programming language) where research software can be registered to help promote its discovery

### Persistent identifiers

Unique persistent identifiers, such as Digital Object Identifiers (DOIs) provided by Zenodo, FigShare and similar digital archiving services, and commits/tags/releases used by GitHub and similar code sharing platforms,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mention software heritage explicitly please :)

help with findability and accessibility of your software, and can help you get credit for your work by providing citable references.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I feel like there needs to be a section about CodeMeta here. It helps on F, I and R (especially on F)

The table below provides a summary of how different tools and practices help with the FAIR software principles.

| Tools and practices | Findable | Accessible | Interoperable | Reusable |
| ---------------------------------------------------------------------------------------------------- | -------- | ---------- | ------------- | -------- |
| Virtual development environments | | x | | x |
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not accessibility, but +1 R3: software meets domain-specific community standards

| Integrated development environments/IDEs | | | | x |
| Command line terminals - automated and reproducible pipelines | | | x | x |
| Standard formats - e.g. for data exchange (CSV, YAML) | | x | x | x |
| Communication protocols - Command Line Interface (CLI) or Application Programming Interface (API) | | x | x | x |
| Version control tools | x | | | |
| Testing - code correctness and reproducibility | | x | | x |
| Coding conventions | | x | x | x |
| Software-level documentation (comments and docstrings, explaining functionality) | | x | x | x |
Comment thread
anenadic marked this conversation as resolved.
Outdated
| Project-level documentation (READMEs, explaining functionality/installation/running) | | x | x | x |
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not accessibility

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd argue it is also about making people understand/grasp the code - hence accessibility in that sense.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed via 88db083.

| License - code sharing and reuse | | x | | x |
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

License is reusability, not accessibility

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd argue also accessibility - if you cannot legally obtain the software, you cannot reuse it.

| Citation - code reuse and credit | x | | | x |
Comment thread
anenadic marked this conversation as resolved.
Outdated
| Software repositories and registries | x | x | | |
| Unique persistent identifiers | x | x | | |



TODO: cross link with other pages talking about specific tools or practices, e.g. version control, code readability, documentation, etc.


[fair-principles-research-software]: https://www.nature.com/articles/s41597-022-01710-x
[fair-data-principles]: https://www.nature.com/articles/sdata201618
[zenodo]: https://zenodo.org/
[software-registries]: https://github.com/NLeSC/awesome-research-software-registries
[github]: https://github.com
[biotools]: https://biotools.us/
[pypi]: https://pypi.org/
[cran]: https://cran.r-project.org/web/packages/
[gitlab]: https://about.gitlab.com/
[awesome-rs-registries]: https://github.com/NLeSC/awesome-research-software-registries