Research Article | Open Access
Arnaldo Pereira, Rui Pedro Lopes, José Luís Oliveira, "SCALEUS-FD: A FAIR Data Tool for Biomedical Applications", BioMed Research International, vol. 2020, Article ID 3041498, 8 pages, 2020. https://doi.org/10.1155/2020/3041498
SCALEUS-FD: A FAIR Data Tool for Biomedical Applications
The Semantic Web and Linked Data concepts and technologies have empowered the scientific community with solutions to take full advantage of the increasingly available distributed and heterogeneous data in distinct silos. Additionally, FAIR Data principles established guidelines for data to be Findable, Accessible, Interoperable, and Reusable, and they are gaining traction in data stewardship. However, to explore their full potential, we must be able to transform legacy solutions smoothly into the FAIR Data ecosystem. In this paper, we introduce SCALEUS-FD, a FAIR Data extension of a legacy semantic web tool successfully used for data integration and semantic annotation and enrichment. The core functionalities of the solution follow the Semantic Web and Linked Data principles, offering a FAIR REST API for machine-to-machine operations. We applied a set of metrics to evaluate its “FAIRness” and created an application scenario in the rare diseases domain.
The creation of large volumes of data in institutions scattered all over the world via widespread computerization, the use of advanced laboratory equipment, and increasing digitization over time have transformed life sciences into data-driven sciences . This exponential growth resulted in data being a fragmented universe of spreadsheets, databases, and nonrelational repositories of documents or just simple raw data dumps, in most cases with zero exposure outside the institutional framework, some in the long tail of science and technology, compromising its reuse [2, 3]. Only considering the clinical and biomedical contexts, we can list a great variety of digital data repositories, fulfilling different purposes, such as electronic health record databases, patient registries, omics datasets, medical imaging repositories, and the digital annotations and representations of the biological samples preserved in biobanks [4–7].
Efficient secondary use of data is of paramount importance to improve the quality of medical care, draw up public health policies, perform pharmacological vigilance, and select patients for clinical trials, to mention only a few cases . Secondary use of data as a way to extract knowledge in the life sciences increased greatly with the creation of several data repositories and the digitalization of biobanks . However, this did not immediately translate into the creation of a coherent ecosystem of data, considering that heterogeneity, sparsity, the coexistence of different formats, and lack of interoperability between distributed data are obstacles to be overcome . Privacy issues often arise regarding sensitive information about patients and professionals, adding more complexity to the problem [11, 12].
We present a semantic web tool complying with FAIR Data principles, designated SCALEUS-FD, which allows data integration and reuse. SCALEUS-FD enables online exposure of data and metadata in a FAIR-compliant manner through creating service endpoints. Once deployed, the solution is self-descriptive and can be cataloged and found using search engines.
We have structured this paper into five more sections. The Background section gives an overview of current ideas for improving data reuse. In the Methods section, we define the requirements semantic FAIR Data approaches must fulfil and present the legacy software used as the starting point of our proposal. The following section introduces the architecture of the tool and refers to the relevant aspects of implementation. Next, we present an application of the solution and discuss the findings of our work. Finally, we round up the paper with the conclusions and point out future work directions.
The “big data” era has revolutionized life sciences and induced the creation of several data repositories. Meanwhile, researchers are struggling with the need to analyze data to answer questions and are demanding solutions to allow the reuse of distributed data. They also seek uncomplicated tools for data sharing so that others can benefit, reproduce scientific work, and give credit . The principles of the Semantic Web (SW) and Linked Data (LD) assist in solving data integration and interoperability problems, allowing the semantic aggregation of information [14–16]. Indeed, nowadays, semantic technologies are at the core of many systems that support data-intensive research areas, as is the case with system biology, integrative neuroscience, biopharmaceutics, and translational medicine, for example . Semantic technologies are more able to describe data and to map and link distributed datasets for use by people and machines. In this way, the information network created can be used to search for information from a single entry point .
One of the pillars of the SW is data representation. To cover this critical issue, the World Wide Web Consortium (W3C) proposed the Resource Description Framework (RDF), a data model defined by a suite of normative specifications . An RDF triple (or RDF statement) consists of three components: the subject, which is an Internationalized Resource Identifier (IRI) or a blank node (bnode); the predicate, which is an IRI; and the object, which is an IRI, a literal or a bnode . Besides this mechanism for the formal representation of knowledge as subject-predicate-object entities, another SW pillar is the SPARQL query language used for data retrieval . More than only expressing information about resources in a standardized way and publishing it on the web, the SW is about linking data. Laying the foundations of the LD paradigm, Berners-Lee recommended the use of HTTP URIs as names for things so that people can look up and be provided with useful information and new links to discover new things .
Usually, in the SW approach, an ontology specifies the shareable knowledge of a domain, using a formal language like the Web Ontology Language (OWL) to describe classes, properties, individuals, and data values . Regarding life sciences, a couple of examples deserve to be mentioned. The Human Phenotype Ontology (HPO) provides a standardized vocabulary of phenotypic abnormalities encountered in human diseases . The Gene Ontology (GO) defines concepts to describe gene function along with three different aspects: molecular function, cellular component, and biological process . Many more biomedical ontologies and terminologies are available on the NCBO BioPortal .
The Findable, Accessible, Interoperable, and Reusable (FAIR) principles proposed by Wilkinson et al. provide guidelines to ensure that humans and machines can discover and reuse data resources . Not constrained by implementation decisions, the idea is to be as broad as possible, summarizing the experience and best practices of the multiple institutions and individuals involved in one way or another in research data sharing . We need to assign a persistent, globally unique identifier to data and metadata and ensure for either indexation or registration in a searchable resource. On the one hand, we use rich metadata to describe data; on the other hand, metadata needs to include, clearly and explicitly, the identifier of the data they are describing. We use multiple accurate and relevant attributes, meeting domain-relevant community standards. The data usage license must be clear and accessible. The declaration of the provenance of the data is mandatory. Data and metadata use a formal, accessible, shared, and broadly applicable language for knowledge representation, include qualified references to other data and metadata, and use vocabularies that follow FAIR principles. The identifier allows retrieving data and metadata, using an open, free, universally implementable, standardized communications protocol allowing, if needed, authentication and authorization. Finally, metadata should remain accessible even if data are no longer available.
“FAIRification” work is not trivial and usually demands close collaboration between IT people and the domain experts. Although FAIR is not equal to RDF, LD, or SW, these technologies are a mature option for the creation of FAIR data [3, 28]. Using a workflow like the one proposed by Jacobsen et al.  helps to manage to convert data into FAIR. We can consider several steps, starting with the formulation of domain questions and a pre-FAIRification analysis to gain focus and confront the original data with the desired outputs. The next step is to look closer at the data elements and define a semantic model capturing the most relevant concepts and relations for the domain experts. Naturally, we can reuse, adapt, combine, and augment existing models. Applying the developed ontological model, we transform the original data records to obtain a FAIR-compliant machine-readable representation. Then, we define the metadata about the data usage license and provenance in a format meaningful to computers. Finally, after deploying the FAIR data resource, a query interface or user app is made available to end-users.
The main goal of the FAIRification process is to expose data as a service in a standardized manner. There is a set of solutions, roughly classified into tools to transform and annotate data, tools to expose metadata referring to the source data, and metadata search engines . From the literature, some examples describe efforts to FAIRify life science data repositories. For instance, Rodríguez-Iglesias et al.  present the FAIRification of a portion of the Pathogen-Host Interaction Database (PHI-base). The extension of the Open Source Registry for Rare Diseases (OSSE) architecture to comply with FAIR principles is reported by Schaaf et al. , consisting of integrating a new component to expose metadata. Outside the scope of the life sciences, we can also highlight experiences such as those presented by Garcia-Silva et al.  around several Earth science disciplines.
3.1. System Requirements
Reflecting on the ideas presented in the previous section, we can state a set of requirements the tool must meet.
It should be a standalone application. Typical users are not IT personnel, and this underlines the need for the tool to be as simple to use as possible. The user’s ability to start work immediately, skipping confusing configuration settings, is of paramount importance. If needed, the configuration process must be straightforward and well documented.
It must be self-describing. The solution must be by itself a FAIR object in the FAIR ecosystem. Metadata, at the software level, describing the deployed instance must be rich and preferably standard to allow the running solution to be registered and integrated into larger data interoperability systems.
It must be possible to store and describe multiple datasets. Storing different datasets allows capturing the reality of different domains or particular views of the same field, thus increasing the solution’s flexibility.
It should make the data FAIRer. Data resulting from tool processing should be as FAIR as possible.
It must expose its services over the web. The tool must offer access points for other software agents to be able to interact in a networked environment, fulfilling findability and accessibility criteria. Software agents access the data using an open, free, universally implementable, standardized communications protocol allowing authentication and authorization if needed.
Authorization. All users can access the metadata. Only authorized users can create or modify the metadata. The tool enforces the authorization levels defined by the owners of each dataset.
User-friendly interfaces. Besides being a piece of machine-actionable software, one central feature is the way human users interact with the solution by using intuitive interfaces. A dashboard must allow users to see the stored datasets at a glance, providing useful and condensed information.
It must allow data queries. The possibility of issuing general queries over the datasets unleashes all the power of data reuse. Compliance with a widely used standard query language is essential.
SCALEUS is a semantic web tool developed to allow the integration of data and validated in the rare diseases domain. It is available as open-source at https://github.com/bioinformatics-ua/scaleus . The solution enables the migration of structured and unstructured information stored in dissimilar formats into the semantic format, without forcing the use of a predefined data integration ontology. This degree of freedom gives users greater flexibility in managing their data models. RDF resource loading is also available. Data is manageable as a collection because of the tool’s support for the creation of multiple datasets. Another significant advantage is the way people can quickly deploy and start using the single package software distribution, without wasting time with configuration settings.
The system enables users to perform a text search or to perform SPARQL queries with inference rules to retrieve the stored information. Additionally, a simplified REST application programming interface (API) allows several operations with different degrees of granularity, ranging from the dataset level to the level of the single triples. It is also possible to add, obtain, and remove namespaces. More importantly, a SPARQL endpoint is available for receiving and processing SPARQL queries over the web. As a summary, we list the essential features: (i)Very easy to deploy and start using(ii)Ontology-independent(iii)RDF resource loading (.ttl, .rdf, .owl, .nt, .jsonld, .rj, .n3, .trig, .trix, .trdf, .rt)(iv)Supports importing data from spreadsheets (.xlsx, .xls, .ods)(v)Support for multiple datasets(vi)Text search(vii)SPARQL queries(viii)Query federation to the available data(ix)Inference support(x)Web services API
3.3. The “FAIRness” of Data and Metadata
The objective of metadata is to state how data can be accessed and reused. A FAIR Data Point (FDP), as proposed by da Silva Santos et al. , provides a mechanism for users to discover properties (metadata) of datasets. The FDP is a crucial piece of the FAIR Data infrastructure, allowing the exposure of metadata in intermediate granularity between fully centralized descriptions of a supercollection of datasets or a fully distributed situation where the metadata of each dataset is published individually. The consideration of metadata clusters referring to several datasets streamline indexation, registration, and search using search engines.
Indexing the solution’s entry points in a search engine is of paramount importance for our data to become findable. It is essential to identify which search engines are most suitable for our purposes. Implemented to scale to all metadata published on the web, the Google Dataset Search (https://toolbox.google.com/datasetsearch) is a novel way to search for data collections that are automatically indexed by Google crawlers . For that to be possible for our solution, the deployed instance must expose, using RDFa, Microdata, or JSON-LD, a description of the entry points for our datasets using the Dataset or the DataCatalog types from the Schema.org vocabulary. Another possibility is to use the Dataset concept from the W3C Data Catalog Vocabulary (DCAT) ontology . This approach of adding simple markup to web pages that describe datasets does away with the need to build or directly feed a specific search engine and allows us to expose our data to a broad audience.
A design framework and exemplar metrics to evaluate the “FAIRness” of any digital object were proposed by Wilkinson et al. , considering the multidimensionality of the FAIR principles. Not only should data be evaluated but also any tool of the ecosystem must be FAIR compliant. Another important aspect is that this general framework of FAIR maturity indicators can be complemented with more specific assessment criteria to address the particular needs of particular communities.
As pointed out, the FAIR Data guidelines intentionally do not impose the architecture or implementation technologies for the infrastructure or tools supporting the FAIRification process. The comparison between the requirements stated in the previous section and the features of the legacy tool guided the specification of the SCALEUS-FD building blocks. As presented in Figure 1, the left branch of the architecture includes the components dealing with the process of semantic data conversion, i.e., the legacy SCALEUS tool, and the right side presents the new elements of SCALEUS-FD, which allow the creation and management of metadata.
The building blocks of the solution fall into three main layers: knowledge base, abstraction, and services. At the knowledge base layer, we have the databases storing the datasets converted into semantic graphs by the users. At this same level, another triplestore stores the metadata as RDF triples, ensuring logical and physical separation between different types of data. The transaction database component (TDB) ensures that data are protected against corruption when dealing with create, read, update, and delete (CRUD) operations. The abstraction layer deals with managing semantic datasets at a higher level, comprising the methods for creating and manipulating the data and metadata. Finally, at the service layer, the tool exposes its functionalities through an API for machine-to-machine (M2M) interaction and a graphical user interface (GUI) for human clients.
The Data Handler provides the operations for converting the user’s data into the semantic format. Metadata describing each of the created datasets must be entered or automatically generated and saved in the system. The ownership, license, and explicit description of the access points allow data navigation, fulfilling FAIR principles by making reuse possible. Management of these metadata in semantic format is through the Metadata Handler component, which connects the TDB dealing with the metadata repository. The Data Handler module can directly trigger this module, although the metadata is also available via the services API and the GUI.
4.2. Metadata Levels
Users can navigate between levels after clicking on any entry point exposed by a search engine, exploring the hierarchical metadata organization. Figure 2 shows the metadata classes used to describe the tool, catalogs, datasets, and distributions. For our profile, we are considering four levels of metadata, using the RE3Data Schema  and the DCAT specification as a basis.
The first level of metadata describes the tool itself as a repository. By default, on the first run of the application, only one catalog is created, but we can add more using the REST API. Users can change the default values for the first two layers using property configurations. In the third layer of metadata, we use a form to set the information about each dataset we add. Finally, the distribution level is automatically created containing a data access URI.
4.3. Services API
A set of RESTful web services provides data and metadata management endpoints for external software applications, enabling M2M interaction. For instance, we can create or remove a dataset or list all existing ones. The same type of operation is available for namespaces management and at the level of the triples. Creating, obtaining, or changing the tool’s metadata is also possible by evoking services (for more details, see the README file that comes with the source code on GitHub). More importantly, a generic SPARQL endpoint allows querying data and metadata unleashing the power of the SW approach.
We used the tool to increase the “FAIRification” of a registry with anonymized data from a cohort of patients with Huntington disease (HD), a fatal neurodegenerative disease affecting the brain. The source of information was on a spreadsheet collecting genetic and phenotypic data of 151 patients. Tabular data is a widespread format in the long tail of science and technology, and the small number of records is usual in the context of a rare disease, further underlining the importance of “FAIRifying” this data. The data headers relate to enrolment (e.g., date of informed consent), demographics (e.g., gender), genetic testing results (e.g., CAG larger allele), medical history, comorbid conditions, and cognitive data. Figure 3 shows the interface for loading the data to be converted to the semantic format.
After loading the data, we select the columns we want to transform into the semantic format. For each column, we must associate the semantic entity and namespace according to the selected ontologies. For instance, we can map the “subject” column to the term http://purl.org/dc/terms/identifier/ from the Dublin Core Metadata Initiative, and the “gender” column to the property http://xmlns.com/foaf/0.1/gender/ from the FOAF Vocabulary Specification. We can continue using other ontologies, as the Human Phenotype Ontology (https://hpo.jax.org/app/) to map columns like “depression” (HP:0000716), “irritability” (HP:0000737), “psychosis” (HP:0000709), and “apathy” (HP:0000741). We conclude the conversion process by creating the triples that are loaded into the preselected dataset.
Finally, Table 1 presents the “FAIRness” assessment of the tool using the maturity metrics mentioned previously.
Looking at the difficulties experienced by researchers when sharing their data, we felt motivated to build SCALEUS-FD, a tool that lightened the burden of publishing FAIR-compliant data and metadata to facilitate interoperability and reuse. The solution uses the SW and LD principles and has been validated in the field of rare diseases, proving to be a valuable aid for people looking for data sharing. In future work, we will improve the visualization interfaces of semantic data and add support for federated queries using external datasets.
The data are made available by the corresponding author upon request.
The funders had no role in the study design, data collection, data analysis, decision to publish, or preparation of the manuscript.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this paper.
Arnaldo Pereira researched and developed the solution under the supervision and coordination of Rui Pedro Lopes and José Luís Oliveira.
FCT - Portuguese Foundation for Science and Technology supports Arnaldo Pereira (Ph.D. Grant PD/BD/142877/2018).
- E. Kolker, E. Stewart, and V. Ozdemir, “Opportunities and challenges for the life sciences community,” Omics: a Journal of Integrative Biology, vol. 16, no. 3, pp. 138–147, 2012.
- J. C. Wallis, E. Rolando, and C. L. Borgman, “If we share data, will anyone use them? Data sharing and reuse in the long tail of science and technology,” PLoS ONE, vol. 8, no. 7, article e67332, 2013.
- B. Mons, C. Neylon, J. Velterop, M. Dumontier, L. O. B. da Silva Santos, and M. D. Wilkinson, “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, 2017.
- T. D. Wade, “Traits and types of health data repositories,” Health Information Science and Systems, vol. 2, no. 1, 2014.
- Y. Perez-Riverol, M. Bai, F. da Veiga Leprevost et al., “Discovering and linking public omics data sets using the Omics Discovery Index,” Nature Biotechnology, vol. 35, no. 5, pp. 406–409, 2017.
- H. D. Tagare, C. C. Jaffe, and J. Duncan, “Medical image databases: a content-based retrieval approach,” Journal of the American Medical Informatics Association: JAMIA, vol. 4, no. 3, pp. 184–198, 1997.
- G. Jacobs, A. Wolf, M. Krawczak, and W. Lieb, “Biobanks in the era of digital medicine,” Clinical Pharmacology and Therapeutics, vol. 103, no. 5, pp. 761-762, 2018.
- S. Schneeweiss and J. Avorn, “A review of uses of health care utilization databases for epidemiologic research on therapeutics,” Journal of Clinical Epidemiology, vol. 58, no. 4, pp. 323–337, 2005.
- A. G. Villanueva, R. Cook-Deegan, B. A. Koenig et al., “Characterizing the biomedical data-sharing landscape,” The Journal of law, medicine & ethics: a journal of the American Society of Law, Medicine & Ethics, vol. 47, no. 1, pp. 21–30, 2019.
- B. Golshan, A. Halevy, G. Mihaila, and W. -C. Tan, “Data integration: after the teenage years,” in Proceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 101–106, Chicago, IL, USA, 2017.
- L. P. Francis and J. G. Francis, “Data reuse and the problem of group identity,” in Studies in Law Politics and Society, vol. 73, pp. 141–164, Emerald Publishing Limited, 2017.
- A. Cambon-Thomsen, “The social and ethical issues of post-genomic human biobanks,” Nature Reviews Genetics, vol. 5, no. 11, pp. 866–873, 2004.
- A. Goodman, A. Pepe, A. W. Blocker et al., “Ten simple rules for the care and feeding of scientific data,” PLoS Computational Biology, vol. 10, no. 4, article e1003542, 2014.
- T. Berners-Lee, J. Hendler, and O. Lassila, “The semantic web,” Scientific American, vol. 284, no. 5, pp. 34–43, 2001.
- S. Speicher, J. Arwe, and A. Malhotra, Linked data platform 1.0, W3C recommendation, 2015, February 2020, https://www.w3.org/TR/ldp/.
- P. Sernadela, L. González-Castro, C. Carta et al., “Linked registries: connecting rare diseases patient registries through a Semantic Web layer,” BioMed Research International, vol. 2017, Article ID 8327980, 13 pages, 2017.
- H. Chen, T. Yu, and J. Y. Chen, “Semantic Web meets integrative biology: a survey,” Briefings in Bioinformatics, vol. 14, no. 1, pp. 109–125, 2013.
- S. Paraiso-Medina, D. Pérez-Rey, R. Alonso-Calvo et al., “Semantic interoperability solution for multicentric breast cancer trials at the integrate EU project,” in Proceedings of the International Conference on Health Informatics, HEALTHINF, pp. 34–41, Barcelona, Spain, 2013.
- G. Schreiber and Y. Raimond, RDF 1.1 primer, W3C working group note, 2014, February 2020, https://www.w3.org/TR/rdf11-primer/.
- R. Cyganiak, D. Wood, and M. Lanthaler, RDF 1.1 concepts and abstract syntax, W3C recommendation, 2014, February 2020, https://www.w3.org/TR/rdf11-concepts/.
- W3C SPARQL Working Group, SPARQL 1.1 overview, W3C recommendation, 2013, February 2020, https://www.w3.org/TR/sparql11-overview/.
- T. Berners-Lee, Linked Data design issues, W3C internal document, 2006, February 2020, https://www.w3.org/DesignIssues/LinkedData.html.
- P. Hitzler, M. Krötzsch, B. Parsia, P. F. Patel-Schneider, and S. Rudolph, OWL 2 web ontology language primer (second edition), W3C recommendation, 2012, February 2020, https://www.w3.org/TR/owl2-primer/.
- S. Köhler, N. A. Vasilevsky, M. Engelstad et al., “The human phenotype ontology in 2017,” Nucleic Acids Research, vol. 45, no. D1, pp. D865–D876, 2017.
- The Gene Ontology Consortium, “Expansion of the Gene Ontology knowledgebase and resources,” Nucleic Acids Research, vol. 45, no. D1, pp. D331–D338, 2017.
- P. L. Whetzel, N. F. Noy, N. H. Shah et al., “BioPortal: enhanced functionality via new Web services from the National Center for Biomedical Ontology to access and use ontologies in software applications,” Nucleic Acids Research, vol. 39, suppl, pp. W541–W545, 2011.
- M. D. Wilkinson, M. Dumontier, I. J. Aalbersberg et al., “The FAIR guiding principles for scientific data management and stewardship,” Scientific Data, vol. 3, no. 1, article 160018, 2016.
- M. D. Wilkinson, R. Verborgh, L. O. da Silva Santos et al., “Interoperability and FAIRness through a novel combination of Web technologies,” PeerJ Computer Science, vol. 3, article e110, 2017.
- A. Jacobsen, M. Thompson, M. Hanauer et al., D8.2 Documentation of the tools for the data manipulation and standard conversions in the rare-disease field, 2018, February 2020, https://zenodo.org/record/1452468.
- M. Thompson, L. Bonino, M. D. Wilkinson et al., “Overview of a suite of middle-ware services for implementing FAIR data principles,” in CEUR Workshop Proceedings, vol. 2042, Rome, Italy, 2017.
- A. Rodríguez-Iglesias, A. Rodríguez-González, A. G. Irvine et al., “Publishing FAIR data: an exemplar methodology utilizing PHI-base,” Frontiers in Plant Science, vol. 7, p. 641, 2016.
- J. Schaaf, D. Kadioglu, J. Goebel et al., “OSSE goes FAIR - implementation of the FAIR Data principles for an open-source registry for rare diseases,” Studies in Health Technology and Informatics, vol. 253, pp. 209–213, 2018.
- A. Garcia-Silva, J. M. Gomez-Perez, R. Palma et al., “Enabling FAIR research in Earth Science through research objects,” Future Generation Computer Systems, vol. 98, pp. 550–564, 2019.
- P. Sernadela, L. González-Castro, and J. L. Oliveira, “SCALEUS: semantic Web services integration for biomedical applications,” Journal of Medical Systems, vol. 41, no. 4, pp. 1–11, 2017.
- L. B. da Silva Santos, M. D. Wilkinson, A. Kuzniar et al., FAIR Data points supporting big data interoperability, Enterprise Interoperability in the Digitized and Networked Factory of the Future, ISTE Press, 2016.
- N. Noy, M. Burgess, and D. Brickley, “Google dataset search: building a search engine for datasets in an open web ecosystem,” in The Web Conference 2019 - Proceedings of the World Wide Web Conference, pp. 1365–1375, San Francisco, USA, 2019.
- F. Maali and J. Erickson, Data Catalog Vocabulary (DCAT), W3C recommendation, 2014, February 2020, https://www.w3.org/TR/vocab-dcat-1/.
- M. D. Wilkinson, S. A. Sansone, E. Schultes, P. Doorn, L. O. da Silva Santos, and M. Dumontier, “A design framework and exemplar metrics for FAIRness,” Scientific Data, vol. 5, no. 1, article 180118, 2018.
- J. Rücknagel, P. Vierkant, R. Ulrich et al., Metadata schema for the description of research data repositories: version 3.0, 2015, February 2020, http://gfzpublic.gfz-potsdam.de/pubman/item/escidoc:1397899.
Copyright © 2020 Arnaldo Pereira et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.