Discovery Environment for Relational Information and Versioned Assets (DERIVA)

DERIVA is a suite of tools and services that are designed to significantly reduce the overhead and complexity of creating and managing complex, big datasets. DERIVA provide a digital asset management system for scientific data to streamlines the acquisition, modeling, management and sharing of complex, big data, and provides interfaces so that these data can be delivered to diverse external tools for big-data analysis and analytic tools.

DERIVA is not intended to work "out of the box" but rather can be easily configured to adapt to a wide variety of different data types and use cases. We are currently working on preconfigured versions of DERIVA services to accommodate specific usage scenarios, such as PheWAS.

The components of the DERIVA ecosystem are shown in the figure below:

ERMREST/CHAISE/HATRAC/IOBOX

A general relational data storage service for web based, data-storage collaboration.

Get Latest ERMrest Software Get Latest Chaise Software Get Latest IObox Software Get Latest Hatrac Software ABIDE Data Catalog

• ERMrest (rhymes with "earn rest") is a general relational data storage service for web-based, data-oriented collaboration. It allows general entity-relationship modeling of data resources manipulated by RESTful access methods.
• Chaise is a model-driven web interface (more formally a user agent) for data discovery, analysis, visualization, editing, sharing and collaboration over tabular data (more specifically relational data) served up as Web resources by the ERMrest service. Chaise dynamically renders relational data resources based on a small set of baseline assumptions, combined with its rendering heuristics, and finally user preferences in order to support common user interactions with the data. Chaise is developed in JavaScript, HTML, CSS, and runs in most modern Web browsers. It is the front-end component of the suite of tools including ERMrest, Hatrac, and IObox.
• Hatrac: Hatrac (pronounced "hat rack") is a simple object storage service for web-based, data-oriented collaboration. It presents a simple HTTP RESTful service model with hierarchical data naming, access control suitable for collaboration, trivial support for browser-based applications, referential stability for immutable data, atomic binding of names to data and consistent use of distributed data.
• IObox is a collection of Extract, Transform, Load (ETL) utilities for ERMrest+Hatrac.
  1. Extract: Connects to a data source (or read from a file) and generates a data "bag".
  2. Transform: Takes a "bag", runs transformations and outputs an updated "bag".
  3. Load: Takes a "bag" and loads it into a data sink.

The Deriva tools have been used for the PheWAS approach use case. ABIDE data can be explored on the Deriva system by clicking on this link.