Fields Scraped and Indexed

The top-down concepts live in ontologies, usually the flat or compositional ones.

The bottom-up formats and the data extracted for use in alignment is described in the tables below. A sample version of the scraped data can be downloaded.

• Dojo (Jataware)

  • Indicator as documented or exemplified

    Field	Required for scrape	Used in index	Shown in output	Used internally
    id	✓		✓
    name	✓
    family_name
    description	✓	/
    created_at
    category	?	/
    maintainer
    data_paths
    tags	?	✓
    geography
    period
    outputs	-
    _.name	✓		✓
    _.display_name	✓	✓	✓
    _.description	✓	✓	✓
    _.type
    _.unit
    _.unit_description
    _.ontologies
    _.is_primary
    _.data_resolution
    qualifier_outputs	-
    _.name	✓		✓
    _.display_name	✓	✓	✓
    _.description	✓	✓	✓
    _.type
    _.unit
    _.unit_description
    _.ontologies
    _.related_features

  scrape key: ✓ = required, ? = optional, - = organizational entry, / = used for specific API method

  • Model as documented or exemplified. The models are not presently scraped at all.

    Field	Required for scrape	Used in index	Shown in output	Used internally
    id	✓		✓
    name	✓
    family_name
    description	✓	/
    created_at
    category	?	/
    maintainer
    image
    observed_data
    is_stochastic
    tags	?	✓
    geography
    period
    parameters	-
    _.name	✓		✓
    _.display_name	✓	✓	✓
    _.description	✓	✓	✓
    _.type
    _.unit
    _.unit_description
    _.ontologies
    _.is_drilldown
    _.additional_options
    _.data_type
    _.default
    _.choices
    _.min
    _.max
    outputs	-
    _.name	✓		✓
    _.display_name	✓	✓	✓
    _.description	✓	✓	✓
    _.type
    _.unit
    _.unit_description
    _.ontologies
    _.is_primary
    _.additional_options
    _.data_resolution
    _.choices
    _.min
    _.max
    qualifier_outputs	-
    _.name	✓		✓
    _.display_name	✓	✓	✓
    _.description	✓	✓	✓
    _.type
    _.unit
    _.unit_description
    _.ontologies
    _.related_features

  scrape key: ✓ = required, ? = optional, - = organizational entry, * = to be added

• SuperMaaS (Galois) as documented or from a local copy

  • Model

    Field	Required for scrape	Used in index	Shown in output	Used internally
    id	✓		✓
    created	✓			✓
    name	?
    tags	?	✓
    description	✓
    parameters	-
    _.name	✓		✓
    _.tags	?	✓
    _.description	?	✓	✓
    outputs	-
    _.name	✓		✓
    _.tags	?	✓
    _.description	?	✓	✓

  scrape key: ✓ = required, ? = optional, - = organizational entry

  • Cube

    Field	Required for scrape	Used in index	Shown in output	Used internally
    id	✓		✓
    created	✓			✓
    name
    tags	?	✓
    description	✓
    parameters	-
    _.name	✓		✓
    _.description	?	✓	✓
    _.tags	?	✓
    independent_vars	-
    _.name	✓		✓
    _.description	?	✓	✓
    _.tags	?	✓
    dependent_vars	-
    _.name	✓		✓
    _.description	?	✓	✓
    _.tags	?	✓

  scrape key: ✓ = required, ? = optional, - = organizational entry

• ISI (Information Sciences Institute, USC Viterbi) as documented

  • Datamart

    Field	Required for scrape	Used in index	Shown in output	Used internally
    dataset_id	✓		✓
    name	✓
    description	✓
    url	✓			✓
    variable_id	✓		✓
    name	✓		✓
    description	✓	✓	✓