Multimodal Module of Functional Status Knowledge Graph (FuS-KG)
language en

Multimodal Module of Functional Status Knowledge Graph (FuS-KG)

Modified on: 2024-04-26
Latest version:
https://w3id.org/fuskg/multimodal#
Revision:
1.0
Issued on:
2024-03-01
Authors:
Gianluca Apriceno
Mauro Dragoni
Tania Bailoni
Imported Ontologies:
core
dcat
prov-o#
Download serialization:
JSON-LD RDF/XML N-Triples TTL
License:
https://creativecommons.org/licenses/by-nc-sa/4.0/
Visualization:
Visualize with WebVowl
Cite as:
Gianluca Apriceno, Mauro Dragoni, Tania Bailoni. Multimodal Module of Functional Status Knowledge Graph (FuS-KG). Revision: 1.0.
Vocabulary maintained at:
https://github.com/IDA-FBK/FuS-KG
Multimodal Module Specification

Abstract

The Multimodal module is imported by the Recipes and Activity modules. The module contains, when available within the adopted sources, the multi-modal knowledge associated with specific Recipe and Activity. In particular, the current version of FuS-KG contains knowledge about image and video modalities. The definition of this module is aligned with the one provided by [Apriceno et al. (2024)](#Apriceno2024) and represents a possible instantiation of it.

Introduction back to ToC

The Multimodal module is imported by the recipes and activity modules. The module contains, when available within the adopted sources, the multi-modal knowledge associated with a specific Recipe and Activity. In particular, the current version of FuS-KG contains knowledge about image and video modalities. This module specifies the ModalDescriptor category, the ModalEntity category which, at the moment, corresponds to a Recipe or Activity and its Modality. In particular, a ModalDescriptor is connected to the ModalEntity by the hasModalDescriptor property and to the corresponding modality with the hasModality property. The definition of this module is aligned with the one provided by [Apriceno et al. (2024)](#Apriceno2024) and represents a possible instantiation of it.

Namespace declarations

Table 1: Namespaces used in the document
dcat<http://www.w3.org/ns/dcat#>
dcterms<http://purl.org/dc/terms/>
fsmumo<https://w3id.org/fuskg/multimodal#>
owl<http://www.w3.org/2002/07/owl#>
rdf<http://www.w3.org/1999/02/22-rdf-syntax-ns#>
rdfs<http://www.w3.org/2000/01/rdf-schema#>
time<http://www.w3.org/2006/time#>
vann<http://purl.org/vocab/vann/>
xml<http://www.w3.org/XML/1998/namespace>
xsd<http://www.w3.org/2001/XMLSchema#>

Multimodal Module of Functional Status Knowledge Graph (FuS-KG): Overview back to ToC

This ontology has the following classes and properties.

Classes

Object Properties

Data Properties

Annotation Properties

Multimodal Module of Functional Status Knowledge Graph (FuS-KG): Description back to ToC

Multimodal Module

The Multimodal module is imported by the Recipes and Activity modules. This module stores multimodal knowledge associated with a specific Recipe or Activity, primarily focusing on image and video modalities. The module defines the following key concepts: - [ModalDescriptor](#ModalDescriptor): Represents the descriptor for a modality associated with a Recipe or Activity. - [ModalEntity](#ModalEntity): Corresponds to a Recipe or Activity and its associated modality. The following key properties are used to connect the concepts: - [hasModalDescriptor](#hasModalDescriptor): Links a [ModalEntity](#ModalEntity) to its [ModalDescriptor](#ModalDescriptor). - [hasModality](#hasModality): Connects a [ModalDescriptor](#ModalDescriptor) to the corresponding modality (e.g., image, video). The definition of this module is aligned with the one provided by [Apriceno et al. (2024)](#Apriceno2024) and represents a possible instantiation of it.

Cross-reference for Multimodal Module of Functional Status Knowledge Graph (FuS-KG) classes, object properties and data properties back to ToC

This section provides details for each class and property defined by Multimodal Module of Functional Status Knowledge Graph (FuS-KG).

Classes

Audioc back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#Audio

Concept denoting Audio modality.
has super-classes
Modality c
is disjoint with
Data stream c, Image c, Text c, Video c

Data streamc back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#DataStream

Concept denoting DataStream modality.
has super-classes
Modality c
is disjoint with
Audio c, Image c, Text c, Video c

Imagec back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#Image

Concept denoting Image modality.
has super-classes
Modality c
is in domain of
height dp, width dp
is disjoint with
Audio c, Data stream c, Text c, Video c

Modal descriptorc back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#ModalDescriptor

Concept used to connect a modal entity with its modality.
has super-classes
Catalogued resource c
is in domain of
Path inside artifact dp, URL resource dp, has modality op
is in range of
ha descrittore modale op

Modal Entityc back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#ModalEntity

Root class used to specify modal entities that can be associated with one or more modal resources.
is in domain of
ha descrittore modale op

Modalityc back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#Modality

Parent class used to specify a data modality of a resource
has sub-classes
Audio c, Data stream c, Image c, Text c, Video c
is in range of
has modality op

Textc back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#Text

Concept denoting Text modality.
has super-classes
Modality c
is disjoint with
Audio c, Data stream c, Image c, Video c

Videoc back to ToC or Class ToC

IRI: https://w3id.org/fuskg/multimodal#Video

Concept denoting Video modality.
has super-classes
Modality c
is in domain of
Frame per second dp, height dp, width dp
is disjoint with
Audio c, Data stream c, Image c, Text c

Object Properties

ha descrittore modaleop back to ToC or Object Property ToC

IRI: https://w3id.org/fuskg/multimodal#hasModalDescriptor

Property used to connect a ModalEntity with its corresponding ModalDescriptor(s).
has domain
Modal Entity c
has range
Modal descriptor c

has modalityop back to ToC or Object Property ToC

IRI: https://w3id.org/fuskg/multimodal#hasModality

Property used to connect a ModalDescriptor with its correspondig Modality.
has domain
Modal descriptor c
has range
Modality c

Data Properties

Frame per seconddp back to ToC or Data Property ToC

IRI: https://w3id.org/fuskg/multimodal#fps

Frame per second of a Video.
has domain
Video c
has range
float

heightdp back to ToC or Data Property ToC

IRI: https://w3id.org/fuskg/multimodal#height

Height of an image or video (related to resolution).
has domain
Image c or Video c
has range
int

Path inside artifactdp back to ToC or Data Property ToC

IRI: https://w3id.org/fuskg/multimodal#hasPathInArtifact

Path inside an artifact (e.g., an archive).
has domain
Modal descriptor c
has range
string

URL resourcedp back to ToC or Data Property ToC

IRI: https://w3id.org/fuskg/multimodal#resourceURL

URL pointing to a resource.
has domain
Modal descriptor c
has range
any U R I

widthdp back to ToC or Data Property ToC

IRI: https://w3id.org/fuskg/multimodal#width

Width of an image or video (related to resolution).
has domain
Image c or Video c
has range
int

Annotation Properties

creatorap back to ToC or Annotation Property ToC

IRI: http://purl.org/dc/terms/creator

issuedap back to ToC or Annotation Property ToC

IRI: http://purl.org/dc/terms/issued

licenseap back to ToC or Annotation Property ToC

IRI: http://purl.org/dc/terms/license

modifiedap back to ToC or Annotation Property ToC

IRI: http://purl.org/dc/terms/modified

preferred Namespace Prefixap back to ToC or Annotation Property ToC

IRI: http://purl.org/vocab/vann/preferredNamespacePrefix

preferred Namespace Uriap back to ToC or Annotation Property ToC

IRI: http://purl.org/vocab/vann/preferredNamespaceUri

publisherap back to ToC or Annotation Property ToC

IRI: http://purl.org/dc/terms/publisher

rightsap back to ToC or Annotation Property ToC

IRI: http://purl.org/dc/terms/rights

titleap back to ToC or Annotation Property ToC

IRI: http://purl.org/dc/terms/title

Legend back to ToC

c: Classes
op: Object Properties
dp: Data Properties
ap: Annotation Properties

References back to ToC

  1. Apriceno, G., Tamma, V., Bailoni, T., de Berardinis, J., & Dragoni, M. (2024). A pattern to align them all: Integrating different modalities to define multi-modal entities. arXiv preprint. https://arxiv.org/abs/2410.13803

Acknowledgments back to ToC

The authors would like to thank Silvio Peroni for developing LODE, a Live OWL Documentation Environment, which is used for representing the Cross Referencing Section of this document and Daniel Garijo for developing Widoco, the program used to create the template used in this documentation.