Skip to content

Class: LabelingStrategy

Was any labeling of the data done (e.g., part-of-speech tagging)? This class documents the annotation process and quality metrics.

__

URI: data_sheets_schema:LabelingStrategy

classDiagram class LabelingStrategy click LabelingStrategy href "../LabelingStrategy/" DatasetProperty <|-- LabelingStrategy click DatasetProperty href "../DatasetProperty/" LabelingStrategy : annotations_per_item LabelingStrategy : annotator_demographics LabelingStrategy : data_annotation_platform LabelingStrategy : data_annotation_protocol LabelingStrategy : description LabelingStrategy : id LabelingStrategy : inter_annotator_agreement LabelingStrategy : labeling_details LabelingStrategy : name LabelingStrategy : notes LabelingStrategy : source_caveats LabelingStrategy : used_software LabelingStrategy --> "*" Software : used_software click Software href "../Software/"

Inheritance

Slots

Name Cardinality and Range Description Inheritance
data_annotation_platform 0..1
String		 One or more platforms or tools used for annotation (e direct
data_annotation_protocol 0..1
String		 Annotation methodology, tasks, and protocols followed during labeling direct
annotations_per_item 0..1
Integer		 Number of annotations collected per data item direct
inter_annotator_agreement 0..1
String		 Measure of agreement between annotators (e direct
annotator_demographics *
String		 One or more demographic characteristics of the annotators, if available and r... direct
labeling_details 0..1
String		 Free-text description of the labeling or annotation procedures, including ann... direct
id 0..1
Uriorcurie		 An optional identifier for this property DatasetProperty
name 0..1
String		 A human-readable name for this property DatasetProperty
description 0..1
String		 A human-readable description for this property DatasetProperty
notes 0..1
String		 Residual content only, after every fitting slot is used (#385): structured sl... DatasetProperty
source_caveats 0..1
String		 Commentary on the evidence behind this object's values — source conflicts, wh... DatasetProperty
used_software *
Software		 What software was used as part of this dataset property? DatasetProperty

Usages

used by used in type used
Dataset labeling_strategies range LabelingStrategy
DataSubset labeling_strategies range LabelingStrategy

Identifier and Mapping Information

Schema Source

  • from schema: https://w3id.org/bridge2ai/data-sheets-schema

Mappings

Mapping Type Mapped Value
self data_sheets_schema:LabelingStrategy
native data_sheets_schema:LabelingStrategy

LinkML Source

Direct

name: LabelingStrategy
description: 'Was any labeling of the data done (e.g., part-of-speech tagging)? This
  class documents the annotation process and quality metrics.

  '
from_schema: https://w3id.org/bridge2ai/data-sheets-schema
is_a: DatasetProperty
attributes:
  data_annotation_platform:
    name: data_annotation_platform
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: Label Studio 1.7.3
    description: One or more platforms or tools used for annotation (e.g., Label Studio,
      Prodigy, Amazon Mechanical Turk, custom annotation tool).
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    slot_uri: rai:dataAnnotationPlatform
    domain_of:
    - LabelingStrategy
    range: string
  data_annotation_protocol:
    name: data_annotation_protocol
    description: Annotation methodology, tasks, and protocols followed during labeling.
      Includes annotation guidelines, quality control procedures, and task definitions.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    exact_mappings:
    - rai:dataAnnotationProtocol
    rank: 1000
    slot_uri: d4d:dataAnnotationProtocol
    domain_of:
    - LabelingStrategy
    range: string
  annotations_per_item:
    name: annotations_per_item
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: 3 (three independent annotators per item)
    description: Number of annotations collected per data item. Multiple annotations
      per item enable calculation of inter-annotator agreement.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    exact_mappings:
    - rai:annotationsPerItem
    rank: 1000
    slot_uri: d4d:annotationsPerItem
    domain_of:
    - LabelingStrategy
    range: integer
  inter_annotator_agreement:
    name: inter_annotator_agreement
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: Cohen's κ = 0.82 (substantial agreement)
    description: Measure of agreement between annotators (e.g., Cohen's kappa, Fleiss'
      kappa, Krippendorff's alpha, percent agreement). Include both the metric name
      and value.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    slot_uri: schema:measurementMethod
    domain_of:
    - LabelingStrategy
    range: string
  annotator_demographics:
    name: annotator_demographics
    description: One or more demographic characteristics of the annotators, if available
      and relevant (e.g., geographic location, language background, expertise level,
      native language).
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    exact_mappings:
    - rai:annotatorDemographics
    rank: 1000
    slot_uri: d4d:annotatorDemographics
    domain_of:
    - LabelingStrategy
    range: string
    multivalued: true
  labeling_details:
    name: labeling_details
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: Board-certified ophthalmologists graded retinal images using ETDRS
          scale
    description: 'Free-text description of the labeling or annotation procedures,
      including annotation guidelines, task definitions, and quality control metrics.

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    slot_uri: dcterms:description
    domain_of:
    - LabelingStrategy
    range: string

Induced

name: LabelingStrategy
description: 'Was any labeling of the data done (e.g., part-of-speech tagging)? This
  class documents the annotation process and quality metrics.

  '
from_schema: https://w3id.org/bridge2ai/data-sheets-schema
is_a: DatasetProperty
attributes:
  data_annotation_platform:
    name: data_annotation_platform
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: Label Studio 1.7.3
    description: One or more platforms or tools used for annotation (e.g., Label Studio,
      Prodigy, Amazon Mechanical Turk, custom annotation tool).
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    slot_uri: rai:dataAnnotationPlatform
    alias: data_annotation_platform
    owner: LabelingStrategy
    domain_of:
    - LabelingStrategy
    range: string
  data_annotation_protocol:
    name: data_annotation_protocol
    description: Annotation methodology, tasks, and protocols followed during labeling.
      Includes annotation guidelines, quality control procedures, and task definitions.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    exact_mappings:
    - rai:dataAnnotationProtocol
    rank: 1000
    slot_uri: d4d:dataAnnotationProtocol
    alias: data_annotation_protocol
    owner: LabelingStrategy
    domain_of:
    - LabelingStrategy
    range: string
  annotations_per_item:
    name: annotations_per_item
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: 3 (three independent annotators per item)
    description: Number of annotations collected per data item. Multiple annotations
      per item enable calculation of inter-annotator agreement.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    exact_mappings:
    - rai:annotationsPerItem
    rank: 1000
    slot_uri: d4d:annotationsPerItem
    alias: annotations_per_item
    owner: LabelingStrategy
    domain_of:
    - LabelingStrategy
    range: integer
  inter_annotator_agreement:
    name: inter_annotator_agreement
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: Cohen's κ = 0.82 (substantial agreement)
    description: Measure of agreement between annotators (e.g., Cohen's kappa, Fleiss'
      kappa, Krippendorff's alpha, percent agreement). Include both the metric name
      and value.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    slot_uri: schema:measurementMethod
    alias: inter_annotator_agreement
    owner: LabelingStrategy
    domain_of:
    - LabelingStrategy
    range: string
  annotator_demographics:
    name: annotator_demographics
    description: One or more demographic characteristics of the annotators, if available
      and relevant (e.g., geographic location, language background, expertise level,
      native language).
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    exact_mappings:
    - rai:annotatorDemographics
    rank: 1000
    slot_uri: d4d:annotatorDemographics
    alias: annotator_demographics
    owner: LabelingStrategy
    domain_of:
    - LabelingStrategy
    range: string
    multivalued: true
  labeling_details:
    name: labeling_details
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: Board-certified ophthalmologists graded retinal images using ETDRS
          scale
    description: 'Free-text description of the labeling or annotation procedures,
      including annotation guidelines, task definitions, and quality control metrics.

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    slot_uri: dcterms:description
    alias: labeling_details
    owner: LabelingStrategy
    domain_of:
    - LabelingStrategy
    range: string
  id:
    name: id
    annotations:
      d4d:docExample:
        tag: d4d:docExample
        value: https://example.org/dataset/property-001
    description: An optional identifier for this property.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: schema:identifier
    alias: id
    owner: LabelingStrategy
    domain_of:
    - NamedThing
    - Organization
    - DatasetProperty
    - Grant
    range: uriorcurie
  name:
    name: name
    description: A human-readable name for this property.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: schema:name
    alias: name
    owner: LabelingStrategy
    domain_of:
    - NamedThing
    - Organization
    - DatasetProperty
    - Grant
    range: string
  description:
    name: description
    description: A human-readable description for this property.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: schema:description
    alias: description
    owner: LabelingStrategy
    domain_of:
    - NamedThing
    - Organization
    - DatasetProperty
    - Grant
    - DatasetRelationship
    range: string
  notes:
    name: notes
    description: 'Residual content only, after every fitting slot is used (#385):
      structured slots first, description as the default home for narrative, notes
      last — solely for content description cannot hold. Never a restatement of a
      sibling slot''s value, and never a substitute for inventing keys the schema
      does not declare (#380).'
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: schema:comment
    alias: notes
    owner: LabelingStrategy
    domain_of:
    - NamedThing
    - Organization
    - DatasetProperty
    - Grant
    range: string
  source_caveats:
    name: source_caveats
    description: 'Commentary on the evidence behind this object''s values — source
      conflicts, what a value was transcribed from, questions the source material
      leaves unanswered (#385). A trust annotation about the sibling slots, not dataset
      content: content belongs in the structured slots, description or notes.'
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: dcterms:provenance
    alias: source_caveats
    owner: LabelingStrategy
    domain_of:
    - NamedThing
    - Organization
    - DatasetProperty
    - Grant
    range: string
  used_software:
    name: used_software
    description: What software was used as part of this dataset property?
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    rank: 1000
    slot_uri: d4d:usedSoftware
    alias: used_software
    owner: LabelingStrategy
    domain_of:
    - DatasetProperty
    range: Software
    multivalued: true
    inlined: true
    inlined_as_list: true