Skip to content

Class: AnnotationAnalysis

Analysis of annotation quality, inter-annotator agreement metrics, and systematic patterns in annotation disagreements.

__

URI: data_sheets_schema:AnnotationAnalysis

classDiagram class AnnotationAnalysis click AnnotationAnalysis href "../AnnotationAnalysis/" DatasetProperty <|-- AnnotationAnalysis click DatasetProperty href "../DatasetProperty/" AnnotationAnalysis : agreement_metric AnnotationAnalysis : analysis_method AnnotationAnalysis : annotation_quality_details AnnotationAnalysis : description AnnotationAnalysis : disagreement_patterns AnnotationAnalysis : id AnnotationAnalysis : inter_annotator_agreement_score AnnotationAnalysis : name AnnotationAnalysis : used_software AnnotationAnalysis --> "*" Software : used_software click Software href "../Software/"

Inheritance

Slots

Name Cardinality and Range Description Inheritance
inter_annotator_agreement_score 0..1
Float		 Measured agreement between annotators (e direct
agreement_metric 0..1
String		 Type of agreement metric used (Cohen's kappa, Fleiss' kappa, Krippendorff's a... direct
analysis_method 0..1
String		 Methodology used to assess annotation quality and resolve disagreements direct
disagreement_patterns *
String		 Systematic patterns in annotator disagreements (e direct
annotation_quality_details *
String		 Additional details on annotation quality assessment and findings direct
id 0..1
Uriorcurie		 An optional identifier for this property DatasetProperty
name 0..1
String		 A human-readable name for this property DatasetProperty
description 0..1
String		 A human-readable description for this property DatasetProperty
used_software *
Software		 What software was used as part of this dataset property? DatasetProperty

Usages

used by used in type used
Dataset annotation_analyses range AnnotationAnalysis
DataSubset annotation_analyses range AnnotationAnalysis

Identifier and Mapping Information

Schema Source

  • from schema: https://w3id.org/bridge2ai/data-sheets-schema

Mappings

Mapping Type Mapped Value
self data_sheets_schema:AnnotationAnalysis
native data_sheets_schema:AnnotationAnalysis
exact rai:dataAnnotationAnalysis

LinkML Source

Direct

name: AnnotationAnalysis
description: 'Analysis of annotation quality, inter-annotator agreement metrics, and
  systematic patterns in annotation disagreements.

  '
from_schema: https://w3id.org/bridge2ai/data-sheets-schema
exact_mappings:
- rai:dataAnnotationAnalysis
is_a: DatasetProperty
attributes:
  inter_annotator_agreement_score:
    name: inter_annotator_agreement_score
    description: 'Measured agreement between annotators (e.g., Cohen''s kappa value,
      Fleiss'' kappa, Krippendorff''s alpha).

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    domain_of:
    - AnnotationAnalysis
    range: float
  agreement_metric:
    name: agreement_metric
    description: 'Type of agreement metric used (Cohen''s kappa, Fleiss'' kappa, Krippendorff''s
      alpha, percentage agreement, etc.).

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    domain_of:
    - AnnotationAnalysis
    range: string
  analysis_method:
    name: analysis_method
    description: 'Methodology used to assess annotation quality and resolve disagreements.

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    domain_of:
    - AnnotationAnalysis
    range: string
  disagreement_patterns:
    name: disagreement_patterns
    description: 'Systematic patterns in annotator disagreements (e.g., by demographic
      group, annotation difficulty, task type).

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    domain_of:
    - AnnotationAnalysis
    range: string
    multivalued: true
  annotation_quality_details:
    name: annotation_quality_details
    description: 'Additional details on annotation quality assessment and findings.

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    domain_of:
    - AnnotationAnalysis
    range: string
    multivalued: true

Induced

name: AnnotationAnalysis
description: 'Analysis of annotation quality, inter-annotator agreement metrics, and
  systematic patterns in annotation disagreements.

  '
from_schema: https://w3id.org/bridge2ai/data-sheets-schema
exact_mappings:
- rai:dataAnnotationAnalysis
is_a: DatasetProperty
attributes:
  inter_annotator_agreement_score:
    name: inter_annotator_agreement_score
    description: 'Measured agreement between annotators (e.g., Cohen''s kappa value,
      Fleiss'' kappa, Krippendorff''s alpha).

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    alias: inter_annotator_agreement_score
    owner: AnnotationAnalysis
    domain_of:
    - AnnotationAnalysis
    range: float
  agreement_metric:
    name: agreement_metric
    description: 'Type of agreement metric used (Cohen''s kappa, Fleiss'' kappa, Krippendorff''s
      alpha, percentage agreement, etc.).

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    alias: agreement_metric
    owner: AnnotationAnalysis
    domain_of:
    - AnnotationAnalysis
    range: string
  analysis_method:
    name: analysis_method
    description: 'Methodology used to assess annotation quality and resolve disagreements.

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    alias: analysis_method
    owner: AnnotationAnalysis
    domain_of:
    - AnnotationAnalysis
    range: string
  disagreement_patterns:
    name: disagreement_patterns
    description: 'Systematic patterns in annotator disagreements (e.g., by demographic
      group, annotation difficulty, task type).

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    alias: disagreement_patterns
    owner: AnnotationAnalysis
    domain_of:
    - AnnotationAnalysis
    range: string
    multivalued: true
  annotation_quality_details:
    name: annotation_quality_details
    description: 'Additional details on annotation quality assessment and findings.

      '
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/preprocessing-cleaning-labeling
    rank: 1000
    alias: annotation_quality_details
    owner: AnnotationAnalysis
    domain_of:
    - AnnotationAnalysis
    range: string
    multivalued: true
  id:
    name: id
    description: An optional identifier for this property.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: schema:identifier
    alias: id
    owner: AnnotationAnalysis
    domain_of:
    - NamedThing
    - DatasetProperty
    range: uriorcurie
  name:
    name: name
    description: A human-readable name for this property.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: schema:name
    alias: name
    owner: AnnotationAnalysis
    domain_of:
    - NamedThing
    - DatasetProperty
    range: string
  description:
    name: description
    description: A human-readable description for this property.
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    slot_uri: schema:description
    alias: description
    owner: AnnotationAnalysis
    domain_of:
    - NamedThing
    - DatasetProperty
    - DatasetRelationship
    range: string
  used_software:
    name: used_software
    description: What software was used as part of this dataset property?
    from_schema: https://w3id.org/bridge2ai/data-sheets-schema/base
    rank: 1000
    alias: used_software
    owner: AnnotationAnalysis
    domain_of:
    - DatasetProperty
    range: Software
    multivalued: true
    inlined: true
    inlined_as_list: true