Homotransphobia Detection in Italian (HODI)

The HODI task (webpage) presented at EVALITA 2023 focused on the detection of homotransphobia in Italian tweets.

The following code can generate an instance of the system used in the competition.

>>> from EvoMSA.competitions import Comp2023
>>> D = # Training set
>>> tailored = 'evalita2023_HODI'
>>> comp2023 = Comp2023(lang='it', tailored=tailored)
>>> ins = comp2023.stack_3_bows_tailored_keywords(D)
Performance in Cross-validation

Configuration

Performance

p-value

Comp2023.stack_3_bows_tailored_keywords

0.7883

1.0000

Comp2023.stack_bows

0.7875

0.3900

Comp2023.stack_3_bows

0.7864

0.2360

Comp2023.bow_voc_selection

0.7862

0.2640

Comp2023.bow

0.7842

0.1100

Comp2023.stack_2_bow_tailored_keywords

0.7838

0.0060

Comp2023.bow_training_set

0.7833

0.0620

Comp2023.stack_2_bow_keywords

0.7830

0.0000

Comp2023.stack_bow_keywords_emojis_voc_selection

0.7765

0.0000

Comp2023.stack_bow_keywords_emojis

0.7758

0.0000