From: Evolution of topics and hate speech in retweet network communities
No. of tweets | Overall | Acceptable | Unacceptable | ||
---|---|---|---|---|---|
Alpha | Acc | F1(A) | F1(U) | ||
Self-agreement | 5981 | 0.79 | 0.88 | 0.92 | 0.87 |
Inter-annotator agreement | 53,831 | 0.60 | 0.79 | 0.85 | 0.75 |
Classification model | |||||
Training set | 50,000 | 0.61 | 0.80 | 0.85 | 0.77 |
Evaluation set | 10,000 | 0.57 | 0.80 | 0.86 | 0.71 |