before_revision: The understanding of an offense is subjective and people may have different opinions about the offensiveness of a comment. Also , offenses and hate speech may occur through sarcasm, which hides the real intention of the comment and makes the decision of the annotators more confusing. Therefore, provide a well-structured annotation process is crucial to a better understanding of hate speech and offensive language phenomena, as well as supply better performance for machine learning classifiers. In this paper, we describe a corpus annotation process , which was guided by a linguist, and a hate speech skilled to support the identification of hate speech and offensive language on social media. In addition, we provide the first robust corpus of this kind for the Brazilian Portuguese language. The corpus was collected from Instagram posts of political personalities and manually annotated, being composed by 7,000 documents annotated according to three different layers: a binary classification (offensive versus non-offensive language), the level of offense (highly offensive, moderately offensive, and slightly offensive messages), and the identification regarding the target of the discriminatory content (xenophobia, racism, homophobia, sexism, religious intolerance, partyism, apology to the dictatorship, antisemitism, and fat phobia ). Each comment was annotated by three different annotators , and achieved high inter-annotator agreement. The new proposed annotation approach is also language and domain-independent (although it has been applied for Brazilian Portuguese ) .
after_revision: The understanding of an offense is subjective and people may have different opinions about the offensiveness of a comment. Moreover , offenses and hate speech may occur through sarcasm, which hides the real intention of the comment and makes the decision of the annotators more confusing. Therefore, providing a well-structured annotation process is crucial to a better understanding of hate speech and offensive language phenomena, as well as supplying better performance for machine learning classifiers. In this paper, we describe a corpus annotation process proposed by a linguist, a hate speech specialist, and machine learning engineers in order to support the identification of hate speech and offensive language on social media. In addition, we provide the first robust dataset of this kind for the Brazilian Portuguese language. The corpus was collected from Instagram posts of political personalities and manually annotated, being composed by 7,000 annotated documents according to three different layers: a binary classification (offensive versus non-offensive language), the level of offense (highly offensive, moderately offensive, and slightly offensive messages), and the identification regarding the target of the discriminatory content (xenophobia, racism, homophobia, sexism, religious intolerance, partyism, apology to the dictatorship, antisemitism, and fatphobia ). Each comment was annotated by three different annotators and achieved high inter-annotator agreement. The proposed annotation approach is also language and domain-independent nevertheless it is currently customized for Brazilian Portuguese .
edit_actions: R
edit_actions: Also
edit_actions: Moreover
edit_actions: coherence
edit_actions: coherence coherence coherence
edit_actions: R
edit_actions: provide
edit_actions: providing
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: R
edit_actions: supply
edit_actions: supplying
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: R
edit_actions: , which was guided
edit_actions: proposed
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: D
edit_actions: and
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: R
edit_actions: skilled
edit_actions: specialist, and machine learning engineers in order
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: R
edit_actions: corpus
edit_actions: dataset
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: documents annotated
edit_actions: annotated documents
edit_actions: fluency
edit_actions: fluency fluency clarity
edit_actions: R
edit_actions: fat phobia
edit_actions: fatphobia
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: D
edit_actions: ,
edit_actions: fluency
edit_actions: fluency coherence fluency
edit_actions: D
edit_actions: new
edit_actions: coherence
edit_actions: coherence style coherence
edit_actions: R
edit_actions: (although it has been applied
edit_actions: nevertheless it is currently customized
edit_actions: coherence
edit_actions: coherence coherence coherence
edit_actions: D
edit_actions: )
edit_actions: fluency
edit_actions: fluency fluency clarity