Skip to content

Cross-domain Fake News Detection using POS-Tag+NER features for English/Portuguese/Spanish documents.

License

Notifications You must be signed in to change notification settings

marcosspalenza/FakeNewsDetection

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FakeNewsDetection

Fake News Detection using Part-Of-Speech Tags (POS-Tags) sequences and Named Entity Recognition (NER). The algorithm analyzes the news articles' language by the grammatical structures, identifying potential unlawful, defamatory, threatening, false, or misleading contents. This system was submitted to Fake News Detection in Spanish task (FakeDeS) from Iberian Languages Evaluation Forum (IberLEF).

Datasets

Requirements

Language Model

The example from Fake.BR dataset illustrates the sentence transformation:

News article

The dataset input contains the plain news articles.

Maior cientista do mundo alerta: "O Planeta Terra estará inabitavel no ano de 3016". Stephen Hawking, em entrevista, alertou mais uma vez que a humanidade corre perigo. A tecnologia e os domínios da ciência são os fatores cruciais para que o planeta Terra seja extinto.

POS-Tag

The POS sequences indicate, grammatically, the text order, coherence, and complexity.

Maior ADJ cientista NOUN do DET mundo NOUN alerta ADJ : PUNCT " PUNCT O DET Planeta PROPN Terra PROPN estara VERB inabitável ADJ no DET ano NOUN de ADP 3016 NUM " NOUN . PUNCT SPACE Stephen PROPN Hawking PROPN , PUNCT SPACE em ADP entrevista NOUN , PUNCT SPACE alertou VERB mais ADV uma ADP vez NOUN que SCONJ a DET humanidade NOUN corre VERB perigo NOUN . PUNCT A DET tecnologia NOUN e CCONJ os DET domínios SYM da ADP ciência NOUN são VERB os DET fatores SYM cruciais ADJ para ADP que SCONJ o DET planeta NOUN Terra PROPN seja VERB extinto VERB . PUNCT

NER

Simultaneously, applying NER, we recognize the names as possible information targets.

Planeta Terra (LOC), Stephen Hawking (PER), Terra (LOC)

POS-Tag+NER

Using the NE label, we replace the targets' POS Tags, increasing the semantic level. The system applies from 1 up to 7-grams sequences to recognize patterns inside the news articles, categorized as true and fake. Distinctly from the domain-dependent techniques, this system collects the textual features without the words as references.

ADJ NOUN DET NOUN ADJ PUNCT PUNCT DET LOC LOC VERB ADJ DET NOUN ADP NUM NOUN PUNCT SPACE PER PER PUNCT SPACE ADP NOUN PUNCT SPACE VERB ADV ADP NOUN SCONJ DET NOUN VERB NOUN PUNCT DET NOUN CCONJ DET SYM ADP NOUN VERB DET SYM ADJ ADP SCONJ DET NOUN LOC VERB VERB PUNCT

Afterward, composing highly-sparse document vectors, the language patterns are evaluated under different classifiers. The classifiers produce models that highlight the relevant features for true and fake classes, identifying the language bias.

References

SPALENZA, M. A.; LUSQUINO-FILHO, L. A. D.; LIMA, P. M. V.; FRANÇA, F. M. G.; OLIVEIRA E. LCAD-UFES at FakeDeS 2021: Fake News Detection Using Named Entity Recognition and Part-of-Speech Sequences. In: Proceedings of the Iberian Languages Evaluation Forum. Málaga, Spain: CEUR-WS, 2021. (IberLEF - SEPLN 2021, v. 37), p. 646-654. PDF

SPALENZA, M. A.; OLIVEIRA E.; LUSQUINO-FILHO, L. A. D.; LIMA, P. M. V.; FRANÇA, F. M. G. Using NER + ML to Automatically Detect Fake News. In: Proceedings of the 20th International Conference on Intelligent Systems Design and Applications. Online Event: Springer International Publishing, 2020. (ISDA 2020, v. 20), p. 1176-1187 Link

About

Cross-domain Fake News Detection using POS-Tag+NER features for English/Portuguese/Spanish documents.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages