Skip to content

In this work, we present our approach for the Author Profiling task of PAN 2019. The task is divided into two sub-problems, bot, and gender detection, for two different languages: English and Spanish.

License

pan-webis-de/bacciu19a

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code
This branch is 1 commit behind andreabac3:master.

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 

Bot and Gender Detection of Twitter Accounts Using Distortion and LSA

License: GPL v3 License: GPL v3

Citation

To cite this work please use:

@article{bacciu2019bot,
  title={Bot and Gender Detection of Twitter Accounts Using Distortion and LSA},
  author={Bacciu, Andrea and La Morgia, Massimo and Mei, Alessandro and Nemmi, Eugenio Nerio and Neri, Valerio and Stefa, Julinda},
  year={2019}
}

Link to the original paper @ ceur-ws.org

Abstract

In this work, we present our approach for the Author Profiling task of PAN 2019. The task is divided into two sub-problems, bot, and gender detection, for two different languages: English and Spanish. For each instance of the problem and each language, we address the problem differently. We use an ensemble architecture to solve the Bot Detection for accounts that write in English and a single SVM for those who write in Spanish. For the Gender detection we use a single SVM architecture for both the languages, but we pre-process the tweets in a different way. Our final models achieve accuracy over the 90% in the bot detection task, while for the gender detection, of 84.17% and 77.61% respectively for the English and Spanish languages.

Getting Started

How to install

Requirements

  • git
  • Python 3.7
  • Pip

After pull the repository, you need to install all dependency.
We suggest the use of python environment.

pip3 install -r --user requirements.txt

Install spacy

Install spacy globally with admin permission. Execute the following command

python -m spacy download es_core_news_sm 

Enter in python3 shell and try to load the 'es_core_news_sm'

import spacy
spacy.load('es_core_news_sm')

Dataset Directory Structure

dataset
|
└───en
│   │   id1.xml
│   │   id2.xml
│   │   ...
|   |   ...
│   │   truth-train.txt
│   │   truth-dev.txt
│   
└───es
    │   id1.xml
    │   id2.xml
    │   ...
    |   ...
    │   truth-train.txt
    │   truth-dev.txt

Authors

About

In this work, we present our approach for the Author Profiling task of PAN 2019. The task is divided into two sub-problems, bot, and gender detection, for two different languages: English and Spanish.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%