Skip to content

This project takes on the goal to improve upon Yachay.ai's infrastructure to train a deep learning model to predict coordinates of individual texts.

Notifications You must be signed in to change notification settings

gguillau/Yachay.ai-Tweet-Geolocation-Prediction

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Text-based Geolocation Prediction of Twitter Users

Objective

Yachay is an open-source Machine Learning community that has collected decades worth of useful natural language data from traditional media (i.e. New York Times articles), social media (i.e. Twitter & Reddit), messenger channels, tech blogs, GitHub profiles and issues, the dark web, and legal proceedings, as well as the decisions and publications of government regulators and legislators all across the world.

This project takes on the goal to improve upon Yachay.ai's infrastructure to train a deep learning model to predict coordinates of individual texts. The first suggested methodology on training the model is to look into the annotated data set on texts posted from across North America. The goal is to identify the location of the user: be that by predicting an exact geopoint, or make a broader, region-based estimate

Models Evaluated

 BERT 
 BERT multilingual 
 XLM RobERTa

Insights

  • Embeddings made using XLM performed better on a base neural network predicting geolocations
  • A NER pipeline with better results would also likely increase the model performance.
  • More hyperparameter tuning, could help to achieve a better result
  • More data per user would also aid in improving the model

Libraries used

Hugging Face 
Haversine Distance
BERT Tokenizer
RoBERTa Tokenizer
Tensor Flow
Keras
Adam
K Means
MENET
LSTM
Convolutional Neural Network
Plotly Express
Pandas
Streamlit

About

This project takes on the goal to improve upon Yachay.ai's infrastructure to train a deep learning model to predict coordinates of individual texts.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published