Update June 9th, 2024
Showcase visualizations about the common Japanese morphemes in YOASOBI's songs' lyrics.
Morphemes are the smallest units of meaning in a language.
Lyrics were based on genius.com
Japanese morphemes were extracted using SudachiPy and romanized using Cutlet.
Based on 25 YOASOBI songs
- Go to
main.py
- Run the script.
- Data is saved to a SQLite database 'yoasobi.db'.
yoasobi_pipeline Package
pipeline.py
- Contain functions of the web-scraping pipeline.
yoasobi_scraper Package
data_extractor.py
- Contain functions related to extracting the desired data.
sql_query.py
- Return a specific SQL query.
sqlite_db.py
- Contain functions that deal with the database itself.
- Migrate the scraped data to SQLite database.
utils.py
- Contain utility functions.
web_scraper.py
- Contain functions related to fetching content from the webpage.