- preprocessing data :
- data/raw -> data_loader.py -> text_cleaner.py -> tokenizer.py -> pos_tagger.py -> stopwords_remover.py -> Store in data/processed/
- Embedding
- data/processed -> embeddings/[phobert|sgns|ppmi_svd]_embedder.py -> qdrant_client.py -> Store in dtaa/embeddings/
- Clustering and analyzwe
- data/embeddings/ -> clustering/[kmeans|dbscan]_clusterer.py -> clustering/cluster_analyzer.py -> Store in data/clusters/
- aligner
- data/clusters/ -> alignment/procrustes_aligner.py -> alignment/temporal_mapper.py -> Store in data/alignments/
- change in ngữ nghĩa
- data/alignments/ -> semantic_change/change_detector.py -> semantic_change/cosine_calculator.py → semantic_change/context_analyzer.py -> semantic_change/social_event_mapper.py → Store in outputs/results/
..... tren day chi la tham khao