Skip to content

xmzzyo/BERT4RS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

BERT4RS

1. 使用Movies_and_TV进行预训练:

Dataset #users #items avg_action/user avg_action/item #action
Movies_and_TV 123960 50052 8.7 21.7 1084572

将数据集按1:1划分为pretrain和test,每部分包括0.5M action,pretrain用于BERT预训练,test用于fine-tune

使用bert预训练

预训练结果:

INFO:tensorflow:***** Eval results *****
INFO:tensorflow:  global_step = 500000
INFO:tensorflow:  loss = 1.1401069
INFO:tensorflow:  masked_lm_accuracy = 0.7652841
INFO:tensorflow:  masked_lm_loss = 1.1527702
INFO:tensorflow:  next_sentence_accuracy = 1.0
INFO:tensorflow:  next_sentence_loss = 3.410484e-05

2. Fine-tune

预训练模型下载,放在data/Movies_and_TV_5

SeqRec为代码目录,执行python bert_main.py

执行tensorboard logdir=./log查看结果

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Sponsor this project

Packages

No packages published

Languages