Nan Representative Docs when loading a serialized model

[felipeinagaki]

Hi,
I've serialized my model using the command topic_model.save(folder_path, serialization="safetensors", save_ctfidf=True, save_embedding_model=model_name). But when I load the model with BERTopic.load(topic_model_path), the column 'Representative_Docs' is filled with NaN values. How can I recover or recompute them after loading the model?

Thanks in advance!

[MaartenGr]

Thanks for sharing your issue. That is currently not possible with public functions but you could use the private ._extract_representative_docs function instead to recalculate the representative documents. It would require you to have access to all documents though.