Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does it support paragraph prediction? #26

Closed
LucasAndLevinAndJadon opened this issue Aug 23, 2020 · 1 comment
Closed

Does it support paragraph prediction? #26

LucasAndLevinAndJadon opened this issue Aug 23, 2020 · 1 comment

Comments

@LucasAndLevinAndJadon
Copy link

I am predicting paragraph based on this model.
The output separates sentences randomly.
Certainly it has something to do with the fast the my data text is not clean.
I wonder whether this is a need for some others too.
Thank you.

@gench
Copy link
Collaborator

gench commented Aug 29, 2020

BERT has a max length limit of 512 tokens. It does not do any sentence-segmentation but treat the given input text as it is. You can segment your paragraph into sentences and calculate the sentence-based sentiment. Then, calculate paragraph-level sentiment over those.

@gench gench closed this as completed Aug 29, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants