Skip to content
This repository has been archived by the owner on Nov 22, 2022. It is now read-only.

implemented cnn pooling for doc classification #872

Closed

Conversation

shreydesai
Copy link
Contributor

Summary: Implements max and average pooling for DeepCNNRepresentation -- this allows it to be used in tasks where each word in a sequence doesn't necessarily need to have its own representation. Attention is commonly used in NLP to attend to important parts of the sequence, but max and average pooling are simpler (but strong) baselines that can compress sequential representations. The resulting representation can be used in tasks such as document classification, which we perform experiments with.

Differential Revision: D16631634

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 2, 2019
shreydesai added a commit to shreydesai/pytext that referenced this pull request Aug 3, 2019
Summary:
Pull Request resolved: facebookresearch#872

Implements max and average pooling for DeepCNNRepresentation -- this allows it to be used in tasks where each word in a sequence doesn't necessarily need to have its own representation. Attention is commonly used in NLP to attend to important parts of the sequence, but max and average pooling are simpler (but strong) baselines that can compress sequential representations. The resulting representation can be used in tasks such as document classification, which we perform experiments with.

Differential Revision: D16631634

fbshipit-source-id: 7f071fa4aff97ad121ac90c2256f744030a86e80
Summary:
Pull Request resolved: facebookresearch#872

Implements max and average pooling for DeepCNNRepresentation -- this allows it to be used in tasks where each word in a sequence doesn't necessarily need to have its own representation. Attention is commonly used in NLP to attend to important parts of the sequence, but max and average pooling are simpler (but strong) baselines that can compress sequential representations. The resulting representation can be used in tasks such as document classification, which we perform experiments with.

Differential Revision: D16631634

fbshipit-source-id: 93a1a3e7d9e7cf54ceebf41523134d9e2c3ba6b7
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 8bc826d.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants