feat: Implement Learnable Gated Pooling approach #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

devin-ai-integration wants to merge 1 commit into main from devin/1737904991-learnable-gated-pooling

devin-ai-integration bot commented Jan 26, 2025

Implement Learnable Gated Pooling Approach

This PR implements the Learnable Gated Pooling approach, which combines learnable weights with a gating mechanism for improved sequence pooling.

Changes:

Implemented LearnableGatedPooling model component
Added data preprocessing functionality
Created training and evaluation scripts
Updated requirements.txt with PyTorch dependencies

Testing:

Verified model training with decreasing loss values
Tested evaluation functionality with accuracy metric
Confirmed end-to-end workflow execution

Link to Devin run: https://app.devin.ai/sessions/5a7a3c5af9fe4893b0abbd2b9fa2ea62


          feat: Implement Learnable Gated Pooling approach

7464c68

Author

devin-ai-integration bot commented Jan 26, 2025

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

Address comments on this PR. Add "(aside)" to your comment to have me ignore it.
Look at CI failures and help fix them

⚙️ Control Options:

Disable automatic comment and CI monitoring

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet