Skip to content
This repository has been archived by the owner on Sep 27, 2021. It is now read-only.
/ TCN-with-attention Public archive

Character based Temporal Convolutional Networks + Attention Layer

Notifications You must be signed in to change notification settings

flrngel/TCN-with-attention

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TCN with attention

Temporal Convolutional Network with attention layer

Concept of model is mostly like Simple Neural Attentive Meta-Learner (SNAIL). But in this model, attention layer is on every top of convolutions layers. And attention size is differ from SNAIL.

Result

Dataset: Agnews without pre-processing

  • with attention: 0.82
  • without attention: 0.81

My thoughts on result

Most of simple models on agnews shows 0.81 accuracy. (Which tested on A Structured Self-Attentive Sentence Embedding, TagSpace and it uses word based embedding)

So 0.82 accuracy with character based model seems worthiness.

About

Character based Temporal Convolutional Networks + Attention Layer

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages