Octavian-ai / attention-focus Public

Notifications You must be signed in to change notification settings
Fork 2
Star 12

Test whether the "focus" mechanism is a valuable addition to attention

octavian.ai

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 61 Commits
data		data
experiments		experiments
src		src
.gitattributes		.gitattributes
.gitignore		.gitignore
00-no-focus-tanh-orthogonal.sh		00-no-focus-tanh-orthogonal.sh
01-yes-focus-tanh-orthogonal.sh		01-yes-focus-tanh-orthogonal.sh
02-no-focus-abs-orthogonal.sh		02-no-focus-abs-orthogonal.sh
03-no-focus-tanh-run-for-ages.sh		03-no-focus-tanh-run-for-ages.sh
03-yes-focus-abs-orthogonal.sh		03-yes-focus-abs-orthogonal.sh
04-no-focus-abs-positive.sh		04-no-focus-abs-positive.sh
05-no-focus-tanh-positive.sh		05-no-focus-tanh-positive.sh
06-yes-focus-abs-positive.sh		06-yes-focus-abs-positive.sh
07-yes-focus-tanh-positive.sh		07-yes-focus-tanh-positive.sh
08-no-focus-abs-orthogonal.sh		08-no-focus-abs-orthogonal.sh
09-yes-focus-abs-orthogonal.sh		09-yes-focus-abs-orthogonal.sh
20-no-focus-tanh-croatia.sh		20-no-focus-tanh-croatia.sh
21-yes-focus-tanh-croatia.sh		21-yes-focus-tanh-croatia.sh
22-no-focus-abs-croatia.sh		22-no-focus-abs-croatia.sh
23-yes-focus-abs-croatia.sh		23-yes-focus-abs-croatia.sh
31-euclidian-max-focus-tanh-orthogonal.sh		31-euclidian-max-focus-tanh-orthogonal.sh
37-euclidian-max-focus-tanh-positive.sh		37-euclidian-max-focus-tanh-positive.sh
38-euclidian-max-focus-tanh-croatia.sh		38-euclidian-max-focus-tanh-croatia.sh
41-euclidian-max-no-focus-tanh-orthogonal.sh		41-euclidian-max-no-focus-tanh-orthogonal.sh
47-euclidian-max-no-focus-tanh-positive.sh		47-euclidian-max-no-focus-tanh-positive.sh
48-euclidian-max-no-focus-tanh-croatia.sh		48-euclidian-max-no-focus-tanh-croatia.sh
Pipfile		Pipfile
Pipfile.lock		Pipfile.lock
README.md		README.md
build-data.sh		build-data.sh
run-article2vec.sh		run-article2vec.sh
run-attention-demos.sh		run-attention-demos.sh
run-experiment.sh		run-experiment.sh
run-tensorboard.sh		run-tensorboard.sh
run-word2vec.sh		run-word2vec.sh
test.sh		test.sh