From 22ad842dc189d7eec8b5fd5f9449e7c099765534 Mon Sep 17 00:00:00 2001 From: Ben Wells-Day Date: Mon, 26 Apr 2021 12:27:38 +0100 Subject: [PATCH] fix typo, closes #9 --- +transformer/+layer/attention.m | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/+transformer/+layer/attention.m b/+transformer/+layer/attention.m index ea52804..fee28fe 100644 --- a/+transformer/+layer/attention.m +++ b/+transformer/+layer/attention.m @@ -28,7 +28,7 @@ % hyper-parameter. % % Outputs: -% Z - A (numFeatures*numHeads)-by-numInputSubwords-by-numObs +% A - A (numFeatures*numHeads)-by-numInputSubwords-by-numObs % output array. % present - A numFeatures-by-numAllSubwords-by-numHeads-by-numObs-by-2 % array. This contains the 'keys' and 'values' that