Skip to content
Permalink
Browse files

made initial weights higher-variance

  • Loading branch information...
arodiss committed Feb 10, 2018
1 parent 78f7872 commit 3c0e93b3d5b1eb88805f5c897848912767aadd3c
Showing with 2 additions and 2 deletions.
  1. +2 −2 extra_capsnets.ipynb
@@ -607,7 +607,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Okay, let's start by creating a trainable variable of shape (1, 1152, 10, 16, 8) that will hold all the transformation matrices. The first dimension of size 1 will make this array easy to tile. We initialize this variable randomly using a normal distribution with a standard deviation to 0.01."
"Okay, let's start by creating a trainable variable of shape (1, 1152, 10, 16, 8) that will hold all the transformation matrices. The first dimension of size 1 will make this array easy to tile. We initialize this variable randomly using a normal distribution with a standard deviation to 0.1."
]
},
{
@@ -616,7 +616,7 @@
"metadata": {},
"outputs": [],
"source": [
"init_sigma = 0.01\n",
"init_sigma = 0.1\n",
"\n",
"W_init = tf.random_normal(\n",
" shape=(1, caps1_n_caps, caps2_n_caps, caps2_n_dims, caps1_n_dims),\n",

0 comments on commit 3c0e93b

Please sign in to comment.
You can’t perform that action at this time.