made initial weights higher-variance

ageron · Feb 10, 2018 · 3c0e93b · 3c0e93b
1 parent 78f7872
commit 3c0e93b
Showing 1 changed file with 2 additions and 2 deletions.
diff --git a/extra_capsnets.ipynb b/extra_capsnets.ipynb
@@ -607,7 +607,7 @@
    "cell_type": "markdown",
    "metadata": {},
    "source": [
-    "Okay, let's start by creating a trainable variable of shape (1, 1152, 10, 16, 8) that will hold all the transformation matrices. The first dimension of size 1 will make this array easy to tile. We initialize this variable randomly using a normal distribution with a standard deviation to 0.01."
+    "Okay, let's start by creating a trainable variable of shape (1, 1152, 10, 16, 8) that will hold all the transformation matrices. The first dimension of size 1 will make this array easy to tile. We initialize this variable randomly using a normal distribution with a standard deviation to 0.1."
    ]
   },
   {
@@ -616,7 +616,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "init_sigma = 0.01\n",
+    "init_sigma = 0.1\n",
     "\n",
     "W_init = tf.random_normal(\n",
     "    shape=(1, caps1_n_caps, caps2_n_caps, caps2_n_dims, caps1_n_dims),\n",