GPT_3_Embeddings_Youtube_.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "GPT-3 Embeddings: Youtube .ipynb",
      "provenance": [],
      "collapsed_sections": []
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "source": [
        "https://openai.com/blog/introducing-text-and-code-embeddings/"
      ],
      "metadata": {
        "id": "_py2vtHRyLk3"
      }
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "JvAXGZk9ZPNY"
      },
      "outputs": [],
      "source": [
        "!pip install openai"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "The **embedding is an information dense representation of the semantic meaning of a piece of text**. <br>\n",
        "Each embedding is a vector of floating point numbers, such that the **distance between two embeddings in the vector space is correlated with semantic similarity between two inputs** in the original format. <br>\n",
        "For example, if two texts are similar, then their vector representations should also be similar."
      ],
      "metadata": {
        "id": "EYls8nVLZg22"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "**Use cases:**\n",
        "\n",
        "*   Text Similarity\n",
        "*   Semantic Search\n",
        "*   Classification\n",
        "*   Clustering\n"
      ],
      "metadata": {
        "id": "_vsj-XmcZnWK"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "\n",
        "\n",
        "1.   **Similarity embeddings** : These models are good at capturing semantic similarity between two or more pieces of text.\n",
        "2.   **Text search embeddings**: These models help measure whether long documents are relevant to a short search query. There are two types: one for ***embedding the documents*** to be retrieved, and one for ***embedding the search query***.\n",
        "\n",
        "\n"
      ],
      "metadata": {
        "id": "-ZfNmsxwZyuX"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "import pandas as pd\n",
        "import openai, numpy as np\n",
        "from openai.embeddings_utils import get_embedding, cosine_similarity"
      ],
      "metadata": {
        "id": "XTLL1cu1UV-l"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "api_key = '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'\n",
        "openai.api_key = api_key"
      ],
      "metadata": {
        "id": "0PHGwPjPT6wa"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "<h3>Text Similarity</h3>"
      ],
      "metadata": {
        "id": "-qkKIhw-UqJZ"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "resp = openai.Embedding.create(\n",
        "    input=[\"eating food\", \"I am hungry\", \"I am traveling\" , \"exploring new places\"],\n",
        "    engine=\"text-similarity-davinci-001\")"
      ],
      "metadata": {
        "id": "uJQ1P7fsTyX4"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "type(resp['data'])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "uABTzaYlUE-j",
        "outputId": "2f3da65b-c6e8-491a-b069-d84be25ff613"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "list"
            ]
          },
          "metadata": {},
          "execution_count": 54
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "len(resp['data'])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "0eUV5ZGqX7Zx",
        "outputId": "698cd94e-f22b-469e-b859-aa5c1ef70100"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "4"
            ]
          },
          "metadata": {},
          "execution_count": 55
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "type(resp['data'][0])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "b5BquNGzX_dp",
        "outputId": "56793c32-f91b-43fa-de4c-b9a8846cdf69"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "openai.openai_object.OpenAIObject"
            ]
          },
          "metadata": {},
          "execution_count": 56
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "resp['data'][0].keys()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "5ilNf-HtYFUx",
        "outputId": "b8774dce-29c1-49de-d027-67f1dcc8ae3e"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "dict_keys(['object', 'index', 'embedding'])"
            ]
          },
          "metadata": {},
          "execution_count": 57
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "resp['data'][0]['embedding']"
      ],
      "metadata": {
        "id": "4nDr72HpYJAW"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "embedding_a = resp['data'][0]['embedding']\n",
        "embedding_b = resp['data'][1]['embedding']\n",
        "embedding_c = resp['data'][2]['embedding']\n",
        "embedding_d = resp['data'][3]['embedding']"
      ],
      "metadata": {
        "id": "I5S-imSkUGyI"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "np.dot(embedding_a, embedding_b)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "1WlXsaxuUJ78",
        "outputId": "2f617943-0abc-4532-9083-140765e1774f"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.8724587274814626"
            ]
          },
          "metadata": {},
          "execution_count": 60
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "np.dot(embedding_a, embedding_c)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "y1_A3ZTVUKhM",
        "outputId": "44409063-7f9d-4010-8d99-b5702b0f6888"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.7891928072645734"
            ]
          },
          "metadata": {},
          "execution_count": 61
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "np.dot(embedding_c, embedding_d)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "qr9yXvzfUM4v",
        "outputId": "ea0778c5-3e0f-4daf-e3f1-5c51440f839d"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.8543601927339739"
            ]
          },
          "metadata": {},
          "execution_count": 62
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# https://www.kaggle.com/datasets/snap/amazon-fine-food-reviews\n",
        "datafile_path = \"https://cdn.openai.com/API/examples/data/fine_food_reviews_with_embeddings_1k.csv\"  # for your convenience, we precomputed the embeddings\n",
        "df = pd.read_csv(datafile_path)\n",
        "df.head()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 791
        },
        "id": "KHaFc5ZXbNdA",
        "outputId": "8da04e35-677f-46e8-ccb9-2a5e07ccac04"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "    ProductId          UserId  Score  \\\n",
              "0  B003XPF9BO  A3R7JR3FMEBXQB      5   \n",
              "1  B003JK537S  A3JBPC3WFUT5ZP      1   \n",
              "2  B000JMBE7M   AQX1N6A51QOKG      4   \n",
              "3  B004AHGBX4  A2UY46X0OSNVUQ      3   \n",
              "4  B001BORBHO  A1AFOYZ9HSM2CZ      5   \n",
              "\n",
              "                                             Summary  \\\n",
              "0  where does one  start...and stop... with a tre...   \n",
              "1                                  Arrived in pieces   \n",
              "2          It isn't blanc mange, but isn't bad . . .   \n",
              "3        These also have SALT and it's not sea salt.   \n",
              "4                             Happy with the product   \n",
              "\n",
              "                                                Text  \\\n",
              "0  Wanted to save some to bring to my Chicago fam...   \n",
              "1  Not pleased at all. When I opened the box, mos...   \n",
              "2  I'm not sure that custard is really custard wi...   \n",
              "3  I like the fact that you can see what you're g...   \n",
              "4  My dog was suffering with itchy skin.  He had ...   \n",
              "\n",
              "                                            combined  n_tokens  \\\n",
              "0  Title: where does one  start...and stop... wit...        51   \n",
              "1  Title: Arrived in pieces; Content: Not pleased...        35   \n",
              "2  Title: It isn't blanc mange, but isn't bad . ....       277   \n",
              "3  Title: These also have SALT and it's not sea s...       246   \n",
              "4  Title: Happy with the product; Content: My dog...        87   \n",
              "\n",
              "                                  babbage_similarity  \\\n",
              "0  [-0.01274053193628788, 0.010849879123270512, -...   \n",
              "1  [-0.024154752492904663, 0.0024838377721607685,...   \n",
              "2  [0.0032693513203412294, 0.017815979197621346, ...   \n",
              "3  [-0.03584608808159828, 0.03424076735973358, -0...   \n",
              "4  [0.005218076519668102, 0.018165964633226395, -...   \n",
              "\n",
              "                                      babbage_search  \n",
              "0  [-0.01880764216184616, 0.019457539543509483, -...  \n",
              "1  [-0.03571609780192375, 0.010356518439948559, -...  \n",
              "2  [-0.010433986783027649, 0.024620095267891884, ...  \n",
              "3  [-0.040209852159023285, 0.03804996609687805, -...  \n",
              "4  [0.010450801812112331, 0.022801749408245087, -...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-6dd1fea1-8143-4a01-92b2-23e78f56a332\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>ProductId</th>\n",
              "      <th>UserId</th>\n",
              "      <th>Score</th>\n",
              "      <th>Summary</th>\n",
              "      <th>Text</th>\n",
              "      <th>combined</th>\n",
              "      <th>n_tokens</th>\n",
              "      <th>babbage_similarity</th>\n",
              "      <th>babbage_search</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>B003XPF9BO</td>\n",
              "      <td>A3R7JR3FMEBXQB</td>\n",
              "      <td>5</td>\n",
              "      <td>where does one  start...and stop... with a tre...</td>\n",
              "      <td>Wanted to save some to bring to my Chicago fam...</td>\n",
              "      <td>Title: where does one  start...and stop... wit...</td>\n",
              "      <td>51</td>\n",
              "      <td>[-0.01274053193628788, 0.010849879123270512, -...</td>\n",
              "      <td>[-0.01880764216184616, 0.019457539543509483, -...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>B003JK537S</td>\n",
              "      <td>A3JBPC3WFUT5ZP</td>\n",
              "      <td>1</td>\n",
              "      <td>Arrived in pieces</td>\n",
              "      <td>Not pleased at all. When I opened the box, mos...</td>\n",
              "      <td>Title: Arrived in pieces; Content: Not pleased...</td>\n",
              "      <td>35</td>\n",
              "      <td>[-0.024154752492904663, 0.0024838377721607685,...</td>\n",
              "      <td>[-0.03571609780192375, 0.010356518439948559, -...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>B000JMBE7M</td>\n",
              "      <td>AQX1N6A51QOKG</td>\n",
              "      <td>4</td>\n",
              "      <td>It isn't blanc mange, but isn't bad . . .</td>\n",
              "      <td>I'm not sure that custard is really custard wi...</td>\n",
              "      <td>Title: It isn't blanc mange, but isn't bad . ....</td>\n",
              "      <td>277</td>\n",
              "      <td>[0.0032693513203412294, 0.017815979197621346, ...</td>\n",
              "      <td>[-0.010433986783027649, 0.024620095267891884, ...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>B004AHGBX4</td>\n",
              "      <td>A2UY46X0OSNVUQ</td>\n",
              "      <td>3</td>\n",
              "      <td>These also have SALT and it's not sea salt.</td>\n",
              "      <td>I like the fact that you can see what you're g...</td>\n",
              "      <td>Title: These also have SALT and it's not sea s...</td>\n",
              "      <td>246</td>\n",
              "      <td>[-0.03584608808159828, 0.03424076735973358, -0...</td>\n",
              "      <td>[-0.040209852159023285, 0.03804996609687805, -...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>B001BORBHO</td>\n",
              "      <td>A1AFOYZ9HSM2CZ</td>\n",
              "      <td>5</td>\n",
              "      <td>Happy with the product</td>\n",
              "      <td>My dog was suffering with itchy skin.  He had ...</td>\n",
              "      <td>Title: Happy with the product; Content: My dog...</td>\n",
              "      <td>87</td>\n",
              "      <td>[0.005218076519668102, 0.018165964633226395, -...</td>\n",
              "      <td>[0.010450801812112331, 0.022801749408245087, -...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-6dd1fea1-8143-4a01-92b2-23e78f56a332')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-6dd1fea1-8143-4a01-92b2-23e78f56a332 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-6dd1fea1-8143-4a01-92b2-23e78f56a332');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 63
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "type(df.loc[0]['babbage_search'])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "eN194_mDmIy_",
        "outputId": "c6ea8ac3-251e-4163-c9ac-47edd3b4abb6"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "str"
            ]
          },
          "metadata": {},
          "execution_count": 64
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        ""
      ],
      "metadata": {
        "id": "bL4X-TmZbmJk"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "df[\"babbage_search\"] = df.babbage_search.apply(eval).apply(np.array)\n",
        "df[\"babbage_similarity\"] = df.babbage_similarity.apply(eval).apply(np.array)\n"
      ],
      "metadata": {
        "id": "dLSy8ojhbPmo"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "type(df.loc[0]['babbage_search'])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "qKRJCIz7mgXe",
        "outputId": "56ab9a74-7415-4a76-e91b-b5aa248cba78"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "numpy.ndarray"
            ]
          },
          "metadata": {},
          "execution_count": 66
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "<h3>Semantic Search</h3>"
      ],
      "metadata": {
        "id": "r_hCLQt9V527"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# search through the reviews for a specific product\n",
        "def search_reviews(df, search_query, n=3):\n",
        "    embedding = get_embedding(\n",
        "        search_query,\n",
        "        engine=\"text-search-babbage-query-001\"\n",
        "    )\n",
        "    df[\"similarities\"] = df.babbage_search.apply(lambda x: cosine_similarity(x, embedding))\n",
        "\n",
        "    top_n =df.sort_values(\"similarities\", ascending=False).head(n)\n",
        "    # res = top_n.combined.str.replace(\"Title: \", \"\").str.replace(\"; Content:\", \": \")\n",
        "    return top_n"
      ],
      "metadata": {
        "id": "LeKKERLFcs4Q"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "res = search_reviews(df, \"delicious beans\", n=3)\n",
        "res['combined'].to_list()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "SA7xS9bKcGJ2",
        "outputId": "cabfb7c2-0279-48b9-b02e-182e76dd7f15"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "['Title: Fantastic Instant Refried beans; Content: Fantastic Instant Refried Beans have been a staple for my family now for nearly 20 years.  All 7 of us love it and my grown kids are passing on the tradition.',\n",
              " 'Title: Jamaican Blue beans; Content: Excellent coffee bean for roasting. Our family just purchased another 5 pounds for more roasting. Plenty of flavor and mild on acidity when roasted to a dark brown bean and before any oil appears on the bean itself (455F @ 17 minutes).',\n",
              " \"Title: Delicious!; Content: I enjoy this white beans seasoning, it gives a rich flavor to the beans I just love it, my mother in law didn't know about this Zatarain's brand and now she is traying different seasoning and she likes it very much.<br />Thank you Amazon for having it because now I can't find it in stores, I like to have this 12 boxes because I can made it whenever my family want it.\"]"
            ]
          },
          "metadata": {},
          "execution_count": 68
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "<h3>Classification</h3>"
      ],
      "metadata": {
        "id": "pdM1bDg9WAcx"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "from sklearn.model_selection import train_test_split\n",
        " \n",
        "X_train, X_test, y_train, y_test = train_test_split(\n",
        "    list(df.babbage_similarity.values),\n",
        "    df.Score,\n",
        "    test_size = 0.2,\n",
        "    random_state=42\n",
        ")"
      ],
      "metadata": {
        "id": "eAcdOnDGeyP5"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "from sklearn.ensemble import RandomForestClassifier\n",
        "from sklearn.metrics import classification_report, accuracy_score\n",
        " \n",
        "clf = RandomForestClassifier(n_estimators=100)\n",
        "clf.fit(X_train, y_train)\n",
        "preds = clf.predict(X_test)"
      ],
      "metadata": {
        "id": "ieOg8bVRldiM"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "print(classification_report(y_test,preds))"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "AoSIs40elsIC",
        "outputId": "8f44353d-a0d8-4770-a3f5-479db6e089d5"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "           1       0.62      0.72      0.67        18\n",
            "           2       1.00      0.35      0.52        17\n",
            "           3       0.50      0.12      0.20         8\n",
            "           4       0.62      0.38      0.48        26\n",
            "           5       0.83      0.98      0.90       131\n",
            "\n",
            "    accuracy                           0.80       200\n",
            "   macro avg       0.72      0.51      0.55       200\n",
            "weighted avg       0.79      0.80      0.77       200\n",
            "\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "len(df)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "0N0A2najnKFJ",
        "outputId": "b3404a23-b951-426c-88c3-a0abf2ebeaa0"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "1000"
            ]
          },
          "metadata": {},
          "execution_count": 72
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "df['Score'].value_counts(normalize=True)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "zCIPgmienray",
        "outputId": "31eef7ab-d5de-4d6a-a09a-2cf2d9e3d763"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "5    0.651\n",
              "4    0.138\n",
              "1    0.087\n",
              "3    0.075\n",
              "2    0.049\n",
              "Name: Score, dtype: float64"
            ]
          },
          "metadata": {},
          "execution_count": 73
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "<h3>Clustering</h3>"
      ],
      "metadata": {
        "id": "jI9wUPHSVzHn"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# source: https://stackoverflow.com/questions/55619176/how-to-cluster-similar-sentences-using-bert\n",
        "from sklearn.cluster import KMeans\n",
        "# Corpus with example sentences\n",
        "corpus = ['A man is eating food.',\n",
        "          'A man is eating a piece of bread.',\n",
        "          'Horse is eating grass.',\n",
        "          'A man is eating pasta.',\n",
        "          'A Woman is eating Biryani.',\n",
        "          'The girl is carrying a baby.',\n",
        "          'The baby is carried by the woman',\n",
        "          'A man is riding a horse.',\n",
        "          'A man is riding a white horse on an enclosed ground.',\n",
        "          'A monkey is playing drums.',\n",
        "          'Someone in a gorilla costume is playing a set of drums.',\n",
        "          'A cheetah is running behind its prey.',\n",
        "          'A cheetah chases prey on across a field.',\n",
        "          'The cheetah is chasing a man who is riding the horse.',\n",
        "          'man and women with their baby are watching cheetah in zoo'\n",
        "          ]"
      ],
      "metadata": {
        "id": "1qUlu0JRvW2g"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "response = openai.Embedding.create(\n",
        "    input=corpus,\n",
        "    model=\"text-similarity-babbage-001\"\n",
        ")"
      ],
      "metadata": {
        "id": "j1HnsmaqwyJk"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "type(response['data'])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "iEajN013w7_z",
        "outputId": "bd9565b7-c31a-4f12-ae8b-c70296a51713"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "list"
            ]
          },
          "metadata": {},
          "execution_count": 76
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# response['data'][0]['embedding']"
      ],
      "metadata": {
        "id": "JjU6zw0Rx67r"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "corpus_embeddings = [ d['embedding'] for d in response['data']]\n",
        "# Normalize the embeddings to unit length\n",
        "corpus_embeddings = corpus_embeddings /  np.linalg.norm(corpus_embeddings, axis=1, keepdims=True)"
      ],
      "metadata": {
        "id": "jyDrgM8jw1wH"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "clustering_model = KMeans(n_clusters=3)\n",
        "clustering_model.fit(corpus_embeddings)\n",
        "cluster_assignment = clustering_model.labels_\n",
        "print(cluster_assignment)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ejRizWSdw5jR",
        "outputId": "9fbd179a-ec60-4585-ea41-b7c0ae479c31"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "[1 1 1 1 2 2 2 1 1 0 0 0 0 0 0]\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "clustered_sentences = {}\n",
        "for sentence_id, cluster_id in enumerate(cluster_assignment):\n",
        "    if cluster_id not in clustered_sentences:\n",
        "        clustered_sentences[cluster_id] = []\n",
        "\n",
        "    clustered_sentences[cluster_id].append(corpus[sentence_id])\n",
        "clustered_sentences"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "RNjism-SxQHW",
        "outputId": "dc15e7bd-5902-4e61-d386-0900ddd0a3c5"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "{0: ['A monkey is playing drums.',\n",
              "  'Someone in a gorilla costume is playing a set of drums.',\n",
              "  'A cheetah is running behind its prey.',\n",
              "  'A cheetah chases prey on across a field.',\n",
              "  'The cheetah is chasing a man who is riding the horse.',\n",
              "  'man and women with their baby are watching cheetah in zoo'],\n",
              " 1: ['A man is eating food.',\n",
              "  'A man is eating a piece of bread.',\n",
              "  'Horse is eating grass.',\n",
              "  'A man is eating pasta.',\n",
              "  'A man is riding a horse.',\n",
              "  'A man is riding a white horse on an enclosed ground.'],\n",
              " 2: ['A Woman is eating Biryani.',\n",
              "  'The girl is carrying a baby.',\n",
              "  'The baby is carried by the woman']}"
            ]
          },
          "metadata": {},
          "execution_count": 79
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "clustering_model = KMeans(n_clusters=4)\n",
        "clustering_model.fit(corpus_embeddings)\n",
        "cluster_assignment = clustering_model.labels_\n",
        "print(cluster_assignment)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Lrg1QtCSxRe-",
        "outputId": "4961835f-ed53-44eb-8dae-c5b4f3d83477"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "[1 1 1 1 2 2 2 1 1 0 0 3 3 3 3]\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "clustered_sentences = {}\n",
        "for sentence_id, cluster_id in enumerate(cluster_assignment):\n",
        "    if cluster_id not in clustered_sentences:\n",
        "        clustered_sentences[cluster_id] = []\n",
        "\n",
        "    clustered_sentences[cluster_id].append(corpus[sentence_id])\n",
        "clustered_sentences"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "6naeu1RYxx5A",
        "outputId": "1cb03a46-1b1c-4ac1-df10-1926cacee29b"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "{0: ['A monkey is playing drums.',\n",
              "  'Someone in a gorilla costume is playing a set of drums.'],\n",
              " 1: ['A man is eating food.',\n",
              "  'A man is eating a piece of bread.',\n",
              "  'Horse is eating grass.',\n",
              "  'A man is eating pasta.',\n",
              "  'A man is riding a horse.',\n",
              "  'A man is riding a white horse on an enclosed ground.'],\n",
              " 2: ['A Woman is eating Biryani.',\n",
              "  'The girl is carrying a baby.',\n",
              "  'The baby is carried by the woman'],\n",
              " 3: ['A cheetah is running behind its prey.',\n",
              "  'A cheetah chases prey on across a field.',\n",
              "  'The cheetah is chasing a man who is riding the horse.',\n",
              "  'man and women with their baby are watching cheetah in zoo']}"
            ]
          },
          "metadata": {},
          "execution_count": 81
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        ""
      ],
      "metadata": {
        "id": "ntc2x0i2xydm"
      },
      "execution_count": null,
      "outputs": []
    }
  ]
}