get_ref_profile.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/andyndang/awesome-mlops/blob/master/get_ref_profile.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Jt7rECajt76O"
      },
      "source": [
        "## Retrieving Reference Profiles from WhyLabs for Local Analysis\n",
        "\n",
        "In this example, we will show you how to retrieve reference profiles from WhyLabs and use the rehydrated profiles for visualization and analysis with the `NotebookProfileVisualizer`\n",
        "\n",
        "First, let's set the proper environment variables:"
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "%pip install --upgrade \"whylogs\""
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "UTlhMJgivDFi",
        "outputId": "db623544-7f8a-4405-9b20-e54019787302"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Collecting whylogs\n",
            "  Downloading whylogs-1.3.6-py3-none-any.whl (1.9 MB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.9/1.9 MB\u001b[0m \u001b[31m19.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: platformdirs<4.0.0,>=3.5.0 in /usr/local/lib/python3.10/dist-packages (from whylogs) (3.10.0)\n",
            "Requirement already satisfied: protobuf>=3.19.4 in /usr/local/lib/python3.10/dist-packages (from whylogs) (3.20.3)\n",
            "Requirement already satisfied: requests<3.0,>=2.27 in /usr/local/lib/python3.10/dist-packages (from whylogs) (2.31.0)\n",
            "Collecting types-requests<3.0.0.0,>=2.30.0.0 (from whylogs)\n",
            "  Downloading types_requests-2.31.0.5-py3-none-any.whl (14 kB)\n",
            "Requirement already satisfied: typing-extensions>=3.10 in /usr/local/lib/python3.10/dist-packages (from whylogs) (4.5.0)\n",
            "Collecting whylabs-client<0.6.0,>=0.5.5 (from whylogs)\n",
            "  Downloading whylabs_client-0.5.7-py3-none-any.whl (401 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m402.0/402.0 kB\u001b[0m \u001b[31m26.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hCollecting whylogs-sketching>=3.4.1.dev3 (from whylogs)\n",
            "  Downloading whylogs_sketching-3.4.1.dev3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (547 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m547.3/547.3 kB\u001b[0m \u001b[31m36.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests<3.0,>=2.27->whylogs) (3.2.0)\n",
            "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests<3.0,>=2.27->whylogs) (3.4)\n",
            "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests<3.0,>=2.27->whylogs) (2.0.4)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests<3.0,>=2.27->whylogs) (2023.7.22)\n",
            "Collecting types-urllib3 (from types-requests<3.0.0.0,>=2.30.0.0->whylogs)\n",
            "  Downloading types_urllib3-1.26.25.14-py3-none-any.whl (15 kB)\n",
            "Requirement already satisfied: python-dateutil in /usr/local/lib/python3.10/dist-packages (from whylabs-client<0.6.0,>=0.5.5->whylogs) (2.8.2)\n",
            "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil->whylabs-client<0.6.0,>=0.5.5->whylogs) (1.16.0)\n",
            "Installing collected packages: whylogs-sketching, types-urllib3, types-requests, whylabs-client, whylogs\n",
            "Successfully installed types-requests-2.31.0.5 types-urllib3-1.26.25.14 whylabs-client-0.5.7 whylogs-1.3.6 whylogs-sketching-3.4.1.dev3\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "4aBYZapXt76P",
        "outputId": "3afb40e2-b9a9-41c4-9be4-2aade20fd354"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "WhyLabs API Key: ··········\n"
          ]
        }
      ],
      "source": [
        "import os\n",
        "import getpass\n",
        "os.environ[\"WHYLABS_DEFAULT_ORG_ID\"] = \"org-5953\"\n",
        "os.environ[\"WHYLABS_DEFAULT_DATASET_ID\"] = \"model-1\"\n",
        "os.environ[\"WHYLABS_API_KEY\"] = getpass.getpass(\"WhyLabs API Key: \")\n",
        "\n",
        "\n",
        "org_id = os.environ[\"WHYLABS_DEFAULT_ORG_ID\"]\n",
        "dataset_id = os.environ[\"WHYLABS_DEFAULT_DATASET_ID\"]\n",
        "api_key = os.environ[\"WHYLABS_API_KEY\"]"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "MTvOnXJbt76P"
      },
      "source": [
        "# Log Example Reference Profile\n",
        "As a reference profile, let's log a dataframe with a single column named `col1` with a normal distribution. We'll then write the profile to WhyLabs as a reference profile called `example-ref-profile`.\n",
        "\n",
        "Note that profile names are not unique and user can publish reference profiles under the same name."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "hl01Q0XIt76P",
        "outputId": "948d15b9-7fc3-4103-d0ab-60cacf35f43f"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "⚠️ No session found. Call whylogs.init() to initialize a session and authenticate. See https://docs.whylabs.ai/docs/whylabs-whylogs-init for more information.\n",
            "⚠️ Initializing default session because no session was found.\n",
            "Initializing session with config /root/.config/whylogs/config.ini\n",
            "\n",
            "✅ Using session type: LOCAL. Profiles won't be uploaded or written anywhere automatically.\n"
          ]
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(True, 'ref-GiGPHFkn2cQwTEti')"
            ]
          },
          "metadata": {},
          "execution_count": 7
        }
      ],
      "source": [
        "import numpy as np\n",
        "import pandas as pd\n",
        "import whylogs as why\n",
        "from whylogs.api.writer.whylabs import WhyLabsWriter\n",
        "\n",
        "mu, sigma = 0, 0.1 # mean and standard deviation\n",
        "s = np.random.normal(mu, sigma, 1000)\n",
        "\n",
        "df_ref = pd.DataFrame(s, columns=['col1'])\n",
        "\n",
        "profile = why.log(df_ref).profile()\n",
        "\n",
        "writer = WhyLabsWriter().option(reference_profile_name=\"example-ref-profile\")\n",
        "writer.write(file=profile.view())\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "G9LDdA7Wt76Q"
      },
      "source": [
        "We can see that the above code returns a reference id in the format `ref-XXXXXX` - this is a unique ID.\n",
        "\n",
        "We can copy paste that id to retrieve it back from the WhyLabs platform. Let's define the functions to do this:"
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "import whylabs_client as wc\n",
        "from whylabs_client.api import dataset_profile_api\n",
        "\n",
        "configuration = wc.Configuration(\n",
        "    host = \"https://api.whylabsapp.com\"\n",
        ")\n",
        "\n",
        "configuration.api_key['ApiKeyAuth'] = api_key\n"
      ],
      "metadata": {
        "id": "DnTseMm-vRlP"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "from whylogs.core import DatasetProfileView\n",
        "\n",
        "def fetch_ref_profile(ref_id: str):\n",
        "  with wc.ApiClient(configuration) as api_client:\n",
        "    # Create an instance of the API class\n",
        "    api_instance = dataset_profile_api.DatasetProfileApi(api_client)\n",
        "    try:\n",
        "        api_response = api_instance.get_reference_profile(org_id, dataset_id, ref_id)\n",
        "        download_url = api_response.download_url\n",
        "        headers = {\"Content-Type\": \"application/octet-stream\"}\n",
        "        downloaded_profile1 = writer._s3_pool.request(\"GET\", download_url, headers=headers, timeout=writer._timeout_seconds)\n",
        "        return DatasetProfileView.deserialize(downloaded_profile1.data)\n",
        "    except wc.ApiException as e:\n",
        "        print(\"Exception when calling DatasetProfileApi->get_reference_profile: %s\\n\" % e)\n"
      ],
      "metadata": {
        "id": "dGtVQ8yTwMKg"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "def get_ref_profile(ref_profile_name: str, from_epoch=None, to_epoch=None):\n",
        "  with wc.ApiClient(configuration) as api_client:\n",
        "    # Create an instance of the API class\n",
        "    api_instance = dataset_profile_api.DatasetProfileApi(api_client)\n",
        "    try:\n",
        "        # Returns a list for reference profiles\n",
        "        # if you know the upload timestamp you can use it to narrow it down\n",
        "        api_response = api_instance.list_reference_profiles(org_id, dataset_id, from_epoch=(from_epoch or 0), to_epoch=(to_epoch or int(datetime.now(tz=timezone.utc).timestamp()*1000)))\n",
        "        for e in api_response:\n",
        "          if e.alias == ref_profile_name:\n",
        "            return e\n",
        "          else:\n",
        "            continue\n",
        "    except wc.ApiException as e:\n",
        "        print(\"Exception when calling DatasetProfileApi->list_reference_profiles: %s\\n\" % e)"
      ],
      "metadata": {
        "id": "RnixuzlpydwY"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [],
      "metadata": {
        "id": "p_oWhlr-0o6C"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "ref_prof_meta = get_ref_profile('example-ref-profile')\n",
        "assert ref_prof_meta is not None, f\"Cannot find ref profile with the given name\"\n",
        "ref_profile_id = ref_prof_meta.id"
      ],
      "metadata": {
        "id": "t3YMN0A1yw_w"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "YeOkWLx5t76Q"
      },
      "source": [
        "Now, we should be able to pass the ref_id to `get_reference_profile` and get back our original reference profile:\n",
        "\n",
        "> Note: if you don't pass anything to `get_reference_profile()`, it will return the most recent reference profile"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 161
        },
        "id": "DFYIaVwAt76Q",
        "outputId": "964667ac-9ff6-4d47-f2fc-ca02a6bf1abc"
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "        cardinality/est  cardinality/lower_1  cardinality/upper_1  counts/inf  \\\n",
              "column                                                                          \n",
              "col1         991.367255           978.706461          1004.343709           0   \n",
              "\n",
              "        counts/n  counts/nan  counts/null  distribution/max  \\\n",
              "column                                                        \n",
              "col1        1000           0            0          0.385595   \n",
              "\n",
              "        distribution/mean  distribution/median  ...  distribution/q_95  \\\n",
              "column                                          ...                      \n",
              "col1            -0.001471            -0.002984  ...           0.157219   \n",
              "\n",
              "        distribution/q_99  distribution/stddev                type  \\\n",
              "column                                                               \n",
              "col1             0.235064             0.100494  SummaryType.COLUMN   \n",
              "\n",
              "        types/boolean  types/fractional  types/integral  types/object  \\\n",
              "column                                                                  \n",
              "col1                0              1000               0             0   \n",
              "\n",
              "        types/string  types/tensor  \n",
              "column                              \n",
              "col1               0             0  \n",
              "\n",
              "[1 rows x 28 columns]"
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-25bd126e-0c4a-446c-a017-8429d1f6b1a4\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>cardinality/est</th>\n",
              "      <th>cardinality/lower_1</th>\n",
              "      <th>cardinality/upper_1</th>\n",
              "      <th>counts/inf</th>\n",
              "      <th>counts/n</th>\n",
              "      <th>counts/nan</th>\n",
              "      <th>counts/null</th>\n",
              "      <th>distribution/max</th>\n",
              "      <th>distribution/mean</th>\n",
              "      <th>distribution/median</th>\n",
              "      <th>...</th>\n",
              "      <th>distribution/q_95</th>\n",
              "      <th>distribution/q_99</th>\n",
              "      <th>distribution/stddev</th>\n",
              "      <th>type</th>\n",
              "      <th>types/boolean</th>\n",
              "      <th>types/fractional</th>\n",
              "      <th>types/integral</th>\n",
              "      <th>types/object</th>\n",
              "      <th>types/string</th>\n",
              "      <th>types/tensor</th>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>column</th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>col1</th>\n",
              "      <td>991.367255</td>\n",
              "      <td>978.706461</td>\n",
              "      <td>1004.343709</td>\n",
              "      <td>0</td>\n",
              "      <td>1000</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.385595</td>\n",
              "      <td>-0.001471</td>\n",
              "      <td>-0.002984</td>\n",
              "      <td>...</td>\n",
              "      <td>0.157219</td>\n",
              "      <td>0.235064</td>\n",
              "      <td>0.100494</td>\n",
              "      <td>SummaryType.COLUMN</td>\n",
              "      <td>0</td>\n",
              "      <td>1000</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>1 rows × 28 columns</p>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-25bd126e-0c4a-446c-a017-8429d1f6b1a4')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-25bd126e-0c4a-446c-a017-8429d1f6b1a4 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-25bd126e-0c4a-446c-a017-8429d1f6b1a4');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ]
          },
          "metadata": {},
          "execution_count": 37
        }
      ],
      "source": [
        "ref_profile = fetch_ref_profile(ref_id=ref_profile_id)\n",
        "ref_profile.to_pandas()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_kZK1fEzt76Q"
      },
      "source": [
        "Let's see if that worked.\n",
        "\n",
        "We will use the reference profile with a target profile. We will generate a new pandas dataframe with a normal distribution, but with different parameters for mean and standard deviation.\n",
        "\n",
        "We will then use the `NotebookProfileVisualizer` to compare target and reference profiles."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 381
        },
        "id": "4IqUBj3Lt76Q",
        "outputId": "4c0f8158-2c43-4111-b2be-b41ab9789f6c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "WARNING:whylogs.viz.utils.html_template_utils:Unable to load pybars; install pybars3 to load profile directly from the current session \n"
          ]
        },
        {
          "output_type": "error",
          "ename": "AttributeError",
          "evalue": "ignored",
          "traceback": [
            "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
            "\u001b[0;31mAttributeError\u001b[0m                            Traceback (most recent call last)",
            "\u001b[0;32m<ipython-input-35-b00ce8292d0f>\u001b[0m in \u001b[0;36m<cell line: 17>\u001b[0;34m()\u001b[0m\n\u001b[1;32m     15\u001b[0m \u001b[0mvisualization\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mset_profiles\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mtarget_profile_view\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mtarget_profile\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mreference_profile_view\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mref_profile\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     16\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 17\u001b[0;31m \u001b[0mvisualization\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msummary_drift_report\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/whylogs/viz/notebook_profile_viz.py\u001b[0m in \u001b[0;36msummary_drift_report\u001b[0;34m(self, height)\u001b[0m\n\u001b[1;32m    321\u001b[0m         )\n\u001b[1;32m    322\u001b[0m         \u001b[0mrendered_template\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mtemplate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mprofiles_summary\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 323\u001b[0;31m         \u001b[0msummary_drift_report\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_display\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mrendered_template\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mpage_spec\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mheight\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    324\u001b[0m         \u001b[0;32mreturn\u001b[0m \u001b[0msummary_drift_report\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    325\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/whylogs/viz/notebook_profile_viz.py\u001b[0m in \u001b[0;36m_display\u001b[0;34m(template, page_spec, height)\u001b[0m\n\u001b[1;32m    102\u001b[0m         \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mheight\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    103\u001b[0m             \u001b[0mheight\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mpage_spec\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mheight\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 104\u001b[0;31m         iframe = f\"\"\"<div></div><iframe srcdoc=\"{html.escape(template)}\" width=100% height={height}\n\u001b[0m\u001b[1;32m    105\u001b[0m         frameBorder=0></iframe>\"\"\"\n\u001b[1;32m    106\u001b[0m         \u001b[0mdisplay\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mHTML\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0miframe\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/lib/python3.10/html/__init__.py\u001b[0m in \u001b[0;36mescape\u001b[0;34m(s, quote)\u001b[0m\n\u001b[1;32m     17\u001b[0m     \u001b[0mtranslated\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     18\u001b[0m     \"\"\"\n\u001b[0;32m---> 19\u001b[0;31m     \u001b[0ms\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0ms\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mreplace\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"&\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m\"&amp;\"\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;31m# Must be done first!\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     20\u001b[0m     \u001b[0ms\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0ms\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mreplace\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"<\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m\"&lt;\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     21\u001b[0m     \u001b[0ms\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0ms\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mreplace\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\">\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m\"&gt;\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;31mAttributeError\u001b[0m: 'NoneType' object has no attribute 'replace'"
          ]
        }
      ],
      "source": [
        "import numpy as np\n",
        "import pandas as pd\n",
        "import whylogs as why\n",
        "from whylogs.viz import NotebookProfileVisualizer\n",
        "\n",
        "mu, sigma = 0.3, 0.4 # mean and standard deviation\n",
        "s = np.random.normal(mu, sigma, 1000)\n",
        "\n",
        "df_target = pd.DataFrame(s, columns=['col1'])\n",
        "\n",
        "target_profile = why.log(df_target).view()\n",
        "\n",
        "\n",
        "visualization = NotebookProfileVisualizer()\n",
        "visualization.set_profiles(target_profile_view=target_profile, reference_profile_view=ref_profile)\n",
        "\n",
        "visualization.summary_drift_report()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "MJp56bGst76Q"
      },
      "source": [
        "We can also check the overlayed histograms for that column:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "960SJQ2Wt76R",
        "outputId": "7e4177f7-ca53-41e6-925d-3611a3e4b6a5"
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<div></div><iframe srcdoc=\"&lt;!DOCTYPE html&gt;\n",
              "&lt;html lang=&quot;en&quot;&gt;\n",
              "  &lt;head&gt;\n",
              "    &lt;meta charset=&quot;UTF-8&quot; /&gt;\n",
              "    &lt;meta http-equiv=&quot;X-UA-Compatible&quot; content=&quot;IE=edge&quot; /&gt;\n",
              "    &lt;meta name=&quot;viewport&quot; content=&quot;width=device-width, initial-scale=1.0&quot; /&gt;\n",
              "    &lt;meta name=&quot;description&quot; content=&quot;&quot; /&gt;\n",
              "    &lt;meta name=&quot;author&quot; content=&quot;&quot; /&gt;\n",
              "\n",
              "    &lt;title&gt;Profile Visualizer | whylogs&lt;/title&gt;\n",
              "\n",
              "    &lt;link rel=&quot;icon&quot; href=&quot;images/whylabs-favicon.png&quot; type=&quot;image/png&quot; sizes=&quot;16x16&quot; /&gt;\n",
              "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.googleapis.com&quot; /&gt;\n",
              "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; crossorigin /&gt;\n",
              "    &lt;link href=&quot;https://fonts.googleapis.com/css2?family=Asap:wght@400;500;600;700&amp;display=swap&quot; rel=&quot;stylesheet&quot; /&gt;\n",
              "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; /&gt;\n",
              "    &lt;link rel=&quot;stylesheet&quot; href=&quot;https://cdn.jsdelivr.net/npm/bootstrap@5.1.0/dist/css/bootstrap.min.css&quot; /&gt;\n",
              "\n",
              "    &lt;script\n",
              "      src=&quot;https://cdnjs.cloudflare.com/ajax/libs/handlebars.js/4.7.7/handlebars.min.js&quot;\n",
              "      integrity=&quot;sha512-RNLkV3d+aLtfcpEyFG8jRbnWHxUqVZozacROI4J2F1sTaDqo1dPQYs01OMi1t1w9Y2FdbSCDSQ2ZVdAC8bzgAg==&quot;\n",
              "      crossorigin=&quot;anonymous&quot;\n",
              "      referrerpolicy=&quot;no-referrer&quot;\n",
              "    &gt;&lt;/script&gt;\n",
              "\n",
              "    &lt;style type=&quot;text/css&quot;&gt;\n",
              "\n",
              "      :root {\n",
              "        /** Branded colors */\n",
              "        --brandSecondary900: #4f595b;\n",
              "        --secondaryLight1000: #313b3d;\n",
              "        /** Purpose colors */\n",
              "        --tealBackground: #eaf2f3;\n",
              "      }\n",
              "\n",
              "      /* RESET STYLE */\n",
              "      *,\n",
              "      *::after,\n",
              "      *::before {\n",
              "        margin: 0;\n",
              "        padding: 0;\n",
              "        box-sizing: border-box;\n",
              "        overflow-y: hidden;\n",
              "      }\n",
              "\n",
              "      /* Screen on smaller screens */\n",
              "      .no-responsive {\n",
              "        display: none;\n",
              "        position: fixed;\n",
              "        top: 0;\n",
              "        left: 0;\n",
              "        z-index: 1031;\n",
              "        width: 100vw;\n",
              "        height: 100vh;\n",
              "        background-color: var(--tealBackground);\n",
              "        display: flex;\n",
              "        align-items: center;\n",
              "        justify-content: center;\n",
              "      }\n",
              "\n",
              "      .desktop-content {\n",
              "        display: flex;\n",
              "        flex-direction: column;\n",
              "      }\n",
              "\n",
              "      .no-responsive__content {\n",
              "        max-width: 600px;\n",
              "        width: 100%;\n",
              "        padding: 0 24px;\n",
              "      }\n",
              "\n",
              "      .no-responsive__title {\n",
              "        font-size: 96px;\n",
              "        font-weight: 300;\n",
              "        color: var(--brandSecondary900);\n",
              "        line-height: 1.167;\n",
              "      }\n",
              "\n",
              "      .no-responsive__text {\n",
              "        margin: 0;\n",
              "        font-size: 16px;\n",
              "        font-weight: 400;\n",
              "        color: var(--brandSecondary900);\n",
              "        line-height: 1.5;\n",
              "      }\n",
              "\n",
              "      .svg-container {\n",
              "        display: inline-block;\n",
              "        position: relative;\n",
              "        width: 100%;\n",
              "        vertical-align: top;\n",
              "        overflow: hidden;\n",
              "      }\n",
              "\n",
              "      .svg-content-responsive {\n",
              "        display: inline-block;\n",
              "        position: absolute;\n",
              "        left: 0;\n",
              "      }\n",
              "\n",
              "      .circle-color {\n",
              "       display: inline-block;\n",
              "       padding: 5px;\n",
              "       border-radius: 50px;\n",
              "     }\n",
              "\n",
              "     .colors-for-distingushing-charts {\n",
              "       padding-right: 10px;\n",
              "     }\n",
              "\n",
              "     .display-flex{\n",
              "       display: flex;\n",
              "     }\n",
              "\n",
              "     .align-items-flex-end {\n",
              "       align-items: flex-end;\n",
              "     }\n",
              "\n",
              "     .chart-box-title {\n",
              "       width: 88%;\n",
              "       justify-content: space-between;\n",
              "       margin: 10px;\n",
              "       margin-top: 15px;\n",
              "       bottom: 0;\n",
              "     }\n",
              "\n",
              "     .chart-box-title p{\n",
              "       margin-bottom: 0;\n",
              "       font-family: Asap;\n",
              "       font-weight: bold;\n",
              "       font-size: 18px;\n",
              "       line-height: 16px;\n",
              "       color: #4F595B;\n",
              "     }\n",
              "\n",
              "    .bar {\n",
              "      font: 10px sans-serif;\n",
              "    }\n",
              "\n",
              "    .bar path,\n",
              "    .bar line {\n",
              "      fill: none;\n",
              "      stroke: #000;\n",
              "      shape-rendering: crispEdges;\n",
              "    }\n",
              "\n",
              "    .error-message {\n",
              "      display: flex;\n",
              "      justify-content: center;\n",
              "      align-items: center;\n",
              "      color: rgb(255, 114, 71);\n",
              "      font-size: 30px;\n",
              "      font-weight: 900;\n",
              "    }\n",
              "\n",
              "     @media screen and (min-width: 500px) {\n",
              "       .desktop-content {\n",
              "         display: block;\n",
              "       }\n",
              "       .no-responsive {\n",
              "         display: none;\n",
              "       }\n",
              "     }\n",
              "    &lt;/style&gt;\n",
              "  &lt;/head&gt;\n",
              "\n",
              "  &lt;body id=&quot;generated-html&quot;&gt;&lt;/body&gt;\n",
              "  &lt;script id=&quot;entry-template&quot; type=&quot;text/x-handlebars-template&quot;&gt;\n",
              "    \n",
              "      &lt;div class=&quot;desktop-content&quot;&gt;\n",
              "{{#each this}}              &lt;div class=&quot;chart-box&quot; id=&quot;chart-box&quot;&gt;\n",
              "                &lt;div class=&quot;chart-box-title display-flex&quot;&gt;\n",
              "                  &lt;p&gt;{{@key}}&lt;/p&gt;\n",
              "                  &lt;div class=&quot;display-flex&quot;&gt;\n",
              "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
              "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #44C0E7;&quot;&gt;&lt;/div&gt;\n",
              "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Target&lt;/text&gt;\n",
              "                    &lt;/div&gt;\n",
              "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
              "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #F5843C&quot;&gt;&lt;/div&gt;\n",
              "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Reference&lt;/text&gt;\n",
              "                    &lt;/div&gt;\n",
              "                  &lt;/div&gt;&lt;/div&gt;\n",
              "                &lt;div class=&quot;svg-container&quot;&gt;{{{getDoubleHistogramChart this}}}&lt;/div&gt;\n",
              "              &lt;/div&gt;\n",
              "{{/each}}      &lt;/div&gt;\n",
              "      &lt;div class=&quot;no-responsive&quot;&gt;\n",
              "        &lt;div class=&quot;no-responsive__content&quot;&gt;\n",
              "          &lt;h1 class=&quot;no-responsive__title&quot;&gt;Hold on! :)&lt;/h1&gt;\n",
              "          &lt;p class=&quot;no-responsive__text&quot;&gt;\n",
              "            It looks like your current screen size or device is not yet supported by the WhyLabs Sandbox. The Sandbox is\n",
              "            best experienced on a desktop computer. Please try maximizing this window or switching to another device. We\n",
              "            are working on adding support for a larger variety of devices.\n",
              "          &lt;/p&gt;\n",
              "        &lt;/div&gt;\n",
              "      &lt;/div&gt;\n",
              "    \n",
              "  &lt;/script&gt;\n",
              "\n",
              "  &lt;script src=&quot;https://code.jquery.com/jquery-3.6.0.min.js&quot; integrity=&quot;sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=&quot; crossorigin=&quot;anonymous&quot;&gt;&lt;/script&gt;\n",
              "\n",
              "  &lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/d3/6.7.0/d3.min.js&quot; integrity=&quot;sha512-cd6CHE+XWDQ33ElJqsi0MdNte3S+bQY819f7p3NUHgwQQLXSKjE4cPZTeGNI+vaxZynk1wVU3hoHmow3m089wA==&quot; crossorigin=&quot;anonymous&quot; referrerpolicy=&quot;no-referrer&quot;&gt;&lt;/script&gt;\n",
              "\n",
              "  &lt;script&gt;\n",
              "    function registerHandlebarHelperFunctions() {\n",
              "      //helper fun\n",
              "\n",
              "      class GenerateChartParams {\n",
              "        constructor(height, width, targetData, referenceData, bottomMargin=30, topMargin=5) {\n",
              "          this.MARGIN = {\n",
              "            TOP: topMargin,\n",
              "            RIGHT: 5,\n",
              "            BOTTOM: bottomMargin,\n",
              "            LEFT: 55,\n",
              "          };\n",
              "          this.SVG_WIDTH = width;\n",
              "          this.SVG_HEIGHT = height;\n",
              "          this.CHART_WIDTH = this.SVG_WIDTH - this.MARGIN.LEFT - this.MARGIN.RIGHT;\n",
              "          this.CHART_HEIGHT = this.SVG_HEIGHT - this.MARGIN.TOP - this.MARGIN.BOTTOM;\n",
              "          this.svgEl = d3.create(&quot;svg&quot;)\n",
              "             .attr(&quot;preserveAspectRatio&quot;, &quot;xMinYMin meet&quot;)\n",
              "             .attr(&quot;viewBox&quot;, `0 0 ${$(window).width()+100} ${$(window).height()-30}`)\n",
              "             .classed(&quot;svg-content-responsive&quot;, true)\n",
              "          this.maxYValue = d3.max(targetData, (d) =&gt; Math.abs(d.axisY));\n",
              "          this.minYValue = d3.min(targetData, (d) =&gt; Math.abs(d.axisY));\n",
              "          const mergedReferenceData = referenceData.map(({axisX, axisY}) =&gt; {\n",
              "            return {axisX, axisY}\n",
              "          })\n",
              "          const mergedTargetedData = targetData.map(({axisX, axisY}) =&gt; {\n",
              "            return {axisX, axisY}\n",
              "          })\n",
              "\n",
              "          this.charts2 = mergedReferenceData.concat(mergedTargetedData)\n",
              "          this.charts2 = this.charts2.sort(function(a, b) { return a - b; });\n",
              "\n",
              "          this.targetBinWidth = targetData[1]?.axisX - targetData[0]?.axisX\n",
              "          this.referenceBinWidth = referenceData[1]?.axisX - referenceData[0]?.axisX\n",
              "          this.maxTargetXValue = d3.max(targetData, (d) =&gt; d.axisX);\n",
              "\n",
              "          this.maxReferenceXValue = d3.max(referenceData, (d) =&gt; d.axisX);\n",
              "\n",
              "          this.xScale = d3\n",
              "              .scaleLinear()\n",
              "         .domain([d3.min(this.charts2, function(d) { return parseFloat(d.axisX); }),(this.maxTargetXValue+this.targetBinWidth &gt;= this.maxReferenceXValue+this.referenceBinWidth) ? this.maxTargetXValue+this.targetBinWidth:this.maxReferenceXValue+this.referenceBinWidth])\n",
              "         .range([0, this.CHART_WIDTH ]);\n",
              "\n",
              "         this.svgEl.append(&quot;g&quot;)\n",
              "             .attr(&quot;transform&quot;, &quot;translate(&quot;+ this.MARGIN.LEFT +&quot;,&quot; + this.SVG_HEIGHT + &quot;)&quot;)\n",
              "             .call(d3.axisBottom(this.xScale));\n",
              "          this.yScale = d3.scaleLinear()\n",
              "              .range([this.CHART_HEIGHT , 0])\n",
              "              .domain([d3.min(this.charts2, function(d) { return parseFloat(d.axisY); }), d3.max(this.charts2, function(d) { return parseFloat(d.axisY); })*1.2])\n",
              "              .nice();\n",
              "        }\n",
              "      }\n",
              "\n",
              "      function chartData(column) {\n",
              "        const data = [];\n",
              "        if (column?.histogram) {\n",
              "          for (let i = 0; i&lt;column.histogram.bins.length; i++) {\n",
              "            data.push({\n",
              "              axisY: column.histogram.counts[i] || 0,\n",
              "              axisX: column.histogram.bins[i] || 0,\n",
              "            });\n",
              "          }\n",
              "        } else {\n",
              "            $(document).ready(() =&gt;\n",
              "              $(&quot;.desktop-content&quot;).html(`\n",
              "                &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt;\n",
              "                  Something went wrong. Please try again.\n",
              "                &lt;/p&gt;\n",
              "              `)\n",
              "            )\n",
              "          }\n",
              "\n",
              "        return data\n",
              "      }\n",
              "\n",
              "      function verticalLine(column) {\n",
              "        const line_data = [];\n",
              "        if (column?.vertical_line) {\n",
              "            line_data.push({\n",
              "              axisX: column?.vertical_line || 0,\n",
              "            });\n",
              "\n",
              "        }\n",
              "\n",
              "        return line_data\n",
              "      }\n",
              "\n",
              "      function generateDoubleHistogramChart(targetData, referenceData) {\n",
              "        let histogramData = [],\n",
              "            overlappedHistogramData = [];\n",
              "        let yFormat;\n",
              "\n",
              "        histogramData = chartData(targetData)\n",
              "        overlappedHistogramData = chartData(referenceData)\n",
              "        lineData = verticalLine(targetData)\n",
              "\n",
              "        const sizes = new GenerateChartParams($(window).height()-80, $(window).width(), histogramData, overlappedHistogramData)\n",
              "        const {\n",
              "          MARGIN,\n",
              "          SVG_WIDTH,\n",
              "          SVG_HEIGHT,\n",
              "          CHART_WIDTH,\n",
              "          CHART_HEIGHT,\n",
              "          svgEl,\n",
              "          maxYValue,\n",
              "          minYValue,\n",
              "          xScale,\n",
              "          yScale\n",
              "        } = sizes\n",
              "\n",
              "        const rectColors = [&quot;#44C0E7&quot;, &quot;#F5843C&quot;]\n",
              "        const yAxis = d3.axisLeft(yScale).ticks(SVG_HEIGHT / 40);\n",
              "\n",
              "        svgEl.append(&quot;g&quot;)\n",
              "          .attr(&quot;transform&quot;, `translate(${MARGIN.LEFT}, ${MARGIN.BOTTOM})`)\n",
              "          .call(yAxis)\n",
              "          .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
              "          .call(g =&gt; g.selectAll(&quot;.tick line&quot;)\n",
              "              .attr(&quot;x2&quot;, CHART_WIDTH)\n",
              "              .attr(&quot;stroke-opacity&quot;, 0.1))\n",
              "          .call(g =&gt; g.append(&quot;text&quot;)\n",
              "              .attr(&quot;x&quot;, -MARGIN.LEFT)\n",
              "              .attr(&quot;y&quot;, 10)\n",
              "              .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
              "              .attr(&quot;text-anchor&quot;, &quot;start&quot;))\n",
              "\n",
              "        svgEl.append(&quot;line&quot;)\n",
              "          .attr(&quot;transform&quot;, `translate(${MARGIN.LEFT}, ${MARGIN.BOTTOM})`)\n",
              "          .data(lineData)\n",
              "          .attr(&quot;x1&quot;, (d) =&gt; xScale(d.axisX))\n",
              "          .attr(&quot;y1&quot;, MARGIN.TOP + MARGIN.TOP)\n",
              "          .attr(&quot;x2&quot;, (d) =&gt; xScale(d.axisX))\n",
              "          .attr(&quot;y2&quot;, CHART_HEIGHT + MARGIN.TOP)\n",
              "          .style(&quot;stroke-width&quot;, 2)\n",
              "          .style(&quot;stroke&quot;, &quot;#44C0E7&quot;)\n",
              "          .style(&quot;stroke-dasharray&quot;, (3,3))\n",
              "          .style(&quot;fill&quot;, &quot;none&quot;);\n",
              "\n",
              "        svgEl.append(&quot;text&quot;)\n",
              "          .attr(&quot;transform&quot;, &quot;rotate(-90)&quot;)\n",
              "          .data(lineData)\n",
              "          .attr(&quot;y&quot;, (d) =&gt; xScale(d.axisX) + MARGIN.LEFT)\n",
              "          .attr(&quot;x&quot;, 0 - (SVG_HEIGHT / 2))\n",
              "          .attr(&quot;dy&quot;, &quot;1em&quot;)\n",
              "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
              "          .text(&quot;single value&quot;)\n",
              "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
              "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
              "\n",
              "        svgEl.append(&quot;text&quot;)\n",
              "          .attr(&quot;transform&quot;,\n",
              "                &quot;translate(&quot; + (CHART_WIDTH/2) + &quot; ,&quot; +\n",
              "                               (CHART_HEIGHT + MARGIN.TOP + 75) + &quot;)&quot;)\n",
              "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
              "          .text(&quot;Values&quot;)\n",
              "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
              "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
              "\n",
              "        svgEl.append(&quot;text&quot;)\n",
              "          .attr(&quot;transform&quot;, &quot;rotate(-90)&quot;)\n",
              "          .attr(&quot;y&quot;, 0)\n",
              "          .attr(&quot;x&quot;, 0 - (SVG_HEIGHT / 2))\n",
              "          .attr(&quot;dy&quot;, &quot;1em&quot;)\n",
              "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
              "          .text(&quot;Counts&quot;)\n",
              "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
              "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
              "\n",
              "          const gChart = svgEl.append(&quot;g&quot;);\n",
              "          gChart\n",
              "          .attr(&quot;transform&quot;, &quot;translate(&quot;+ MARGIN.LEFT +&quot;,0)&quot;)\n",
              "          .selectAll(&quot;.bar&quot;)\n",
              "          .data(histogramData)\n",
              "          .enter()\n",
              "          .append(&quot;rect&quot;)\n",
              "          .style(&quot;stroke&quot;, &quot;#021826&quot;)\n",
              "          .classed(&quot;bar&quot;, true)\n",
              "          .attr(&quot;width&quot;, function(d) { return xScale(histogramData[1]?.axisX)-xScale(histogramData[0]?.axisX); })\n",
              "          .attr(&quot;height&quot;, (d) =&gt; CHART_HEIGHT - yScale(d.axisY))\n",
              "          .attr(&quot;x&quot;, 1)\n",
              "          .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d.axisX) + &quot;,&quot; + 0  +  &quot;)&quot;; })\n",
              "          .attr(&quot;y&quot;, (d) =&gt; yScale(d.axisY) + MARGIN.TOP + MARGIN.BOTTOM)\n",
              "          .attr(&quot;fill&quot;, rectColors[0])\n",
              "          .style(&quot;opacity&quot;,&quot;0.6&quot;)\n",
              "\n",
              "          const gChart1 = svgEl.append(&quot;g&quot;);\n",
              "          gChart1\n",
              "          .attr(&quot;transform&quot;, &quot;translate(&quot;+ MARGIN.LEFT +&quot;,0)&quot;)\n",
              "          .selectAll(&quot;.bar&quot;)\n",
              "          .data(overlappedHistogramData)\n",
              "          .enter()\n",
              "          .append(&quot;rect&quot;)\n",
              "          .style(&quot;stroke&quot;, &quot;#021826&quot;)\n",
              "          .classed(&quot;bar&quot;, true)\n",
              "          .attr(&quot;width&quot;, function(d) { return xScale(overlappedHistogramData[1]?.axisX)-xScale(overlappedHistogramData[0]?.axisX); })\n",
              "          .attr(&quot;height&quot;, (d) =&gt; CHART_HEIGHT - yScale(d.axisY))\n",
              "          .attr(&quot;x&quot;, 1)\n",
              "          .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d.axisX) + &quot;,&quot; + 0  +  &quot;)&quot;; })\n",
              "          .attr(&quot;y&quot;, (d) =&gt; yScale(d.axisY) + MARGIN.TOP + MARGIN.BOTTOM)\n",
              "          .attr(&quot;fill&quot;, rectColors[1])\n",
              "          .style(&quot;opacity&quot;,&quot;0.6&quot;)\n",
              "\n",
              "        return svgEl._groups[0][0].outerHTML;\n",
              "      }\n",
              "\n",
              "      const profileFromCSVfile = {&quot;col1&quot;: {&quot;histogram&quot;: {&quot;start&quot;: -0.30776376906186104, &quot;end&quot;: 0.3092176212004504, &quot;width&quot;: 0, &quot;counts&quot;: [4, 0, 5, 11, 12, 15, 17, 24, 38, 46, 53, 75, 81, 60, 74, 81, 84, 53, 61, 61, 44, 26, 26, 13, 10, 9, 3, 9, 3, 2], &quot;max&quot;: 0.30921759027869133, &quot;min&quot;: -0.30776376906186104, &quot;bins&quot;: [-0.30776376906186104, -0.287197722719784, -0.26663167637770696, -0.2460656300356299, -0.22549958369355286, -0.20493353735147582, -0.18436749100939875, -0.16380144466732172, -0.14323539832524468, -0.12266935198316764, -0.1021033056410906, -0.08153725929901354, -0.0609712129569365, -0.040405166614859434, -0.019839120272782396, 0.0007269260692946422, 0.02129297241137168, 0.04185901875344872, 0.062425065095525756, 0.0829911114376028, 0.10355715777967983, 0.12412320412175692, 0.14468925046383396, 0.165255296805911, 0.18582134314798804, 0.20638738949006513, 0.22695343583214217, 0.2475194821742192, 0.26808552851629625, 0.2886515748583733, 0.3092176212004503], &quot;n&quot;: 1000}}}\n",
              "\n",
              "      Handlebars.registerHelper(&quot;getDoubleHistogramChart&quot;,(column,key) =&gt; {\n",
              "          const columnKey = key.data.key\n",
              "        try {\n",
              "          if (profileFromCSVfile) {\n",
              "          return  generateDoubleHistogramChart (\n",
              "              column,\n",
              "              profileFromCSVfile[columnKey]\n",
              "            )\n",
              "          }\n",
              "        } catch (err) {\n",
              "          $(document).ready(() =&gt;\n",
              "            $(&quot;.desktop-content&quot;).html(`\n",
              "              &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt;\n",
              "                Something went wrong. Please try again.\n",
              "              &lt;/p&gt;\n",
              "            `)\n",
              "          )\n",
              "        }\n",
              "      });\n",
              "    }\n",
              "\n",
              "    function initWebsiteScripts() {\n",
              "      $(&quot;.svg-container&quot;).css(&quot;height&quot;, $(window).height() - 32)\n",
              "    }\n",
              "\n",
              "    function initHandlebarsTemplate() {\n",
              "      // Replace this context with JSON from .py file\n",
              "      const context = {&quot;col1&quot;: {&quot;histogram&quot;: {&quot;start&quot;: -0.9974387655769048, &quot;end&quot;: 1.3854350158908169, &quot;width&quot;: 0, &quot;counts&quot;: [1, 1, 0, 0, 4, 9, 8, 20, 18, 23, 40, 57, 66, 61, 87, 73, 78, 71, 76, 62, 56, 39, 38, 40, 25, 19, 14, 8, 2, 4], &quot;max&quot;: 1.385434877347329, &quot;min&quot;: -0.9974387655769048, &quot;bins&quot;: [-0.9974387655769048, -0.9180096395279808, -0.8385805134790567, -0.7591513874301326, -0.6797222613812086, -0.6002931353322845, -0.5208640092833604, -0.44143488323443636, -0.3620057571855123, -0.28257663113658826, -0.20314750508766422, -0.12371837903874017, -0.04428925298981601, 0.03513987305910793, 0.11456899910803209, 0.19399812515695602, 0.2734272512058802, 0.35285637725480434, 0.4322855033037283, 0.5117146293526524, 0.5911437554015764, 0.6705728814505005, 0.7500020074994245, 0.8294311335483486, 0.9088602595972728, 0.9882893856461967, 1.0677185116951207, 1.147147637744045, 1.226576763792969, 1.306005889841893, 1.3854350158908169], &quot;n&quot;: 1000}}};\n",
              "      // Config handlebars and pass data to HBS template\n",
              "      const source = document.getElementById(&quot;entry-template&quot;).innerHTML;\n",
              "      const template = Handlebars.compile(source);\n",
              "      const html = template(context);\n",
              "      const target = document.getElementById(&quot;generated-html&quot;);\n",
              "      target.innerHTML = html;\n",
              "    }\n",
              "\n",
              "    // Invoke functions -- keep in mind invokation order\n",
              "    registerHandlebarHelperFunctions();\n",
              "    initHandlebarsTemplate();\n",
              "    initWebsiteScripts();\n",
              "  &lt;/script&gt;\n",
              "&lt;/html&gt;\n",
              "\" width=100% height=300px\n",
              "        frameBorder=0></iframe>"
            ],
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ]
          },
          "execution_count": 8,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "visualization.double_histogram(feature_name=\"col1\")"
      ]
    }
  ],
  "metadata": {
    "kernelspec": {
      "display_name": ".venv",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.8.10"
    },
    "orig_nbformat": 4,
    "colab": {
      "provenance": [],
      "include_colab_link": true
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}