Skip to content

Instantly share code, notes, and snippets.

@sugatoray

sugatoray/install_dbias_dependencies_from_file.ipynb

Last active December 24, 2021 19:59
Show Gist options
  • Save sugatoray/a9aae8e7e3b9ff1dc34876b02654fc35 to your computer and use it in GitHub Desktop.
Save sugatoray/a9aae8e7e3b9ff1dc34876b02654fc35 to your computer and use it in GitHub Desktop.
Download ZIP
scratchpad
Display the source blob
Display the rendered blob
Raw
install_dbias_dependencies_from_file.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
scratchpad.ipynb
{
"cells": [
{
"cell_type": "markdown",
"metadata": {
"id": "view-in-github",
"colab_type": "text"
},
"source": [
"<a href=\"https://colab.research.google.com/gist/sugatoray/a9aae8e7e3b9ff1dc34876b02654fc35/scratchpad.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "lIYdn1woOS1n",
"outputId": "89422fd7-b202-4b04-9700-15116e87c88f"
},
"outputs": [
{
"output_type": "stream",
"name": "stdout",
"text": [
"Overwriting requirements.txt\n"
]
}
],
"source": [
"%%writefile requirements.txt\n",
"\n",
"pandas==1.2.4 \n",
"numpy==1.19.5 \n",
"spacy==3.2.1\n",
"transformers==4.6.1\n",
"tensorflow==2.4.1\n",
"https://huggingface.co/d4data/en_pipeline/resolve/main/en_pipeline-any-py3-none-any.whl"
]
},
{
"cell_type": "code",
"source": [
"! pip install -r requirements.txt"
],
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "l0lo8Xg19yJy",
"outputId": "c56e5002-fa9e-4502-a8e7-45ad3786eaa0"
},
"execution_count": null,
"outputs": [
{
"output_type": "stream",
"name": "stdout",
"text": [
"Collecting en-pipeline==any\n",
" Downloading https://huggingface.co/d4data/en_pipeline/resolve/main/en_pipeline-any-py3-none-any.whl (436.3 MB)\n",
"\u001b[K |████████████████████████████████| 436.3 MB 3.8 kB/s \n",
"\u001b[?25hRequirement already satisfied: pandas==1.2.4 in /usr/local/lib/python3.7/dist-packages (from -r requirements.txt (line 2)) (1.2.4)\n",
"Requirement already satisfied: numpy==1.19.5 in /usr/local/lib/python3.7/dist-packages (from -r requirements.txt (line 3)) (1.19.5)\n",
"Requirement already satisfied: spacy==3.2.1 in /usr/local/lib/python3.7/dist-packages (from -r requirements.txt (line 4)) (3.2.1)\n",
"Requirement already satisfied: transformers==4.6.1 in /usr/local/lib/python3.7/dist-packages (from -r requirements.txt (line 5)) (4.6.1)\n",
"Requirement already satisfied: tensorflow==2.4.1 in /usr/local/lib/python3.7/dist-packages (from -r requirements.txt (line 6)) (2.4.1)\n",
"Collecting spacy-transformers<1.2.0,>=1.1.3\n",
" Downloading spacy_transformers-1.1.3-py2.py3-none-any.whl (51 kB)\n",
"\u001b[K |████████████████████████████████| 51 kB 114 kB/s \n",
"\u001b[?25hRequirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.7/dist-packages (from pandas==1.2.4->-r requirements.txt (line 2)) (2018.9)\n",
"Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.7/dist-packages (from pandas==1.2.4->-r requirements.txt (line 2)) (2.8.2)\n",
"Requirement already satisfied: thinc<8.1.0,>=8.0.12 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (8.0.13)\n",
"Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (57.4.0)\n",
"Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (1.0.1)\n",
"Requirement already satisfied: pathy>=0.3.5 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (0.6.1)\n",
"Requirement already satisfied: pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (1.8.2)\n",
"Requirement already satisfied: srsly<3.0.0,>=2.4.1 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (2.4.2)\n",
"Requirement already satisfied: requests<3.0.0,>=2.13.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (2.23.0)\n",
"Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (2.0.6)\n",
"Requirement already satisfied: jinja2 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (2.11.3)\n",
"Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.8 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (3.0.8)\n",
"Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (21.3)\n",
"Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (3.0.6)\n",
"Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (2.0.6)\n",
"Requirement already satisfied: wasabi<1.1.0,>=0.8.1 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (0.8.2)\n",
"Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (4.62.3)\n",
"Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (3.3.0)\n",
"Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (1.0.6)\n",
"Requirement already satisfied: typing-extensions<4.0.0.0,>=3.7.4 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (3.7.4.3)\n",
"Requirement already satisfied: typer<0.5.0,>=0.3.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (0.4.0)\n",
"Requirement already satisfied: blis<0.8.0,>=0.4.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->-r requirements.txt (line 4)) (0.4.1)\n",
"Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->-r requirements.txt (line 5)) (4.8.2)\n",
"Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->-r requirements.txt (line 5)) (2019.12.20)\n",
"Requirement already satisfied: filelock in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->-r requirements.txt (line 5)) (3.4.0)\n",
"Requirement already satisfied: sacremoses in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->-r requirements.txt (line 5)) (0.0.46)\n",
"Requirement already satisfied: huggingface-hub==0.0.8 in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->-r requirements.txt (line 5)) (0.0.8)\n",
"Requirement already satisfied: tokenizers<0.11,>=0.10.1 in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->-r requirements.txt (line 5)) (0.10.3)\n",
"Requirement already satisfied: google-pasta~=0.2 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (0.2.0)\n",
"Requirement already satisfied: tensorboard~=2.4 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (2.7.0)\n",
"Requirement already satisfied: grpcio~=1.32.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (1.32.0)\n",
"Requirement already satisfied: astunparse~=1.6.3 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (1.6.3)\n",
"Requirement already satisfied: keras-preprocessing~=1.1.2 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (1.1.2)\n",
"Requirement already satisfied: absl-py~=0.10 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (0.12.0)\n",
"Requirement already satisfied: gast==0.3.3 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (0.3.3)\n",
"Requirement already satisfied: wrapt~=1.12.1 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (1.12.1)\n",
"Requirement already satisfied: tensorflow-estimator<2.5.0,>=2.4.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (2.4.0)\n",
"Requirement already satisfied: protobuf>=3.9.2 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (3.17.3)\n",
"Requirement already satisfied: h5py~=2.10.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (2.10.0)\n",
"Requirement already satisfied: opt-einsum~=3.3.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (3.3.0)\n",
"Requirement already satisfied: six~=1.15.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (1.15.0)\n",
"Requirement already satisfied: termcolor~=1.1.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (1.1.0)\n",
"Requirement already satisfied: wheel~=0.35 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (0.37.0)\n",
"Requirement already satisfied: flatbuffers~=1.12.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->-r requirements.txt (line 6)) (1.12)\n",
"Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from catalogue<2.1.0,>=2.0.6->spacy==3.2.1->-r requirements.txt (line 4)) (3.6.0)\n",
"Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=20.0->spacy==3.2.1->-r requirements.txt (line 4)) (3.0.6)\n",
"Requirement already satisfied: smart-open<6.0.0,>=5.0.0 in /usr/local/lib/python3.7/dist-packages (from pathy>=0.3.5->spacy==3.2.1->-r requirements.txt (line 4)) (5.2.1)\n",
"Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->-r requirements.txt (line 4)) (2.10)\n",
"Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->-r requirements.txt (line 4)) (3.0.4)\n",
"Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->-r requirements.txt (line 4)) (2021.10.8)\n",
"Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->-r requirements.txt (line 4)) (1.24.3)\n",
"Collecting spacy-alignments<1.0.0,>=0.7.2\n",
" Downloading spacy_alignments-0.8.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)\n",
"\u001b[K |████████████████████████████████| 1.1 MB 10.4 MB/s \n",
"\u001b[?25hRequirement already satisfied: torch>=1.6.0 in /usr/local/lib/python3.7/dist-packages (from spacy-transformers<1.2.0,>=1.1.3->en-pipeline==any->-r requirements.txt (line 7)) (1.10.0+cu111)\n",
"Requirement already satisfied: werkzeug>=0.11.15 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (1.0.1)\n",
"Requirement already satisfied: google-auth<3,>=1.6.3 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (1.35.0)\n",
"Requirement already satisfied: tensorboard-data-server<0.7.0,>=0.6.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (0.6.1)\n",
"Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (0.4.6)\n",
"Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (1.8.0)\n",
"Requirement already satisfied: markdown>=2.6.8 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (3.3.6)\n",
"Requirement already satisfied: rsa<5,>=3.1.4 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (4.8)\n",
"Requirement already satisfied: cachetools<5.0,>=2.0.0 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (4.2.4)\n",
"Requirement already satisfied: pyasn1-modules>=0.2.1 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (0.2.8)\n",
"Requirement already satisfied: requests-oauthlib>=0.7.0 in /usr/local/lib/python3.7/dist-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (1.3.0)\n",
"Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /usr/local/lib/python3.7/dist-packages (from pyasn1-modules>=0.2.1->google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (0.4.8)\n",
"Requirement already satisfied: oauthlib>=3.0.0 in /usr/local/lib/python3.7/dist-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard~=2.4->tensorflow==2.4.1->-r requirements.txt (line 6)) (3.1.1)\n",
"Requirement already satisfied: click<9.0.0,>=7.1.1 in /usr/local/lib/python3.7/dist-packages (from typer<0.5.0,>=0.3.0->spacy==3.2.1->-r requirements.txt (line 4)) (7.1.2)\n",
"Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python3.7/dist-packages (from jinja2->spacy==3.2.1->-r requirements.txt (line 4)) (2.0.1)\n",
"Requirement already satisfied: joblib in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers==4.6.1->-r requirements.txt (line 5)) (1.1.0)\n",
"Installing collected packages: spacy-alignments, spacy-transformers, en-pipeline\n",
"Successfully installed en-pipeline-0.0.0 spacy-alignments-0.8.4 spacy-transformers-1.1.3\n"
]
}
]
},
{
"cell_type": "code",
"source": [
"! pip install Dbias"
],
"metadata": {
"id": "8big54G4-Wps",
"outputId": "6072a523-1814-448c-c496-d15d9fb9873b",
"colab": {
"base_uri": "https://localhost:8080/",
"height": 1000
}
},
"execution_count": 1,
"outputs": [
{
"output_type": "stream",
"name": "stdout",
"text": [
"Collecting Dbias\n",
" Downloading Dbias-0.0.8-py3-none-any.whl (7.1 kB)\n",
"Collecting pandas==1.2.4\n",
" Downloading pandas-1.2.4-cp37-cp37m-manylinux1_x86_64.whl (9.9 MB)\n",
"\u001b[K |████████████████████████████████| 9.9 MB 7.5 MB/s \n",
"\u001b[?25hCollecting transformers==4.6.1\n",
" Downloading transformers-4.6.1-py3-none-any.whl (2.2 MB)\n",
"\u001b[K |████████████████████████████████| 2.2 MB 21.6 MB/s \n",
"\u001b[?25hCollecting spacy==3.2.1\n",
" Downloading spacy-3.2.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.0 MB)\n",
"\u001b[K |████████████████████████████████| 6.0 MB 39.4 MB/s \n",
"\u001b[?25hCollecting tensorflow==2.4.1\n",
" Downloading tensorflow-2.4.1-cp37-cp37m-manylinux2010_x86_64.whl (394.3 MB)\n",
"\u001b[K |████████████████████████████████| 394.3 MB 13 kB/s \n",
"\u001b[?25hRequirement already satisfied: numpy==1.19.5 in /usr/local/lib/python3.7/dist-packages (from Dbias) (1.19.5)\n",
"Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.7/dist-packages (from pandas==1.2.4->Dbias) (2.8.2)\n",
"Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.7/dist-packages (from pandas==1.2.4->Dbias) (2018.9)\n",
"Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (2.0.6)\n",
"Collecting pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4\n",
" Downloading pydantic-1.8.2-cp37-cp37m-manylinux2014_x86_64.whl (10.1 MB)\n",
"\u001b[K |████████████████████████████████| 10.1 MB 38.2 MB/s \n",
"\u001b[?25hCollecting spacy-legacy<3.1.0,>=3.0.8\n",
" Downloading spacy_legacy-3.0.8-py2.py3-none-any.whl (14 kB)\n",
"Collecting langcodes<4.0.0,>=3.2.0\n",
" Downloading langcodes-3.3.0-py3-none-any.whl (181 kB)\n",
"\u001b[K |████████████████████████████████| 181 kB 56.1 MB/s \n",
"\u001b[?25hRequirement already satisfied: typing-extensions<4.0.0.0,>=3.7.4 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (3.10.0.2)\n",
"Collecting pathy>=0.3.5\n",
" Downloading pathy-0.6.1-py3-none-any.whl (42 kB)\n",
"\u001b[K |████████████████████████████████| 42 kB 1.6 MB/s \n",
"\u001b[?25hCollecting catalogue<2.1.0,>=2.0.6\n",
" Downloading catalogue-2.0.6-py3-none-any.whl (17 kB)\n",
"Collecting typer<0.5.0,>=0.3.0\n",
" Downloading typer-0.4.0-py3-none-any.whl (27 kB)\n",
"Requirement already satisfied: requests<3.0.0,>=2.13.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (2.23.0)\n",
"Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (1.0.6)\n",
"Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (57.4.0)\n",
"Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (21.3)\n",
"Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (3.0.6)\n",
"Requirement already satisfied: blis<0.8.0,>=0.4.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (0.4.1)\n",
"Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (4.62.3)\n",
"Collecting spacy-loggers<2.0.0,>=1.0.0\n",
" Downloading spacy_loggers-1.0.1-py3-none-any.whl (7.0 kB)\n",
"Requirement already satisfied: jinja2 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (2.11.3)\n",
"Collecting srsly<3.0.0,>=2.4.1\n",
" Downloading srsly-2.4.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (451 kB)\n",
"\u001b[K |████████████████████████████████| 451 kB 64.5 MB/s \n",
"\u001b[?25hCollecting thinc<8.1.0,>=8.0.12\n",
" Downloading thinc-8.0.13-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (628 kB)\n",
"\u001b[K |████████████████████████████████| 628 kB 51.4 MB/s \n",
"\u001b[?25hRequirement already satisfied: wasabi<1.1.0,>=0.8.1 in /usr/local/lib/python3.7/dist-packages (from spacy==3.2.1->Dbias) (0.8.2)\n",
"Collecting tensorflow-estimator<2.5.0,>=2.4.0\n",
" Downloading tensorflow_estimator-2.4.0-py2.py3-none-any.whl (462 kB)\n",
"\u001b[K |████████████████████████████████| 462 kB 60.5 MB/s \n",
"\u001b[?25hRequirement already satisfied: six~=1.15.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (1.15.0)\n",
"Requirement already satisfied: wheel~=0.35 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (0.37.0)\n",
"Requirement already satisfied: protobuf>=3.9.2 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (3.17.3)\n",
"Collecting typing-extensions<4.0.0.0,>=3.7.4\n",
" Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)\n",
"Requirement already satisfied: absl-py~=0.10 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (0.12.0)\n",
"Requirement already satisfied: opt-einsum~=3.3.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (3.3.0)\n",
"Collecting gast==0.3.3\n",
" Downloading gast-0.3.3-py2.py3-none-any.whl (9.7 kB)\n",
"Collecting wrapt~=1.12.1\n",
" Downloading wrapt-1.12.1.tar.gz (27 kB)\n",
"Requirement already satisfied: keras-preprocessing~=1.1.2 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (1.1.2)\n",
"Requirement already satisfied: tensorboard~=2.4 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (2.7.0)\n",
"Requirement already satisfied: google-pasta~=0.2 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (0.2.0)\n",
"Collecting h5py~=2.10.0\n",
" Downloading h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9 MB)\n",
"\u001b[K |████████████████████████████████| 2.9 MB 46.3 MB/s \n",
"\u001b[?25hRequirement already satisfied: astunparse~=1.6.3 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (1.6.3)\n",
"Requirement already satisfied: termcolor~=1.1.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow==2.4.1->Dbias) (1.1.0)\n",
"Collecting flatbuffers~=1.12.0\n",
" Downloading flatbuffers-1.12-py2.py3-none-any.whl (15 kB)\n",
"Collecting grpcio~=1.32.0\n",
" Downloading grpcio-1.32.0-cp37-cp37m-manylinux2014_x86_64.whl (3.8 MB)\n",
"\u001b[K |████████████████████████████████| 3.8 MB 48.9 MB/s \n",
"\u001b[?25hRequirement already satisfied: filelock in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->Dbias) (3.4.0)\n",
"Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->Dbias) (4.8.2)\n",
"Collecting huggingface-hub==0.0.8\n",
" Downloading huggingface_hub-0.0.8-py3-none-any.whl (34 kB)\n",
"Collecting tokenizers<0.11,>=0.10.1\n",
" Downloading tokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (3.3 MB)\n",
"\u001b[K |████████████████████████████████| 3.3 MB 50.0 MB/s \n",
"\u001b[?25hRequirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.7/dist-packages (from transformers==4.6.1->Dbias) (2019.12.20)\n",
"Collecting sacremoses\n",
" Downloading sacremoses-0.0.46-py3-none-any.whl (895 kB)\n",
"\u001b[K |████████████████████████████████| 895 kB 71.0 MB/s \n",
"\u001b[?25hRequirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from catalogue<2.1.0,>=2.0.6->spacy==3.2.1->Dbias) (3.6.0)\n",
"Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=20.0->spacy==3.2.1->Dbias) (3.0.6)\n",
"Requirement already satisfied: smart-open<6.0.0,>=5.0.0 in /usr/local/lib/python3.7/dist-packages (from pathy>=0.3.5->spacy==3.2.1->Dbias) (5.2.1)\n",
"Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->Dbias) (2021.10.8)\n",
"Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->Dbias) (1.24.3)\n",
"Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->Dbias) (2.10)\n",
"Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy==3.2.1->Dbias) (3.0.4)\n",
"Requirement already satisfied: google-auth<3,>=1.6.3 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->Dbias) (1.35.0)\n",
"Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->Dbias) (1.8.0)\n",
"Requirement already satisfied: markdown>=2.6.8 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->Dbias) (3.3.6)\n",
"Requirement already satisfied: werkzeug>=0.11.15 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->Dbias) (1.0.1)\n",
"Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->Dbias) (0.4.6)\n",
"Requirement already satisfied: tensorboard-data-server<0.7.0,>=0.6.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard~=2.4->tensorflow==2.4.1->Dbias) (0.6.1)\n",
"Requirement already satisfied: cachetools<5.0,>=2.0.0 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->Dbias) (4.2.4)\n",
"Requirement already satisfied: pyasn1-modules>=0.2.1 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->Dbias) (0.2.8)\n",
"Requirement already satisfied: rsa<5,>=3.1.4 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->Dbias) (4.8)\n",
"Requirement already satisfied: requests-oauthlib>=0.7.0 in /usr/local/lib/python3.7/dist-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard~=2.4->tensorflow==2.4.1->Dbias) (1.3.0)\n",
"Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /usr/local/lib/python3.7/dist-packages (from pyasn1-modules>=0.2.1->google-auth<3,>=1.6.3->tensorboard~=2.4->tensorflow==2.4.1->Dbias) (0.4.8)\n",
"Requirement already satisfied: oauthlib>=3.0.0 in /usr/local/lib/python3.7/dist-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard~=2.4->tensorflow==2.4.1->Dbias) (3.1.1)\n",
"Requirement already satisfied: click<9.0.0,>=7.1.1 in /usr/local/lib/python3.7/dist-packages (from typer<0.5.0,>=0.3.0->spacy==3.2.1->Dbias) (7.1.2)\n",
"Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python3.7/dist-packages (from jinja2->spacy==3.2.1->Dbias) (2.0.1)\n",
"Requirement already satisfied: joblib in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers==4.6.1->Dbias) (1.1.0)\n",
"Building wheels for collected packages: wrapt\n",
" Building wheel for wrapt (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
" Created wheel for wrapt: filename=wrapt-1.12.1-cp37-cp37m-linux_x86_64.whl size=68721 sha256=bbd10c76fbcb05033fd8532d2347f4fccf71a7d44d63357386f2e9184f309ff5\n",
" Stored in directory: /root/.cache/pip/wheels/62/76/4c/aa25851149f3f6d9785f6c869387ad82b3fd37582fa8147ac6\n",
"Successfully built wrapt\n",
"Installing collected packages: typing-extensions, catalogue, typer, srsly, pydantic, grpcio, wrapt, tokenizers, thinc, tensorflow-estimator, spacy-loggers, spacy-legacy, sacremoses, pathy, langcodes, huggingface-hub, h5py, gast, flatbuffers, transformers, tensorflow, spacy, pandas, Dbias\n",
" Attempting uninstall: typing-extensions\n",
" Found existing installation: typing-extensions 3.10.0.2\n",
" Uninstalling typing-extensions-3.10.0.2:\n",
" Successfully uninstalled typing-extensions-3.10.0.2\n",
" Attempting uninstall: catalogue\n",
" Found existing installation: catalogue 1.0.0\n",
" Uninstalling catalogue-1.0.0:\n",
" Successfully uninstalled catalogue-1.0.0\n",
" Attempting uninstall: srsly\n",
" Found existing installation: srsly 1.0.5\n",
" Uninstalling srsly-1.0.5:\n",
" Successfully uninstalled srsly-1.0.5\n",
" Attempting uninstall: grpcio\n",
" Found existing installation: grpcio 1.42.0\n",
" Uninstalling grpcio-1.42.0:\n",
" Successfully uninstalled grpcio-1.42.0\n",
" Attempting uninstall: wrapt\n",
" Found existing installation: wrapt 1.13.3\n",
" Uninstalling wrapt-1.13.3:\n",
" Successfully uninstalled wrapt-1.13.3\n",
" Attempting uninstall: thinc\n",
" Found existing installation: thinc 7.4.0\n",
" Uninstalling thinc-7.4.0:\n",
" Successfully uninstalled thinc-7.4.0\n",
" Attempting uninstall: tensorflow-estimator\n",
" Found existing installation: tensorflow-estimator 2.7.0\n",
" Uninstalling tensorflow-estimator-2.7.0:\n",
" Successfully uninstalled tensorflow-estimator-2.7.0\n",
" Attempting uninstall: h5py\n",
" Found existing installation: h5py 3.1.0\n",
" Uninstalling h5py-3.1.0:\n",
" Successfully uninstalled h5py-3.1.0\n",
" Attempting uninstall: gast\n",
" Found existing installation: gast 0.4.0\n",
" Uninstalling gast-0.4.0:\n",
" Successfully uninstalled gast-0.4.0\n",
" Attempting uninstall: flatbuffers\n",
" Found existing installation: flatbuffers 2.0\n",
" Uninstalling flatbuffers-2.0:\n",
" Successfully uninstalled flatbuffers-2.0\n",
" Attempting uninstall: tensorflow\n",
" Found existing installation: tensorflow 2.7.0\n",
" Uninstalling tensorflow-2.7.0:\n",
" Successfully uninstalled tensorflow-2.7.0\n",
" Attempting uninstall: spacy\n",
" Found existing installation: spacy 2.2.4\n",
" Uninstalling spacy-2.2.4:\n",
" Successfully uninstalled spacy-2.2.4\n",
" Attempting uninstall: pandas\n",
" Found existing installation: pandas 1.1.5\n",
" Uninstalling pandas-1.1.5:\n",
" Successfully uninstalled pandas-1.1.5\n",
"\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n",
"google-colab 1.0.0 requires pandas~=1.1.0; python_version >= \"3.0\", but you have pandas 1.2.4 which is incompatible.\u001b[0m\n",
"Successfully installed Dbias-0.0.8 catalogue-2.0.6 flatbuffers-1.12 gast-0.3.3 grpcio-1.32.0 h5py-2.10.0 huggingface-hub-0.0.8 langcodes-3.3.0 pandas-1.2.4 pathy-0.6.1 pydantic-1.8.2 sacremoses-0.0.46 spacy-3.2.1 spacy-legacy-3.0.8 spacy-loggers-1.0.1 srsly-2.4.2 tensorflow-2.4.1 tensorflow-estimator-2.4.0 thinc-8.0.13 tokenizers-0.10.3 transformers-4.6.1 typer-0.4.0 typing-extensions-3.7.4.3 wrapt-1.12.1\n"
]
},
{
"output_type": "display_data",
"data": {
"application/vnd.colab-display-data+json": {
"pip_warning": {
"packages": [
"pandas"
]
}
}
},
"metadata": {}
}
]
},
{
"cell_type": "code",
"source": [
""
],
"metadata": {
"id": "PV2ONKMWAo6R"
},
"execution_count": null,
"outputs": []
}
],
"metadata": {
"colab": {
"name": "scratchpad",
"provenance": [],
"include_colab_link": true
},
"kernelspec": {
"display_name": "Python 3",
"name": "python3"
}
},
"nbformat": 4,
"nbformat_minor": 0
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment