- Using https://github.com/ghuntley/python-repro/commit/248b8d687524a61569ab7324616eb4223d7be980
- Which has the following requirements.txt
# Essentials:
datasette
sqlite-utils
pip
# Plugins - uncomment to install:
# - Plot latitude/longitude on a map:
# datasette-cluster-map
# - Add bar/line/scatter plots:
# datasette-vega
# More plugins here:
# https://datasette.readthedocs.io/en/stable/ecosystem.html#datasette-plugins
- Prebuilds are configured and ran
pip3 install -U -r requirements.txt --user
- Workspace started and ran the following
gitpod /workspace/python-repro $ pip list
Package Version
--------------------------------- ---------
aiofiles 0.8.0
anyio 3.4.0
argon2-cffi 21.1.0
asgi-csrf 0.9
asgiref 3.4.1
astroid 2.7.3
attrs 21.2.0
autopep8 1.5.7
backcall 0.2.0
backports.entry-points-selectable 1.1.0
bandit 1.7.0
bleach 4.1.0
certifi 2021.5.30
cffi 1.14.6
charset-normalizer 2.0.4
click 8.0.3
click-default-group 1.2.2
colorama 0.4.4
cryptography 3.4.8
datasette 0.59.4
debugpy 1.4.3
decorator 5.1.0
defusedxml 0.7.1
distlib 0.3.2
docutils 0.17.1
entrypoints 0.3
filelock 3.0.12
flake8 3.9.2
gitdb 4.0.7
GitPython 3.1.18
h11 0.12.0
httpcore 0.14.3
httpx 0.21.1
hupper 1.10.3
idna 3.2
importlib-metadata 4.8.1
ipykernel 6.4.1
ipython 7.27.0
ipython-genutils 0.2.0
isort 5.9.3
itsdangerous 2.0.1
janus 0.7.0
jedi 0.18.0
jeepney 0.7.1
Jinja2 3.0.1
jsonschema 3.2.0
jupyter-client 7.0.2
jupyter-core 4.7.1
jupyterlab-pygments 0.1.2
keyring 23.2.1
lazy-object-proxy 1.6.0
MarkupSafe 2.0.1
matplotlib-inline 0.1.3
mccabe 0.6.1
mergedeep 1.3.4
mistune 0.8.4
mypy 0.910
mypy-extensions 0.4.3
nbclient 0.5.4
nbconvert 6.1.0
nbformat 5.1.3
nest-asyncio 1.5.1
notebook 6.4.3
packaging 21.0
pandocfilters 1.4.3
parso 0.8.2
pbr 5.6.0
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
Pint 0.18
pip 21.3.1
pipenv 2021.5.29
pkginfo 1.7.1
platformdirs 2.3.0
pluggy 1.0.0
prometheus-client 0.11.0
prompt-toolkit 3.0.20
ptyprocess 0.7.0
pycodestyle 2.7.0
pycparser 2.20
pydocstyle 6.1.1
pyflakes 2.3.1
Pygments 2.10.0
pylama 7.7.1
pylint 2.10.2
pyparsing 2.4.7
pyrsistent 0.18.0
python-baseconv 1.2.2
python-dateutil 2.8.2
python-multipart 0.0.5
PyYAML 5.4.1
pyzmq 22.2.1
readme-renderer 29.0
requests 2.26.0
requests-toolbelt 0.9.1
rfc3986 1.5.0
rope 0.19.0
SecretStorage 3.3.1
Send2Trash 1.8.0
setuptools 58.0.4
six 1.16.0
smmap 4.0.0
sniffio 1.2.0
snowballstemmer 2.1.0
sqlite-fts4 1.0.1
sqlite-utils 3.19
stevedore 3.4.0
tabulate 0.8.9
terminado 0.12.1
testpath 0.5.0
toml 0.10.2
tornado 6.1
tqdm 4.62.2
traitlets 5.1.0
twine 3.4.2
typing-extensions 3.10.0.2
urllib3 1.26.6
uvicorn 0.15.0
virtualenv 20.7.2
virtualenv-clone 0.5.7
wcwidth 0.2.5
webencodings 0.5.1
wheel 0.37.0
wrapt 1.12.1
zipp 3.5.0
- Using https://github.com/ghuntley/full (empty)
pip gitpod /workspace/full $ pip list
Package Version
--------------------------------- ---------
argon2-cffi 21.1.0
astroid 2.7.3
attrs 21.2.0
autopep8 1.5.7
backcall 0.2.0
backports.entry-points-selectable 1.1.0
bandit 1.7.0
bleach 4.1.0
certifi 2021.5.30
cffi 1.14.6
charset-normalizer 2.0.4
colorama 0.4.4
cryptography 3.4.8
debugpy 1.4.3
decorator 5.1.0
defusedxml 0.7.1
distlib 0.3.2
docutils 0.17.1
entrypoints 0.3
filelock 3.0.12
flake8 3.9.2
gitdb 4.0.7
GitPython 3.1.18
idna 3.2
importlib-metadata 4.8.1
ipykernel 6.4.1
ipython 7.27.0
ipython-genutils 0.2.0
isort 5.9.3
jedi 0.18.0
jeepney 0.7.1
Jinja2 3.0.1
jsonschema 3.2.0
jupyter-client 7.0.2
jupyter-core 4.7.1
jupyterlab-pygments 0.1.2
keyring 23.2.1
lazy-object-proxy 1.6.0
MarkupSafe 2.0.1
matplotlib-inline 0.1.3
mccabe 0.6.1
mistune 0.8.4
mypy 0.910
mypy-extensions 0.4.3
nbclient 0.5.4
nbconvert 6.1.0
nbformat 5.1.3
nest-asyncio 1.5.1
notebook 6.4.3
packaging 21.0
pandocfilters 1.4.3
parso 0.8.2
pbr 5.6.0
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
pip 21.2.4
pipenv 2021.5.29
pkginfo 1.7.1
platformdirs 2.3.0
prometheus-client 0.11.0
prompt-toolkit 3.0.20
ptyprocess 0.7.0
pycodestyle 2.7.0
pycparser 2.20
pydocstyle 6.1.1
pyflakes 2.3.1
Pygments 2.10.0
pylama 7.7.1
pylint 2.10.2
pyparsing 2.4.7
pyrsistent 0.18.0
python-dateutil 2.8.2
PyYAML 5.4.1
pyzmq 22.2.1
readme-renderer 29.0
requests 2.26.0
requests-toolbelt 0.9.1
rfc3986 1.5.0
rope 0.19.0
SecretStorage 3.3.1
Send2Trash 1.8.0
setuptools 58.0.4
six 1.16.0
smmap 4.0.0
snowballstemmer 2.1.0
stevedore 3.4.0
terminado 0.12.1
testpath 0.5.0
toml 0.10.2
tornado 6.1
tqdm 4.62.2
traitlets 5.1.0
twine 3.4.2
typing-extensions 3.10.0.2
urllib3 1.26.6
virtualenv 20.7.2
virtualenv-clone 0.5.7
wcwidth 0.2.5
webencodings 0.5.1
wheel 0.37.0
wrapt 1.12.1
zipp 3.5.0
WARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/home/gitpod/.pyenv/versions/3.8.12/bin/python3 -m pip install --upgrade pip' command.
- Created https://github.com/ghuntley/full/commit/2e3a81133d76dd146f41fc6f854ab56a6fa0f6e4 to reproduce below
Thanks @JanKoehnlein - this seems to half work. I used one of the previous commits (commit-8fc141dbdd92030a435ead06617c6d37651d8312) and the build worked fine with none of the bloat; however, on stopping and restarting the workspace, the bloatware appears again. I'm going to try with an older commit and see what happens.
gitpod /workspace/full $ pip list
Package Version
--------------------------------- ---------
argon2-cffi 21.1.0
astroid 2.7.3
attrs 21.2.0
autopep8 1.5.7
backcall 0.2.0
backports.entry-points-selectable 1.1.0
bandit 1.7.0
bleach 4.1.0
certifi 2021.5.30
cffi 1.14.6
charset-normalizer 2.0.4
colorama 0.4.4
cryptography 3.4.8
debugpy 1.4.3
decorator 5.1.0
defusedxml 0.7.1
distlib 0.3.2
docutils 0.17.1
entrypoints 0.3
filelock 3.0.12
flake8 3.9.2
gitdb 4.0.7
GitPython 3.1.18
idna 3.2
importlib-metadata 4.8.1
ipykernel 6.4.1
ipython 7.27.0
ipython-genutils 0.2.0
isort 5.9.3
jedi 0.18.0
jeepney 0.7.1
Jinja2 3.0.1
jsonschema 3.2.0
jupyter-client 7.0.2
jupyter-core 4.7.1
jupyterlab-pygments 0.1.2
keyring 23.2.1
lazy-object-proxy 1.6.0
MarkupSafe 2.0.1
matplotlib-inline 0.1.3
mccabe 0.6.1
mistune 0.8.4
mypy 0.910
mypy-extensions 0.4.3
nbclient 0.5.4
nbconvert 6.1.0
nbformat 5.1.3
nest-asyncio 1.5.1
notebook 6.4.3
packaging 21.0
pandocfilters 1.4.3
parso 0.8.2
pbr 5.6.0
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
pip 21.2.4
pipenv 2021.5.29
pkginfo 1.7.1
platformdirs 2.3.0
prometheus-client 0.11.0
prompt-toolkit 3.0.20
ptyprocess 0.7.0
pycodestyle 2.7.0
pycparser 2.20
pydocstyle 6.1.1
pyflakes 2.3.1
Pygments 2.10.0
pylama 7.7.1
pylint 2.10.2
pyparsing 2.4.7
pyrsistent 0.18.0
python-dateutil 2.8.2
PyYAML 5.4.1
pyzmq 22.2.1
readme-renderer 29.0
requests 2.26.0
requests-toolbelt 0.9.1
rfc3986 1.5.0
rope 0.19.0
SecretStorage 3.3.1
Send2Trash 1.8.0
setuptools 58.0.4
six 1.16.0
smmap 4.0.0
snowballstemmer 2.1.0
stevedore 3.4.0
terminado 0.12.1
testpath 0.5.0
toml 0.10.2
tornado 6.1
tqdm 4.62.2
traitlets 5.1.0
twine 3.4.2
typing-extensions 3.10.0.2
urllib3 1.26.6
virtualenv 20.7.2
virtualenv-clone 0.5.7
wcwidth 0.2.5
webencodings 0.5.1
wheel 0.37.0
wrapt 1.12.1
zipp 3.5.0
WARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/home/gitpod/.pyenv/versions/3.8.12/bin/python3 -m pip install --upgrade pip' command.
- Running a diff vs full and the above commit shows there are no differences.
diff full old
1c1
< pip gitpod /workspace/full $ pip list
---
> gitpod /workspace/full $ pip list
108c108
< You should consider upgrading via the '/home/gitpod/.pyenv/versions/3.8.12/bin/python3 -m pip install --upgrade pip' command.
---
> You should consider upgrading via the '/home/gitpod/.pyenv/versions/3.8.12/bin/python3 -m pip install --upgrade pip' command.
\ No newline at end of file
gitpod /workspace/full $ pip list --user
WARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/home/gitpod/.pyenv/versions/3.8.12/bin/python3 -m pip install --upgrade pip' command.
- Using https://github.com/ghuntley/python-repro/commit/248b8d687524a61569ab7324616eb4223d7be980 once again
gitpod /workspace/python-repro $ pip list --user
Package Version
------------------- -------
aiofiles 0.8.0
anyio 3.4.0
asgi-csrf 0.9
asgiref 3.4.1
click 8.0.3
click-default-group 1.2.2
datasette 0.59.4
h11 0.12.0
httpcore 0.14.3
httpx 0.21.1
hupper 1.10.3
itsdangerous 2.0.1
janus 0.7.0
mergedeep 1.3.4
Pint 0.18
pip 21.3.1
pluggy 1.0.0
python-baseconv 1.2.2
python-multipart 0.0.5
sniffio 1.2.0
sqlite-fts4 1.0.1
sqlite-utils 3.19
tabulate 0.8.9
uvicorn 0.15.0
Which aligns with the requirements.txt of
# Essentials:
datasette
sqlite-utils
pip
# Plugins - uncomment to install:
# - Plot latitude/longitude on a map:
# datasette-cluster-map
# - Add bar/line/scatter plots:
# datasette-vega
# More plugins here:
# https://datasette.readthedocs.io/en/stable/ecosystem.html#datasette-plugins
So let's go back in time further... circa 4 months ago
Adjusted https://github.com/ghuntley/full/commit/8972c4d0de9ff629da925727be8f8f2fda49a367
gitpod /workspace/full $ pip list
Package Version
------------------- ---------
appdirs 1.4.4
argon2-cffi 20.1.0
astroid 2.6.2
async-generator 1.10
attrs 21.2.0
autopep8 1.5.7
backcall 0.2.0
bandit 1.7.0
bleach 3.3.0
certifi 2021.5.30
cffi 1.14.5
chardet 4.0.0
colorama 0.4.4
cryptography 3.4.7
debugpy 1.3.0
decorator 5.0.9
defusedxml 0.7.1
distlib 0.3.2
docutils 0.17.1
entrypoints 0.3
filelock 3.0.12
flake8 3.9.2
gitdb 4.0.7
GitPython 3.1.18
idna 2.10
importlib-metadata 4.6.1
ipykernel 6.0.1
ipython 7.25.0
ipython-genutils 0.2.0
isort 5.9.1
jedi 0.18.0
jeepney 0.6.0
Jinja2 3.0.1
jsonschema 3.2.0
jupyter-client 6.1.12
jupyter-core 4.7.1
jupyterlab-pygments 0.1.2
keyring 23.0.1
lazy-object-proxy 1.6.0
MarkupSafe 2.0.1
matplotlib-inline 0.1.2
mccabe 0.6.1
mistune 0.8.4
mypy 0.910
mypy-extensions 0.4.3
nbclient 0.5.3
nbconvert 6.1.0
nbformat 5.1.3
nest-asyncio 1.5.1
notebook 6.4.0
packaging 21.0
pandocfilters 1.4.3
parso 0.8.2
pbr 5.6.0
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
pip 21.1.3
pipenv 2021.5.29
pkginfo 1.7.0
prometheus-client 0.11.0
prompt-toolkit 3.0.19
ptyprocess 0.7.0
pycodestyle 2.7.0
pycparser 2.20
pydocstyle 6.1.1
pyflakes 2.3.1
Pygments 2.9.0
pylama 7.7.1
pylint 2.9.3
pyparsing 2.4.7
pyrsistent 0.18.0
python-dateutil 2.8.1
PyYAML 5.4.1
pyzmq 22.1.0
readme-renderer 29.0
requests 2.25.1
requests-toolbelt 0.9.1
rfc3986 1.5.0
rope 0.19.0
SecretStorage 3.3.1
Send2Trash 1.7.1
setuptools 57.1.0
six 1.16.0
smmap 4.0.0
snowballstemmer 2.1.0
stevedore 3.3.0
terminado 0.10.1
testpath 0.5.0
toml 0.10.2
tornado 6.1
tqdm 4.61.2
traitlets 5.0.5
twine 3.4.1
typing-extensions 3.10.0.0
urllib3 1.26.6
virtualenv 20.4.7
virtualenv-clone 0.5.4
wcwidth 0.2.5
webencodings 0.5.1
wheel 0.36.2
wrapt 1.12.1
zipp 3.5.0
WARNING: You are using pip version 21.1.3; however, version 21.3.1 is available.
You should consider upgrading via the '/home/gitpod/.pyenv/versions/3.8.11/bin/python3 -m pip install --upgrade pip' command.
- Ran diff against full and 2 month old version
$ diff full old
1,108c1,108
< pip gitpod /workspace/full $ pip list
< Package Version
< --------------------------------- ---------
< argon2-cffi 21.1.0
< astroid 2.7.3
< attrs 21.2.0
< autopep8 1.5.7
< backcall 0.2.0
< backports.entry-points-selectable 1.1.0
< bandit 1.7.0
< bleach 4.1.0
< certifi 2021.5.30
< cffi 1.14.6
< charset-normalizer 2.0.4
< colorama 0.4.4
< cryptography 3.4.8
< debugpy 1.4.3
< decorator 5.1.0
< defusedxml 0.7.1
< distlib 0.3.2
< docutils 0.17.1
< entrypoints 0.3
< filelock 3.0.12
< flake8 3.9.2
< gitdb 4.0.7
< GitPython 3.1.18
< idna 3.2
< importlib-metadata 4.8.1
< ipykernel 6.4.1
< ipython 7.27.0
< ipython-genutils 0.2.0
< isort 5.9.3
< jedi 0.18.0
< jeepney 0.7.1
< Jinja2 3.0.1
< jsonschema 3.2.0
< jupyter-client 7.0.2
< jupyter-core 4.7.1
< jupyterlab-pygments 0.1.2
< keyring 23.2.1
< lazy-object-proxy 1.6.0
< MarkupSafe 2.0.1
< matplotlib-inline 0.1.3
< mccabe 0.6.1
< mistune 0.8.4
< mypy 0.910
< mypy-extensions 0.4.3
< nbclient 0.5.4
< nbconvert 6.1.0
< nbformat 5.1.3
< nest-asyncio 1.5.1
< notebook 6.4.3
< packaging 21.0
< pandocfilters 1.4.3
< parso 0.8.2
< pbr 5.6.0
< pep8 1.7.1
< pexpect 4.8.0
< pickleshare 0.7.5
< pip 21.2.4
< pipenv 2021.5.29
< pkginfo 1.7.1
< platformdirs 2.3.0
< prometheus-client 0.11.0
< prompt-toolkit 3.0.20
< ptyprocess 0.7.0
< pycodestyle 2.7.0
< pycparser 2.20
< pydocstyle 6.1.1
< pyflakes 2.3.1
< Pygments 2.10.0
< pylama 7.7.1
< pylint 2.10.2
< pyparsing 2.4.7
< pyrsistent 0.18.0
< python-dateutil 2.8.2
< PyYAML 5.4.1
< pyzmq 22.2.1
< readme-renderer 29.0
< requests 2.26.0
< requests-toolbelt 0.9.1
< rfc3986 1.5.0
< rope 0.19.0
< SecretStorage 3.3.1
< Send2Trash 1.8.0
< setuptools 58.0.4
< six 1.16.0
< smmap 4.0.0
< snowballstemmer 2.1.0
< stevedore 3.4.0
< terminado 0.12.1
< testpath 0.5.0
< toml 0.10.2
< tornado 6.1
< tqdm 4.62.2
< traitlets 5.1.0
< twine 3.4.2
< typing-extensions 3.10.0.2
< urllib3 1.26.6
< virtualenv 20.7.2
< virtualenv-clone 0.5.7
< wcwidth 0.2.5
< webencodings 0.5.1
< wheel 0.37.0
< wrapt 1.12.1
< zipp 3.5.0
< WARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
< You should consider upgrading via the '/home/gitpod/.pyenv/versions/3.8.12/bin/python3 -m pip install --upgrade pip' command.
---
> gitpod /workspace/full $ pip list
> Package Version
> ------------------- ---------
> appdirs 1.4.4
> argon2-cffi 20.1.0
> astroid 2.6.2
> async-generator 1.10
> attrs 21.2.0
> autopep8 1.5.7
> backcall 0.2.0
> bandit 1.7.0
> bleach 3.3.0
> certifi 2021.5.30
> cffi 1.14.5
> chardet 4.0.0
> colorama 0.4.4
> cryptography 3.4.7
> debugpy 1.3.0
> decorator 5.0.9
> defusedxml 0.7.1
> distlib 0.3.2
> docutils 0.17.1
> entrypoints 0.3
> filelock 3.0.12
> flake8 3.9.2
> gitdb 4.0.7
> GitPython 3.1.18
> idna 2.10
> importlib-metadata 4.6.1
> ipykernel 6.0.1
> ipython 7.25.0
> ipython-genutils 0.2.0
> isort 5.9.1
> jedi 0.18.0
> jeepney 0.6.0
> Jinja2 3.0.1
> jsonschema 3.2.0
> jupyter-client 6.1.12
> jupyter-core 4.7.1
> jupyterlab-pygments 0.1.2
> keyring 23.0.1
> lazy-object-proxy 1.6.0
> MarkupSafe 2.0.1
> matplotlib-inline 0.1.2
> mccabe 0.6.1
> mistune 0.8.4
> mypy 0.910
> mypy-extensions 0.4.3
> nbclient 0.5.3
> nbconvert 6.1.0
> nbformat 5.1.3
> nest-asyncio 1.5.1
> notebook 6.4.0
> packaging 21.0
> pandocfilters 1.4.3
> parso 0.8.2
> pbr 5.6.0
> pep8 1.7.1
> pexpect 4.8.0
> pickleshare 0.7.5
> pip 21.1.3
> pipenv 2021.5.29
> pkginfo 1.7.0
> prometheus-client 0.11.0
> prompt-toolkit 3.0.19
> ptyprocess 0.7.0
> pycodestyle 2.7.0
> pycparser 2.20
> pydocstyle 6.1.1
> pyflakes 2.3.1
> Pygments 2.9.0
> pylama 7.7.1
> pylint 2.9.3
> pyparsing 2.4.7
> pyrsistent 0.18.0
> python-dateutil 2.8.1
> PyYAML 5.4.1
> pyzmq 22.1.0
> readme-renderer 29.0
> requests 2.25.1
> requests-toolbelt 0.9.1
> rfc3986 1.5.0
> rope 0.19.0
> SecretStorage 3.3.1
> Send2Trash 1.7.1
> setuptools 57.1.0
> six 1.16.0
> smmap 4.0.0
> snowballstemmer 2.1.0
> stevedore 3.3.0
> terminado 0.10.1
> testpath 0.5.0
> toml 0.10.2
> tornado 6.1
> tqdm 4.61.2
> traitlets 5.0.5
> twine 3.4.1
> typing-extensions 3.10.0.0
> urllib3 1.26.6
> virtualenv 20.4.7
> virtualenv-clone 0.5.4
> wcwidth 0.2.5
> webencodings 0.5.1
> wheel 0.36.2
> wrapt 1.12.1
> zipp 3.5.0