Skip to content

Instantly share code, notes, and snippets.

@xwjiang2010
Created November 1, 2021 01:27
Show Gist options
  • Save xwjiang2010/ae1fd9c9cc40700c561dac978e7c8dbc to your computer and use it in GitHub Desktop.
Save xwjiang2010/ae1fd9c9cc40700c561dac978e7c8dbc to your computer and use it in GitHub Desktop.
ubuntu@ip-172-31-50-62:~/ray/release/util$ ./pip_download_test.sh
conda exists
Start downloading Ray version 1.8.0.post1 of commit e94e67b9badd542b7b99efe412e7019983260ad0
Requirement already satisfied: pip in /home/ubuntu/anaconda3/lib/python3.8/site-packages (21.0.1)
Collecting pip
Downloading pip-21.3.1-py3-none-any.whl (1.7 MB)
|████████████████████████████████| 1.7 MB 5.9 MB/s
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 21.0.1
Uninstalling pip-21.0.1:
Successfully uninstalled pip-21.0.1
Successfully installed pip-21.3.1
Collecting package metadata (current_repodata.json): done
Solving environment: done
==> WARNING: A newer version of conda exists. <==
current version: 4.10.1
latest version: 4.10.3
Please update conda by running
$ conda update -n base -c defaults conda
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.6-env
added / updated specs:
- python=3.6
The following packages will be downloaded:
package | build
---------------------------|-----------------
_openmp_mutex-4.5 | 1_gnu 22 KB
ca-certificates-2021.10.26 | h06a4308_2 115 KB
certifi-2020.12.5 | py36h06a4308_0 140 KB
ld_impl_linux-64-2.35.1 | h7274673_9 586 KB
libgcc-ng-9.3.0 | h5101ec6_17 4.8 MB
libgomp-9.3.0 | h5101ec6_17 311 KB
libstdcxx-ng-9.3.0 | hd4cf53a_17 3.1 MB
openssl-1.1.1l | h7f8727e_0 2.5 MB
pip-21.0.1 | py36h06a4308_0 1.8 MB
python-3.6.13 | h12debd9_1 32.5 MB
setuptools-58.0.4 | py36h06a4308_0 788 KB
sqlite-3.36.0 | hc218d9a_0 990 KB
tk-8.6.11 | h1ccaba5_0 3.0 MB
wheel-0.37.0 | pyhd3eb1b0_1 33 KB
------------------------------------------------------------
Total: 50.6 MB
The following NEW packages will be INSTALLED:
_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
_openmp_mutex pkgs/main/linux-64::_openmp_mutex-4.5-1_gnu
ca-certificates pkgs/main/linux-64::ca-certificates-2021.10.26-h06a4308_2
certifi pkgs/main/linux-64::certifi-2020.12.5-py36h06a4308_0
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.35.1-h7274673_9
libffi pkgs/main/linux-64::libffi-3.3-he6710b0_2
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.3.0-h5101ec6_17
libgomp pkgs/main/linux-64::libgomp-9.3.0-h5101ec6_17
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses pkgs/main/linux-64::ncurses-6.2-he6710b0_1
openssl pkgs/main/linux-64::openssl-1.1.1l-h7f8727e_0
pip pkgs/main/linux-64::pip-21.0.1-py36h06a4308_0
python pkgs/main/linux-64::python-3.6.13-h12debd9_1
readline pkgs/main/linux-64::readline-8.1-h27cfd23_0
setuptools pkgs/main/linux-64::setuptools-58.0.4-py36h06a4308_0
sqlite pkgs/main/linux-64::sqlite-3.36.0-hc218d9a_0
tk pkgs/main/linux-64::tk-8.6.11-h1ccaba5_0
wheel pkgs/main/noarch::wheel-0.37.0-pyhd3eb1b0_1
xz pkgs/main/linux-64::xz-5.2.5-h7b6447c_0
zlib pkgs/main/linux-64::zlib-1.2.11-h7b6447c_3
Downloading and Extracting Packages
setuptools-58.0.4 | 788 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
sqlite-3.36.0 | 990 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
_openmp_mutex-4.5 | 22 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
libgcc-ng-9.3.0 | 4.8 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
certifi-2020.12.5 | 140 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
pip-21.0.1 | 1.8 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
openssl-1.1.1l | 2.5 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
ca-certificates-2021 | 115 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
libstdcxx-ng-9.3.0 | 3.1 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
libgomp-9.3.0 | 311 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
python-3.6.13 | 32.5 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
tk-8.6.11 | 3.0 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
wheel-0.37.0 | 33 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
ld_impl_linux-64-2.3 | 586 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate 1.8.0.post1-3.6-env
#
# To deactivate an active environment, use
#
# $ conda deactivate
=========================================================
Python version.
Python 3.6.13 :: Anaconda, Inc.
This should be equal to 3.6
=========================================================
Looking in indexes: https://test.pypi.org/simple/, https://pypi.org/simple
Collecting ray[cpp]==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/a7/d7/50fe873cd998d039452ca34f8a5637feec307136ea2821b7c1406f35f2ee/ray-1.8.0.post1-cp36-cp36m-manylinux2014_x86_64.whl (54.7 MB)
|████████████████████████████████| 54.7 MB 30 kB/s
Collecting attrs
Downloading attrs-21.2.0-py2.py3-none-any.whl (53 kB)
|████████████████████████████████| 53 kB 2.2 MB/s
Collecting msgpack<2.0.0,>=1.0.0
Downloading msgpack-1.0.2-cp36-cp36m-manylinux1_x86_64.whl (272 kB)
|████████████████████████████████| 272 kB 12.8 MB/s
Collecting redis>=3.5.0
Downloading redis-3.5.3-py2.py3-none-any.whl (72 kB)
|████████████████████████████████| 72 kB 969 kB/s
Collecting filelock
Downloading filelock-3.3.2-py3-none-any.whl (9.7 kB)
Collecting jsonschema
Downloading jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
|████████████████████████████████| 56 kB 7.2 MB/s
Collecting pyyaml
Downloading PyYAML-6.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (603 kB)
|████████████████████████████████| 603 kB 123.0 MB/s
Collecting dataclasses
Downloading dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting click>=7.0
Downloading click-8.0.3-py3-none-any.whl (97 kB)
|████████████████████████████████| 97 kB 10.9 MB/s
Collecting numpy>=1.16
Downloading numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB)
|████████████████████████████████| 14.8 MB 123.5 MB/s
Collecting grpcio>=1.28.1
Downloading grpcio-1.41.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB)
|████████████████████████████████| 3.9 MB 117.9 MB/s
Collecting protobuf>=3.15.3
Downloading protobuf-3.19.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
|████████████████████████████████| 1.1 MB 124.0 MB/s
Collecting ray-cpp==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/9e/7d/1ab2ddd6980d1d5834bbbe45a65483c075d63e9d7c8116b01b563d9e6a57/ray_cpp-1.8.0.post1-cp36-cp36m-manylinux2014_x86_64.whl (28.7 MB)
|████████████████████████████████| 28.7 MB 5.1 MB/s
Collecting importlib-metadata
Downloading importlib_metadata-4.8.1-py3-none-any.whl (17 kB)
Collecting six>=1.5.2
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting zipp>=0.5
Downloading zipp-3.6.0-py3-none-any.whl (5.3 kB)
Collecting typing-extensions>=3.6.4
Downloading typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Requirement already satisfied: setuptools in /home/ubuntu/anaconda3/envs/1.8.0.post1-3.6-env/lib/python3.6/site-packages (from jsonschema->ray[cpp]==1.8.0.post1) (58.0.4)
Collecting pyrsistent>=0.14.0
Downloading pyrsistent-0.18.0-cp36-cp36m-manylinux1_x86_64.whl (117 kB)
|████████████████████████████████| 117 kB 121.5 MB/s
Installing collected packages: zipp, typing-extensions, six, pyrsistent, importlib-metadata, attrs, redis, pyyaml, protobuf, numpy, msgpack, jsonschema, grpcio, filelock, dataclasses, click, ray-cpp, ray
Successfully installed attrs-21.2.0 click-8.0.3 dataclasses-0.8 filelock-3.3.2 grpcio-1.41.1 importlib-metadata-4.8.1 jsonschema-3.2.0 msgpack-1.0.2 numpy-1.19.5 protobuf-3.19.1 pyrsistent-0.18.0 pyyaml-6.0 ray-1.8.0.post1 ray-cpp-1.8.0.post1 redis-3.5.3 six-1.16.0 typing-extensions-3.10.0.2 zipp-3.6.0
=========================================================
Sanity check python version: 3.6.13 |Anaconda, Inc.| (default, Jun 4 2021, 14:25:59)
[GCC 7.5.0]
Running basic sanity check.
PYTHON 3.6 succeed sanity check.
Project template generated to /home/ubuntu/ray/release/util/ray-template
To build and run this template, run
cd /home/ubuntu/ray/release/util/ray-template && bash run.sh
~/ray/release/util/ray-template ~/ray/release/util
Starting local Bazel server and connecting to it...
INFO: Analyzed target //:example (15 packages loaded, 3286 targets configured).
INFO: Found 1 target...
Target //:example up-to-date:
bazel-bin/example
INFO: Elapsed time: 6.610s, Critical Path: 2.78s
INFO: 3236 processes: 3232 internal, 4 linux-sandbox.
INFO: Build completed successfully, 3236 total actions
[2021-11-01 01:23:11,810 I 11560 11560] config_internal.cc:131: No code search path found yet. The program location path "/home/ubuntu/.cache/bazel/_bazel_ubuntu/d04bd2e20e9ed1f6aeedc874fe906cee/execroot/__main__/bazel-out/k8-fastbuild/bin" will be added for searching dynamic libraries by default. And you can add some search paths by '--ray_code_search_path'
[2021-11-01 01:23:11,810 I 11560 11560] process_helper.cc:37: ray start --head --port 6379 --redis-password 5241590000000000 --node-ip-address '172.31.50.62'
Local node IP: 172.31.50.62
--------------------
Ray runtime started.
--------------------
Next steps
To connect to this Ray runtime from another node, run
ray start --address='172.31.50.62:6379' --redis-password='5241590000000000'
Alternatively, use the following Python code:
import ray
ray.init(address='auto', _redis_password='5241590000000000')
To connect to this Ray runtime from outside of the cluster, for example to
connect to a remote cluster from your laptop directly, use the following
Python code:
import ray
ray.init(address='ray://<head_node_ip_address>:10001')
If connection fails, check your firewall settings and network configuration.
To terminate the Ray runtime, run
ray stop
put_get_result = 100
task_result = 3
actor_task_result = 3
actor_task_result2 = 6
Stopped all 10 Ray processes.
PYTHON 3.6 succeed sanity check C++.
=========================================================
Remove all packages in environment /home/ubuntu/anaconda3/envs/1.8.0.post1-3.6-env:
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.6-env
The following packages will be REMOVED:
_libgcc_mutex-0.1-main
_openmp_mutex-4.5-1_gnu
ca-certificates-2021.10.26-h06a4308_2
certifi-2020.12.5-py36h06a4308_0
ld_impl_linux-64-2.35.1-h7274673_9
libffi-3.3-he6710b0_2
libgcc-ng-9.3.0-h5101ec6_17
libgomp-9.3.0-h5101ec6_17
libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses-6.2-he6710b0_1
openssl-1.1.1l-h7f8727e_0
pip-21.0.1-py36h06a4308_0
python-3.6.13-h12debd9_1
readline-8.1-h27cfd23_0
setuptools-58.0.4-py36h06a4308_0
sqlite-3.36.0-hc218d9a_0
tk-8.6.11-h1ccaba5_0
wheel-0.37.0-pyhd3eb1b0_1
xz-5.2.5-h7b6447c_0
zlib-1.2.11-h7b6447c_3
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Collecting package metadata (current_repodata.json): done
Solving environment: done
==> WARNING: A newer version of conda exists. <==
current version: 4.10.1
latest version: 4.10.3
Please update conda by running
$ conda update -n base -c defaults conda
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.7-env
added / updated specs:
- python=3.7
The following packages will be downloaded:
package | build
---------------------------|-----------------
certifi-2021.10.8 | py37h06a4308_0 151 KB
pip-21.0.1 | py37h06a4308_0 1.8 MB
python-3.7.11 | h12debd9_0 45.3 MB
setuptools-58.0.4 | py37h06a4308_0 775 KB
------------------------------------------------------------
Total: 48.0 MB
The following NEW packages will be INSTALLED:
_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
_openmp_mutex pkgs/main/linux-64::_openmp_mutex-4.5-1_gnu
ca-certificates pkgs/main/linux-64::ca-certificates-2021.10.26-h06a4308_2
certifi pkgs/main/linux-64::certifi-2021.10.8-py37h06a4308_0
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.35.1-h7274673_9
libffi pkgs/main/linux-64::libffi-3.3-he6710b0_2
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.3.0-h5101ec6_17
libgomp pkgs/main/linux-64::libgomp-9.3.0-h5101ec6_17
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses pkgs/main/linux-64::ncurses-6.2-he6710b0_1
openssl pkgs/main/linux-64::openssl-1.1.1l-h7f8727e_0
pip pkgs/main/linux-64::pip-21.0.1-py37h06a4308_0
python pkgs/main/linux-64::python-3.7.11-h12debd9_0
readline pkgs/main/linux-64::readline-8.1-h27cfd23_0
setuptools pkgs/main/linux-64::setuptools-58.0.4-py37h06a4308_0
sqlite pkgs/main/linux-64::sqlite-3.36.0-hc218d9a_0
tk pkgs/main/linux-64::tk-8.6.11-h1ccaba5_0
wheel pkgs/main/noarch::wheel-0.37.0-pyhd3eb1b0_1
xz pkgs/main/linux-64::xz-5.2.5-h7b6447c_0
zlib pkgs/main/linux-64::zlib-1.2.11-h7b6447c_3
Downloading and Extracting Packages
python-3.7.11 | 45.3 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
setuptools-58.0.4 | 775 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
pip-21.0.1 | 1.8 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
certifi-2021.10.8 | 151 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate 1.8.0.post1-3.7-env
#
# To deactivate an active environment, use
#
# $ conda deactivate
=========================================================
Python version.
Python 3.7.11
This should be equal to 3.7
=========================================================
Looking in indexes: https://test.pypi.org/simple/, https://pypi.org/simple
Collecting ray[cpp]==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/ed/b4/e533c0ce124595a5343871f286798809e31eaeda139c1f102e50ae3436a0/ray-1.8.0.post1-cp37-cp37m-manylinux2014_x86_64.whl (54.7 MB)
|████████████████████████████████| 54.7 MB 5.3 MB/s
Collecting protobuf>=3.15.3
Downloading protobuf-3.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
|████████████████████████████████| 1.1 MB 5.9 MB/s
Collecting jsonschema
Downloading jsonschema-4.1.2-py3-none-any.whl (69 kB)
|████████████████████████████████| 69 kB 14.3 MB/s
Collecting numpy>=1.16
Downloading numpy-1.21.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
|████████████████████████████████| 15.7 MB 62.2 MB/s
Collecting msgpack<2.0.0,>=1.0.0
Downloading msgpack-1.0.2-cp37-cp37m-manylinux1_x86_64.whl (273 kB)
|████████████████████████████████| 273 kB 117.3 MB/s
Collecting grpcio>=1.28.1
Downloading grpcio-1.41.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB)
|████████████████████████████████| 3.9 MB 53.8 MB/s
Collecting click>=7.0
Using cached click-8.0.3-py3-none-any.whl (97 kB)
Collecting filelock
Using cached filelock-3.3.2-py3-none-any.whl (9.7 kB)
Collecting attrs
Using cached attrs-21.2.0-py2.py3-none-any.whl (53 kB)
Collecting redis>=3.5.0
Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB)
Collecting pyyaml
Downloading PyYAML-6.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (596 kB)
|████████████████████████████████| 596 kB 100.7 MB/s
Collecting ray-cpp==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/7e/4b/59760ae5d5dd5c92ae12f7618b6d8865dc31c10caa88d902d834f1492f30/ray_cpp-1.8.0.post1-cp37-cp37m-manylinux2014_x86_64.whl (28.7 MB)
|████████████████████████████████| 28.7 MB 10.3 MB/s
Collecting importlib-metadata
Using cached importlib_metadata-4.8.1-py3-none-any.whl (17 kB)
Collecting six>=1.5.2
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting typing-extensions>=3.6.4
Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Collecting zipp>=0.5
Using cached zipp-3.6.0-py3-none-any.whl (5.3 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
Downloading pyrsistent-0.18.0-cp37-cp37m-manylinux1_x86_64.whl (119 kB)
|████████████████████████████████| 119 kB 116.9 MB/s
Installing collected packages: zipp, typing-extensions, six, pyrsistent, importlib-metadata, attrs, redis, pyyaml, protobuf, numpy, msgpack, jsonschema, grpcio, filelock, click, ray-cpp, ray
Successfully installed attrs-21.2.0 click-8.0.3 filelock-3.3.2 grpcio-1.41.1 importlib-metadata-4.8.1 jsonschema-4.1.2 msgpack-1.0.2 numpy-1.21.3 protobuf-3.19.1 pyrsistent-0.18.0 pyyaml-6.0 ray-1.8.0.post1 ray-cpp-1.8.0.post1 redis-3.5.3 six-1.16.0 typing-extensions-3.10.0.2 zipp-3.6.0
=========================================================
Sanity check python version: 3.7.11 (default, Jul 27 2021, 14:32:16)
[GCC 7.5.0]
Running basic sanity check.
PYTHON 3.7 succeed sanity check.
Project template generated to /home/ubuntu/ray/release/util/ray-template
To build and run this template, run
cd /home/ubuntu/ray/release/util/ray-template && bash run.sh
~/ray/release/util/ray-template ~/ray/release/util
Starting local Bazel server and connecting to it...
INFO: Analyzed target //:example (15 packages loaded, 3286 targets configured).
INFO: Found 1 target...
Target //:example up-to-date:
bazel-bin/example
INFO: Elapsed time: 6.396s, Critical Path: 2.92s
INFO: 6 processes: 2 internal, 4 linux-sandbox.
INFO: Build completed successfully, 6 total actions
[2021-11-01 01:23:48,541 I 12684 12684] config_internal.cc:131: No code search path found yet. The program location path "/home/ubuntu/.cache/bazel/_bazel_ubuntu/d04bd2e20e9ed1f6aeedc874fe906cee/execroot/__main__/bazel-out/k8-fastbuild/bin" will be added for searching dynamic libraries by default. And you can add some search paths by '--ray_code_search_path'
[2021-11-01 01:23:48,541 I 12684 12684] process_helper.cc:37: ray start --head --port 6379 --redis-password 5241590000000000 --node-ip-address '172.31.50.62'
Local node IP: 172.31.50.62
--------------------
Ray runtime started.
--------------------
Next steps
To connect to this Ray runtime from another node, run
ray start --address='172.31.50.62:6379' --redis-password='5241590000000000'
Alternatively, use the following Python code:
import ray
ray.init(address='auto', _redis_password='5241590000000000')
To connect to this Ray runtime from outside of the cluster, for example to
connect to a remote cluster from your laptop directly, use the following
Python code:
import ray
ray.init(address='ray://<head_node_ip_address>:10001')
If connection fails, check your firewall settings and network configuration.
To terminate the Ray runtime, run
ray stop
put_get_result = 100
task_result = 3
actor_task_result = 3
actor_task_result2 = 6
Stopped all 10 Ray processes.
PYTHON 3.7 succeed sanity check C++.
=========================================================
Remove all packages in environment /home/ubuntu/anaconda3/envs/1.8.0.post1-3.7-env:
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.7-env
The following packages will be REMOVED:
_libgcc_mutex-0.1-main
_openmp_mutex-4.5-1_gnu
ca-certificates-2021.10.26-h06a4308_2
certifi-2021.10.8-py37h06a4308_0
ld_impl_linux-64-2.35.1-h7274673_9
libffi-3.3-he6710b0_2
libgcc-ng-9.3.0-h5101ec6_17
libgomp-9.3.0-h5101ec6_17
libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses-6.2-he6710b0_1
openssl-1.1.1l-h7f8727e_0
pip-21.0.1-py37h06a4308_0
python-3.7.11-h12debd9_0
readline-8.1-h27cfd23_0
setuptools-58.0.4-py37h06a4308_0
sqlite-3.36.0-hc218d9a_0
tk-8.6.11-h1ccaba5_0
wheel-0.37.0-pyhd3eb1b0_1
xz-5.2.5-h7b6447c_0
zlib-1.2.11-h7b6447c_3
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Collecting package metadata (current_repodata.json): done
Solving environment: done
==> WARNING: A newer version of conda exists. <==
current version: 4.10.1
latest version: 4.10.3
Please update conda by running
$ conda update -n base -c defaults conda
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.8-env
added / updated specs:
- python=3.8
The following packages will be downloaded:
package | build
---------------------------|-----------------
certifi-2021.10.8 | py38h06a4308_0 151 KB
pip-21.2.4 | py38h06a4308_0 1.8 MB
python-3.8.12 | h12debd9_0 18.3 MB
setuptools-58.0.4 | py38h06a4308_0 790 KB
------------------------------------------------------------
Total: 21.0 MB
The following NEW packages will be INSTALLED:
_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
_openmp_mutex pkgs/main/linux-64::_openmp_mutex-4.5-1_gnu
ca-certificates pkgs/main/linux-64::ca-certificates-2021.10.26-h06a4308_2
certifi pkgs/main/linux-64::certifi-2021.10.8-py38h06a4308_0
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.35.1-h7274673_9
libffi pkgs/main/linux-64::libffi-3.3-he6710b0_2
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.3.0-h5101ec6_17
libgomp pkgs/main/linux-64::libgomp-9.3.0-h5101ec6_17
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses pkgs/main/linux-64::ncurses-6.2-he6710b0_1
openssl pkgs/main/linux-64::openssl-1.1.1l-h7f8727e_0
pip pkgs/main/linux-64::pip-21.2.4-py38h06a4308_0
python pkgs/main/linux-64::python-3.8.12-h12debd9_0
readline pkgs/main/linux-64::readline-8.1-h27cfd23_0
setuptools pkgs/main/linux-64::setuptools-58.0.4-py38h06a4308_0
sqlite pkgs/main/linux-64::sqlite-3.36.0-hc218d9a_0
tk pkgs/main/linux-64::tk-8.6.11-h1ccaba5_0
wheel pkgs/main/noarch::wheel-0.37.0-pyhd3eb1b0_1
xz pkgs/main/linux-64::xz-5.2.5-h7b6447c_0
zlib pkgs/main/linux-64::zlib-1.2.11-h7b6447c_3
Downloading and Extracting Packages
setuptools-58.0.4 | 790 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
pip-21.2.4 | 1.8 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
certifi-2021.10.8 | 151 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
python-3.8.12 | 18.3 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate 1.8.0.post1-3.8-env
#
# To deactivate an active environment, use
#
# $ conda deactivate
=========================================================
Python version.
Python 3.8.12
This should be equal to 3.8
=========================================================
Looking in indexes: https://test.pypi.org/simple/, https://pypi.org/simple
Collecting ray[cpp]==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/d0/e8/9558b61eba35e3d0e86a798f872afe1b926ccf8d4bc394af5db9fc5b0f0d/ray-1.8.0.post1-cp38-cp38-manylinux2014_x86_64.whl (54.4 MB)
|████████████████████████████████| 54.4 MB 840 kB/s
Collecting filelock
Using cached filelock-3.3.2-py3-none-any.whl (9.7 kB)
Collecting numpy>=1.16
Downloading numpy-1.21.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
|████████████████████████████████| 15.7 MB 6.3 MB/s
Collecting protobuf>=3.15.3
Downloading protobuf-3.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
|████████████████████████████████| 1.1 MB 133.4 MB/s
Collecting grpcio>=1.28.1
Downloading grpcio-1.41.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB)
|████████████████████████████████| 3.9 MB 132.4 MB/s
Collecting pyyaml
Downloading PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
|████████████████████████████████| 701 kB 139.2 MB/s
Collecting redis>=3.5.0
Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB)
Collecting msgpack<2.0.0,>=1.0.0
Downloading msgpack-1.0.2-cp38-cp38-manylinux1_x86_64.whl (302 kB)
|████████████████████████████████| 302 kB 128.0 MB/s
Collecting click>=7.0
Using cached click-8.0.3-py3-none-any.whl (97 kB)
Collecting jsonschema
Using cached jsonschema-4.1.2-py3-none-any.whl (69 kB)
Collecting attrs
Using cached attrs-21.2.0-py2.py3-none-any.whl (53 kB)
Collecting ray-cpp==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/dd/f3/c00cb6e534b68cefbd99f4f25d524c8f8c41a2a195c7883c120658cd109d/ray_cpp-1.8.0.post1-cp38-cp38-manylinux2014_x86_64.whl (28.7 MB)
|████████████████████████████████| 28.7 MB 7.4 MB/s
Collecting six>=1.5.2
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
Downloading pyrsistent-0.18.0-cp38-cp38-manylinux1_x86_64.whl (118 kB)
|████████████████████████████████| 118 kB 134.3 MB/s
Installing collected packages: six, pyrsistent, attrs, redis, pyyaml, protobuf, numpy, msgpack, jsonschema, grpcio, filelock, click, ray-cpp, ray
Successfully installed attrs-21.2.0 click-8.0.3 filelock-3.3.2 grpcio-1.41.1 jsonschema-4.1.2 msgpack-1.0.2 numpy-1.21.3 protobuf-3.19.1 pyrsistent-0.18.0 pyyaml-6.0 ray-1.8.0.post1 ray-cpp-1.8.0.post1 redis-3.5.3 six-1.16.0
=========================================================
Sanity check python version: 3.8.12 (default, Oct 12 2021, 13:49:34)
[GCC 7.5.0]
Running basic sanity check.
PYTHON 3.8 succeed sanity check.
Project template generated to /home/ubuntu/ray/release/util/ray-template
To build and run this template, run
cd /home/ubuntu/ray/release/util/ray-template && bash run.sh
~/ray/release/util/ray-template ~/ray/release/util
Starting local Bazel server and connecting to it...
INFO: Analyzed target //:example (15 packages loaded, 3286 targets configured).
INFO: Found 1 target...
Target //:example up-to-date:
bazel-bin/example
INFO: Elapsed time: 6.299s, Critical Path: 2.87s
INFO: 6 processes: 2 internal, 4 linux-sandbox.
INFO: Build completed successfully, 6 total actions
[2021-11-01 01:24:25,435 I 13780 13780] config_internal.cc:131: No code search path found yet. The program location path "/home/ubuntu/.cache/bazel/_bazel_ubuntu/d04bd2e20e9ed1f6aeedc874fe906cee/execroot/__main__/bazel-out/k8-fastbuild/bin" will be added for searching dynamic libraries by default. And you can add some search paths by '--ray_code_search_path'
[2021-11-01 01:24:25,435 I 13780 13780] process_helper.cc:37: ray start --head --port 6379 --redis-password 5241590000000000 --node-ip-address '172.31.50.62'
Local node IP: 172.31.50.62
--------------------
Ray runtime started.
--------------------
Next steps
To connect to this Ray runtime from another node, run
ray start --address='172.31.50.62:6379' --redis-password='5241590000000000'
Alternatively, use the following Python code:
import ray
ray.init(address='auto', _redis_password='5241590000000000')
To connect to this Ray runtime from outside of the cluster, for example to
connect to a remote cluster from your laptop directly, use the following
Python code:
import ray
ray.init(address='ray://<head_node_ip_address>:10001')
If connection fails, check your firewall settings and network configuration.
To terminate the Ray runtime, run
ray stop
put_get_result = 100
task_result = 3
actor_task_result = 3
actor_task_result2 = 6
Stopped all 10 Ray processes.
PYTHON 3.8 succeed sanity check C++.
=========================================================
Remove all packages in environment /home/ubuntu/anaconda3/envs/1.8.0.post1-3.8-env:
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.8-env
The following packages will be REMOVED:
_libgcc_mutex-0.1-main
_openmp_mutex-4.5-1_gnu
ca-certificates-2021.10.26-h06a4308_2
certifi-2021.10.8-py38h06a4308_0
ld_impl_linux-64-2.35.1-h7274673_9
libffi-3.3-he6710b0_2
libgcc-ng-9.3.0-h5101ec6_17
libgomp-9.3.0-h5101ec6_17
libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses-6.2-he6710b0_1
openssl-1.1.1l-h7f8727e_0
pip-21.2.4-py38h06a4308_0
python-3.8.12-h12debd9_0
readline-8.1-h27cfd23_0
setuptools-58.0.4-py38h06a4308_0
sqlite-3.36.0-hc218d9a_0
tk-8.6.11-h1ccaba5_0
wheel-0.37.0-pyhd3eb1b0_1
xz-5.2.5-h7b6447c_0
zlib-1.2.11-h7b6447c_3
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Collecting package metadata (current_repodata.json): done
Solving environment: done
==> WARNING: A newer version of conda exists. <==
current version: 4.10.1
latest version: 4.10.3
Please update conda by running
$ conda update -n base -c defaults conda
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.9-env
added / updated specs:
- python=3.9
The following packages will be downloaded:
package | build
---------------------------|-----------------
certifi-2021.10.8 | py39h06a4308_0 151 KB
pip-21.2.4 | py39h06a4308_0 1.8 MB
python-3.9.7 | h12debd9_1 18.6 MB
setuptools-58.0.4 | py39h06a4308_0 790 KB
tzdata-2021e | hda174b7_0 112 KB
------------------------------------------------------------
Total: 21.4 MB
The following NEW packages will be INSTALLED:
_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
_openmp_mutex pkgs/main/linux-64::_openmp_mutex-4.5-1_gnu
ca-certificates pkgs/main/linux-64::ca-certificates-2021.10.26-h06a4308_2
certifi pkgs/main/linux-64::certifi-2021.10.8-py39h06a4308_0
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.35.1-h7274673_9
libffi pkgs/main/linux-64::libffi-3.3-he6710b0_2
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.3.0-h5101ec6_17
libgomp pkgs/main/linux-64::libgomp-9.3.0-h5101ec6_17
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses pkgs/main/linux-64::ncurses-6.2-he6710b0_1
openssl pkgs/main/linux-64::openssl-1.1.1l-h7f8727e_0
pip pkgs/main/linux-64::pip-21.2.4-py39h06a4308_0
python pkgs/main/linux-64::python-3.9.7-h12debd9_1
readline pkgs/main/linux-64::readline-8.1-h27cfd23_0
setuptools pkgs/main/linux-64::setuptools-58.0.4-py39h06a4308_0
sqlite pkgs/main/linux-64::sqlite-3.36.0-hc218d9a_0
tk pkgs/main/linux-64::tk-8.6.11-h1ccaba5_0
tzdata pkgs/main/noarch::tzdata-2021e-hda174b7_0
wheel pkgs/main/noarch::wheel-0.37.0-pyhd3eb1b0_1
xz pkgs/main/linux-64::xz-5.2.5-h7b6447c_0
zlib pkgs/main/linux-64::zlib-1.2.11-h7b6447c_3
Downloading and Extracting Packages
python-3.9.7 | 18.6 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
tzdata-2021e | 112 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
pip-21.2.4 | 1.8 MB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
certifi-2021.10.8 | 151 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
setuptools-58.0.4 | 790 KB | ################################################################################################################################################################################################################################################################################################################################################ | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate 1.8.0.post1-3.9-env
#
# To deactivate an active environment, use
#
# $ conda deactivate
=========================================================
Python version.
Python 3.9.7
This should be equal to 3.9
=========================================================
Looking in indexes: https://test.pypi.org/simple/, https://pypi.org/simple
Collecting ray[cpp]==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/b7/e2/9197cbe081f72b3b8e09c0ec40b709f4189bd77261c23fde84fe39704d4c/ray-1.8.0.post1-cp39-cp39-manylinux2014_x86_64.whl (54.4 MB)
|████████████████████████████████| 54.4 MB 266 kB/s
Collecting msgpack<2.0.0,>=1.0.0
Downloading msgpack-1.0.2-cp39-cp39-manylinux1_x86_64.whl (294 kB)
|████████████████████████████████| 294 kB 7.6 MB/s
Collecting pyyaml
Downloading PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB)
|████████████████████████████████| 661 kB 147.8 MB/s
Collecting click>=7.0
Using cached click-8.0.3-py3-none-any.whl (97 kB)
Collecting jsonschema
Using cached jsonschema-4.1.2-py3-none-any.whl (69 kB)
Collecting redis>=3.5.0
Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB)
Collecting attrs
Using cached attrs-21.2.0-py2.py3-none-any.whl (53 kB)
Collecting filelock
Using cached filelock-3.3.2-py3-none-any.whl (9.7 kB)
Collecting protobuf>=3.15.3
Downloading protobuf-3.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
|████████████████████████████████| 1.1 MB 133.8 MB/s
Collecting grpcio>=1.28.1
Downloading grpcio-1.41.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB)
|████████████████████████████████| 3.9 MB 127.3 MB/s
Collecting numpy>=1.19.3
Downloading numpy-1.21.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
|████████████████████████████████| 15.7 MB 129.3 MB/s
Collecting ray-cpp==1.8.0.post1
Downloading https://test-files.pythonhosted.org/packages/ca/1f/c049d9e754a8ad61c35ee9be1cd2f743c9c928aa7c4850449c2d141aae2f/ray_cpp-1.8.0.post1-cp39-cp39-manylinux2014_x86_64.whl (28.7 MB)
|████████████████████████████████| 28.7 MB 101 kB/s
Collecting six>=1.5.2
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
Downloading pyrsistent-0.18.0-cp39-cp39-manylinux1_x86_64.whl (117 kB)
|████████████████████████████████| 117 kB 141.1 MB/s
Installing collected packages: six, pyrsistent, attrs, redis, pyyaml, protobuf, numpy, msgpack, jsonschema, grpcio, filelock, click, ray-cpp, ray
Successfully installed attrs-21.2.0 click-8.0.3 filelock-3.3.2 grpcio-1.41.1 jsonschema-4.1.2 msgpack-1.0.2 numpy-1.21.3 protobuf-3.19.1 pyrsistent-0.18.0 pyyaml-6.0 ray-1.8.0.post1 ray-cpp-1.8.0.post1 redis-3.5.3 six-1.16.0
=========================================================
Sanity check python version: 3.9.7 (default, Sep 16 2021, 13:09:58)
[GCC 7.5.0]
Running basic sanity check.
PYTHON 3.9 succeed sanity check.
Project template generated to /home/ubuntu/ray/release/util/ray-template
To build and run this template, run
cd /home/ubuntu/ray/release/util/ray-template && bash run.sh
~/ray/release/util/ray-template ~/ray/release/util
Starting local Bazel server and connecting to it...
INFO: Analyzed target //:example (15 packages loaded, 3286 targets configured).
INFO: Found 1 target...
Target //:example up-to-date:
bazel-bin/example
INFO: Elapsed time: 6.287s, Critical Path: 2.85s
INFO: 6 processes: 2 internal, 4 linux-sandbox.
INFO: Build completed successfully, 6 total actions
[2021-11-01 01:25:01,480 I 14859 14859] config_internal.cc:131: No code search path found yet. The program location path "/home/ubuntu/.cache/bazel/_bazel_ubuntu/d04bd2e20e9ed1f6aeedc874fe906cee/execroot/__main__/bazel-out/k8-fastbuild/bin" will be added for searching dynamic libraries by default. And you can add some search paths by '--ray_code_search_path'
[2021-11-01 01:25:01,481 I 14859 14859] process_helper.cc:37: ray start --head --port 6379 --redis-password 5241590000000000 --node-ip-address '172.31.50.62'
Local node IP: 172.31.50.62
--------------------
Ray runtime started.
--------------------
Next steps
To connect to this Ray runtime from another node, run
ray start --address='172.31.50.62:6379' --redis-password='5241590000000000'
Alternatively, use the following Python code:
import ray
ray.init(address='auto', _redis_password='5241590000000000')
To connect to this Ray runtime from outside of the cluster, for example to
connect to a remote cluster from your laptop directly, use the following
Python code:
import ray
ray.init(address='ray://<head_node_ip_address>:10001')
If connection fails, check your firewall settings and network configuration.
To terminate the Ray runtime, run
ray stop
put_get_result = 100
task_result = 3
actor_task_result = 3
actor_task_result2 = 6
Stopped all 10 Ray processes.
PYTHON 3.9 succeed sanity check C++.
=========================================================
Remove all packages in environment /home/ubuntu/anaconda3/envs/1.8.0.post1-3.9-env:
## Package Plan ##
environment location: /home/ubuntu/anaconda3/envs/1.8.0.post1-3.9-env
The following packages will be REMOVED:
_libgcc_mutex-0.1-main
_openmp_mutex-4.5-1_gnu
ca-certificates-2021.10.26-h06a4308_2
certifi-2021.10.8-py39h06a4308_0
ld_impl_linux-64-2.35.1-h7274673_9
libffi-3.3-he6710b0_2
libgcc-ng-9.3.0-h5101ec6_17
libgomp-9.3.0-h5101ec6_17
libstdcxx-ng-9.3.0-hd4cf53a_17
ncurses-6.2-he6710b0_1
openssl-1.1.1l-h7f8727e_0
pip-21.2.4-py39h06a4308_0
python-3.9.7-h12debd9_1
readline-8.1-h27cfd23_0
setuptools-58.0.4-py39h06a4308_0
sqlite-3.36.0-hc218d9a_0
tk-8.6.11-h1ccaba5_0
tzdata-2021e-hda174b7_0
wheel-0.37.0-pyhd3eb1b0_1
xz-5.2.5-h7b6447c_0
zlib-1.2.11-h7b6447c_3
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment