Skip to content

Instantly share code, notes, and snippets.

@simonsays1980
Created November 29, 2022 11:56
Show Gist options
  • Save simonsays1980/ea214377e3ad1890fd7aaa2fd99c52d6 to your computer and use it in GitHub Desktop.
Save simonsays1980/ea214377e3ad1890fd7aaa2fd99c52d6 to your computer and use it in GitHub Desktop.
Running as user: `tensorboard --logdir gs://<bucket_name>/<folder>/ --load_fast false`
2022-11-29 11:47:51.961773: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2022-11-29 11:47:51.961827: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
WARNING:root:Limited tf.compat.v2.summary API due to missing TensorBoard installation.
WARNING:root:Limited tf.compat.v2.summary API due to missing TensorBoard installation.
WARNING:root:Limited tf.compat.v2.summary API due to missing TensorBoard installation.
WARNING:root:Limited tf.summary API due to missing TensorBoard installation.
WARNING:root:Limited tf.compat.v2.summary API due to missing TensorBoard installation.
WARNING:root:Limited tf.compat.v2.summary API due to missing TensorBoard installation.
WARNING:root:Limited tf.compat.v2.summary API due to missing TensorBoard installation.
Traceback (most recent call last):
File "/home/simon_zehnder/.local/bin/tensorboard", line 5, in <module>
from tensorboard.main import run_main
File "/home/simon_zehnder/.local/lib/python3.9/site-packages/tensorboard/main.py", line 30, in <module>
from tensorboard import default
File "/home/simon_zehnder/.local/lib/python3.9/site-packages/tensorboard/default.py", line 40, in <module>
from tensorboard.plugins.debugger import debugger_plugin_loader
File "/home/simon_zehnder/.local/lib/python3.9/site-packages/tensorboard/plugins/debugger/debugger_plugin_loader.py", line 26, in <module>
tf.flags.DEFINE_integer(
AttributeError: module 'tensorflow' has no attribute 'flags'
```
Or when running with
`sudo tensorboard --logdir gs://<bucket_name>/<folder_name> --load_fast false`
Error:
```
Traceback (most recent call last):
File "/usr/local/bin/tensorboard", line 5, in <module>
from tensorboard.main import run_main
File "/usr/local/lib/python3.9/dist-packages/tensorboard/main.py", line 27, in <module>
from tensorboard import default
File "/usr/local/lib/python3.9/dist-packages/tensorboard/default.py", line 33, in <module>
from tensorboard.plugins.audio import audio_plugin
File "/usr/local/lib/python3.9/dist-packages/tensorboard/plugins/audio/audio_plugin.py", line 25, in <module>
from tensorboard.data import provider
File "/usr/local/lib/python3.9/dist-packages/tensorboard/data/__init__.py", line 17, in <module>
from tensorboard.data import experimental # noqa: F401
File "/usr/local/lib/python3.9/dist-packages/tensorboard/data/experimental/__init__.py", line 17, in <module>
from tensorboard.data.experimental.experiment_from_dev import ( # noqa: F401
File "/usr/local/lib/python3.9/dist-packages/tensorboard/data/experimental/experiment_from_dev.py", line 27, in <module>
from tensorboard.uploader import server_info as server_info_lib
File "/usr/local/lib/python3.9/dist-packages/tensorboard/uploader/server_info.py", line 23, in <module>
from tensorboard.plugins.scalar import metadata as scalars_metadata
File "/usr/local/lib/python3.9/dist-packages/tensorboard/plugins/scalar/metadata.py", line 18, in <module>
from tensorboard.compat.proto import summary_pb2
File "/usr/local/lib/python3.9/dist-packages/tensorboard/compat/proto/summary_pb2.py", line 17, in <module>
from tensorboard.compat.proto import tensor_pb2 as tensorboard_dot_compat_dot_proto_dot_tensor__pb2
File "/usr/local/lib/python3.9/dist-packages/tensorboard/compat/proto/tensor_pb2.py", line 16, in <module>
from tensorboard.compat.proto import resource_handle_pb2 as tensorboard_dot_compat_dot_proto_dot_resource__handle__pb2
File "/usr/local/lib/python3.9/dist-packages/tensorboard/compat/proto/resource_handle_pb2.py", line 16, in <module>
from tensorboard.compat.proto import tensor_shape_pb2 as tensorboard_dot_compat_dot_proto_dot_tensor__shape__pb2
File "/usr/local/lib/python3.9/dist-packages/tensorboard/compat/proto/tensor_shape_pb2.py", line 36, in <module>
_descriptor.FieldDescriptor(
File "/usr/local/lib/python3.9/dist-packages/google/protobuf/descriptor.py", line 560, in __new__
_message.Message._CheckCalledFromGeneratedFile()
TypeError: Descriptors cannot not be created directly.
If this call came from a _pb2.py file, your generated code is out of date and must be regenerated with protoc >= 3.19.0.
If you cannot immediately regenerate your protos, some other possible workarounds are:
1. Downgrade the protobuf package to 3.20.x or lower.
2. Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python (but this will use pure-Python parsing and will be much slower).
More information: https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates
```
I downgrade protobuf: `sudo python -m pip install protobuf==3.20.`
I run again: `sudo tensorboard --logdir gs://<bucket_name>/<folder_name> --load_fast false`
That runs, but I get:
```
2022-11-29 11:54:18.518372: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2022-11-29 11:54:18.518441: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
2022-11-29 11:54:20.512294: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory
2022-11-29 11:54:20.512358: W tensorflow/stream_executor/cuda/cuda_driver.cc:269] failed call to cuInit: UNKNOWN ERROR (303)
2022-11-29 11:54:20.512406: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (cs-595745336402-default): /proc/driver/nvidia/version does not exist
Serving TensorBoard on localhost; to expose to the network, use a proxy or pass --bind_all
TensorBoard 2.9.0 at http://localhost:6006/ (Press CTRL+C to quit)
W1129 11:54:54.587562 140454733526784 security_validator.py:46] In 3.0, this warning will become an error:
X-Content-Type-Options is required to be "nosniff"
W1129 11:54:54.588264 140454733526784 security_validator.py:46] In 3.0, this warning will become an error:
Requires default-src for Content-Security-Policy
W1129 11:54:54.611760 140454741919488 security_validator.py:46] In 3.0, this warning will become an error:
X-Content-Type-Options is required to be "nosniff"
W1129 11:54:54.617290 140454741919488 security_validator.py:46] In 3.0, this warning will become an error:
Requires default-src for Content-Security-Policy
W1129 11:54:54.624678 140455057024768 security_validator.py:46] In 3.0, this warning will become an error:
X-Content-Type-Options is required to be "nosniff"
W1129 11:54:54.646923 140455057024768 security_validator.py:46] In 3.0, this warning will become an error:
Requires default-src for Content-Security-Policy
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment