Skip to content

Instantly share code, notes, and snippets.

View mbforbes's full-sized avatar
🖋️
Sketches

Maxwell Forbes mbforbes

🖋️
Sketches
67 followers · 5 following
View GitHub Profile
@mbforbes
mbforbes / stubgen, recursive on torch, resulting errors
Created September 26, 2017 18:19
Running `stubgen --recursive torch` and seeing that pytorch's syntax decisions (using reserved keywords; mixing default w/ non-default args) causes stubgen to make invalid `.pyi` files
##########Linting Output - mypy##########
out/torch/_C.pyi:2691: error: invalid syntax
@mbforbes
mbforbes / stubgen, torch only, resulting errors.txt
Created September 26, 2017 18:17
Running `stubgen torch`, looking at errors that result. Need submodules
out/torch/__init__.pyi:21: error: Name '_C' is not defined
out/torch/__init__.pyi:22: error: Name '_C' is not defined
out/torch/__init__.pyi:23: error: Name '_C' is not defined
out/torch/__init__.pyi:24: error: Name '_C' is not defined
out/torch/__init__.pyi:25: error: Name '_C' is not defined
out/torch/__init__.pyi:26: error: Name '_C' is not defined
out/torch/__init__.pyi:27: error: Name '_C' is not defined
out/torch/__init__.pyi:28: error: Name '_C' is not defined
out/torch/__init__.pyi:30: error: Name '_C' is not defined
out/torch/__init__.pyi:35: error: Name '_C' is not defined
@mbforbes
mbforbes / gist:0fdf4b842b4f6abde5aaadcc86228547
Created September 22, 2017 22:23
Full mypy output for torch IntTensor vs FloatTensor
$ mypy mypy_minimal_example.py
/Users/max/.pyenv/versions/rndj1/lib/python3.6/site-packages/torch/__init__.py:45: error: Cannot find module named 'DLFCN'
/Users/max/.pyenv/versions/rndj1/lib/python3.6/site-packages/torch/__init__.py:48: error: Cannot find module named 'torch._dl'
/Users/max/.pyenv/versions/rndj1/lib/python3.6/site-packages/torch/__init__.py:48: note: (Perhaps setting MYPYPATH or using the "--ignore-missing-imports" flag would help)
/Users/max/.pyenv/versions/rndj1/lib/python3.6/site-packages/torch/__init__.py:53: error: Cannot find module named 'torch._C'
/Users/max/.pyenv/versions/rndj1/lib/python3.6/site-packages/numpy/_import_tools.py:352: error: Cannot assign to a type
/Users/max/.pyenv/versions/rndj1/lib/python3.6/site-packages/torch/cuda/__init__.py:13: error: No library stub file for standard library module 'ctypes'
/Users/max/.pyenv/versions/rndj1/lib/python3.6/site-packages/torch/cuda/__init__.py:13: note: (Stub files are from https://github.com/python/typeshed)
/Users/max/.pyenv/ver
@mbforbes
mbforbes / gutenberg.md
Created March 29, 2017 22:37
How to scrape English Project Gutenberg and get the raw text out of it
@mbforbes
mbforbes / gist:0aded988fa727fa3cab8
Created May 14, 2015 22:34
Reboot failure: heapster & influxdb: kubectl get pods
~/go/src/github.com/GoogleCloudPlatform/kubernetes$ kubectl get pods
POD IP CONTAINER(S) IMAGE(S) HOST LABELS STATUS CREATED MESSAGE
elasticsearch-logging-fi3yn 10.245.0.4 e2e-test-maxforbes-minion-0y1d/104.197.13.131 kubernetes.io/cluster-service=true,name=elasticsearch-logging Running 2 hours
elasticsearch-logging gcr.io/google_containers/elasticsearch:1.3 Running About an hour
elasticsearch-logging-hdboh 10.245.0.7
@mbforbes
mbforbes / gist:e860bf28a399e4a2dbdf
Created May 14, 2015 22:21
Reboot failure: heapster & influxdb: sudo docker ps
maxforbes@e2e-test-maxforbes-minion-0y1d:~$ sudo docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
8f489c214090 gcr.io/google_containers/skydns:2015-03-11-001 "/skydns -machines=h About an hour ago Up About an hour k8s_skydns.99d2ff80_kube-dns-i7v2g_default_14002c59-fa6e-11e4-a2fd-42010af0174f_9622b836
a595256039a0 gcr.io/google_containers/kube2sky:1.4 "/kube2sky -domain=c About an hour ago Up About an hour k8s_kube2sky.eb47751_kube-dns-i7v2g_default_14002c59-fa6e-11e4-a2fd-42010af0174f_849c4505
3597cc0c1768 gcr.io/google_containers/heapster_grafana:v0.7 "/kuisp -p 8080 -c / About an hour ago Up About an hour k8s_grafana.92a0b5d6_monitoring-influx-g
@mbforbes
mbforbes / gist:152ba7e1578c383408aa
Last active August 29, 2015 14:21
Reboot failure: heapster & influxdb: kubectl describe pod ...
~/go/src/github.com/GoogleCloudPlatform/kubernetes$ kubectl describe pod monitoring-heapster-controller-m115q
W0514 15:14:05.697482 80666 request.go:289] field selector: v1beta1 - events - involvedObject.id - monitoring-heapster-controller-m115q: need to check if this is versioned correctly.
W0514 15:14:05.698030 80666 request.go:289] field selector: v1beta1 - events - involvedObject.namespace - default: need to check if this is versioned correctly.
W0514 15:14:05.698041 80666 request.go:289] field selector: v1beta1 - events - involvedObject.uid - 13c64d0f-fa6e-11e4-a2fd-42010af0174f: need to check if this is versioned correctly.
Name: monitoring-heapster-controller-m115q
Image(s): gcr.io/google_containers/heapster:v0.11.0
Host: e2e-test-maxforbes-minion-0y1d/104.197.13.131
Labels: kubernetes.io/cluster-service=true,name=heapster
Status: Running
Replication Controllers: monitoring-heapster-controller (1/1 replicas created)
@mbforbes
mbforbes / gist:64624f694de522f79047
Created May 14, 2015 22:08
Reboot test failure: heapster failure: kubelet log
This file has been truncated, but you can view the full file.
maxforbes@e2e-test-maxforbes-minion-0y1d:~$ cat /var/log/kubelet.log
W0514 19:18:51.296121 2445 server.go:327] Could not load kubernetes auth path: stat /var/lib/kubelet/kubernetes_auth: no such file or directory. Continuing with defaults.
I0514 19:18:51.296174 2445 server.go:226] Using root directory: /var/lib/kubelet
I0514 19:18:51.296224 2445 manager.go:106] cAdvisor running in container: "/"
I0514 19:18:51.296528 2445 fs.go:87] Filesystem partitions: map[/dev/disk/by-uuid/6cc2497e-4350-495e-bf91-c9488eb20b9f:{mountpoint:/ major:8 minor:1}]
I0514 19:18:51.297391 2445 machine.go:223] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
I0514 19:18:51.297426 2445 manager.go:127] Machine: {NumCores:1 CpuFrequency:2299988 MemoryCapacity:1787019264 MachineID: SystemUUID:48CD6555-0450-0A4E-8C77-8DF80AA37D0C BootID:193c1127-787d-4c33-86ab-ccf21369d0eb Filesystems:[{Device:/dev/disk/by-uuid/6cc2497e-4350-495e-bf91-c9488eb20b9f Capacity:105553100800}] DiskMap:m
@mbforbes
mbforbes / gist:214b59e41d12c1e377cb
Last active August 29, 2015 14:21
Reboot failure: heapster & influxdb: kubectl log monitoring-heapster-controller-... heapster
~/go/src/github.com/GoogleCloudPlatform/kubernetes$ kubectl log monitoring-heapster-controller-m115q heapster
2015-05-14T20:34:53.372159368Z + EXTRA_ARGS=
2015-05-14T20:34:53.469810559Z + '[' '!' -z '--poll_duration=2m --stats_resolution=1m --sink influxdb:http://monitoring-influxdb.default:8086' ']'
2015-05-14T20:34:53.469829643Z + EXTRA_ARGS='--poll_duration=2m --stats_resolution=1m --sink influxdb:http://monitoring-influxdb.default:8086'
2015-05-14T20:34:53.469834004Z + '[' '!' -z 10.0.0.1 ']'
2015-05-14T20:34:53.469837276Z + EXTRA_ARGS='--source=kubernetes:http://10.0.0.1:80 --poll_duration=2m --stats_resolution=1m --sink influxdb:http://monitoring-influxdb.default:8086'
2015-05-14T20:34:53.469858715Z + HEAPSTER=/usr/bin/heapster
2015-05-14T20:34:53.469862361Z + case $SINK in
2015-05-14T20:34:53.469865409Z + /usr/bin/heapster --source=kubernetes:http://10.0.0.1:80 --poll_duration=2m --stats_resolution=1m --sink influxdb:http://monitoring-influxdb.default:8086
2015-05-14T20:34:56.517594552Z I0514 20:34:56.
@mbforbes
mbforbes / gist:fbafbdc1688c5b1236b1
Created May 14, 2015 18:05
Reboot test failure — reboot (pods not 'Running' after reboot)
Reboot
should reboot each node and ensure they function upon restart
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/reboot.go:97
[BeforeEach] Reboot
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/reboot.go:62
>>> testContext.KubeConfig: /Users/maxforbes/.kube/config
[It] should reboot each node and ensure they function upon restart
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/reboot.go:97
INFO: Getting e2e-test-maxforbes-minion-3t1x
INFO: Getting e2e-test-maxforbes-minion-66vd