Skip to content

Instantly share code, notes, and snippets.

View sully90's full-sized avatar

David Sullivan sully90

8 followers · 5 following
View GitHub Profile
@sully90
sully90 / keybase.md
Created January 21, 2020 13:03

Keybase proof

I hereby claim:

  • I am sully90 on github.
  • I am dsull (https://keybase.io/dsull) on keybase.
  • I have a public key ASA-OBdeMDnoOJWhtdaEtv7omqMCYbj_o0UO0_UMCrOPvwo

To claim this, I am signing this object:

@sully90
sully90 / LightGBM NullPointerException
Created March 14, 2019 09:13
stdout from spark worker
2019-03-14 08:27:28 INFO CoarseGrainedExecutorBackend:2566 - Started daemon with process name: 3356@worker-2
2019-03-14 08:27:28 INFO SignalUtils:54 - Registered signal handler for TERM
2019-03-14 08:27:28 INFO SignalUtils:54 - Registered signal handler for HUP
2019-03-14 08:27:28 INFO SignalUtils:54 - Registered signal handler for INT
2019-03-14 08:27:28 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2019-03-14 08:27:28 INFO SecurityManager:54 - Changing view acls to: spark
2019-03-14 08:27:28 INFO SecurityManager:54 - Changing modify acls to: spark
2019-03-14 08:27:28 INFO SecurityManager:54 - Changing view acls groups to:
2019-03-14 08:27:28 INFO SecurityManager:54 - Changing modify acls groups to:
2019-03-14 08:27:28 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Se
@sully90
sully90 / LightGBM Issue
Created March 13, 2019 12:48
LightGBM Issue
#!/usr/bin/env python
# coding: utf-8
# In[1]:
import os
os.environ['PYSPARK_SUBMIT_ARGS'] = "--packages anguenot:pyspark-cassandra:0.9.0,Azure:mmlspark:0.16 pyspark-shell"
from pyspark import SparkConf
@sully90
sully90 / gist:5cb977594ab0f2a752124cd413c990bc
Created November 29, 2018 12:03
Openvpn
(anaconda3)[david@kepler]:~/Downloads/vpn/config $ sudo openvpn --config dsullivan@office.incop.ro.ovpn
Thu Nov 29 12:01:20 2018 OpenVPN 2.4.4 x86_64-pc-linux-gnu [SSL (OpenSSL)] [LZO] [LZ4] [EPOLL] [PKCS11] [MH/PKTINFO] [AEAD] built on Sep 5 2018
Thu Nov 29 12:01:20 2018 library versions: OpenSSL 1.1.0g 2 Nov 2017, LZO 2.08
Enter Auth Username: dsullivan
Enter Auth Password: ************
Thu Nov 29 12:01:30 2018 TCP/UDP: Preserving recently used remote address: [AF_INET]89.197.94.106:1194
Thu Nov 29 12:01:30 2018 Socket Buffers: R=[87380->87380] S=[16384->16384]
Thu Nov 29 12:01:30 2018 Attempting to establish TCP connection with [AF_INET]89.197.94.106:1194 [nonblock]
Thu Nov 29 12:01:31 2018 TCP connection established with [AF_INET]89.197.94.106:1194
Thu Nov 29 12:01:31 2018 TCP_CLIENT link local: (not bound)