Skip to content

Instantly share code, notes, and snippets.

View leosouzadias's full-sized avatar

Leonardo Dias leosouzadias

1 follower · 1 following
  • Cork - Ireland
View GitHub Profile
@leosouzadias
leosouzadias / destroy_disk.sh
Created January 15, 2019 12:51
Destroy Disk
# Destroy all content on disk, replacing with zero once
nohup shred --verbose --random-source=/dev/zero -z -n 1 /dev/sdX &
# Destroy all content on disk, replacing with zero three times - SLOW but Powerfull
nohup shred --verbose --random-source=/dev/zero -z -n 3 /dev/sdX &
@leosouzadias
leosouzadias / net-test.md
Created October 12, 2018 12:21
Network Tests

Test Internet Speed

curl -s https://raw.githubusercontent.com/sivel/speedtest-cli/master/speedtest.py | python -

Test speed between nodes

Use iperf3 to do that, install it with apt / yum and run:

on "server":

@leosouzadias
leosouzadias / gist:25847dff5e1254680fc62d49bb3c761b
Created May 16, 2018 20:21
Install Image for Centro74
ner## ===================================================
## Hetzner Online AG - installimage - standardconfig.
## ===================================================
## ====================
## HARD DISK DRIVE(S):
## ====================
@leosouzadias
leosouzadias / enable_log_nifi_processor.xml
Created May 16, 2018 20:19
Enable log for a specific NIFI Processor
<appender name="X_FILE" class="ch.qos.logback.core.rolling.RollingFileAppender">
<file>${org.apache.nifi.bootstrap.config.log.dir}/hivestreaming.log</file>
<rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
<fileNamePattern>${org.apache.nifi.bootstrap.config.log.dir}/x_%d.log</fileNamePattern>
<maxHistory>30</maxHistory>
</rollingPolicy>
<encoder class="ch.qos.logback.classic.encoder.PatternLayoutEncoder">
<pattern>%date %level [%thread] %logger{40} %msg%n</pattern>
</encoder>
</appender>
@leosouzadias
leosouzadias / r.md
Last active October 6, 2017 10:17
Using R

###Export environment variable:

export PATH=$PATH:/opt/mango/R/3.2.5/bin
export PATH=$PATH:/opt/mango/R/3.2.5/lib/R/bin
export HIVE_HOME=/usr/hdp/2.5.5.0-157/hive2
export JAVA_HOME=/usr/java/latest
export SPARK_HOME=/usr/hdp/current/spark-client
echo 'R_LIBS_USER="/opt/mango/R/3.2.5/lib/R/library"'
export YARN_CONF_DIR=/etc/hadoop/conf/
@leosouzadias
leosouzadias / disable_smart_sense_upload.md
Created May 2, 2017 11:54
Disable Smartsense Automatic Upload

###Disabling Smartsense automatic upload

Automatic upload of bundles to HWX is an awesome feature of Smartsense, however some companies won't allow access from servers to Internet (even if we use a gateway). For those companies, we may disable automatic upload of bundles on SmartSense, following the steps below:

Go to Ambari->Services->SmartSense->Advanced->custom hst-server-conf and add

gateway.enabled=false
@leosouzadias
leosouzadias / knox_ranger_plugin_SSL.md
Created May 2, 2017 11:36
Knox + Ranger Plugin with SSL

Enabling Ranger Plugin for Knox with SSL

To enable Ranger Plugin for Knox, using SSL, it is required to have 2-WAY SSL configured for Ranger.

Also, it is important to rememeber Knox will only try to sync its policy if it receive a request. So, always try to access Knox to make it sync.

@leosouzadias
leosouzadias / check_jce.md
Created April 24, 2017 14:24
Check if JCE is Enabled 
jrunscript -e 'println(java.lang.Integer.MAX_VALUE == javax.crypto.Cipher.getMaxAllowedKeyLength("AES"))'
@leosouzadias
leosouzadias / check_jce.md
Created April 24, 2017 14:15
Check if JCE is enabled 
jrunscript -e 'println(java.lang.Integer.MAX_VALUE == javax.crypto.Cipher.getMaxAllowedKeyLength("AES"))'
@leosouzadias
leosouzadias / knox_ranger_plugin_debug.md
Created April 24, 2017 13:27
DEBUG Ranger Plugin for Knox

To enabled DEBUG for Ranger Plugin on knox, add the following content to gateway-log4j.properties

#Ranger Knox Plugin debug
ranger.knoxagent.logger=DEBUG,console,KNOXAGENT
ranger.knoxagent.log.file=ranger.knoxagent.log
log4j.logger.org.apache.ranger=${ranger.knoxagent.logger}
log4j.additivity.org.apache.ranger=false
log4j.appender.KNOXAGENT =org.apache.log4j.DailyRollingFileAppender
log4j.appender.KNOXAGENT.File=${app.log.dir}/${ranger.knoxagent.log.file}