View iterm2-solarized.md

Default

Default

Powerlevel9k

Powerlevel9k

View git_ammend_old.sh
#!/bin/bash
# Usage:
# ./git_ammend_old.sh <commit-sha>
# then we change pick to edit for this commit in interactive mode
set -evx
git stash && \
echo "REMEBER TO CHANGE THE COMMIT TO EDIT" && \
git rebase --interactive "${1}^" && \
View spark-debug-profile.md

Debugging locally run Spark application in IntelliJ

  • Add the following lines to your spark-submit command
--num-executors 1 \
--executor-cores 1 \
--conf "spark.executor.extraJavaOptions=-agentlib:jdwp=transport=dt_socket,server=n,address=localhost:5005,suspend=n" \
--driver-java-options -agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=5005 \
  • Configure Run/Debug Configuration in Intellij: Remote -> default settings for localhost