Skip to content

Instantly share code, notes, and snippets.

@xl8or

xl8or/setup4Ubuntu.mkd

Created November 26, 2011 22:16
Show Gist options
  • Save xl8or/1396392 to your computer and use it in GitHub Desktop.
Save xl8or/1396392 to your computer and use it in GitHub Desktop.
Download ZIP
Setup development environment for Ubuntu
Raw
setup4Ubuntu.mkd

Setup development environment for Ubuntu

  • Learn Unix command-line tools
  • Setup Java & Android dev. tools
  • Learn Git repository
  • Jump-start Desktop Java project
  • Jump-start Android Java project
  • Reverse com.facebook.katana.apk

Install Mac OS X applications

iterm2, menu meters, fraise, better touch tool, adium, iStat, textmate, StartUpSound.PrefPane, little snitch, sequel.pro, oracle.sql.developer, Day-O.

Learn Unix command-line tools

Install baselines

Set up github.com and assembla.com accounts

  • ssh-keygen -t rsa # generates a key pair for password-less SSH logins.
  • cat ~/.ssh/id_rsa.pub # should password-less-login to Git repositories.
  • http://www.github.com → Account Settings → SSH Public Keys → Add another public key
  • http://www.assembla.com → Edit Profile → Manage SSH Keys → Add key

Install workspaces and dot resource files

sudo mkdir /workspace/
sudo chown $USER /workspace/
mkdir /workspace/gits/ # home for git repositories
git clone git@github.com:henry4j/-.git /workspace/gits/henry4j

cp /workspace/gits/henry4j/bin/.profile ~ # `source ~/.profile`, or open a new shell
cp /workspace/gits/henry4j/bin/.vimrc ~
cp -R /workspace/gits/henry4j/bin/.vim ~
cp /workspace/gits/henry4j/bin/.git-aliases ~
sudo mdutil -a -i off # (optional) disables spotlight.

Install CLI utilities

sudo port install wget
sudo port install unzip
sudo port install unrar
sudo port install maven3
sudo port install colordiff

Install Mac VIM

wget -P /tmp/ https://github.com/downloads/b4winckler/macvim/macvim-snapshot-62.tbz
pushd /tmp/; tar xvf /tmp/macvim-snapshot-62.tbz; popd
mv /tmp/MacVim-snapshot-62/MacVim.app /Applications/
alias vim='/Applications/MacVim.app/Contents/MacOS/Vim'

Install Ruby through RVM on Mac

  • Uninstall Xcode 4.2 by sudo /Developer/Library/uninstall-devtools –mode=all in case of build errors.
  • Install Xcode 4.1 according to rvm requirements

bash < <(curl -s https://rvm.beginrescueend.com/install/rvm)
[[ -s "$HOME/.rvm/scripts/rvm" ]] && source "$HOME/.rvm/scripts/rvm" # loads rvm into shell, or .profile.
rvm # in a new shell
rvm install 1.9.2-head
rvm use 1.9.2-head
ruby -v
rvm --default use 1.9.2-head
echo '1+1' | irb
gem install bundler
# gem install rails

Install VIM markdown preview

rvm system
sudo gem install redcarpet
sudo gem install github-markup
git clone git://github.com/robgleeson/hammer.vim.git /tmp/hammer.vim
rm -rf ~/.vim/plugin/*
cp -R /tmp/hammer.vim/plugin/* ~/.vim/plugin/

Install JDK for Mac OS X

^-^;;;;; -- install JDK 6, JDK 7, or both in order to debug-step into JDK sources.

Install Android SDK

wget -P /tmp/ http://dl.google.com/android/android-sdk_r15-macosx.zip
unzip -o /tmp/android-sdk_r15-macosx.zip -d /workspace/
cd /workspace/
mv android-sdk-macosx android-sdk-r15
ln -s android-sdk-r15 android-sdk
android update sdk --no-ui --no-https # takes forever on sluggish network connections!!!

Install Fastboot

wget -P /tmp/ http://dl.dropbox.com/u/47820156/fastboot-mac.zip
unzip -o /tmp/fastboot-mac.zip -d /tmp/
sudo mv /tmp/fastboot-mac /opt/local/bin/fastboot

Set up environment variables for Android on Mac OS X

# see if .profile already has these by `grep 'HOME\|PATH' ~/.profile`
cat <<EOF >> ~/.profile
export ANDROID_HOME=/workspace/android-sdk
export M3_HOME=/usr/share/maven
export PATH=$PATH:$ANDROID_HOME/tools:$ANDROID_HOME/platform-tools
EOF

Set up Android 2.3.3 virtual devices

echo | android create avd -f -n 5 -t 5 # android 2.3.3 (5)
emulator -avd 5

Maven build and deploy -- no longer in our uses.

git clone git://git.springsource.org/spring-mobile/samples.git /workspace/gits/spring-mobile-samples
cd /workspace/gits/spring-mobile-samples/spring-android-showcase/client
mvn clean install
mvn android:emulator-start
mvn android:deploy

Install Eclipse Indigo

wget -P ~/Downloads/ http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-jee-indigo-SR1-macosx-cocoa-x86_64.tar.gz
pushd /Applications/; tar xvf ~/Downloads/eclipse-jee-indigo-SR1-macosx-cocoa-x86_64.tar.gz; popd
open /Applications/eclipse/Eclipse.app # and then keep this in dock

Install Eclipse plugins

  1. Eclipse | Help | Install New Software... | Add...
  2. Enter ADT Plugin and https://dl-ssl.google.com/android/eclipse/ into Add Repository | OK
  3. Select All | Next | Next | Accept EULA | Finish | Restart Now
  4. Repeat 1 - 3 for m2e and http://download.eclipse.org/technology/m2e/releases/
  5. (Optional) Repeat it for Maven Integration for Android Development Tools.

Set Android SDK Location & Custom Debug Keystore

  1. Preferences... | Android | SDK Location: /workspace/android-sdk
  2. Optionally to build platform applications & services
    • wget -P /workspace/ http://dl.dropbox.com/u/47820156/platform.jks
    • Android | Build | Custom debug keystore: /workspace/platform.jks

Git Config

git config --global user.name "Henry Lee" # your name instead
git config --global user.email henrylee4j@gmail.com # your email address instead
git config --global color.diff auto
git config --global color.status auto
git config --global color.branch auto

, or cp /workspace/gits/henry4j/bin/.gitconfig ~

Install P4 merge in use by git diff

wget -P /tmp/ https://github.com/henry4j/-/raw/master/bin/p4merge
wget -P /tmp/ https://github.com/henry4j/-/raw/master/bin/p4diff
wget -P /tmp/ http://dl.dropbox.com/u/47820156/p4merge-mac-osx-july-2011.zip
unzip -o /tmp/p4merge-mac-osx-july-2011.zip -d /Applications/
sudo mv /tmp/p4merge /opt/local/bin/
sudo mv /tmp/p4diff /opt/local/bin/
sudo chmod +x /opt/local/bin/p4merge
sudo chmod +x /opt/local/bin/p4diff

Git Ignore

cat <<EOF > ~/.gitignore
*.class
*.md.html
*.mkd.html
.DS_Store
.p4config
.settings/
bin/
gen/
target/
project.properties
EOF

Git Reference, Screencast, and Guide

^-^;;;;;

git init, add, commit, and push
mkdir notes
cd notes
git init
touch readme.mkd
git add readme.mkd
git commit -m 'git init'
git remote add origin git@github.com:henry4j/notes.git
git push -u origin master

EGit - no longer in our uses.

Build Oxygen AOSP custom ROM on Mac OSX Lion

Initialize the build environment
export USE_CCACHE=1 # sets up the C/C++ compiler cache in .profile

POSIXLY_CORRECT=1 sudo port install libsdl git-core gnupg

make --version # 3.81 is required, while 3.82 has an issue
python --version # 2.4 - 2.7 is required, while 3.x has an issue

ulimit -S -n 1024 # sets up the file descriptor limit to 1024 in .profile
Download the open source project
curl https://dl-ssl.google.com/dl/googlesource/git-repo/repo > /tmp/repo
sudo mv /tmp/repo /opt/local/bin/repo
sudo chmod a+x /opt/local/bin/repo

mkdir /workspace/gits/oxygen-gingerbread
pushd /workspace/gits/oxygen-gingerbread
repo init -u git://github.com/oxygen-rom/android_manifest.git -b gingerbread

# let's sync once the repo got initialized in /workspace/gits/oxygen-gingerbread
repo sync -j16
Tweaks the environment for Mac OSX Lion
sudo port install gsed findutils
sudo ln -s /opt/local/bin/gsed /opt/local/bin/sed
sudo ln -s /opt/local/libexec/gnubin/find /opt/local/bin/find

sudo ln -s /Developer/SDKs/MacOSX10.6.sdk /Developer/SDKs/MacOSX10.5.sdk

sudo sed -i '.bak' -e 's:^size_t   strnlen:// size_t   strnlen:g' /usr/include/string.h
sed -i '.bak' -e 's:^:# :g' /workspace/gits/oxygen-gingerbread/external/qemu/Android.mk
Build Oxygen for Nexus S for engineering
source build/envsetup.sh
lunch oxygen_crespo-eng # or, lunch cyanogen_crespo-eng

pushd device/samsung/crespo; ./extract-files.sh; popd # extract device specific files

make -j8
Enable 'experimental' system packages on unprotected storage -- patch & build services.jar
source build/envsetup.sh
sed -i '' -e 's:(!pkg.applicationInfo.sourceDir.startsWith(E:(!pkg.packageName.contains("experimental") \&\& \
                !pkg.applicationInfo.sourceDir.startsWith(E:1' \
    frameworks/base/services/java/com/android/server/PackageManagerService.java

repo status frameworks/base # lists services/java/com/android/server/PackageManagerService.java
repo diff frameworks/base

mmm frameworks/base/services/java

adb shell mount -o remount,rw /system
adb shell cp /system/framework/services.jar /system/framework/services.jar.bak
adb push out/target/product/crespo/system/framework/services.jar /system/framework/services.jar
adb shell reboot

Enable 'experimental' system packages on unprotected storage -- patch prebuilt services.jar

wget -P /tmp/ http://dl.dropbox.com/u/47820156/crespo-system-framework-services.jar
# or wget -P /tmp/ http://dl.dropbox.com/u/47820156/generic-system-framework-services.jar

adb shell mount -o remount,rw /system
adb shell cp /system/framework/services.jar /system/framework/services.jar.bak
adb push /tmp/crespo-system-framework-services.jar /system/framework/services.jar
# or adb push /tmp/generic-system-framework-services.jar /system/framework/services.jar
adb shell reboot

Work with Desktop Java project

  1. pushd /workspace/gits/henry4j/projs./places;
    mvn eclipse:eclipse -DdownloadSources=true # spawns an eclipse project w/ sources
  2. File → Import... → General → Existing Projects into Workspace
  3. Enter /workspace/gits/henry4j/projs./places for root directory
  4. Refresh → Finish
  5. Eclipse → Preferences → Java → Build Path → Classpath Variables → New... → M2_REPO and /Users/henry/.m2/repository

Work with Android Java project

  1. File → Import... → General → Existing Projects into Workspace
  2. Enter /workspace/gits/henry4j/projs./yamba for root directory
  3. Refresh → Finish

Install apktool to reverse APK resources

wget -P /tmp/ http://android-apktool.googlecode.com/files/apktool1.4.1.tar.bz2
wget -P /tmp/ http://android-apktool.googlecode.com/files/apktool-install-macosx-r04-brut1.tar.bz2
pushd /opt/local/bin/
sudo tar xvf /tmp/apktool1.4.1.tar.bz2
sudo tar xvf /tmp/apktool-install-macosx-r04-brut1.tar.bz2
popd

Install dex2jar to reverse Dalvik bytecode

wget -P /tmp/ http://dex2jar.googlecode.com/files/dex2jar-0.0.9.2-SNAPSHOT.zip
sudo unzip -o /tmp/dex2jar-0.0.9.2-SNAPSHOT.zip -d /opt/local/share/
sudo ln -s /opt/local/share/dex-translator-0.0.9.2-SNAPSHOT /opt/local/share/dex2jar
sudo chmod +x /opt/local/share/dex2jar/dex2jar.sh
sudo ln -s /opt/local/share/dex2jar/dex2jar.sh /opt/local/bin/dex2jar

Install fernflower to reverse Java bytecode

wget -P /tmp/ https://github.com/henry4j/-/raw/master/bin/fernflower.jar
wget -P /tmp/ https://github.com/henry4j/-/raw/master/bin/fernflower
sudo mv /tmp/fernflower.jar /opt/local/bin/
sudo mv /tmp/fernflower /opt/local/bin/
sudo chmod +x /opt/local/bin/fernflower

Install apk2eclipse to reverse APK using apktool, dex2jar, and fernflower

wget -P /tmp/ https://raw.github.com/henry4j/-/master/bin/apk2eclipse
sudo mv /tmp/apk2eclipse /opt/local/bin/
sudo chmod +x /opt/local/bin/apk2eclipse

Install Jad-Clipse and Jad

wget -P /tmp/ http://www.varaneckas.com/sites/default/files/jad/jad158g.mac.intel.zip
sudo unzip -o /tmp/jad158g.mac.intel.zip -d /usr/bin/

wget -P /tmp/ http://dl.dropbox.com/u/47820156/jadretro-1_6-jre.tar
pushd /tmp/; tar xvf jadretro-1_6-jre.tar; popd;

cat <<EOF > /tmp/jadretro/jadretro
#!/bin/bash
java -jar \`dirname \$0\`/jadretro.jar \$@
EOF

sudo mv /tmp/jadretro/jadretro.jar /usr/bin/
sudo mv /tmp/jadretro/jadretro /usr/bin/
sudo chmod +x /usr/bin/jadretro

  • Help | Install New Software ... | Add ... to open the Add Repository dialog
    • Type http://jadclipse.sourceforge.net/update/ to location | OK
    • Check Java Decompiler Eclipse Plug-in | Next twice
    • Choose to accept the license and then Finish
  • Preferences | General | Editors | File Associations
    • Make default editor Decompiled Class File Viewer for *.class.
  • Preferences | Java | Decompilers | Jad
    • Debug → Check Output original line numbers as comments
    • Formatting → Check Don't insert a newline before opening brace

DO USE Jad-Clipse, Fernflower, and JD-GUI together.

Inside Eclipse, we will use CMD + Shift + T, or R for decompiled projects.

  • CMD + Shift + T to open a type that gets decompiled instantly by Jad-Clipse, e.g. FacebookService type.
  • CMD + Shift + R to open a source file that is already decompiled by Fernflower, e.g. FacebookService.java.

Outside Eclipse, we will use JD-GUI

  • File | Open ... | "*.jar" (any Java Archive that we want to decompile)
  • File | Save All Sources to save the decompiled sources into a zip file

JD-Eclipse -- no longer in our uses.

  • Help | Install New Software ... | Add ... to open the Add Repository dialog
  • Type http://java.decompiler.free.fr/jd-eclipse/update to location | OK
  • Check Java Decompiler Eclipse Plug-in | Next twice
  • Choose to accept the license and then Finish

JD-Eclipse w/ realignment at sourceforge -- no longer in our use.

  • wget -P /Applications/eclipse/plugins http://iweb.dl.sourceforge.net/project/realignmentjd/realignment.jd.ide.eclipse_1.0.2.jar
  • Preferences → General → Editors → File Associations and select "*.class" file type and to choose "Realignment for JD Class File Editor" for Associated editors.

Decompile facebook.apk and deep-dive into ...

adb shell sqlite3 /data/data/com.android.vending/databases/market_assets.db .dump | grep facebook
adb shell 'pm path com.facebook.katana' # tells /data/app/com.facebook.katana-1.apk for facebook 1.7.2
adb pull /data/app/com.facebook.katana-1.apk
mv com.facebook.katana-1.apk com.facebook.katana-1.7.2.apk
apk2eclipse com.facebook.katana-1.7.2.apk

Decompile google service framework

adb shell 'pm list packages -f com.google.android.gsf'
adb shell 'pm path com.google.android.gsf'
adb pull /system/app/GoogleServicesFramework.apk
mv GoogleServicesFramework.apk com.google.android.gsf-2.3.apk
apk2eclipse com.google.android.gsf-2.3.apk

apk sign

wget -P /tmp/ http://dl.dropbox.com/u/47820156/AndroidMod.zip
unzip -o /tmp/AndroidMod.zip -d /tmp/

cat <<EOF > /tmp/SignApk/signapk
#!/bin/bash
java -jar \`dirname \$0\`/signapk.jar \$@
EOF

sudo mv /tmp/SignApk/signapk.jar /usr/bin/
sudo mv /tmp/SignApk/signapk /usr/bin/
sudo chmod +x /usr/bin/signapk

Install Busybox to Android

wget -P /tmp/ http://busybox.net/downloads/binaries/latest/busybox-armv4tl
adb shell mount -o remount,rw /system
adb push /tmp/busybox-armv4tl /system/bin/busybox
adb shell chmod 755 /system/bin/busybox

Install Superuser unless installed

wget -P /tmp/ http://downloads.androidsu.com/superuser/Superuser-3.0.6-efgh-signed.zip
unzip -o /tmp/Superuser-3.0.6-efgh-signed.zip -d /tmp/
adb push /tmp/system/app/Superuser.apk /system/app
adb push /tmp/system/bin/su /system/bin
adb shell chmod 664 /system/app/Superuser.apk
adb shell chmod 4755 /system/bin/su

Common Java & ORM Recipes

mkdir -p /workspace/gits/commons; cd /workspace/gits/commons
git clone https://code.google.com/p/guava-libraries/ google-guava
svn checkout http://svn.apache.org/repos/asf/commons/proper/beanutils/trunk/ commons-beanutils
svn checkout http://svn.apache.org/repos/asf/commons/proper/cli/trunk/ commons-cli
svn checkout http://svn.apache.org/repos/asf/commons/proper/collections/trunk commons-collections
svn checkout http://svn.apache.org/repos/asf/commons/proper/functor/trunk/ commons-functor
svn checkout http://svn.apache.org/repos/asf/commons/proper/io/trunk commons-io
svn checkout http://svn.apache.org/repos/asf/commons/proper/lang/trunk commons-lang3
svn checkout http://svn.apache.org/repos/asf/commons/proper/primitives/trunk commons-primitives
wget -P /tmp/ http://apache.mirrors.redwire.net//httpcomponents/httpclient/source/httpcomponents-client-4.1.2-src.tar.gz
tar xvf /tmp/httpcomponents-client-4.1.2-src.tar
svn checkout http://svn.apache.org/repos/asf/lucene/dev/trunk lucene-trunk
export GREP_OPTIONS='--color=auto'
find . | grep -v 'git\|svn\|Test' | xargs grep -n -A1 -B1 'public .*[eE]xists' # to see usages of exists

Wicked Cool Scripts

diff -rq samsung-SGH-I727-Email samsung-SGH-I717-KJ5-Email # to see the diffs between Celox and Quincy
Nuke System and Email accounts
cat <<EOF >> ~/bin/delete-edb 
adb shell rm /data/system/accounts.db
adb shell rm -r /data/data/com.htc.android.mail/databases/*
adb shell rm -r /data/data/com.htc.android.mail/shared_prefs/*
adb shell rm -r /data/data/com.android.email/databases/*
adb shell rm -r /data/data/com.android.email/shared_prefs/*
adb shell busybox killall com.htc.android.mail
adb shell busybox killall com.android.email
adb shell busybox killall com.google.android.gm
adb shell busybox killall com.google.process.gapps
# adb shell reboot
EOF
List and Add to market-assets
cat <<EOF > ~/bin/list-mdb
adb shell sqlite3 /data/data/com.android.vending/databases/market_assets.db .dump
EOF
chmod +x ~/bin/list-mdb

cat <<EOF > ~/bin/add-to-mdb
adb shell sqlite3 /data/data/com.android.vending/databases/market_assets.db "INSERT OR REPLACE INTO asset_versions VALUES('v2:com.joulespersecond.seattlebusbot:1:21','content://downloads/my_downloads/6','DOWNLOAD_PENDING',1320161445169,1320161447243,1320161453103,0,447135,'com.joulespersecond.seattlebusbot','false','KP1Z29pn70_zfKRDHQCHWCpEFJU',0,21,'details?doc=com.joulespersecond.seattlebusbot',NULL,-1,'','',-1,4,-1,'','',-1,4)"
adb shell sqlite3 /data/data/com.android.vending/databases/market_assets.db "INSERT OR REPLACE INTO assets VALUES('com.joulespersecond.seattlebusbot','DEFAULT','honesthenry@gmail.com')"
adb shell busybox killall com.android.vending
EOF
chmod +x ~/bin/add-to-mdb

Install & Instantiate Redis → tutorial

mkdir ~/opt/; pushd ~/opt/;
wget http://redis.googlecode.com/files/redis-2.4.2.tar.gz;
tar xvf redis-2.4.2.tar.gz;
ln -s redis-2.4.2 redis; pushd redis;

sed -e 's/port 6379/port 6389/g' redis.conf > redis-6389;
src/redis-server redis-6389.conf; # in one terminal
src/redis-server; # in another terminal

Install & Instantiate Node → downloads

mkdir ~/opt/; pushd ~/opt/;
wget http://nodejs.org/dist/node-v0.4.12.tar.gz
tar xvf node-v0.4.12.tar.gz
ln -s node-v0.4.12 node; pushd node

# to build according to README.md
./configure
make
sudo make install

# to test an example node
cat <<EOF >> /tmp/example.js
var http = require('http');
http.createServer(function (req, res) {
  res.writeHead(200, {'Content-Type': 'text/plain'});
  res.end('Hello World\n');
}).listen(1337, "127.0.0.1");
console.log('Server running at http://127.0.0.1:1337/');
EOF

node /tmp/example.js & # plays a server.
curl http://127.0.0.1:1337/ # plays a client.

Resources

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment