marianboda

[alias]
  st = status -s
  ls = log --pretty=format:"%C(yellow)%h%Cred%d\\ %Creset%s%Cblue\\ [%cn]" --decorate
  ll = log --pretty=format:"%C(yellow)%h%Cred%d\\ %Creset%s%Cblue\\ [%cn]" --decorate --numstat
  lds = log --pretty=format:"%C(yellow)%h\\ %ad%Cred%d\\ %Creset%s%Cblue\\ [%cn]" --decorate --date=short
  le = log --oneline --decorate

marianboda

git config --global alias.lo 'log --date=format:"%Y-%m-%d %H:%M" --pretty=format:"%ad %C(yellow)%h%Creset %an: %Cblue%s%Creset"'

marianboda

#

marianboda

find . -maxdepth 1 -type d -print0 | xargs -0 -I {} sh -c 'echo $(find "{}" | wc -l) \\t "{}"' | sort -rn | less

marianboda

version 1.0.3 # +

Text Analysis and Entity Resolution

####Entity resolution is a common, yet difficult problem in data cleaning and integration. This lab will demonstrate how we can use Apache Spark to apply powerful and scalable text analysis techniques and perform entity resolution across two datasets of commercial products.

Entity Resolution, or "[Record linkage][wiki]" is the term used by statisticians, epidemiologists, and historians, among others, to describe the process of joining records from one data source with another that describe the same entity. Our terms with the same meaning include, "entity disambiguation/linking", duplicate detection", "deduplication", "record matching", "(reference) reconciliation", "object identification", "data/information integration", and "conflation".

Entity Resol

marianboda

if [ -x /usr/bin/tput ] && tput setaf 1 >& /dev/null; then
    c_git_clean=$(tput setaf 2)
    c_git_dirty=$(tput setaf 1)
    c_git_semi_dirty=$(tput setaf 3)
    c_reset=$(tput sgr0)
else
    c_git_clean=
    c_git_dirty=
    c_reset=
    c_git_semi_dirty=

marianboda

a = 
  name: 'n1'
  items: [
    {
      name: 'n1.1'
      items: [
        {name: 'n1.1.1', items: []}
        {
          name: 'n1.1.2', items: [
            { name: 'n1.1.2.1', items: []}

marianboda

OS X soft

Package Manager

• Homebrew
• Homebrew Cask

Apps

# Terminal: iTerm 2

marianboda

Front-end build setup

Tools used

• [node.js][node] - JavaScript Runtime
• [Gulp][gulp] - Task Runner
• [Bower][bower] - Package manager

Configure environment