William Watson WattsInABox

## install_gnu_parallel_redhat_ubi8.sh
cd /tmp \
    && curl --output parallel-latest.tar.bz2 http://ftp.gnu.org/gnu/parallel/parallel-latest.tar.bz2 \
    && tar xjf parallel-latest.tar.bz2 \
    && cd parallel-2* \
    && ./configure && make \
    && make install \
    && cd /tmp \
    && rm -rf parallel-* \
    && mkdir -p ~/.parallel \
    && touch ~/.parallel/will-cite

## dnsmasq-in-os-x(Mojave but older should work too)-to-resolve-ec2-internal-ips.md

      
              1 file
            
          
              0 forks
            
          
              0 comments
            
          
              0 stars
            
          
                WattsInABox
                / dnsmasq-in-os-x(Mojave but older should work too)-to-resolve-ec2-internal-ips.md
            
            
              Last active
              November 15, 2019 15:30
            
          
    AWS internal ip's

EMR has components running on internal ip's such as ip-172-23-53-101.ec2.internal.
To resolve to the implied public/vpn IP's, setup dnsmasq
Setup dnsmasq on Mac

(You'll need to do something different on windows. Linux should have another installer.)
$ brew install dnsmasq

  
## s3a_configs.txt
# a list of all available configuration options in hadoop 2.7 for the s3a filesystem

fs.s3a.access.key
fs.s3a.secret.key
fs.s3a.connection.maximum
fs.s3a.connection.ssl.enabled
fs.s3a.endpoint
fs.s3a.proxy.host
fs.s3a.proxy.port
fs.s3a.proxy.username

## gem_make.out
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

    /Users/williamrwatson/.rvm/rubies/ruby-2.1.5/bin/ruby -r ./siteconf20151012-90285-1dtklec.rb extconf.rb
building local copy/version of google sparse/dense hash library
sh configure --prefix=/Users/williamrwatson/.rvm/gems/ruby-2.1.5@o2o/gems/google_hash-0.8.8/ext/local_installed
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ./install-sh -c -d
checking for gawk... no
checking for mawk... no

## configure_sparsehash_2.0.2_os_x_mavericks_llvm_5.1
$ gcc -v
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/usr/include/c++/4.2.1
Apple LLVM version 5.1 (clang-503.0.38) (based on LLVM 3.4svn)
Target: x86_64-apple-darwin13.1.0
Thread model: posix
$ ./configure
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ./install-sh -c -d
checking for gawk... no

## configure_sparsehash_1.8.1_os_x_mavericks_llvm_5.1
$ gcc -v
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/usr/include/c++/4.2.1
Apple LLVM version 5.1 (clang-503.0.38) (based on LLVM 3.4svn)
Target: x86_64-apple-darwin13.1.0
Thread model: posix
$ ./configure
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for gawk... no
checking for mawk... no

## .gitignore
# Ignore static version of the site (used to upload error pages to S3 for Heroku errors)
/out

## gist:6719217
$ brew doctor
Warning: "config" scripts exist outside your system or Homebrew directories.
`./configure` scripts often look for *-config scripts to determine if
software packages are installed, and what additional flags to use when
compiling and linking.

Having additional scripts in your path can confuse software installed via
Homebrew if the config script overrides a system or Homebrew provided
script of the same name. We found the following "config" scripts:
	cd /tmp \
	&& curl --output parallel-latest.tar.bz2 http://ftp.gnu.org/gnu/parallel/parallel-latest.tar.bz2 \
	&& tar xjf parallel-latest.tar.bz2 \
	&& cd parallel-2* \
	&& ./configure && make \
	&& make install \
	&& cd /tmp \
	&& rm -rf parallel-* \
	&& mkdir -p ~/.parallel \
	&& touch ~/.parallel/will-cite
	# a list of all available configuration options in hadoop 2.7 for the s3a filesystem

	fs.s3a.access.key
	fs.s3a.secret.key
	fs.s3a.connection.maximum
	fs.s3a.connection.ssl.enabled
	fs.s3a.endpoint
	fs.s3a.proxy.host
	fs.s3a.proxy.port
	fs.s3a.proxy.username
	Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

	/Users/williamrwatson/.rvm/rubies/ruby-2.1.5/bin/ruby -r ./siteconf20151012-90285-1dtklec.rb extconf.rb
	building local copy/version of google sparse/dense hash library
	sh configure --prefix=/Users/williamrwatson/.rvm/gems/ruby-2.1.5@o2o/gems/google_hash-0.8.8/ext/local_installed
	checking for a BSD-compatible install... /usr/bin/install -c
	checking whether build environment is sane... yes
	checking for a thread-safe mkdir -p... ./install-sh -c -d
	checking for gawk... no
	checking for mawk... no
	$ gcc -v
	Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/usr/include/c++/4.2.1
	Apple LLVM version 5.1 (clang-503.0.38) (based on LLVM 3.4svn)
	Target: x86_64-apple-darwin13.1.0
	Thread model: posix
	$ ./configure
	checking for a BSD-compatible install... /usr/bin/install -c
	checking whether build environment is sane... yes
	checking for a thread-safe mkdir -p... ./install-sh -c -d
	checking for gawk... no
	# Ignore static version of the site (used to upload error pages to S3 for Heroku errors)
	/out
	$ brew doctor
	Warning: "config" scripts exist outside your system or Homebrew directories.
	`./configure` scripts often look for *-config scripts to determine if
	software packages are installed, and what additional flags to use when
	compiling and linking.

	Having additional scripts in your path can confuse software installed via
	Homebrew if the config script overrides a system or Homebrew provided
	script of the same name. We found the following "config" scripts: