Skip to content

Instantly share code, notes, and snippets.

View miharp's full-sized avatar

Michael Harp miharp

  • ServiceNow
  • San Diego
View GitHub Profile

Change Log

2.1.0 - ACTIVE DEVELOPMENT

Changed

  • Added CHANGELOG

2.0.3 - 2018-03-01

Added

@miharp
miharp / omsa.sh
Created February 23, 2018 23:46
omsa.sh
[bmdapi15233.sea33:/root]# yum install http://repo.bfi0.service-now.com/dell/hardware/Dell-OMSA-14G/7/metaRPMS/srvadmin-all-9.1.0-2757.12163.el7.x86_64.rpm
Loaded plugins: fastestmirror, security
Setting up Install Process
srvadmin-all-9.1.0-2757.12163.el7.x86_64.rpm | 2.8 kB 00:00
Examining /var/tmp/yum-root-fwE9qN/srvadmin-all-9.1.0-2757.12163.el7.x86_64.rpm: srvadmin-all-9.1.0-2757.12163.el7.x86_64
Marking /var/tmp/yum-root-fwE9qN/srvadmin-all-9.1.0-2757.12163.el7.x86_64.rpm to be installed
Loading mirror speeds from cached hostfile
snc | 2.5 kB 00:00
snc-ppe | 2.5 kB 00:00
Resolving Dependencies

Mike's Rule Reminders

  • Trust, but verify.
  • KISS.
  • Be Scotty, not Geordi. (Under promise and overdeliver.)
  • Document everything; especially requests, approvals, and configurations. (If it's not in a ticket, it didn't happen.)
  • Fridays are READ ONLY!
  • It's always DNS.
  • Do it right. The first time may be your only time.

LZO Notes

We use s3cmd to download and package HDP and HDP-UTILS from s3://dev.hortonworks.com

s3 sync command which excludes lzo from HDP stack

s3cmd sync --no-check-md5 --exclude 'hadooplzo/*' --exclude '*m2-artifacts.tar' --exclude '*.tar.gz' --exclude '*.src.rpm' s3://dev.hortonworks.com/HDP/${SUSE_VERSION}/2.x/BUILDS/$VERSION-${BUILD_NUMBER}/ $hdpDir

s3 sync which excludes lzo from HDP-UTILS

stderr: /var/lib/ambari-agent/data/errors-185.txt
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py", line 177, in <module>
DataNode().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 313, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py", line 52, in install

Teradata HDP Releases

HDP-2.4 -- 3/24/2016

- Ambari-2.2.2
- Ambari-2.2.1

HDP-2.3 -- 7/31/2015

- Ambari-2.2.0
- Ambari-2.1.0
cmdall "sed -i 's/^#server 127.127.1.0/server 127.127.1.0\# local clock (LCL)/g' /etc/ntp.conf"
cmdall "sed -i 's/^#fudge 127.127.1.0 stratum 10/fudge 127.127.1.0 stratum 10 # LCL is unsynchronized/g' /etc/ntp.conf"
cmdall "/etc/init.d/ntp restart"

Download and install Intellij

  • Add Plugins
    • Python
    • Vagrant
    • Bash

Checkout Hadoop Builder from subversion

svn co https://continuum.td.teradata.com/svn/HadoopBuilder/trunk/ HadoopBuilder-Trunk
@miharp
miharp / gist:9205f96cc828ff324a69
Last active August 29, 2015 14:02
HDP-2.1.2.2
#!/bin/bash
#Get RPMs
hdpDir='HDP/suse11/2.x/updates/2.1.2.0/'
mkdir -p $hdpDir
/usr/local/src/s3cmd-master/s3cmd sync --exclude '*.tar.gz' --exclude '*.src.rpm' s3://public-repo-1.hortonworks.com/HDP/suse11/2.x/updates/2.1.2.0/ $hdpDir
rm -f HDP/suse11/2.x/updates/2.1.2.0/hbase/*
rm -f HDP/suse11/2.x/updates/2.1.2.0/hive/*
/usr/local/src/s3cmd-master/s3cmd sync --exclude '*.tar.gz' --exclude '*.src.rpm' s3://TD-dev.hortonworks.com/HDP-2.1.2.2/suse11/hbase/ HDP/suse11/2.x/updates/2.1.2.0/hbase/
/usr/local/src/s3cmd-master/s3cmd sync --exclude '*.tar.gz' --exclude '*.src.rpm' s3://TD-dev.hortonworks.com/HDP-2.1.2.2/suse11/hive/ HDP/suse11/2.x/updates/2.1.2.0/hive/
createrepo $hdpDir