cjmatta

In the /etc/clustershell/groups.conf file I like to put the following definitions:

[mygroup]
map: sed -n '1,/$GROUP/d;/\[/,$d;/^$/d;p' /etc/clustershell/groups.conf.d/mygroup_poc_cluster.hosts | awk '{print $1}'
all: grep -v "^\[" /etc/clustershell/groups.conf.d/mygroup_poc_cluster.hosts | grep -v ^$
list: grep "^\[" /etc/clustershell/groups.conf.d/mygroup_poc_cluster.hosts | sed -e "s/\[//" -e "s/\]//"

The cluster.hosts file is generated from the mapr-ansible-roles and looks like this:

cjmatta

[
	"AL": 0.015802252,
	"AK": 0.00222773,
	"AZ": 0.018231104,
	"AR": 0.009499616,
	"CA": 0.12035896,
	"CO": 0.015284031,
	"CT": 0.012101279,
	"DE": 0.002784431,
	"DC": 0.002032745,

cjmatta

[
	"01001":	5.43143e-05,
	"01002":	9.40889e-05,
	"01003":	3.35946e-05,
	"01005":	1.64507e-05,
	"01007":	4.74477e-05,
	"01008":	4.09082e-06,
	"01009":	2.40008e-06,
	"01010":	1.16895e-05,
	"01011":	4.43739e-06,

cjmatta

ACT I

SCENE I. Venice. A street.

Enter RODERIGO and IAGO
RODERIGO
Tush! never tell me; I take it much unkindly
That thou, Iago, who hast had my purse
As if the strings were thine, shouldst know of this.
IAGO

cjmatta

##Teradata TDCH and Parallel Transporter with MapR

##Environment Running on Peep.local: 192.168.1.26

###Tasks

• Load sample data into Teradata database
• Run queries to ensure it's in there
• Move data using TDCH
• Move data using TD Parallel transporter

cjmatta

## test customer view
```SQL
select 
cast(row_key as int) as row_key,
cast(`address`['state'] as VARCHAR(255)) as state,
cast(`loyalty`['agg_rev'] as VARCHAR(255)) as agg_rev, 
cast(`loyalty`['membership'] as VARCHAR(255)) as membership,

cjmatta

Tweets

SELECT 
CAST(`t`.`dir0` AS VARCHAR(255)) AS `topic`,
CAST(`t`.`dir1` AS INTEGER) AS `year`,
CAST(`t`.`dir2` AS INTEGER) AS `month`,
CAST(`t`.`dir3` AS INTEGER) AS `day`,
CAST(`t`.`dir4` AS INTEGER) AS `hour`,
CAST(`t`.`id` AS BIGINT) AS `id`,
CAST(`t`.`user`['id'] AS BIGINT) AS `user_id`,

cjmatta

#!/bin/bash
# checkcomp - A script to show the relative compressed and uncompressd file sizes on a MapR filesystem.
# Chris Matta
# cmatta@mapr.com
#
# Currently broken when a directory has multiple dir children. Need to write a directory walk funciton.

set -o nounset
set -o errexit

cjmatta

#!/bin/bash
# Copyright (C) 2013  by Teradata Corporation.
# All Rights Reserved.
#
# This script installs tdch for Oozie transfers with Hadoop
#
# Version : $Id$

# MapR Notes
# Since MapR doesn't need a nameNode, we've removed it from this script

cjmatta

#!/bin/bash
set -o nounset
set -o errexit

if [[ ! -f $1 ]];
then
    echo "Query file ${1} not found, exiting.";
    exit 1;
fi