Skip to content

Instantly share code, notes, and snippets.

Ian Downard iandow

Block or report user

Report or block iandow

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
View create_stack.sh
$ aws cloudformation describe-stack-events --stack-name mas1
{
"StackEvents": [
{
"StackId": "arn:aws:cloudformation:us-west-2:773074507832:stack/mas1/e0df81c0-54c7-11e9-9a27-0ae01deb57d8",
"EventId": "49ea43c0-54c9-11e9-bfc1-064b816f3a4a",
"StackName": "mas1",
"LogicalResourceId": "mas1",
"PhysicalResourceId": "arn:aws:cloudformation:us-west-2:773074507832:stack/mas1/e0df81c0-54c7-11e9-9a27-0ae01deb57d8",
"ResourceType": "AWS::CloudFormation::Stack",
View gist:8236b9789d17c6788a572e04369f28f1
[Feb 22, 2019 1:49:45 PM]: Integration test for 'Connection' started.
[Feb 22, 2019 1:49:45 PM]: Using Radoop version 9.1.0.
[Feb 22, 2019 1:49:45 PM]: Running 8 tests: [Fetch dynamic settings, NameNode networking, DataNode networking, YARN services networking, MapReduce, HDFS upload, Radoop jar upload, Import job]
[Feb 22, 2019 1:49:45 PM]: Running test 1/8: Fetch dynamic settings
[Feb 22, 2019 1:49:45 PM]: Retrieving required configuration properties...
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: hive.execution.engine
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.resourcemanager.scheduler.address
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.resourcemanager.resource-tracker.address
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.resourcemanager.admin.address
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.app.mapreduce.am.staging-dir
View license.txt
-----BEGIN SIGNED MESSAGE-----
clusterid: "5427061983691452296"
version: "4.0"
customerid: "ignore"
issuer: "MapR Technologies"
licType: Demo
description: "MapR Enterprise Trial Edition"
enforcement: HARD
gracePeriod: 0
issuedate: 1550010076
View teststaticpvc.yaml
# Copyright (c) 2009 & onwards. MapR Tech, Inc., All rights reserved
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: test-static-pvc
namespace: test-csi
spec:
accessModes:
- ReadWriteOnce
resources:
@iandow
iandow / teststaticpv.yaml
Last active Jan 29, 2019
teststaticpv.yaml
View teststaticpv.yaml
# Copyright (c) 2009 & onwards. MapR Tech, Inc., All rights reserved
apiVersion: v1
kind: PersistentVolume
metadata:
name: test-static-pv
namespace: test-csi
spec:
accessModes:
- ReadWriteOnce
persistentVolumeReclaimPolicy: Delete
View mapred-site.xml
<configuration>
<property>
<name>mapreduce.jobhistory.address</name>
<value>nodec:10020</value>
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>nodec:19888</value>
</property>
<property>
View yarn-site.xml
<configuration>
<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.resourcemanager.hostname</name>
<value>nodeb</value>
<description>host is the hostname of the resourcemanager</description>
</property>
<property>
<name>yarn.resourcemanager.recovery.enabled</name>
<value>true</value>
View sandbox copy.html
<div class="col-md-12">
<h2 id="the-mapr-data-platform">THE MAPR SANDBOX FOR HADOOP</h2>
<p>The MapR Sandbox for Hadoop is a fully-functional single-node cluster that provides data scientists, developers, and other DataOps stakeholders a safe environment in which to explore MapR’s core data storage for files, tables, and streams, plus ecosystem components for Hadoop, HBase, Hive, Hue, Kafka, Pig, Spark, and more.</p>
<p><h2 id="the-mapr-data-platform">THE MAPR SANDBOX FOR APACHE DRILL</h2></p>
<p>The MapR Sandbox with Drill is a fully functional single-node cluster that can be used to get an overview of <a href="/products/apache-drill/">Apache Drill</a> in the MapR data platform. Data scientists, developers, and other DataOps stakeholders can use this sandbox environment to get a feel for the power and capabilities of Drill by performing various types of queries outlined in the <a href="http://drill.apache.org/docs/getting-to-know-the-drill-sandbox/">Drill tutorial.</a></p>
<h2 id
View misc CLDB troubleshooting commands
3 cat /opt/mapr/conf/mapr-clusters.conf
4 ping localhost
5 ping localhost.localdomain
6 jps
7 hadoop fs -ls /
8 id mapr
9 sudo su mapr
10 maprlogin print
11 maprlogin password
12 passwd
View here.md

Create a docker network to bridge containers

docker network create mynetwork

Start StreamSets like this:

docker run -it -p 18630:18630 -d --name sdc --network mynetwork streamsets/datacollector
You can’t perform that action at this time.