bcajes

aws ec2 describe-spot-price-history --instance-types i3.2xlarge --start-time (date +%s) --filter Name=product-description,Values=Linux/UNIX

bcajes

SQL ACLs in Databricks

We support fine-grained access control via the SparkSQL interface in Databricks. In this context, access can be restricted on any securable objects, e.g. tables, views, databases or functions. Fine-grained level access control (i.e. on rows or columns matching specific conditions) can be accomplished via access control on derived views that can contain arbitrary queries. These access control policies are enforced by the SQL query analyzer at runtime. Fine-grained access control can be enabled on a Databricks Spark 2.1+ cluster by setting a custom spark config on the cluster creation page:

spark.databricks.acl.enabled true

Privileges

bcajes

# you need to sign-up https://developer.nvidia.com/rdp/cudnn-download                                                                                                             
#scp cudnn-7.0-linux-x64-v4.0-prod.tgz ubuntu@your-ec2-instance:~/                                                                                                                
#ssh ubuntu@your-ec2-instance                                                                                                                                                     
wget <DOWNLOAD_URL>/cudnn-7.0-linux-x64-v4.0-prod.tgz
curl -O http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1404/x86_64/cuda-repo-ubuntu1404_7.5-18_amd64.deb
sudo dpkg -i cuda-repo-ubuntu1404_7.5-18_amd64.deb
sudo apt-get update
# see http://tleyden.github.io/blog/2015/11/22/cuda-7-dot-5-on-aws-gpu-instance-running-ubuntu-14-dot-04/                                                                         
sudo apt-get install -y linux-image-extra-`uname -r` linux-head

bcajes

#sort directories by space
du --max-depth=1 /path | sort -r -k1,1n

bcajes

 $ curl -X POST "http://master:5050/shutdown?frameworkId=20141206-200247-1643591690-5050-13501-0056"
 $ Missing 'frameworkId' query parameter

bcajes

(venv)~/ontomics/Query-tool-pyramid /master> export LANG=en_US.UTF-8
(venv)~/ontomics/Query-tool-pyramid /master> ./bin/buildout         
mr.developer: Queued 'query_tool' for checkout.
mr.developer: Queued 'substanced' for checkout.
mr.developer: Queued 'thunderdome' for checkout.
mr.developer: Skipped checkout of existing package 'query_tool'.
mr.developer: Skipped checkout of existing package 'substanced'.
mr.developer: Skipped checkout of existing package 'thunderdome'.
Develop: '/Users/bcajes1/ontomics/Query-tool-pyramid/src/thunderdome'
Develop: '/Users/bcajes1/ontomics/Query-tool-pyramid/src/substanced'

bcajes

#!/bin/bash
for i in {1..5}
do
    bin/titan.sh stop
    sleep 10
    bin/titan.sh -v -c cassandra-es start  
    sleep 18
    curl http://localhost:8182/graphs/graph/vertices
done

bcajes

import com.thinkaurelius.titan.core.TitanFactory;

g = TitanFactory.open("conf/titan-cassandra-es.properties") 

import java.util.Random
rand = new Random()


g.V.remove();g.commit()

bcajes

#!/usr/bin/env bash                                                                                                                                                                           
sudo apt-get install -y python-software-properties
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
echo debconf shared/accepted-oracle-license-v1-1 select true | sudo debconf-set-selections
echo debconf shared/accepted-oracle-license-v1-1 seen true | sudo debconf-set-selections
sudo apt-get install -y oracle-java7-installer
sudo apt-get install -y oracle-java7-set-default
sudo update-java-alternatives -s java-7-oracle
java -version

bcajes

from pyramid.config import Configurator
from herokuapp.resources import RootFactory, groupfinder
from pyramid.events import subscriber, NewRequest
from pyramid.authentication import AuthTktAuthenticationPolicy
from pyramid.authorization import ACLAuthorizationPolicy
from pymongo.cursor import Cursor
from pymongo.connection import Connection
from pymongo.errors import AutoReconnect, TimeoutError
from socket import timeout
from time import sleep