Skip to content

Instantly share code, notes, and snippets.

@sameerz
sameerz / cuspatial-refine-docker.txt
Created July 4, 2022 22:28
docker build cuSpatial
(base) $ ~/dev/nvliyuan/spark-rapids-examples/examples/UDF-Examples/Spark-cuSpatial$ docker build -f Dockerfile . -t build-spark-cuspatial
Sending build context to Docker daemon 85.5kB
Step 1/16 : ARG CUDA_VER=11.2.2
Step 2/16 : FROM nvidia/cuda:${CUDA_VER}-devel-ubuntu18.04
---> 74b12a1f9ef3
Step 3/16 : RUN apt-key adv --fetch-keys https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu1804/x86_64/3bf863cc.pub
---> Using cache
---> f1d1af43d886
Step 4/16 : RUN apt-get update
---> Using cache
@sameerz
sameerz / cluster-init-10-2-GPU-master.sh
Created October 17, 2020 01:38
GCP Dataproc spark-rapids initialization script
#!/bin/bash
set -euxo pipefail
export REGION=europe-west4
export ZONE=europe-west4-c
export GCS_BUCKET=[BUCKET CONTAINING MORTGAGE ETL DATA]
export CLUSTER_NAME=[CLUSTER NAME]
export NUM_GPUS=1
export NUM_WORKERS=2
@sameerz
sameerz / gist:e660c7feea06a8f02137f7d7641fa80a
Created August 17, 2020 22:55
Query issues and PRs in a repository
query {
repository(owner:"nvidia", name:"spark-rapids") {
project(number:3) {
name
columns(first:50) {
edges {
node {
name
cards(first:5) {
edges {