Skip to content

Instantly share code, notes, and snippets.

View archenroot's full-sized avatar
🏠
Working from home

Ladislav Zitka archenroot

🏠
Working from home
View GitHub Profile
@camullen
camullen / installation.md
Created December 10, 2022 23:52
KDE Install on WSL2
@ManojNair
ManojNair / spark-defaults.conf
Created August 26, 2020 02:38
Spark Configuration for AWS Glue Local
# Example:
# spark.master spark://master:7077
# spark.eventLog.enabled true
# spark.eventLog.dir hdfs://namenode:8021/directory
# spark.serializer org.apache.spark.serializer.KryoSerializer
# spark.driver.memory 5g
# spark.executor.extraJavaOptions -XX:+PrintGCDetails -Dkey=value -Dnumbers="one two three"
spark.driver.extraClassPath /glue/aws-glue-libs/jarsv1/*
spark.executor.extraClassPath /glue/aws-glue-libs/jarsv1/*
@hakonhagland
hakonhagland / kvm-copy-paste.md
Last active April 18, 2024 16:11
How to make copy&paste work between Ubuntu host and Windows 10 guest for a KVM virtual machine?
import os
import sys
import numpy as np
from pyspark import SparkConf, SparkContext
def create_spark_context():
pex_file = os.path.basename([path for path in sys.path if path.endswith('.pex')][0])
conf = SparkConf() \
.setMaster("yarn") \
.set("spark.submit.deployMode", "client") \
import json
import subprocess
import sys
from pex.fetcher import PyPIFetcher
from pex.pex_builder import PEXBuilder
from pex.resolvable import Resolvable
from pex.resolver import resolve_multi, Unsatisfiable, Untranslateable
from pex.resolver_options import ResolverOptionsBuilder
@AdamBien
AdamBien / 48thAirhacksQ&A.md
Last active March 26, 2018 19:27
48thAirhacksQ&A.md
docker network ls
docker network create --driver bridge isolated_network ## create ~ create custom network, bridge ~ use a bridge network, isolated_network ~ name of the custom network
docker network isolated_network
docker network inspect isolated_network
docker run -d --net=isolated_network --name nodeapp -p 3000:3000 abhinavkorpal/node ## net ~ run container in network, mongodb ~ link to this containe by name
@dghubble
dghubble / kubeception.md
Last active April 24, 2024 18:29
Running QEMU/KVM and Nested Kubernetes on Bare-Metal Kubernetes
@Brainiarc7
Brainiarc7 / build-tensorflow-from-source.md
Last active July 29, 2023 21:28
Build Tensorflow from source, for better performance on Ubuntu.

Building Tensorflow from source on Ubuntu 16.04LTS for maximum performance:

TensorFlow is now distributed under an Apache v2 open source license on GitHub.

On Ubuntu 16.04LTS+:

Step 1. Install NVIDIA CUDA:

To use TensorFlow with NVIDIA GPUs, the first step is to install the CUDA Toolkit as shown:

package org.deeplearning4j.examples.dataExamples;
import org.datavec.image.loader.NativeImageLoader;
import org.deeplearning4j.nn.multilayer.MultiLayerNetwork;
import org.deeplearning4j.util.ModelSerializer;
import org.nd4j.linalg.api.ndarray.INDArray;
import org.nd4j.linalg.dataset.api.preprocessor.DataNormalization;
import org.nd4j.linalg.dataset.api.preprocessor.ImagePreProcessingScaler;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;