Skip to content

Instantly share code, notes, and snippets.

@pulsation
pulsation / spark2-addfile-test.scala
Created May 14, 2019 12:31
addFile test in spark2 shell
import org.apache.spark.SparkFiles
import org.apache.spark.SparkContext
val context = spark.sparkContext
val fileName = "file.csv"
val fetchedFile = context.addFile(s"ftp://my-ftp-server.net/$fileName")
val readFile = context.textFile(SparkFiles.get(fileName)).collect()
readFile.foreach(println)

Keybase proof

I hereby claim: * I am pulsation on github. * I am pulsation (https://keybase.io/pulsation) on keybase. * I have a public key ASB7h5_tSmXYXTtO3zKdiVeZ2Wg5kfOKhwZ2IufMAK8vgwo To claim this, I am signing this object:

{   "body": {     "key": {       "eldest_kid": "01207b879fed4a65d85d3b4edf329d895799d9683991f38a87067622e7cc00af2f830a",       "host": "keybase.io",       "kid": "01207b879fed4a65d85d3b4edf329d895799d9683991f38a87067622e7cc00af2f830a",       "uid": "3a079d7e17eb61cd2eddbefe8a46f219",       "username": "pulsation"     },     "merkle_root": {       "ctime": 1565805634,       "hash": "fe188eb21153f07221fa5ab59ea3ced3be204a8add143ab0430fa68f72eacb64d9f1a7cf0f195ac7cab6152138bc83b5fabd5d9d91bbd0d4fb9cff965e0ab3d5",       "hash_meta": "697c53dd5477e7556b5a4444766d691bd11a09c19040b53dce75c8a18570effe",       "seqno": 6016018     },     "service": {       "entropy": "jOrxAxWVMpeoM6x1hUrmzuWx",       "name": "github",       "username": "pulsation"     },     "type": "web_
@pulsation
pulsation / gist:342addfd7b9a849a99dfcb5c03978eb9
Created November 4, 2020 14:58
nixpkgs-review pr 102669 execution result
➜ nixpkgs-review pr 102669
$ git -c fetch.prune=false fetch --force https://github.com/NixOS/nixpkgs master:refs/nixpkgs-review/0 pull/102669/head:refs/nixpkgs-review/1
$ git worktree add /home/phil/.cache/nixpkgs-review/pr-102669-1/nixpkgs 0d3256564447e8cca0b0df4400790abff73c5401
Préparation de l'arbre de travail (HEAD détachée 0d325656444)
Mise à jour des fichiers: 100% (23093/23093), fait.
HEAD est maintenant à 0d325656444 libical: disable rest of failing tests
$ git merge --no-commit a9085c1b4f38e6b334853d87d6beb815c1087890
Fusion automatique de pkgs/top-level/all-packages.nix
La fusion automatique a réussi ; stoppée avant la validation comme demandé
$ nix build --no-link --keep-going --option build-use-sandbox relaxed -f /home/phil/.cache/nixpkgs-review/pr-102669-1/build.nix
@pulsation
pulsation / nixpkgs-review pr 102669.txt
Last active November 4, 2020 19:25
nixpkgs-review pr 102669 as root
# ~phil/src/nixpkgs-review/result/bin/nixpkgs-review pr 102669
$ git -c fetch.prune=false fetch --force https://github.com/NixOS/nixpkgs master:refs/nixpkgs-review/0 pull/102669/head:refs/nixpkgs-review/1
remote: Enumerating objects: 12, done.
remote: Counting objects: 100% (12/12), done.
remote: Compressing objects: 100% (3/3), done.
remote: Total 13 (delta 8), reused 12 (delta 8), pack-reused 1
Dépaquetage des objets: 100% (13/13), 1.69 Kio | 46.00 Kio/s, fait.
Depuis https://github.com/NixOS/nixpkgs
* [nouvelle branche] master -> refs/nixpkgs-review/0
* [nouvelle référence] refs/pull/102669/head -> refs/nixpkgs-review/1