Ista Zahn izahn
izahn
/ fst_rds_benchmark.R
Created
July 18, 2019 18:53
A quick comparison between fst and rds IO characteristics
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| library(fst) | |
| n <- 1000000 | |
| d1 <- as.data.frame(c(replicate(50, sample(letters[1:10], n, replace = TRUE), simplify = FALSE), | |
| replicate(50, runif(n), simplify = FALSE))) | |
| tmpf <- tempfile() | |
| rw_time <- function(compression, file, write.fun, read.fun) { | |
| data.frame(compression = compression, | |
| writeTime = system.time(write.fun(d1, file, compress = compression))[[3]], |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| abind=1.4-5 | |
| assertthat=0.2.0 | |
| backports=1.1.2 | |
| base=3.5.1 | |
| base64enc=0.1-3 | |
| BH=1.66.0-1 | |
| bindr=0.1.1 | |
| bindrcpp=0.2.2 | |
| bit=1.1-14 | |
| bit64=0.9-7 |
izahn
/ tensorflow_build.log
Last active
June 1, 2021 20:47
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ python build-locally.py | |
| valid configs are {'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.8.____cpython', 'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.9.____cpython', 'osx_64_python3.9.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.8.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.6.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.6.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.8.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.7.____cpython', 'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.7.____cpython', 'osx_64_python3.7.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.9.____cpython', 'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.6.____cpython', 'osx_64_python3.8.____cpython', 'osx_arm64_python3.8.____cpython', 'osx_64_python3.6.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.7.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.9.____cpython', 'osx |
izahn
/ tensorflow_build_2021_06_02a.log
Created
June 2, 2021 18:23
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ python build-locally.py | |
| valid configs are {'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.6.____cpython', 'osx_64_python3.9.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.6.____cpython', 'osx_64_python3.8.____cpython', 'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.7.____cpython', 'osx_64_python3.6.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.7.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.7.____cpython', 'osx_arm64_python3.8.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.8.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.6.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.9.____cpython', 'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.8.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.9.____cpython', 'osx_arm64_python3.9.____cpython', 'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.9.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.8.____cpython', ' |
izahn
/ sklearn_parallel_example.py
Created
June 3, 2021 18:48
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Adapted from https://www.featureranking.com/tutorials/machine-learning-tutorials/sk-part-5-advanced-topics-pipelines-statistical-model-comparison-and-model-deployment/ | |
| ## by Ista | |
| import numpy as np | |
| from sklearn.datasets import load_breast_cancer | |
| from sklearn import preprocessing | |
| from sklearn.pipeline import Pipeline | |
| from sklearn.neighbors import KNeighborsClassifier | |
| from sklearn.model_selection import RepeatedStratifiedKFold, GridSearchCV | |
| from sklearn.feature_selection import SelectKBest, f_classif, mutual_info_classif |
izahn
/ tensorflow_build_2021_06_05.log
Created
June 7, 2021 09:40
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (test18) | |
| ~/D/tensorflow-feedstock $ python build-locally.py (mamba) | |
| valid configs are {'osx_arm64_python3.9.____cpython', 'linux_64_cuda_compiler_version10.2cudnn7python3.9.____cpython', 'linux_64_cuda_compiler_versionNonecudnnundefinedpython3.9.____cpython', 'linux_64_cuda_compiler_version11.1cudnn8python3.9.____cpython', 'osx_64_python3.9.____cpython', 'linux_64_cuda_compiler_version11.2cudnn8python3.9.____cpython'} | |
| config not selected, please choose from the following: | |
| 1. linux_64_cuda_compiler_version10.2cudnn7python3.9.____cpython | |
| 2. linux_64_cuda_compiler_version11.1cudnn8python3.9.____cpython | |
| 3. linux_64_cuda_compiler_version11.2cudnn8python3.9.____cpython | |
| 4. linux_64_cuda_compiler_versionNonecudnnundefinedpython3.9.____cpython | |
| 5. osx_64_python3.9.____cpython |
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $SRC_DIR/qttranslations/translations/lrelease_wrapper.sh qtquickcontrols_fr.ts -qm qtquickcontrols_fr.qm | |
| Updating 'qtquickcontrols_fr.qm'... | |
| Generated 75 translation(s) (75 finished and 0 unfinished) | |
| $SRC_DIR/qttranslations/translations/lrelease_wrapper.sh qtquickcontrols_ja.ts -qm qtquickcontrols_ja.qm | |
| Updating 'qtquickcontrols_ja.qm'... | |
| Generated 69 translation(s) (69 finished and 0 unfinished) | |
| $SRC_DIR/qttranslations/translations/lrelease_wrapper.sh qtquickcontrols_ru.ts -qm qtquickcontrols_ru.qm | |
| Updating 'qtquickcontrols_ru.qm'... | |
| Generated 69 translation(s) (69 finished and 0 unfinished) | |
| $SRC_DIR/qttranslations/translations/lrelease_wrapper.sh qtquickcontrols_uk.ts -qm qtquickcontrols_uk.qm |
izahn
/ pkgdiff.txt
Created
June 11, 2021 00:23
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| linux-64::abinit-9.4.2-hed82a66_0.tar.bz2 | |
| - "mpich >=3.4,<3.5.0a0", | |
| + "mpich >=3.4,<4.0.0a0", | |
| linux-64::mpi4jax-0.3.0-py37h1e5cb63_0.tar.bz2 | |
| - "mpich >=3.4,<3.5.0a0", | |
| + "mpich >=3.4,<4.0.0a0", | |
| linux-64::mpi4jax-0.3.0-py38he865349_0.tar.bz2 | |
| - "mpich >=3.4,<3.5.0a0", | |
| + "mpich >=3.4,<4.0.0a0", | |
| linux-64::mpi4jax-0.3.0-py39h6438238_0.tar.bz2 |
izahn
/ cuda111py38hdd42111_1.log
Created
June 23, 2021 11:41
tensorflow build log for python 3.8 with cuda 11.1
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| bash-5.0$ conda build -m .ci_support/linux_64_cuda_compiler_version11.1cudnn8python3.8.____cpython.yaml recipe | |
| No numpy version specified in conda_build_config.yaml. Falling back to default numpy value of 1.16 | |
| WARNING:conda_build.metadata:No numpy version specified in conda_build_config.yaml. Falling back to default numpy value of 1.16 | |
| Adding in variants from internal_defaults | |
| INFO:conda_build.variants:Adding in variants from internal_defaults | |
| Adding in variants from /tmp/rcs_izahn/tftmp/.ci_support/linux_64_cuda_compiler_version11.1cudnn8python3.8.____cpython.yaml | |
| INFO:conda_build.variants:Adding in variants from /tmp/rcs_izahn/tftmp/.ci_support/linux_64_cuda_compiler_version11.1cudnn8python3.8.____cpython.yaml | |
| Attempting to finalize metadata for tensorflow-base | |
| INFO:conda_build.metadata:Attempting to finalize metadata for tensorflow-base | |
| Collecting package metadata (repodata.json): ...working... done |
izahn
/ cuda111py39h769e6be_1.log
Created
June 23, 2021 11:52
ensorflow build log for python 3.9 with cuda 11.1
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| bash-5.0$ conda build -m .ci_support/linux_64_cuda_compiler_version11.1cudnn8python3.9.____cpython.yaml recipe | |
| No numpy version specified in conda_build_config.yaml. Falling back to default numpy value of 1.16 | |
| WARNING:conda_build.metadata:No numpy version specified in conda_build_config.yaml. Falling back to default numpy value of 1.16 | |
| Adding in variants from internal_defaults | |
| INFO:conda_build.variants:Adding in variants from internal_defaults | |
| Adding in variants from /tmp/rcs_izahn/tftmp/.ci_support/linux_64_cuda_compiler_version11.1cudnn8python3.9.____cpython.yaml | |
| INFO:conda_build.variants:Adding in variants from /tmp/rcs_izahn/tftmp/.ci_support/linux_64_cuda_compiler_version11.1cudnn8python3.9.____cpython.yaml | |
| Attempting to finalize metadata for libtensorflow | |
| INFO:conda_build.metadata:Attempting to finalize metadata for libtensorflow | |
| Collecting package metadata (repodata.json): ...working... done |