Skip to content

Instantly share code, notes, and snippets.

View ogrisel's full-sized avatar

Olivier Grisel ogrisel

View GitHub Profile
@ogrisel
ogrisel / quantile_regression_as_classification.py
Last active November 29, 2023 17:18
Quantile regression as classification
View quantile_regression_as_classification.py
# %%
from scipy.interpolate import interp1d
from sklearn.base import BaseEstimator, RegressorMixin, clone
from sklearn.utils.validation import check_is_fitted
from sklearn.ensemble import RandomForestClassifier
from sklearn.preprocessing import KBinsDiscretizer
from sklearn.utils.validation import check_consistent_length
from sklearn.utils import check_random_state
import numpy as np
@ogrisel
ogrisel / bench_pca.py
Last active July 3, 2023 18:30
PCA GPU
View bench_pca.py
# %%
from sklearn import set_config
from sklearn.base import clone
set_config(array_api_dispatch=True)
# %%
try:
import torch
except ModuleNotFoundError:
View iterative_loop_with_lazy_eval.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ogrisel
ogrisel / monotonic_bias.ipynb
Last active June 16, 2023 07:29
Monotonic bias study
View monotonic_bias.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ogrisel
ogrisel / minimum_norm_ridge_limit.ipynb
Last active April 21, 2023 17:20
Ridge and intercept estimation
View minimum_norm_ridge_limit.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
View loky_failures_log.txt
2023-02-24T08:51:55.0856095Z ##[section]Starting: Test loky
2023-02-24T08:51:55.0862853Z ==============================================================================
2023-02-24T08:51:55.0863227Z Task : Command line
2023-02-24T08:51:55.0863416Z Description : Run a command line script using Bash on Linux and macOS and cmd.exe on Windows
2023-02-24T08:51:55.0863830Z Version : 2.212.0
2023-02-24T08:51:55.0864023Z Author : Microsoft Corporation
2023-02-24T08:51:55.0864198Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/command-line
2023-02-24T08:51:55.0864458Z ==============================================================================
2023-02-24T08:51:55.2236683Z Generating script.
2023-02-24T08:51:55.2246660Z Script contents:
View float32_rng.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
View float32 issue
## Context: the new `global_dtype` fixture and `SKLEARN_RUN_FLOAT32_TESTS` environment variable
Introduction of low-level computational routines for 32bit motivated an extension of tests to run them on 32bit.
In this regards, https://github.com/scikit-learn/scikit-learn/pull/22690 introduced a new `global_dtype` fixture as well has the `SKLEARN_RUN_FLOAT32_TESTS` env. variable to make it possible to run the test on 32bit data.
Running test on 32bit can be done using `SKLEARN_RUN_FLOAT32_TESTS=1`.
For instance, this run the first `global_dtype`-parametrised test:
View bench_knn_scalability.py
from pathlib import Path
import sys
from time import perf_counter
from threadpoolctl import threadpool_limits
from sklearn.datasets import make_blobs
from sklearn.model_selection import train_test_split
from sklearn.neighbors import NearestNeighbors
from joblib import Memory
import pandas as pd
import matplotlib.pyplot as plt
View scipy_test.log
This file has been truncated, but you can view the full file.
============================= test session starts ==============================
platform darwin -- Python 3.9.7, pytest-6.2.5, py-1.10.0, pluggy-1.0.0 -- /Users/ogrisel/mambaforge/envs/crash-scipy-dev/bin/python
cachedir: .pytest_cache
rootdir: /Users/ogrisel
collecting ... collected 47225 items
mambaforge/envs/crash-scipy-dev/lib/python3.9/site-packages/scipy/_build_utils/tests/test_scipy_version.py::test_valid_scipy_version PASSED [ 0%]
mambaforge/envs/crash-scipy-dev/lib/python3.9/site-packages/scipy/_lib/tests/test__gcutils.py::test_set_gc_state PASSED [ 0%]
mambaforge/envs/crash-scipy-dev/lib/python3.9/site-packages/scipy/_lib/tests/test__gcutils.py::test_gc_state PASSED [ 0%]
mambaforge/envs/crash-scipy-dev/lib/python3.9/site-packages/scipy/_lib/tests/test__gcutils.py::test_assert_deallocated PASSED [ 0%]