Skip to content

Instantly share code, notes, and snippets.

View petersen-poul's full-sized avatar

Poul Petersen petersen-poul

View GitHub Profile
{
"name": "Lat/Long Distance between a pair of points",
"description": "Extends a dataset with the distance in meters between pairs of lat/long fields.",
"inputs": [
{
"name": "dataset-in",
"type": "dataset-id",
"description": "Dataset for extending with distance calculation."
},
{
{
"name": "Apply Date Format by Field Name",
"description": "Allows applying a custom date format to a source by matching field names",
"inputs": [
{
"name": "source",
"description": "Source to update",
"type": "source-id"
}
],
@petersen-poul
petersen-poul / one-click-cluster-labels.json
Created March 22, 2019 19:16
one-click-cluster-labels
{
"name": "One Click Cluster Labels",
"description": "Given a cluster as input, assigns the cluster label to every instance in the dataset used to train the cluster.",
"inputs": [
{
"name": "cluster",
"description": "Cluster to use for labeling",
"type": "cluster-id"
}
],
{
"name": "Assign Field Types by Field Name",
"description": "Sometimes, the automatic field detection does not assign field types correctly. This is especially a problem with fields that have a lot of missing values since the detection process only takes a peek at the data to determine if a field should be numeric, categorical, etc. This script allows you to alter the field types for a source based on the name of each field. Just put a partial match for the name in the list for the type you want to assign, and it will change all the fields whose name contain that string.",
"inputs": [
{
"name": "source",
"description": "Source to update.",
"type": "source-id"
},
{
{
"name": "1-Click Dataset Prefer-it-All",
"description": "Given a source, creates a 1-click dataset and then marks all non-preferred field as preferred.",
"inputs": [
{
"name": "source",
"type": "source-id",
"description": "Source to process."
}
],
{
"name": "Minimum Scale for Cluster Class Purity",
"description": "Given a dataset and a categorical field, finds the minimum scale required to create class purity in the cluster with k = number of classes.",
"inputs": [
{
"name": "dataset",
"type": "dataset-id",
"description": "Dataset to analyze."
},
{
{
"name": "Simple JSON key/val extraction",
"description": "Given a dataset field containing JSON documents and a key, this WhizzML script creates a new feature with the JSON values. This is a hack and *NOT* a valid JSON parser",
"inputs": [
{
"name": "dataset-in",
"type": "dataset-id",
"description": "Dataset to transform by extracting JSON values."
},
{
@petersen-poul
petersen-poul / json-extract.json
Last active May 12, 2016 16:48
JSON key/val extraction
{
"name": "JSON key/val extraction",
"description": "Given a dataset field containing JSON documents and a key, this WhizzML script creates a new feature with the JSON values. This is a hack and *NOT* a valid JSON parser",
"inputs": [
{
"name": "dataset-in",
"type": "dataset-id",
"description": "Dataset to transform by extracting JSON values."
},
{
{
"name": "Redfin Deals",
"description": "Given a source of sold homes and listed homes, builds a model to predict the price and then shows possible deals.",
"inputs": [
{
"name": "redfin-sold-source",
"type": "source-id",
"description": "Source of sold homes from Redfin."
},
{
{
"name": "Lat/Long Distance from a reference point",
"description": "Extends a dataset with the distance in meters between lat/long fields and a reference point.",
"inputs": [
{
"name": "dataset-in",
"type": "dataset-id",
"description": "Dataset for extending with distance calculation."
},
{