Skip to content

Instantly share code, notes, and snippets.

@Qfl3x
Qfl3x / week3.md
Last active May 30, 2023 07:31
MLOps-Zoomcamp: Workflow Orchestration - Prefect

NOTE: commands and UI are deprecated

Content:

  • Negative Engineering
  • What is workflow orchestration?
  • Introduction to Prefect 2.0
  • First Prefect flow and Basics

Workflow Orchestration

library(dplyr)
library(purrr)
library(rlang)
derange <- function(data, ..., by_group = FALSE){
arrange( data, !!!map( quos(...), ~ quo(desc(!!.)) ), by_group = by_group )
}
d <- data.frame( x = 1:10, y = letters[1:10])
derange(d, x, y)
.DS_Store
@shagunsodhani
shagunsodhani / t-SNE.md
Created May 15, 2016 09:30
Notes for t-SNE paper

Visualizing Data using t-SNE

Introduction

  • Method to visualize high-dimensional data points in 2/3 dimensional space.
  • Data visualization techniques like Chernoff faces and graph approaches just provide a representation and not an interpretation.
  • Dimensionality reduction techniques fail to retain both local and global structure of the data simultaneously. For example, PCA and MDS are linear techniques and fail on data lying on a non-linear manifold.
  • t-SNE approach converts data into a matrix of pairwise similarities and visualizes this matrix.
  • Based on SNE (Stochastic Neighbor Embedding)
  • Link to paper
@hrbrmstr
hrbrmstr / orig.png
Last active July 16, 2023 06:43
Supreme Annotations - moar splainin here: http://rud.is/b/2016/03/16/supreme-annotations/ - NOTE: this requires the github version of ggplot2
orig.png
@muschellij2
muschellij2 / Differ.R
Last active November 19, 2015 19:50
Get the Diff of 2 file solely with R functions
rm(list=ls())
library(git2r)
library(plyr)
library(daff)
differ = function(file1, file2){
path <- tempfile(pattern="git2r-")
dir.create(path)
repo <- init(path)
@jennybc
jennybc / reverse-categorical-axis-ggplot2.r
Created October 10, 2014 01:06
Reverse the order of a categorical axis in ggplot2
scale_x_discrete(limits = rev(levels(the_factor)))