Skip to content

Instantly share code, notes, and snippets.

View gregsheremeta's full-sized avatar

Greg Sheremeta gregsheremeta

View GitHub Profile
/*
Copyright (c) 2018 Red Hat, Inc.
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
@gregsheremeta
gregsheremeta / dev-node.yaml
Created July 10, 2018 17:42
dev-node.yml
---
# tasks file for dev-base
# setup repos
- dnf:
name: fedora-workstation-repositories
state: latest
- name: enable yarn repo
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoing_file: kfp.components.OutputPath(),
):
def create_test_file(path, size):
with open(path, 'wb') as file:
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoing_file: kfp.components.OutputPath(),
):
def create_test_file(path, size):
with open(path, 'wb') as file:
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoing_file: kfp.components.OutputPath(),
):
def create_test_file(path, size):
with open(path, 'wb') as file:
@gregsheremeta
gregsheremeta / a1.py
Last active July 17, 2023 21:12
a1 - with add_pod_annotation - success, but 0 byte result
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoingfile: kfp.components.OutputPath(),
):
import urllib.request
@gregsheremeta
gregsheremeta / a2.py
Last active July 17, 2023 21:12
a2 - without add_pod_annotation - 'Termination message is above max allowed size 4096' error, but 20MB result exists in minio
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoingfile: kfp.components.OutputPath(),
):
import urllib.request
@gregsheremeta
gregsheremeta / a4.py
Last active July 17, 2023 21:11
a4 - same as a2, but with no string in the OutputPath
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoingfile: kfp.components.OutputPath(),
):
import urllib.request
@gregsheremeta
gregsheremeta / a5.py
Last active July 17, 2023 21:11
a5 - same as a2, but with empty string in OutputPath
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoingfile: kfp.components.OutputPath(),
):
import urllib.request
@gregsheremeta
gregsheremeta / a3.py
Last active July 17, 2023 21:03
a3 - same as a1, but no string in OutputPath
"""Test pipeline to exercise various data flow mechanisms."""
import kfp
"""Producer"""
def send_file(
outgoingfile: kfp.components.OutputPath(),
):
import urllib.request