Skip to content

Instantly share code, notes, and snippets.

View imyoungyang's full-sized avatar

Young Yang imyoungyang

46 followers · 9 following
View GitHub Profile
@imyoungyang
imyoungyang / gist:af705e75aa6319549b41fa638ac5d0f5
Last active August 7, 2020 08:22
hsagemaker-bootcam-materials
## Day 3 Materials
git clone https://github.com/HKT-SSA/bring-your-own-container-on-sm.git
git clone https://github.com/HKT-SSA/yolov5-on-sagemaker.git
powerpoint: https://tinyurl.com/y43bxytx
billing alert: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/monitor_estimated_charges_with_cloudwatch.html
mlops:
https://github.com/imyoungyang/myAWSStudyBlog/tree/master/ml-ops-poc
https://github.com/imyoungyang/iam-nija-workshop
@imyoungyang
imyoungyang / gist:456a8fbccd459ad20ac6bd1926c14784
Last active August 5, 2020 02:54
curl commands for the materials
curl -o /home/ec2-user/SageMaker/xgboost_customer_churn_bootcamp_student.ipynb https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/xgboost_customer_churn_bootcamp_student_EN_C.ipynb
curl -o /home/ec2-user/SageMaker/xgboost_customer_churn_bootcamp_student_solution.ipynb https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/xgboost_customer_churn_bootcamp_student_EN_C.ipynb
curl -o /home/ec2-user/SageMaker/churn.txt https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/churn.txt
curl -o /home/ec2-user/SageMaker/template-cloudwatch.yaml https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/template-cloudwatch.yaml
curl -o /home/ec2-user/SageMaker/UsingDeepARtoForecastElectricityTimeSeriesData.ipynb https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/UsingDeepARtoForecastElectricityTimeSeriesData.ipynb
curl -o /home/ec2-user/SageMaker/household_power_consumption.txt https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/household_power_consumption.txt
curl -o /home/ec2-user/SageMaker/labALL.zip htt
@imyoungyang
imyoungyang / gist:d9091503a38bf096dafaa050791611b6
Last active November 20, 2019 08:51
NLP-Workshop-20191120
arn:aws:iam::<account-id>:role/SageMakerExecutionRole
go to codecommit to create a repo "nlp-workshop-<your-id>"
git clone https://git-codecommit.us-west-2.amazonaws.com/v1/repos/nlp-workshop
create a notebooks using t3 with existing role
arn:aws:iam::<account-id>:role/SageMakerExecutionRole
wget https://bit.ly/35gjdDw -O workshop.zip
wget https://bit.ly/2r4mcAi -O glove6b50dtxt.zip
@imyoungyang
imyoungyang / gist:e688cf2a7be44b7247716cc522dcf645
Last active July 18, 2019 08:10
sample code
# Bird
!wget -O /tmp/test.jpg https://upload.wikimedia.org/wikipedia/commons/1/17/Rotkehlchen_bird.jpg
file_name = '/tmp/test.jpg'
from IPython.display import Image
Image(file_name)
# resize and padding
from matplotlib.pyplot import imshow
from PIL import Image
import numpy as np
@imyoungyang
imyoungyang / workshops.md
Created January 1, 2019 14:23 — forked from triggan/workshops.md
re:Invent 2017 - Workshop Repositories

Workshops

A list of public repositories and content from re:Invent 2017 Workshops. Some of these repos also contain the slides from teh workshops as well, but not all. Many of the links are subject to be moved or completely removed at any point in time in the future.

Session ID Session Name Repo
ABD313 Building an End-to-End Serverless Data Analytics Solution on AWS https://github.com/aws-samples/serverless-data-analytics
AMF303 Deep Dive into the Connected Vehicle Reference Architecture https://github.com/awslabs/aws-connected-vehicle-solution
ARC325 Managing Multiple AWS Accounts at Scale https://github.com/aws-samples/arc325-multiple-accounts-workshop
@imyoungyang
imyoungyang / gist:f740bf74d1b477c0067b4a2bb8b3f7a8
Created March 27, 2018 05:19
error info
[2018-03-27T03:33:41.147Z][INFO]-Building artifact downloader edba2da8-2103-4ca7-98ec-e71b6ee342a9 : arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000
[2018-03-27T03:33:41.148Z][INFO]-Downloading edba2da8-2103-4ca7-98ec-e71b6ee342a9 : arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000
[2018-03-27T03:33:47.748Z][ERROR]-rollback of ArtifactDownloader.process(), cause: Error while unpacking the file from /greengrass/ggc/deployment/mlmodel/arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000/mlmodel to /greengrass/ggc/deployment/mlmodel/arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000, error: Invalid compressed file type for file: /greengrass/ggc/deployment/mlmodel/arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000/mlmodel, file type: application/octet-stream
[2018-03-27T03:33:48.84Z][ERROR]-Greengrass deployment error: unable to download the artifact arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000: Error while processing. Error while unpacking the file fr
@imyoungyang
imyoungyang / gist:d88520881d021c54df58788b2bc1dc1f
Last active February 22, 2018 07:09
kubectl port-forward
*for the kubernetes dashboard*
kubectl proxy --port=8080 --address 0.0.0.0 --accept-hosts '.*'
*port-forward*
kubectl port-forward $(kubectl get po -l prometheus=prometheus -n monitoring -o jsonpath={.items[0].metadata.name}) 8080:9090 -n monitoring
Forwarding from 127.0.0.1:8080 -> 9090
@imyoungyang
imyoungyang / python_opencv_camera_haar.py
Created December 7, 2017 04:25 — forked from radames/python_opencv_camera_haar.py
Example of Python with Opencv and camera face detection
import cv2
cap = cv2.VideoCapture(0)
cap.set(3, 640) #WIDTH
cap.set(4, 480) #HEIGHT
face_cascade = cv2.CascadeClassifier('/usr/local/Cellar/opencv/2.4.13/share/OpenCV/haarcascades/haarcascade_frontalface_default.xml')
eye_cascade = cv2.CascadeClassifier('/usr/local/Cellar/opencv/2.4.13/share/OpenCV/haarcascades/haarcascade_eye.xml')
while(True):
@imyoungyang
imyoungyang / React and Flux Studay
Last active August 29, 2015 14:12
React and Flux Studay
Yahoo special:
* flux-examples https://github.com/yahoo/flux-examples
fluxible-app, fluxible-plugin-routr, and fluxible-plugin-fetchr.
* fluxible-app https://github.com/yahoo/fluxible-app
Pluggable container for isomorphic flux applications that provides interfaces that are common throughout the Flux architecture and restricts usage of these APIs to only the parts that need them to enforce the unidirectional flow.
* fetchr https://github.com/yahoo/fetchr
Fetchr augments Flux applications by allowing Flux stores to be used on server and client to fetch data
@imyoungyang
imyoungyang / HK MHYQL 405
Created November 15, 2014 15:13
HK 302 redirect to brb.yahoo.com
Remote Address:202.43.192.109:443
Request URL:https://hk.yahoo.com/
Request Method:GET
Status Code:302 Found
Request Headers
:host:hk.yahoo.com
:method:GET
:path:/
:scheme:https
:version:HTTP/1.1