Lynn Langit lynnlangit

## Dec-2020-links.md

      
              1 file
            
          
              1 fork
            
          
              0 comments
            
          
              2 stars
            
          
                lynnlangit
                / Dec-2020-links.md
            
            
              Last active
              January 12, 2023 19:46
            
          
    Dec 2020 Links

Here's a list of Links
Day 1

Intro


Google Cloud console --> https://console.cloud.google.com/
GCP-for-Bioinformatics --> https://github.com/lynnlangit/gcp-for-bioinformatics


## tutorial.nf
#!/usr/bin/env nextflow

params.str = 'Hello world!'

process splitLetters {

    output:
    file 'chunk_*' into letters

    """

## hello2.nf
#!/usr/bin/env nextflow

nextflow.enable.dsl=2

process sayHello{
  input:
    val djaeet
  output:
    stdout


## GCP-SDK DOCKERFILE
FROM google/cloud-sdk:295.0.0

# Tell gcloud to save state in /.config so it's easy to override as a mounted volume.
ENV HOME=/

# install python3 to make that also available - modified from https://tecadmin.net/install-python-3-7-on-ubuntu-linuxmint/
RUN apt-get install -y build-essential checkinstall \
    && apt-get install -y libreadline-gplv2-dev libncursesw5-dev libssl-dev libsqlite3-dev \
        tk-dev libgdbm-dev libc6-dev libbz2-dev libffi-dev zlib1g-dev liblzma-dev\
    && cd /usr/bin \

## alibaba-cloud-to-aws.csv

          
            Category
            Type
            Alibaba
            AWS
            Notes

            
              Security
               Resources
               RAM
               IAM
               for users/roles/permissions via policies

            
              Storage
              Objects
              OSS
              s3
              not all features in USRegion

            
              Storage
              Blocks
               EBS
               EBS
               with Compute (VMs)

            
              Storage
              Other
              NAS
              EFS
               file server

            
              Compute
              VMs
               ECS
               EC2
               n/a

            
              Compute
               Containers
              Container Service
               EKS/ECS/Fargate
               differs

            
              Compute
               Functions
              Function Compute
               Lambda
               n/a

            
              Data
               RDBSM
               ApsaraDB for RDS
               RDS
               n/a

            
              Data
               Serverless NoSQL
               TableStore
               DynamoDB
               n/a

## visualizing-cloud-systems-links.csv
Image or Article, Link, Slide Section, Notes
Title Image, www.amazon.in/Gene-Machine-Decipher-Secrets-Ribosome-ebook/dp/B07B8LF2DQ, 1, Ribosome
Alibaba architecture, img.alicdn.com/tfs/TB1OuNEG7yWBuNjy0FpXXassXXa-1530-1140.png, 1, for GT-Scan2
GCP icons, cacoo.com/wp-app/uploads/2018/02/GCP-Symbols.png, 1, all icons
AWS ML, www.lynda.com/Amazon-Web-Services-tutorials/Amazon-Web-Services-Machine-Learning-Essential-Training/624308-2.html, 1, from Lynda.com course
GCP ML, www.lynda.com/Google-Cloud-tutorials/Google-Cloud-Platform-Machine-Learning-Essential-Training/738138-2.html, 1, from Lynda.com course
50% sequnced, www.genome.gov/about-genomics/fact-sheets/DNA-Sequencing-Costs-Data, 2, stat
GT-Scan2, www.computerworld.com.au/article/647046/csiro-launches-serverless-search-engine-genome-alibaba-cloud/, 2, screen from app
X-Ray & GT-Scan2, aws.amazon.com/blogs/publicsector/faster-genome-search-via-aws-x-ray/, 2, AWS blog post
Alibaba & GT-Scan2, www.alibabacloud.com/blog/gt-scan2-bringing-bioinformatics-to-alib

## script.csv
# Start

[https://cloud.google.com/kubernetes-engine/docs/tutorials/gitops-cloud-build](https://cloud.google.com/kubernetes-engine/docs/tutorials/gitops-cloud-build)
gcloud commands as a GitHub gist - [https://gist.github.com/lynnlangit/725f44779641a0e2c5b2bacb9768e04e](https://gist.github.com/lynnlangit/725f44779641a0e2c5b2bacb9768e04e)

# Use GCP test project

gcloud config set project [PROJECT_ID]

# Enable APIs

## LinkedList.cpp
#include <iostream>
#include <cstdlib>

class Node
{
public:
    Node* next;
    int data;
};

## index.html

<!DOCTYPE html>

<html style="background-image:url(img/watefall01.jpg)">
<head>
    <meta charset="utf-8" />

    <title>Waterfall Express</title>

    <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.3.1/jquery.min.js"></script>

## vs-eks-params.csv

          
            Type
            Service
             Notes

            
              Data
               S3
               Location & input file types

            
              Compute
               EC2
               Type & Quantity & Pricing

            
              Kubernetes & Hadoop
               EKS
               Number of cores & total memory & Driver config

            
              Spark
               Spark
               Spark version & executor count/size & more

            
              Algorithm
               VariantSpark
               Input files & Tree-building params
	#!/usr/bin/env nextflow

	params.str = 'Hello world!'

	process splitLetters {

	output:
	file 'chunk_*' into letters

	"""
	#!/usr/bin/env nextflow

	nextflow.enable.dsl=2

	process sayHello{
	input:
	val djaeet
	output:
	stdout
	FROM google/cloud-sdk:295.0.0

	# Tell gcloud to save state in /.config so it's easy to override as a mounted volume.
	ENV HOME=/

	# install python3 to make that also available - modified from https://tecadmin.net/install-python-3-7-on-ubuntu-linuxmint/
	RUN apt-get install -y build-essential checkinstall \
	&& apt-get install -y libreadline-gplv2-dev libncursesw5-dev libssl-dev libsqlite3-dev \
	tk-dev libgdbm-dev libc6-dev libbz2-dev libffi-dev zlib1g-dev liblzma-dev\
	&& cd /usr/bin \
Category	Type	Alibaba	AWS	Notes
Security	Resources	RAM	IAM	for users/roles/permissions via policies
Storage	Objects	OSS	s3	not all features in USRegion
Storage	Blocks	EBS	EBS	with Compute (VMs)
Storage	Other	NAS	EFS	file server
Compute	VMs	ECS	EC2	n/a
Compute	Containers	Container Service	EKS/ECS/Fargate	differs
Compute	Functions	Function Compute	Lambda	n/a
Data	RDBSM	ApsaraDB for RDS	RDS	n/a
Data	Serverless NoSQL	TableStore	DynamoDB	n/a
	Image or Article, Link, Slide Section, Notes
	Title Image, www.amazon.in/Gene-Machine-Decipher-Secrets-Ribosome-ebook/dp/B07B8LF2DQ, 1, Ribosome
	Alibaba architecture, img.alicdn.com/tfs/TB1OuNEG7yWBuNjy0FpXXassXXa-1530-1140.png, 1, for GT-Scan2
	GCP icons, cacoo.com/wp-app/uploads/2018/02/GCP-Symbols.png, 1, all icons
	AWS ML, www.lynda.com/Amazon-Web-Services-tutorials/Amazon-Web-Services-Machine-Learning-Essential-Training/624308-2.html, 1, from Lynda.com course
	GCP ML, www.lynda.com/Google-Cloud-tutorials/Google-Cloud-Platform-Machine-Learning-Essential-Training/738138-2.html, 1, from Lynda.com course
	50% sequnced, www.genome.gov/about-genomics/fact-sheets/DNA-Sequencing-Costs-Data, 2, stat
	GT-Scan2, www.computerworld.com.au/article/647046/csiro-launches-serverless-search-engine-genome-alibaba-cloud/, 2, screen from app
	X-Ray & GT-Scan2, aws.amazon.com/blogs/publicsector/faster-genome-search-via-aws-x-ray/, 2, AWS blog post
	Alibaba & GT-Scan2, www.alibabacloud.com/blog/gt-scan2-bringing-bioinformatics-to-alib
	# Start

	[https://cloud.google.com/kubernetes-engine/docs/tutorials/gitops-cloud-build](https://cloud.google.com/kubernetes-engine/docs/tutorials/gitops-cloud-build)
	gcloud commands as a GitHub gist - [https://gist.github.com/lynnlangit/725f44779641a0e2c5b2bacb9768e04e](https://gist.github.com/lynnlangit/725f44779641a0e2c5b2bacb9768e04e)

	# Use GCP test project

	gcloud config set project [PROJECT_ID]

	# Enable APIs
	#include <iostream>
	#include <cstdlib>

	class Node
	{
	public:
	Node* next;
	int data;
	};

	<!DOCTYPE html>

	<html style="background-image:url(img/watefall01.jpg)">
	<head>
	<meta charset="utf-8" />

	<title>Waterfall Express</title>

	<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.3.1/jquery.min.js"></script>
Type	Service	Notes
Data	S3	Location & input file types
Compute	EC2	Type & Quantity & Pricing
Kubernetes & Hadoop	EKS	Number of cores & total memory & Driver config
Spark	Spark	Spark version & executor count/size & more
Algorithm	VariantSpark	Input files & Tree-building params