Skip to content

Instantly share code, notes, and snippets.

View rupakg's full-sized avatar
😎
drinking from the firehose...

Rupak Ganguly rupakg

😎
drinking from the firehose...
View GitHub Profile
@rupakg
rupakg / automating-ci-for-python-serverless-app-with-circleci.md
Last active July 1, 2019 02:06
Post: Automating a CI workflow for a Python app with Circle CI

Automating a CI workflow for a Python app with Circle CI

There are big benefits to using serverless architectures in continuous integration & deployment (CI/CD) processes. We'll show you why, and how to do it.

Published on Dec. 6th, 2017 at https://serverless.com/blog/ci-cd-workflow-serverless-apps-with-circleci/

thumbnail

I had previously written a post defining the CI/CD process, discussing various deployment patterns, creating a NodeJS app and automating the end-to-end CI flow.

In this post, I will jump straight into creating a Python app and go over the end-to-end process for automating the CI flow.

@rupakg
rupakg / etl-job-processing-with-serverless-lambda-and-redshift.md
Last active April 29, 2019 14:39
Post: ETL job processing with Serverless, Lambda, and AWS Redshift

ETL job processing with Serverless, Lambda, and AWS Redshift

Build an ETL job service by fetching data from a public API endpoint and dumping it into an AWS Redshift database.

Published on Feb 20th, 2018 at https://serverless.com/blog/etl-job-processing-with-serverless-lambda-and-redshift/

thumbnail

One of the big use cases of using serverless is ETL job processing: dumping data into a database, and possibily visualizing the data.

In this post, I'll go over the process step by step. We'll build a serverless ETL job service that will fetch data from a public API endpoint and dump it into an AWS Redshift database. The service will be scheduled to run every hour, and we'll visualize the data using Chart.io.

@rupakg
rupakg / how-to-create-a-rest-api-in-java-using-dynamodb-and-serverless.md
Last active February 22, 2021 13:23
Post: How to create a REST API in Java using DynamoDB and Serverless

How to create a REST API in Java using DynamoDB and Serverless

Build a serverless REST API service in Java, store the data in a DynamoDB table, and deploy it to AWS. All using the Serverless Framework.

Published on April 16th, 2018 at https://serverless.com/blog/how-to-create-a-rest-api-in-java-using-dynamodb-and-serverless/

thumbnail

In this walkthough, we will build a products-api serverless service that will implement a REST API for products. We will be using Java as our language of choice. The data will be stored in a DynamoDB table, and the service will be deployed to AWS.

image

@rupakg
rupakg / serverless-application-for-long-running-process-fargate-lambda.md
Last active August 31, 2021 21:41
Post: How to use AWS Fargate and Lambda for long-running processes in a Serverless app

How to use AWS Fargate and Lambda for long-running processes in a Serverless app

Build an ETL job service by fetching data from a public API endpoint and dumping it into an AWS Redshift database.

Published on Jan. 11th, 2018 at https://serverless.com/blog/serverless-application-for-long-running-process-fargate-lambda/

thumbnail

AWS dropped so many serverless announcements at re:Invent, the community is still scrambling to make sense of them all. This post is all about AWS Fargate.

In this article, I will show you how to create an end-to-end serverless application that extracts thumbnails from video files. But, oh no, processing video files is a long-running process! Whatever will we do?

@rupakg
rupakg / s3.sh
Created December 30, 2017 09:43 — forked from chrismdp/s3.sh
Uploading to S3 in 18 lines of Shell (used to upload builds for http://soltrader.net)
# You don't need Fog in Ruby or some other library to upload to S3 -- shell works perfectly fine
# This is how I upload my new Sol Trader builds (http://soltrader.net)
# Based on a modified script from here: http://tmont.com/blargh/2014/1/uploading-to-s3-in-bash
S3KEY="my aws key"
S3SECRET="my aws secret" # pass these in
function putS3
{
path=$1
@rupakg
rupakg / event-driven-serverless-app-local-dev-exp.md
Last active April 25, 2018 07:19
Post: Writing an Event-driven Serverless Application with Full Local Development Experience

Writing an Event-driven Serverless Application with Full Local Development Experience

Learn how to write an event-driven serverless application with full local development experience using the Serverless Application Platform.

Published on Sept. 12th, 2017 at https://serverless.com/blog/event-driven-serverless-app-local-dev-exp/

thumbnail

In my previous post on Anatomy of a Serverless Application, I lay the foundation for building a very simple application with an email service using the Serverless Framework, deployed to AWS Lambda.

In this post, we will build mailman, an event-driven serverless application. The application has a simple frontend using curl that calls into a couple of backend services: a users service and an email service. The post will highlight event-driven application development with focus on full local development experience. We will

@rupakg
rupakg / mesos_cadvisor_prometheus_grafana
Created December 7, 2016 17:25 — forked from charlesmims/mesos_cadvisor_prometheus_grafana
monitoring docker containers in mesos with prometheus and cadvisor and grafana
# This marathon.json deploys cadvisor to each node and exposes it on port 3002.
cadvisor/marathon.json
{
"id": "cadvisor",
"cpus": 0.1,
"mem": 100,
"disk": 0,
"instances": 8, // equal to number of agent nodes you have
"constraints": [["hostname", "UNIQUE"]],
@rupakg
rupakg / backup-github.sh
Created October 5, 2016 18:53 — forked from rodw/backup-github.sh
A simple script to backup an organization's GitHub repositories, wikis and issues.
#!/bin/bash
# A simple script to backup an organization's GitHub repositories.
# NOTE: if you have more than 100 repositories, you'll need to step thru the list of repos
# returned by GitHub one page at a time, as described at https://gist.github.com/darktim/5582423
GHBU_BACKUP_DIR=${GHBU_BACKUP_DIR-"github-backups"} # where to place the backup files
GHBU_ORG=${GHBU_ORG-"<CHANGE-ME>"} # the GitHub organization whose repos will be backed up
# (if you're backing up a user's repos instead, this should be your GitHub username)
GHBU_UNAME=${GHBU_UNAME-"<CHANGE-ME>"} # the username of a GitHub account (to use with the GitHub API)
@rupakg
rupakg / BluetoothRestart
Last active September 16, 2015 19:27 — forked from ajmaradiaga/BluetoothRestart
Force Bluetooth Restart on Mac
sudo launchctl unload /System/Library/LaunchDaemons/com.apple.blued.plist
sudo launchctl load /System/Library/LaunchDaemons/com.apple.blued.plist
@rupakg
rupakg / typography.md
Last active August 29, 2015 14:21
Typography