Skip to content

Instantly share code, notes, and snippets.

View snigdhasjg's full-sized avatar
🏠
Working from home

Snigdhajyoti Ghosh snigdhasjg

🏠
Working from home
View GitHub Profile
@snigdhasjg
snigdhasjg / emrfs.md
Last active April 30, 2021 11:34
Getting started with EMRFS.

Getting started with EMRFS

The EMR File System (EMRFS) is an implementation of HDFS that all Amazon EMR clusters use for reading and writing regular files from Amazon EMR directly to Amazon S3.

How to access a file from S3 using EMRFS

Using Java

Coming from HDFS it is very easy to implement EMRFS. You just need to pass URI("s3://<bucket-name>") object while getting filesystem object.

package com.joe;
@snigdhasjg
snigdhasjg / keybase.md
Created July 11, 2021 15:29
keybase config

Keybase proof

I hereby claim:

  • I am snigdhasjg on github.
  • I am discotoma2 (https://keybase.io/discotoma2) on keybase.
  • I have a public key ASDnDXioUZiAyPk8rlNxG1t6Gxx-JscFUtLeyO7BTcQ8BQo

To claim this, I am signing this object:

@snigdhasjg
snigdhasjg / uom-swagger.yml
Last active February 19, 2024 08:54
Shows how discriminator can be used
openapi: 3.0.3
info:
title: Unit of measure
description: Gives ratio
version: "0.0.1"
servers:
- url: 'https://uom.com/v1'
tags:
- name: UOM
description: Unit of measure
@snigdhasjg
snigdhasjg / .gitconfig
Last active August 5, 2023 21:19
Mac setup
# ~/.gitconfig
# Note:
# [Windows users] If you are on windows, please search for the word 'windows' - and fix those lines - they seem to cause some trouble
# [General] Since some of the settings are specific to my setup (ie presence of fles), I have marked those lines with comments 'Personal' - you can go ahead and change those to your equivalents or delete them altogether
# [General] Since I use 'diff-so-fancy' as the diffing tool, it's absence on your system will cause some errors. If you are able to, I would sincerely urge you to install and use it for a much better experience. If not, please replace all such occurrences back to use 'diff'
# Note: Even though this will show up twice in `git config -l` - it will still be overridden based on the order of the includeIf lines below
[user]
email = snigdhasjg@users.noreply.github.com
@snigdhasjg
snigdhasjg / Dockerfile
Created December 9, 2023 18:28
git local server
# Use the official Ubuntu image as the base image
FROM ubuntu:22.04
# Install OpenSSH server
RUN apt update && apt install -y openssh-server git
# Create an app user with git-shell
RUN useradd -ms /bin/bash -s $(which git-shell) git
# Switch as git user