Skip to content

Instantly share code, notes, and snippets.

View vaquarkhan's full-sized avatar
:octocat:
while( !(succeed=try())){}

Vaquar Khan vaquarkhan

:octocat:
while( !(succeed=try())){}
690 followers · 146 following
View GitHub Profile
@vaquarkhan
vaquarkhan / gist:855238c617dc790913f1a88b50754bce
Created May 28, 2024 21:27
reactjs-deshboard-trigger
import React, { useState } from 'react';
import Select from 'react-select';
import makeAnimated from 'react-select/animated';
const App = () => {
const animatedComponents = makeAnimated();
// Options for the first dropdown
const firstDropdownOptions = [
{ label: 'All', value: 'all' },
@vaquarkhan
vaquarkhan / quicksight-info-lambda
Created May 27, 2024 06:42
quicksight-info-lambda
import boto3
from botocore.exceptions import ClientError
def lambda_handler(event, context):
# Configure DynamoDB and QuickSight clients
dynamodb = boto3.resource('dynamodb')
quicksight_client = boto3.client('quicksight')
# Define table name (replace with your actual table name)
table_name = 'your_dashboard_inventory'
@vaquarkhan
vaquarkhan / _AWS Resource-Based Policy Examples.md
Created April 18, 2024 22:38 — forked from deskoh/_AWS Resource-Based Policy Examples.md
AWS Resource-based policies example

AWS Resource-Based Policy Examples

@vaquarkhan
vaquarkhan / lambda_handler.py
Created March 14, 2024 20:07 — forked from djg07/lambda_handler.py
DynamoDB Streams Lambda Handler
import json
print('Loading function')
def lambda_handler(event, context):
print('------------------------')
print(event)
#1. Iterate over each record
try:
for record in event['Records']:
@vaquarkhan
vaquarkhan / reinvent.md
Created December 4, 2023 07:55 — forked from pfeilbr/reinvent.md
link for reinvent slides
@vaquarkhan
vaquarkhan / queries.sql
Created September 26, 2023 15:21 — forked from iconara/queries.sql
Low level Redshift cheat sheet
-- Table information like sortkeys, unsorted percentage
-- see http://docs.aws.amazon.com/redshift/latest/dg/r_SVV_TABLE_INFO.html
SELECT * FROM svv_table_info;
-- Table sizes in GB
SELECT t.name, COUNT(tbl) / 1000.0 AS gb
FROM (
SELECT DISTINCT datname, id, name
FROM stv_tbl_perm
JOIN pg_database ON pg_database.oid = db_id
@vaquarkhan
vaquarkhan / CognitoAuthenticationProvider.java
Created July 30, 2023 07:44 — forked from alexramos1/CognitoAuthenticationProvider.java
Simplest possible implementation of AWS Cognito username/password authentication on Spring Security.
import java.nio.charset.StandardCharsets;
import java.util.ArrayList;
import java.util.Base64;
import java.util.HashMap;
import java.util.Map;
import javax.annotation.Nonnull;
import javax.crypto.Mac;
import javax.crypto.spec.SecretKeySpec;
@vaquarkhan
vaquarkhan / compare_two_s3_dataframes.py
Created March 2, 2023 19:07 — forked from mappingvermont/compare_two_s3_dataframes.py
Use hadoop to compare two data tables on s3, write out differences
import os
import subprocess
import sys
os.environ["SPARK_HOME"] = r"/usr/lib/spark"
# Set PYTHONPATH for Spark
for path in [r'/usr/lib/spark/python/', r'/usr/lib/spark/python/lib/py4j-src.zip']:
sys.path.append(path)
@vaquarkhan
vaquarkhan / read_write_pyspark_redshift.py
Created December 9, 2022 04:50 — forked from mlivingston40/read_write_pyspark_redshift.py
Basics set up on Read and Write with Redshift in PySpark Env
# Configuration needed of jars
%%configure
{
"conf": {
"spark.jars": "https://s3.amazonaws.com/redshift-downloads/drivers/jdbc/1.2.36.1060/RedshiftJDBC42-no-awssdk-1.2.36.1060.jar",
"spark.jars.packages": "org.apache.spark:spark-avro_2.11:2.4.2,io.github.spark-redshift-community:spark-redshift_2.11:4.0.1"
}
}
# define redshift connection info
@vaquarkhan
vaquarkhan / gist:71a72fc652296c77d836cb975e234451
Created November 22, 2022 16:58 — forked from juliensimon/gist:e17e6179b5bfa91c35ae6e2b23ae7e31
Create Athena table for GDELT
CREATE EXTERNAL TABLE IF NOT EXISTS gdelt.events (
`globaleventid` INT,`day` INT,`monthyear` INT,`year` INT,`fractiondate` FLOAT,
`actor1code` string,`actor1name` string,`actor1countrycode` string,`actor1knowngroupcode` string,
`actor1ethniccode` string,`actor1religion1code` string,`actor1religion2code` string,
`actor1type1code` string,`actor1type2code` string,`actor1type3code` string,
`actor2code` string,`actor2name` string,`actor2countrycode` string,`actor2knowngroupcode` string,
`actor2ethniccode` string,`actor2religion1code` string,`actor2religion2code` string,
`actor2type1code` string,`actor2type2code` string,`actor2type3code` string,
`isrootevent` BOOLEAN,`eventcode` string,`eventbasecode` string,`eventrootcode` string,
`quadclass` INT,`goldsteinscale` FLOAT,`nummentions` INT,`numsources` INT,`numarticles` INT,`avgtone` FLOAT,