This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import sys | |
from awsglue.transforms import * | |
from awsglue.utils import getResolvedOptions | |
from pyspark.context import SparkContext | |
from awsglue.context import GlueContext | |
from awsglue.job import Job | |
## @params: [JOB_NAME] | |
args = getResolvedOptions(sys.argv, ['JOB_NAME']) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
################ | |
# 1. Catalog of DB's | |
################ | |
EXEC sp_helpdb; | |
################ | |
# 2. Fetch file structure metadata | |
################ | |
SELECT | |
fg.name AS [File_Group_Name], |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
;USE 'Ctrl-/' TO TOGGLE 'UP' ARROW INTO 'SHIFT' KEY. | |
^/::bigShift:=!bigShift | |
#If bigShift | |
Up::RShift | |
#If | |
;REPLACE 'INSERT' AND 'DELETE' WITH 'HOME' AND 'END' KEYS. | |
Del::End | |
Insert::Home | |
;MOVE 'DELETE' KEY TO Shift-Backspace |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
tail -n 10000 train.csv > validate.csv | |
head -n -10000 train.csv > train0.csv;mv train0.csv train.csv | |
wc -l train.csv;wc -l validate.csv;wc -l test.csv |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
//This code is an algorithm for computing a "health metric" representing software architectural maintainability and testability. | |
//It could also be called a "coupling metric", as excessive coupling degrades maintainability and testability. | |
//The metric is called Cumulative Component Dependency (CCD). | |
// CCD = sum over all components C in a subsystem of the number | |
// of components needed in order to test each C incrementally. | |
//More info: | |
//https://baruzzo.wordpress.com/2009/08/22/how-testable-is-a-software-architecture/ | |
//CCD should also account for cyclical dependencies, but this current | |
//implementation does not handle cyclical dependencies. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Pause::Home | |
Insert::End | |
^t:: | |
Run, notepad.exe | |
Return | |
#s:: | |
Run, SnippingTool.exe | |
Return |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#Visual Studio already installs GIT, but the VS | |
#version is usually older and does not make available | |
#useful tools, such as "git bash". | |
choco install -y git.install | |
#choco install -y python2 | |
#choco install -y anaconda3 | |
choco install -y sql-server-management-studio | |
choco install -y vscode | |
#choco install -y visualstudio2017community | |
choco install -y docker-desktop |