Skip to content

Instantly share code, notes, and snippets.

@keithatdv01
Created April 21, 2021 21:55
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save keithatdv01/647050d524cf51e80363272dee40910d to your computer and use it in GitHub Desktop.
Save keithatdv01/647050d524cf51e80363272dee40910d to your computer and use it in GitHub Desktop.
dv01_spark_run 1.0
Usage: scopt [options]
--job-id <value> id of job to run. Matches directory in Azure blob. `client/platform` for full pipeline. `client/platform/file` for just file
affirm/affirm
affirm_internal/affirm
affirm_platform/affirm
ag/barclays
allya_2017_1/edgar_auto
allya_2017_2/edgar_auto
allya_2017_3/edgar_auto
allya_2017_4/edgar_auto
allya_2017_5/edgar_auto
allya_2018_1/edgar_auto
allya_2018_2/edgar_auto
allya_2018_3/edgar_auto
allya_2019_1/edgar_auto
allya_2019_2/edgar_auto
allya_2019_3/edgar_auto
allya_2019_4/edgar_auto
amcar_2017_1/edgar_auto
amcar_2017_2/edgar_auto
amcar_2017_3/edgar_auto
amcar_2017_4/edgar_auto
amcar_2018_1/edgar_auto
amcar_2018_2/edgar_auto
amcar_2018_3/edgar_auto
amcar_2019_1/edgar_auto
amcar_2019_2/edgar_auto
amcar_2019_3/edgar_auto
amcar_2020_1/edgar_auto
amcar_2020_2/edgar_auto
amcar_2020_3/edgar_auto
arct_2017_1/lending_club
arct_2017_1_backfill/lending_club
arrw_2018_1/wamco
arrw_2019_1/wamco
arrw_2019_2/wamco
arrw_2019_3/wamco
arrw_2020_1/wamco
avant/avant
avant_unfiltered/avant
avnt_2016_a/avant
avnt_2016_b/avant
avnt_2016_c/avant
avnt_2017_a/avant
avnt_2017_b/avant
avnt_2018_a/avant
avnt_2018_b/avant
avnt_2019_a/avant
avnt_2019_b/avant
avnt_2020_rev1/avant
axonic/shellpoint
bhld_2019_1/bhld
bhld_2019_2/bhld
bhld_2019_3/bhld
bhld_2020_1/bhld
bmwot_2018_a/edgar_auto
bmwot_2019_a/edgar_auto
bmwot_2020_a/edgar_auto
bond_street/bond_street
bpti_2018_1/upstart
bpti_2018_2/upstart
bpti_2018_3/upstart
bpti_2018_4/upstart
bpti_2018_5/upstart
bpti_2018_6/upstart
bpti_2019_1/upstart
bpti_2019_10/upstart
bpti_2019_11/upstart
bpti_2019_12/upstart
bpti_2019_2/upstart
bpti_2019_3/upstart
bpti_2019_4/upstart
bpti_2019_5/upstart
bpti_2019_6/upstart
bpti_2019_7/upstart
bpti_2019_8/upstart
bpti_2019_9/upstart
bpti_2020_1/upstart
carmx_2017_1/edgar_auto
carmx_2017_2/edgar_auto
carmx_2017_3/edgar_auto
carmx_2017_4/edgar_auto
carmx_2018_1/edgar_auto
carmx_2018_2/edgar_auto
carmx_2018_3/edgar_auto
carmx_2018_4/edgar_auto
carmx_2019_1/edgar_auto
carmx_2019_2/edgar_auto
carmx_2019_3/edgar_auto
carmx_2019_4/edgar_auto
carmx_2020_1/edgar_auto
carmx_2020_2/edgar_auto
carmx_2020_3/edgar_auto
carmx_2020_4/edgar_auto
cas_2013_c01/cas
cas_2014_c01/cas
cas_2014_c021/cas
cas_2014_c022/cas
cas_2014_c031/cas
cas_2014_c032/cas
cas_2014_c041/cas
cas_2014_c042/cas
cas_2015_c011/cas
cas_2015_c012/cas
cas_2015_c021/cas
cas_2015_c022/cas
cas_2015_c031/cas
cas_2015_c032/cas
cas_2015_c041/cas
cas_2015_c042/cas
cas_2016_c011/cas
cas_2016_c012/cas
cas_2016_c02/cas
cas_2016_c031/cas
cas_2016_c032/cas
cas_2016_c04/cas
cas_2016_c05/cas
cas_2016_c06/cas
cas_2016_c07/cas
cas_2017_c01/cas
cas_2017_c02/cas
cas_2017_c03/cas
cas_2017_c04/cas
cas_2017_c05/cas
cas_2017_c061/cas
cas_2017_c062/cas
cas_2017_c071/cas
cas_2017_c072/cas
cas_2018_c01/cas
cas_2018_c02/cas
cas_2018_c03/cas
cas_2018_c04/cas
cas_2018_c05/cas
cas_2018_c061/cas
cas_2018_c062/cas
cas_2018_r07/cas
cas_2019_r01/cas
cas_2019_r02/cas
cas_2019_r03/cas
cas_2019_r04/cas
cas_2019_r05/cas
cas_2019_r06/cas
cas_2019_r07/cas
cas_2020_r01/cas
cas_2020_r02/cas
cbslt_2017_a/commonbond
cbslt_2017_b/commonbond
cbslt_2018_a/commonbond
cbslt_2018_b/commonbond
cbslt_2018_c/commonbond
cbslt_2019_a/commonbond
cbslt_2020_1/commonbond
cbslt_2020_a/commonbond
cbslt_2021_a/commonbond
citadel/citadel
citadel_masked_platform/citadel
clrt_2019_a/lending_club
clrt_2019_a_backfill/lending_club
club_2017_np1/lending_club
club_2017_np1_backfill/lending_club
club_2017_np2/lending_club
club_2017_np2_backfill/lending_club
club_2017_p1/lending_club
club_2017_p1_backfill/lending_club
club_2017_p2/lending_club
club_2017_p2_backfill/lending_club
club_2018_np1/lending_club
club_2018_np1_backfill/lending_club
club_2018_p1/lending_club
club_2018_p1_backfill/lending_club
club_2018_p2/lending_club
club_2018_p2_backfill/lending_club
club_2018_p3/lending_club
club_2018_p3_backfill/lending_club
club_2019_hp1/lending_club
club_2019_p1/lending_club
club_2019_p2/lending_club
club_2020_p1/lending_club
clubc_2017_1/lending_club
clubc_2017_2/lending_club
clubc_2017_2_backfill/lending_club
clubc_2018_1/lending_club
clubc_2018_10/lending_club
clubc_2018_10_backfill/lending_club
clubc_2018_11/lending_club
clubc_2018_12/lending_club
clubc_2018_12_backfill/lending_club
clubc_2018_13/lending_club
clubc_2018_13_backfill/lending_club
clubc_2018_14/lending_club
clubc_2018_14_backfill/lending_club
clubc_2018_15/lending_club
clubc_2018_15_backfill/lending_club
clubc_2018_16/lending_club
clubc_2018_16_backfill/lending_club
clubc_2018_17/lending_club
clubc_2018_17_backfill/lending_club
clubc_2018_18/lending_club
clubc_2018_18_backfill/lending_club
clubc_2018_19/lending_club
clubc_2018_19_backfill/lending_club
clubc_2018_2/lending_club
clubc_2018_20/lending_club
clubc_2018_20_backfill/lending_club
clubc_2018_21/lending_club
clubc_2018_22/lending_club
clubc_2018_23/lending_club
clubc_2018_24/lending_club
clubc_2018_25/lending_club
clubc_2018_26/lending_club
clubc_2018_27/lending_club
clubc_2018_28/lending_club
clubc_2018_29/lending_club
clubc_2018_2_backfill/lending_club
clubc_2018_3/lending_club
clubc_2018_30/lending_club
clubc_2018_31/lending_club
clubc_2018_32/lending_club
clubc_2018_33/lending_club
clubc_2018_34/lending_club
clubc_2018_3_backfill/lending_club
clubc_2018_4/lending_club
clubc_2018_4_backfill/lending_club
clubc_2018_5/lending_club
clubc_2018_5_backfill/lending_club
clubc_2018_6/lending_club
clubc_2018_6_backfill/lending_club
clubc_2018_7/lending_club
clubc_2018_7_backfill/lending_club
clubc_2018_8/lending_club
clubc_2018_8_backfill/lending_club
clubc_2018_9/lending_club
clubc_2018_9_backfill/lending_club
clubc_2019_1/lending_club
clubc_2019_10/lending_club
clubc_2019_11/lending_club
clubc_2019_12/lending_club
clubc_2019_13/lending_club
clubc_2019_14/lending_club
clubc_2019_15/lending_club
clubc_2019_16/lending_club
clubc_2019_17/lending_club
clubc_2019_18/lending_club
clubc_2019_19/lending_club
clubc_2019_2/lending_club
clubc_2019_20/lending_club
clubc_2019_21/lending_club
clubc_2019_22/lending_club
clubc_2019_23/lending_club
clubc_2019_24/lending_club
clubc_2019_25/lending_club
clubc_2019_26/lending_club
clubc_2019_27/lending_club
clubc_2019_28/lending_club
clubc_2019_29/lending_club
clubc_2019_3/lending_club
clubc_2019_30/lending_club
clubc_2019_31/lending_club
clubc_2019_32/lending_club
clubc_2019_33/lending_club
clubc_2019_34/lending_club
clubc_2019_35/lending_club
clubc_2019_36/lending_club
clubc_2019_37/lending_club
clubc_2019_38/lending_club
clubc_2019_39/lending_club
clubc_2019_4/lending_club
clubc_2019_40/lending_club
clubc_2019_41/lending_club
clubc_2019_42/lending_club
clubc_2019_43/lending_club
clubc_2019_44/lending_club
clubc_2019_45/lending_club
clubc_2019_46/lending_club
clubc_2019_47/lending_club
clubc_2019_48/lending_club
clubc_2019_49/lending_club
clubc_2019_5/lending_club
clubc_2019_50/lending_club
clubc_2019_51/lending_club
clubc_2019_52/lending_club
clubc_2019_53/lending_club
clubc_2019_54/lending_club
clubc_2019_6/lending_club
clubc_2019_7/lending_club
clubc_2019_8/lending_club
clubc_2019_9/lending_club
clubc_2019_slct1/lending_club
clubc_2019_slct2/lending_club
clubc_2019_slct3/lending_club
clubc_2019_slct4/lending_club
clubc_2019_slct5/lending_club
clubc_2019_slct6/lending_club
clubc_2019_slct7/lending_club
clubc_2019_slct8/lending_club
clubc_2020_1/lending_club
clubc_2020_2/lending_club
clubc_2020_3/lending_club
clubc_2020_4/lending_club
clubc_2020_5/lending_club
clubc_2020_6/lending_club
clubc_2020_7/lending_club
clubc_2020_8/lending_club
clubc_2020_9/lending_club
clubc_2020_slct1/lending_club
clubc_hypo_a36/lending_club
clubc_hypo_a60/lending_club
clubc_hypo_b36/lending_club
clubc_hypo_b60/lending_club
clubc_hypo_c36/lending_club
clubc_hypo_c60/lending_club
clubc_hypo_d36/lending_club
clubc_hypo_d60/lending_club
clubc_hypo_n/lending_club
cmlti_2012_a/cmlti
cmlti_2013_a/cmlti
cmlti_2013_j1/cmlti
cmlti_2014_a/cmlti
cmlti_2014_c/cmlti
cmlti_2014_j1/cmlti
cmlti_2014_j2/cmlti
cmlti_2015_a/cmlti
cmlti_2015_ps1/cmlti
cmlti_2015_rp2/cmlti
cmlti_2017_rp1/cmlti
cmlti_2017_rp2/cmlti
cmlti_2018_a/cmlti
cmlti_2018_b/cmlti
cmlti_2018_c/cmlti
cmlti_2018_rp1/cmlti
cmlti_2018_rp2/cmlti
cmlti_2018_rp3/cmlti
cmlti_2019_a/cmlti
cmlti_2019_b/cmlti
cmlti_2019_c/cmlti
cmlti_2019_d/cmlti
cmlti_2019_e/cmlti
cmlti_2019_imc1/cmlti
cmlti_2019_rp1/cmlti
cmlti_2020_exp1/cmlti
cmlti_2020_exp2/cmlti
cmlti_2021_jl1/cmlti
commerce/dv01
commonbond/commonbond
commonbond_base/commonbond
commonbond_platform/commonbond
commonbond_prepayment/commonbond
consortium_unsecuritized/prosper
copar_2019_1/edgar_auto
copar_2019_2/edgar_auto
copar_2020_1/edgar_auto
crart_2017_1/edgar_auto
crart_2018_1/edgar_auto
crt_benchmark/dv01
crvna_2020_p1/edgar_auto
csmc_2017_2/dk
csmc_2017_rpl2/csmc
csmc_2018_rpl2/csmc
csmc_2019_jr1/dk
csmc_2019_jr11/csmc
csmc_2019_jr12/csmc
csmc_2019_nqm1/csmc
csmc_2020_afc1/csmc
csmc_2020_nqm1/csmc
csmc_2020_spt1/csmc
csmc_2021_nqm1/csmc
ctdl_2020_1/citadel
dart_2017_1/edgar_auto
dart_2017_2/edgar_auto
dart_2017_3/edgar_auto
dart_2018_1/edgar_auto
dart_2018_2/edgar_auto
dart_2018_3/edgar_auto
dart_2018_4/edgar_auto
dart_2018_5/edgar_auto
dart_2019_1/edgar_auto
dart_2019_2/edgar_auto
dart_2019_3/edgar_auto
dart_2019_4/edgar_auto
dart_2020_1/edgar_auto
dart_2020_2/edgar_auto
db_repo/sofi
db_repo_without_backfill/sofi
demo_mortgage/oaktree
drive_2017_1/edgar_auto
drive_2017_2/edgar_auto
drive_2017_3/edgar_auto
drive_2018_1/edgar_auto
drive_2018_2/edgar_auto
drive_2018_3/edgar_auto
drive_2018_4/edgar_auto
drive_2018_5/edgar_auto
drive_2019_1/edgar_auto
drive_2019_2/edgar_auto
drive_2019_3/edgar_auto
drive_2019_4/edgar_auto
drive_2020_1/edgar_auto
drive_2020_2/edgar_auto
eagle/avant
eagle/lending_club
eagle/marlette
eagle/prosper
eagle/upstart
early_look/redwood
eart_2020_3/edgar_auto
eart_2021_1/edgar_auto
enova/enova
enova_clients/enova
enva_2018_a/enova
enva_2019_a/enova
exigent/marlette
experian/experian
fannie/fannie
fannie_mae/fannie_mae
fcuk/fcuk
fcuk_portfolio/fcuk
fcus/fcus
fcus_monthly/fcus
fcus_portfolio/fcus
figure/figure
figure_platform/figure
figure_platform_backfill/figure
fitat_2017_1/edgar_auto
fitat_2019_1/edgar_auto
floc_2020_1/figure
fordo_2017_a/edgar_auto
fordo_2017_b/edgar_auto
fordo_2017_c/edgar_auto
fordo_2018_a/edgar_auto
fordo_2018_b/edgar_auto
fordo_2019_a/edgar_auto
fordo_2019_b/edgar_auto
fordo_2019_c/edgar_auto
fordo_2020_a/edgar_auto
fordo_2020_b/edgar_auto
fordo_2020_c/edgar_auto
fortress/prosper
franklin_templeton/upgrade
freddie/freddie
freed_2018_1/freedom_financial
freed_2018_2/freedom_financial
freed_2019_1/freedom_financial
freed_2019_2/freedom_financial
freed_2020_2cp/freedom_financial
freed_2020_3fp/freedom_financial
freed_2020_fp1/freedom_financial
freed_2021_1cp/freedom_financial
freedom_financial/freedom_financial
freedom_financial_cp/freedom_financial
freedom_financial_cp_portfolio/freedom_financial
freedom_financial_portfolio/freedom_financial
gcat_2019_nqm1/gcat
gcat_2019_nqm2/gcat
gcat_2019_nqm3/gcat
gcat_2020_nqm1/gcat
gcat_2020_nqm2/gcat
gcat_2021_nqm1/gcat
gmcar_2018_1/edgar_auto
gmcar_2018_2/edgar_auto
gmcar_2018_3/edgar_auto
gmcar_2018_4/edgar_auto
gmcar_2019_1/edgar_auto
gmcar_2019_2/edgar_auto
gmcar_2019_3/edgar_auto
gmcar_2019_4/edgar_auto
gmcar_2020_1/edgar_auto
gmcar_2020_2/edgar_auto
gmcar_2020_3/edgar_auto
gmcar_2020_4/edgar_auto
gmcar_2021_1/edgar_auto
gmcar_2021_2/edgar_auto
goldentree/commonbond
goldentree/gtsc
grade_2020_fig1/figure
gsmbs_2019_pj1/gsmbs
gsmbs_2019_pj2/gsmbs
gsmbs_2019_pj3/gsmbs
gsmbs_2019_sl1/dk
gsmbs_2019_sl1/gsmbs
gsmbs_2020_inv1/gsmbs
gsmbs_2020_nqm1/gsmbs
gsmbs_2020_pj1/gsmbs
gsmbs_2020_pj2/gsmbs
gsmbs_2020_pj3/gsmbs
gsmbs_2020_pj4/gsmbs
gsmbs_2020_pj5/gsmbs
gsmbs_2020_pj6/gsmbs
gsmbs_2021_pj1/gsmbs
gsmbs_2021_pj2/gsmbs
gsmbs_2021_pj3/gsmbs
gso/lending_club
harot_2017_1/edgar_auto
harot_2017_2/edgar_auto
harot_2017_3/edgar_auto
harot_2017_4/edgar_auto
harot_2018_1/edgar_auto
harot_2018_2/edgar_auto
harot_2018_3/edgar_auto
harot_2018_4/edgar_auto
harot_2019_1/edgar_auto
harot_2019_2/edgar_auto
harot_2019_3/edgar_auto
harot_2019_4/edgar_auto
harot_2020_1/edgar_auto
harot_2020_2/edgar_auto
harot_2020_3/edgar_auto
harot_2021_1/edgar_auto
hart_2017_a/edgar_auto
hart_2017_b/edgar_auto
hart_2018_a/edgar_auto
hart_2018_b/edgar_auto
hart_2019_a/edgar_auto
hart_2019_b/edgar_auto
hart_2020_a/edgar_auto
hart_2020_b/edgar_auto
hart_2020_c/edgar_auto
hedging_feed/redwood
hof_2020_2/hof
ibi/lending_club
ibi/prosper
ibi/upgrade
ibi/upstart
ibi_backfill/lending_club
jefferies/avant
jefferies/bond_street
jefferies/lending_club
jefferies/prosper
jefferies/upgrade
jefferies_backfill/lending_club
jpmmt_2020_2/jpmmt
jpmmt_2020_3/jpmmt
jpmmt_2020_4/jpmmt
jpmmt_2020_5/jpmmt
jpmmt_2020_7/jpmmt
jpmmt_2020_8/jpmmt
jpmmt_2020_inv1/jpmmt
jpmmt_2020_inv2/jpmmt
jpmmt_2020_ltv2/jpmmt
jpmmt_2021_1/jpmmt
jpmmt_2021_3/jpmmt
jpmmt_2021_4/jpmmt
l_cert_c36/lending_club
l_cert_c60/lending_club
l_cert_d36/lending_club
l_cert_d60/lending_club
l_cert_hypon/lending_club
lc_all/lending_club
lc_all_sec/lending_club
lc_certs_aggregated/lending_club
lc_pool_sale_citi_ac_july20/lending_club
lc_pool_sale_macquarie_ac_july20/lending_club
lc_q1_prime_scale_pool/lending_club
lc_warehouse_backfill/lending_club
lc_warehouse_ii_backfill/lending_club
lcit_2016_np1/lending_club
lcit_2016_np1_backfill/lending_club
lcit_2016_np2/lending_club
lcit_2016_np2_backfill/lending_club
lcrt_2019_1/lending_club
lcrt_2019_10/lending_club
lcrt_2019_11/lending_club
lcrt_2019_2/lending_club
lcrt_2019_3/lending_club
lcrt_2019_4/lending_club
lcrt_2019_5/lending_club
lcrt_2019_6/lending_club
lcrt_2019_7/lending_club
lcrt_2019_8/lending_club
lcrt_2019_9/lending_club
lcrt_2020_1/lending_club
lcrt_2020_2/lending_club
lcrt_2020_3/lending_club
lcrt_2020_4/lending_club
lcrt_2020_5/lending_club
lcrt_2020_6/lending_club
lcrt_2020_jpmsl1/lending_club
lcrt_2020_t1/lending_club
lending_club/lending_club
lending_club/lending_club_near_prime
lending_club/lending_club_super_prime
lending_club_daily_securitizations/dv01
lending_club_prop_backfill/lending_club
lmat_2018_gs1/lmat
lmat_2018_gs2/lmat
lmat_2018_gs3/lmat
lmat_2018_sl1/dk
lmat_2019_gs1/lmat
lmat_2019_gs2/lmat
lmat_2019_gs3/lmat
lmat_2019_gs4/lmat
lmat_2019_gs5/lmat
lmat_2019_gs6/lmat
lmat_2019_gs7/lmat
lmat_2019_sl1/dk
lmat_2019_sl3/dk
lmat_2019_sl3/lmat
lmat_2020_gs1/lmat
lmat_2020_gs2/lmat
lmat_2020_gs3/lmat
lmat_2020_gs4/lmat
lmat_2020_gs5/lmat
lmat_2020_sl1/lmat
lmat_2021_gs1/lmat
lmat_2021_sl1/lmat
macquarie/lending_club
magnetar/marlette
mapt_2019_09a/marlette
mapt_2019_09a_pt/marlette
mapt_2019_11a/marlette
mapt_2019_11a_pt/marlette
mapt_2019_12a/marlette
mapt_2019_12a_pt/marlette
mapt_2020_01a/marlette
mapt_2020_01a_pt/marlette
mapt_2020_05a/marlette
mapt_2020_07a/marlette
mapt_2020_10a/marlette
marlette/marlette
marlette_daily/marlette
marlette_daily_securitizations/dv01
mbart_2018_1/edgar_auto
mbart_2019_1/edgar_auto
mbart_2020_1/edgar_auto
mcmlt_2021_nmr1/mcmlt
metabank_cp/freedom_financial
mfa/barclays
mfa_2020_nqm1/mfa
mfa_2020_nqm3/mfa
mfa_2021_inv1/mfa
mfa_2021_nqm1/mfa
mft_2016_1/marlette
mft_2017_1/marlette
mft_2017_2/marlette
mft_2017_3/marlette
mft_2018_1/marlette
mft_2018_2/marlette
mft_2018_3/marlette
mft_2018_4/marlette
mft_2019_1/marlette
mft_2019_2/marlette
mft_2019_3/marlette
mft_2019_4/marlette
mft_2020_1/marlette
mft_2020_2/marlette
mhmt_2016_lc1/lending_club
mhmt_2016_lc1_backfill/lending_club
morgan_stanley/fcus
morgan_stanley/lending_club
morgan_stanley/prosper
morgan_stanley/sofi
morgan_stanley/upstart
morgan_stanley_without_backfill/sofi
mpl_benchmark/dv01
mpl_securitization_benchmark/dv01
mplt_2015_av1/avant
mplt_2015_av2/avant
mplt_2015_cb1/circleback
mplt_2015_cb2/circleback
mplt_2016_bs1/bond_street
mplt_2016_cb1/circleback
mplt_2017_bs1/bond_street
msim/marlette
msim/square
msrm_2020_1/msrm
msrm_2020_rpl1/msrm
msrm_2021_1/msrm
napier/upgrade
narot_2017_a/edgar_auto
narot_2017_b/edgar_auto
narot_2017_c/edgar_auto
narot_2018_a/edgar_auto
narot_2018_b/edgar_auto
narot_2018_c/edgar_auto
narot_2019_a/edgar_auto
narot_2019_b/edgar_auto
narot_2019_c/edgar_auto
narot_2020_a/edgar_auto
narot_2020_b/edgar_auto
neuberger_berman/lending_club
neuberger_berman_backfill/lending_club
nqm_demo_portfolio/dv01
nqm_market_surveillance/dv01
nrpl_2018_2/nrpl
nrpl_2019_2/nrpl
nrpl_2019_3/nrpl
nrpl_2020_1/nrpl
nrz/shellpoint
nrz_pool1/figure
nrz_pool2/figure
nrzt_2014_3/nrzt
nrzt_2015_1/nrzt
nrzt_2015_2/nrzt
nrzt_2016_1/nrzt
nrzt_2016_2/nrzt
nrzt_2016_3/nrzt
nrzt_2016_4/nrzt
nrzt_2017_1/nrzt
nrzt_2017_2/nrzt
nrzt_2017_3/nrzt
nrzt_2017_4/nrzt
nrzt_2017_5/nrzt
nrzt_2017_6/nrzt
nrzt_2018_1/nrzt
nrzt_2018_2/nrzt
nrzt_2018_3/nrzt
nrzt_2018_4/nrzt
nrzt_2018_5/nrzt
nrzt_2018_nqm1/nrzt
nrzt_2019_1/nrzt
nrzt_2019_2/nrzt
nrzt_2019_3/nrzt
nrzt_2019_4/nrzt
nrzt_2019_5/nrzt
nrzt_2019_6/nrzt
nrzt_2019_nqm1/nrzt
nrzt_2019_nqm2/nrzt
nrzt_2019_nqm3/nrzt
nrzt_2019_nqm4/nrzt
nrzt_2019_nqm5/nrzt
nrzt_2019_rpl1/nrzt
nrzt_2019_rpl2/nrzt
nrzt_2019_rpl3/nrzt
nrzt_2020_1/nrzt
nrzt_2020_2/nrzt
nrzt_2020_nqm1/nrzt
nrzt_2020_nqm2/nrzt
nrzt_2020_rpl1/nrzt
nrzt_2020_rpl2/nrzt
nrzt_2021_nqm1r/nrzt
oaktree/barclays
oaktree/oaktree
oceanbeach_2020_1_pool/lending_club
oconnor/marlette
omega/upgrade
petal/petal
pimco/avant
pimco/barclays
pimco/lending_club
pimco/marlette
pimco/pimco
pimco_backfill/lending_club
pimco_certs/lending_club
pimco_certs_sold/lending_club
pimco_ii/avant
pmit_2017_1/prosper
pmit_2017_2/prosper
pmit_2017_3/prosper
pmit_2018_1/prosper
pmit_2018_2/prosper
pmit_2019_1/prosper
pmit_2019_2/prosper
pmit_2019_3/prosper
pmit_2019_4/prosper
pptti_2018_1/prosper
pptti_2018_2/prosper
pptti_2019_1/prosper
pptti_2019_2/prosper
pptti_2019_3/prosper
pptti_2019_4/prosper
pptti_2019_5/prosper
pptti_2019_6/prosper
pptti_2020_1/prosper
pptti_2020_2/prosper
pptti_2021_1/prosper
pptti_2021_2/prosper
ppttii_2018_1/prosper
ppttii_2019_1/prosper
ppttii_2019_2/prosper
ppttii_2019_3/prosper
ppttii_2019_4/prosper
ppttii_2019_5/prosper
ppttii_2019_6/prosper
ppttii_2019_7/prosper
ppttii_2019_8/prosper
ppttii_2019_9/prosper
ppttii_2019_st1/prosper
ppttii_2019_st2/prosper
ppttii_2020_1/prosper
ppttii_2020_2/prosper
ppttiii_2020_pt1/prosper
ppttiii_2020_pt2/prosper
ppttiii_2020_pt3/prosper
pragmic/pragmic
prime_auto_benchmark/dv01
prosper/prosper
prosper_consortium/prosper
prosper_consortium_eligible/prosper
prosper_daily_securitizations/dv01
prosper_warehouse/prosper
prosper_warehouse_ii/prosper
quorum_pool/figure
redwood/cenlar
redwood/shellpoint
regions/sofi
regions_without_backfill/sofi
remit_2015_1qa2a/wamco
remit_2015_1qr2a/wamco
remit_2017_brc1/wamco
remit_2017_brq1/wamco
remit_2018_rna/wamco
remit_2018_rnr/wamco
rpl_demo_portfolio/dv01
sat_2019_a/sofi_sl
sat_2019_c/sofi_sl
sat_2019_e/sofi_sl
sat_2020_a/sofi_sl
sat_2021_a/sofi_sl
sat_2021_b/sofi_sl
sbiz_2019_a/fcus
sbiz_2020_a/fcus
sclp_2015_1/sofi
sclp_2016_1/sofi
sclp_2016_2/sofi
sclp_2016_3/sofi
sclp_2016_4/sofi
sclp_2016_5/sofi
sclp_2017_1/sofi
sclp_2017_2/sofi
sclp_2017_3/sofi
sclp_2017_4/sofi
sclp_2017_5/sofi
sclp_2017_6/sofi
sclp_2018_1/sofi
sclp_2018_2/sofi
sclp_2018_3/sofi
sclp_2018_4/sofi
sclp_2019_1/sofi
sclp_2019_2/sofi
sclp_2019_3/sofi
sclp_2019_4/sofi
sclp_2020_1/sofi
scrf/fcuk
scrf/fcus
sdart_2017_1/edgar_auto
sdart_2017_2/edgar_auto
sdart_2017_3/edgar_auto
sdart_2018_1/edgar_auto
sdart_2018_2/edgar_auto
sdart_2018_3/edgar_auto
sdart_2018_4/edgar_auto
sdart_2018_5/edgar_auto
sdart_2019_1/edgar_auto
sdart_2019_2/edgar_auto
sdart_2019_3/edgar_auto
sdart_2020_1/edgar_auto
sdart_2020_2/edgar_auto
sdart_2020_3/edgar_auto
sdart_2020_4/edgar_auto
sdart_2021_1/edgar_auto
semt_2013_1/redwood
semt_2013_10/redwood
semt_2013_11/redwood
semt_2013_12/redwood
semt_2013_2/redwood
semt_2013_3/redwood
semt_2013_3_portfolio/redwood
semt_2013_4/redwood
semt_2013_5/redwood
semt_2013_6/redwood
semt_2013_7/redwood
semt_2013_8/redwood
semt_2013_9/redwood
semt_2014_1/redwood
semt_2014_2/redwood
semt_2014_3/redwood
semt_2014_4/redwood
semt_2015_1/redwood
semt_2015_2/redwood
semt_2015_3/redwood
semt_2015_4/redwood
semt_2016_1/redwood
semt_2016_2/redwood
semt_2016_3/redwood
semt_2017_1/redwood
semt_2017_2/redwood
semt_2017_3/redwood
semt_2017_4/redwood
semt_2017_5/redwood
semt_2017_6/redwood
semt_2017_7/redwood
semt_2017_ch1/redwood
semt_2017_ch2/redwood
semt_2018_1/redwood
semt_2018_2/redwood
semt_2018_3/redwood
semt_2018_4/redwood
semt_2018_5/redwood
semt_2018_6/redwood
semt_2018_7/redwood
semt_2018_8/redwood
semt_2018_ch1/redwood
semt_2018_ch1_portfolio/redwood
semt_2018_ch2/redwood
semt_2018_ch2_portfolio/redwood
semt_2018_ch3/redwood
semt_2018_ch3_portfolio/redwood
semt_2018_ch4/redwood
semt_2018_ch4_portfolio/redwood
semt_2019_1/redwood
semt_2019_2/redwood
semt_2019_3/redwood
semt_2019_4/redwood
semt_2019_5/redwood
semt_2019_ch1/redwood
semt_2019_ch2/redwood
semt_2019_ch3/redwood
semt_2020_1/redwood
semt_2020_2/redwood
semt_2020_3/redwood
semt_2020_4/redwood
semt_2020_5/redwood
semt_2020_mc1/redwood
semt_2021_1/redwood
semt_2021_2/redwood
shared_securitization/freedom_financial
slc_2018_1/dk
sofi/sofi
sofi_2014_a/sofi_sl
sofi_2014_b/sofi_sl
sofi_2015_a/sofi_sl
sofi_2015_b/sofi_sl
sofi_2015_c/sofi_sl
sofi_2015_d/sofi_sl
sofi_2016_a/sofi_sl
sofi_2016_b/sofi_sl
sofi_2016_c/sofi_sl
sofi_2016_d/sofi_sl
sofi_2016_e/sofi_sl
sofi_2016_f/sofi_sl
sofi_2017_a/sofi_sl
sofi_2017_b/sofi_sl
sofi_2017_c/sofi_sl
sofi_2017_d/sofi_sl
sofi_2017_e/sofi_sl
sofi_2017_f/sofi_sl
sofi_2018_a/sofi_sl
sofi_2018_b/sofi_sl
sofi_2018_c/sofi_sl
sofi_2018_d/sofi_sl
sofi_2019_a/sofi_sl
sofi_2019_b/sofi_sl
sofi_2019_c/sofi_sl
sofi_2020_a/sofi_sl
sofi_2020_b/sofi_sl
sofi_2020_c/sofi_sl
sofi_daily/sofi
sofi_daily_securitizations/dv01
sofi_latest/sofi
sofi_new_filter/sofi
sofi_platform_filtered/sofi
sofi_sl_platform/sofi_sl
soros/eresi
soros/lending_club
soros/marlette
soros/prosper
soros_fractional/lending_club
stacr_2013_dn1/stacr
stacr_2013_dn2/stacr
stacr_2014_dn1/stacr
stacr_2014_dn2/stacr
stacr_2014_dn3/stacr
stacr_2014_dn4/stacr
stacr_2014_hq1/stacr
stacr_2014_hq2/stacr
stacr_2014_hq3/stacr
stacr_2015_dn1/stacr
stacr_2015_dna1/stacr
stacr_2015_dna2/stacr
stacr_2015_dna3/stacr
stacr_2015_hq1/stacr
stacr_2015_hq2/stacr
stacr_2015_hqa1/stacr
stacr_2015_hqa2/stacr
stacr_2016_dna1/stacr
stacr_2016_dna2/stacr
stacr_2016_dna3/stacr
stacr_2016_dna4/stacr
stacr_2016_hqa1/stacr
stacr_2016_hqa2/stacr
stacr_2016_hqa3/stacr
stacr_2016_hqa4/stacr
stacr_2017_dna1/stacr
stacr_2017_dna2/stacr
stacr_2017_dna3/stacr
stacr_2017_hqa1/stacr
stacr_2017_hqa2/stacr
stacr_2017_hqa3/stacr
stacr_2017_hrp1/stacr
stacr_2018_dna1/stacr
stacr_2018_dna2/stacr
stacr_2018_dna3/stacr
stacr_2018_hqa1/stacr
stacr_2018_hqa2/stacr
stacr_2019_dna1/stacr
stacr_2019_dna2/stacr
stacr_2019_dna3/stacr
stacr_2019_dna4/stacr
stacr_2019_hqa1/stacr
stacr_2019_hqa2/stacr
stacr_2019_hqa3/stacr
stacr_2019_hqa4/stacr
stacr_2020_dna1/stacr
stacr_2020_dna2/stacr
stacr_2020_dna3/stacr
stacr_2020_dna4/stacr
stacr_2020_dna5/stacr
stacr_2020_dna6/stacr
stacr_2020_hqa1/stacr
stacr_2020_hqa2/stacr
stacr_2020_hqa3/stacr
stacr_2020_hqa4/stacr
stacr_2020_hqa5/stacr
stacr_2021_dna1/stacr
stacr_2021_dna2/stacr
stacr_2021_hqa1/stacr
stone_ridge_lending_club/dv01
stone_ridge_lending_club_near_prime/dv01
stone_ridge_sofi/dv01
structured_pass_through/upgrade
subprime_auto_benchmark/dv01
taot_2017_a/edgar_auto
taot_2017_b/edgar_auto
taot_2017_c/edgar_auto
taot_2017_d/edgar_auto
taot_2018_a/edgar_auto
taot_2018_b/edgar_auto
taot_2018_c/edgar_auto
taot_2018_d/edgar_auto
taot_2019_a/edgar_auto
taot_2019_b/edgar_auto
taot_2019_c/edgar_auto
taot_2019_d/edgar_auto
taot_2020_a/edgar_auto
taot_2020_b/edgar_auto
taot_2020_c/edgar_auto
taot_2020_d/edgar_auto
taot_2021_a/edgar_auto
test/test
theorem/lending_club
theorem/marlette
theorem/prosper
theorem_first_look/upgrade
theorem_main_fund/upstart
theorem_main_fund_trust/upstart
theorem_prime_plus/upstart
theorem_prime_plus_trust/upstart
theorem_prime_plus_trust_iii/upstart
theorem_turn_down/upgrade
third_point/upgrade
thrm_2020_1/lending_club
uati_2020_1_gs/upstart
uati_2020_2_gs/upstart
uati_2020_3_gs/upstart
uati_2020_4_gs/upstart
ucl_2018_1/upgrade
umcpt_2020_st1/upgrade
umcpt_2021_st1/upgrade
umcpt_2021_st2/upgrade
umpt_2019_pt1/upgrade
umpt_2019_pt2/upgrade
umpt_2019_st1/upgrade
umpt_2019_st2/upgrade
umpt_2019_st3/upgrade
umpt_2019_st4/upgrade
umpt_2019_st5/upgrade
umpt_2019_st6/upgrade
umpt_2020_st1/upgrade
umpt_2020_st2/upgrade
umpt_2020_st3/upgrade
umpt_2021_pt1/upgrade
umpt_2021_pt2/upgrade
upgr_2018_1/upgrade
upgr_2019_1/upgrade
upgr_2019_2/upgrade
upgrade/upgrade
upgrade_daily_securitizations/dv01
upgrade_filtered_monthly/upgrade
upgrade_pcl/upgrade
upgrade_unfiltered_monthly/upgrade
upspt_2020_st1/upstart
upspt_2020_st2/upstart
upspt_2020_st3/upstart
upspt_2020_st4/upstart
upspt_2020_st5/upstart
upspt_2020_st6/upstart
upspt_2021_st1/upstart
upspt_2021_st2/upstart
upspt_2021_st3/upstart
upst_2017_1/upstart
upst_2017_2/upstart
upst_2018_1/upstart
upst_2018_2/upstart
upst_2019_1/upstart
upst_2019_2/upstart
upst_2019_3/upstart
upst_2020_1/upstart
upst_2020_2/upstart
upst_2020_3/upstart
upst_2021_1/upstart
upstart/upstart
upstart_non_fw/upstart
upstart_warehouse/upstart
upti_2017_1/upgrade
upti_2018_1/upgrade
upti_2018_2/upgrade
upti_2018_3/upgrade
upti_2018_4/upgrade
upti_2018_5/upgrade
upti_2018_6/upgrade
upti_2018_7/upgrade
uptii_2018_1/upgrade
uptii_2018_2/upgrade
uptii_2018_3/upgrade
uptii_2018_4/upgrade
uptii_2018_5/upgrade
uptii_2018_6/upgrade
uptii_2018_7/upgrade
uptii_2018_8/upgrade
uptii_2018_9/upgrade
uptii_2019_1/upgrade
uptii_2019_2/upgrade
uptii_2019_3/upgrade
uptii_2019_4/upgrade
uptii_2021_1/upgrade
uptiii_2018_1/upgrade
usaa_2017_1/edgar_auto
usaa_2019_1/edgar_auto
valet_2018_1/edgar_auto
valet_2018_2/edgar_auto
valet_2020_1/edgar_auto
velocity/barclays
vfn/upgrade
vfn_ii/upgrade
vrst_2019_1_portfolio/vrst
vrst_2019_2_portfolio/vrst
vrst_2019_3/vrst
vrst_2019_3_portfolio/vrst
vrst_2019_4_portfolio/vrst
vrst_2019_inv1_portfolio/vrst
vrst_2019_inv2_portfolio/vrst
vrst_2019_inv3_portfolio/vrst
wamco/upgrade
woart_2017_a/edgar_auto
woart_2017_b/edgar_auto
woart_2018_a/edgar_auto
woart_2018_b/edgar_auto
woart_2018_c/edgar_auto
woart_2018_d/edgar_auto
woart_2019_a/edgar_auto
woart_2019_b/edgar_auto
woart_2019_c/edgar_auto
woart_2020_a/edgar_auto
woart_2020_b/edgar_auto
woart_2020_c/edgar_auto
woart_2021_a/edgar_auto
wosat_2019_a/edgar_auto
wosat_2020_a/edgar_auto
zais/upgrade
--schema <value> Schema class to use when normalizing a file like com.dv01.pipeline.filetable.schemas.promise_financial.LoanSaleTape
--diff-staging Turns on local diffing of daily tables to staging
--diff-prod Turns on local diffing of daily tables to production
--diff-against <value> Run diffs against specified environment
--no-diff Turns off diffing
--save-diff-to <value> Saves diffs to folder inside integration-test-diffs container
--no-diff-print If running integration tests do no print diffs to console
--dynamic Sets global flag to use dynamic data
--next-period Run Securitization Jobs not for release but rather next period
--max-date-override <value>
Override of Securitization max-date
--no-checks Flag to skip data checks
--validate-str-len Flag to check string byte length <= varchar limit
--disable-assertions Flag to disable data quality assertions on dev jobs.
--force-delta setting this forces every job to use delta table, used in testing
--force-parquet setting this forces every job to use parquet table, used in testing
--dry-run Prints what would have happened
--bq-load Flag to run db load to Bigquery
-k, --kinds ,... kind of tables to run!
daily
static
history
loan_performance
originations
performance_loan_age
performance_monthly
commonbond_prepayment
--mode <value> determines if db writes upsert last few days or regenerate the table
rebuild -> replace existing database table
partial -> upserts main database table
--only <value> Run only etl or db export
--recursive Will recursively run upstream data jobs
--db-server <value> Change server data written to ie., db00.dv01.co vs db00-replica.dv01.co
--db-name <value> Change database data written to ie., elias vs staging
--seed-from <value> Seed normalized data from other environment before running
--normalization-file <value>
--alert-slack-handle <value>
--clear-webapp-cache <value>
List of webapp subnets whose cache you wish to clear. Only works in dev
--single-loan-override <value>
specify a comma-separated sequence of loan_ids to override single-loan in ClientConfig
--job-execution-id <value>
Override Job Execution ID to continue writing artifacts for previous execution.
--help prints this usage text
Process finished with exit code 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment