A simple record of random coding tools/tricks/concepts that I've learnt over time. Separate concepts are delimited with ;

Learning Journal

# My learning journal
2015-12-22,hdf5 h5py
2016-01-04,gnu screen
2016-01-06,how to build ATLAS from source
2016-01-07,how to set http_proxy;how to find proxy address from .pac script in Internet Options
2016-01-08,sloth
2016-01-15,json (python)
2016-01-17,cv2
2016-01-20,keras
2016-01-22,python generators
2016-02-19,docker
2016-02-22,setup cuda
2016-03-18,how to set proxy in Rstudio server via web interface
2016-04-13,how to connect to linux server via LAN;how to configure server to use dhcp provided ip address
2016-03-18,sparkSQL
2016-03-22,how to connect with PuTTy using SSH keys
2016-04-13,iptables;how to connect to physical linux server via LAN;how to set ip address via ifconfig
2016-04-14,MEAN stack
2016-04-15,MySQL Workbench
2016-04-20,what is CDN
2016-04-22,JQuery modal
2016-04-25,dropping learning rate boosts learning
2016-04-26,sys.stdout \b \r
2016-04-29,firewalld;run sparkR from Rstudio
2016-05-06,SQLAlchemy;ORM (Object Relational Mapping)
2016-05-07,ensembling
2016-05-09,OSI model;Google API;Flask
2016-05-10,mount cifs
2016-05-11,AJAX
2016-05-16,Revolution R;solved webR session hanging in browser via ps -u jp & kill PID;rsync
2016-05-18,LDA (Latent Dirichlet Allocation)
2016-05-19,Angular
2016-05-25,qemu;virsh
2016-05-26,bower
2016-06-25,sbt
2016-06-27,mesosphere;scala
2016-06-30,ejs;mongoose;passportjs
2016-07-04,Postman (send req with cookies)
2016-07-11,caffe
2016-07-12,kafka
2016-07-13,ctrl-z bg;jobs;fg
2016-07-22,twython
2016-07-23,difference between 'a' and "a" in scala/java
2016-07-28,jqcloud
2016-07-29,azure network security group
2016-08-02,C3.js
2016-08-05,azure documentDB
2016-08-08,azure git add remote;git post-receive hook;git --work-tree --git-dir
2016-08-09,append to PYTHONPATH to import python files from other folders
2016-08-12,RODBC
2016-08-16,dplyr only works with POSIXct not POSIXlt
2016-08-17,pymongo;javascript has function scoping but no block scoping;variable/function hoisting in javascript
2016-08-18,apidocjs;flask_restful;mongo text index
2016-08-21,Access-Control-Allow-Origin
2016-08-23,$watch on arrays only listen for reference changes (Angular)
2016-09-08,block vs function scoping in javascript (let vs var);function hoisting in javascript;pure functions
2016-09-09,BOM (browser object model)
2016-09-12,npm install --production;translation of for expressions in Scala
2016-09-13,scala Stream for lazy evaluation
2016-09-21,export bash var vs var assignment
2016-09-23,postfix;cron MAILTO
2016-09-24,Make project in IntelliJIDEA
2016-09-27,reload python module
2016-09-28,using codecs to read UTF-8 encoded files;PYTHONPATH on windows need C:\\... not /c/...;mongodb text index delimits words by spaces
2016-10-07,bind ng-model to objects instead of primitives
2016-10-27,ssh tunneling;DBVisualizer
2016-11-01,anaconda has curl which may interfere with system's curl when putting in $PATH
2016-11-11,Vertica
2016-11-12,presto-cli
2016-11-14,tidyr spread;dimension and fact tables
2016-11-28,scalding REPL
2016-11-29,iTerm2;pants;oscar;bash alias
2016-12-13,Finatra;Thrift;beaker
2016-12-14,Manhattan
2016-12-15,scala Promise for returning from callback;embed tweet with blockquote and widget.js
2016-12-17,bash for loop
2016-12-27,AffineTransform doesn't preserve out of border sections of images;combine sequence of SimilarityTransform using + then use .params to get the matrix
2017-01-04,implicit arguments in scala
2017-01-29,git submodule
2017-01-30,how to snapshot and attach AWS EBS volumes;lsblk
2017-02-05,keras functional API has no predict_proba
2017-02-15,window functions in SQL OVER (PARTITION BY ... )
2017-02-19,softmax sometimes better than regression for predicting annotations
2017-02-21,approx_distinct in presto
2017-03-01,squash y to (-1,+1) when regressing coordinates
2017-03-06,tensorboard
2017-03-12,AWS spot instances
2017-03-13,dtplyr
2017-03-14,data.table,data.table syntax faster than dtplyr,fasttime
2017-04-05,predict_generator does not guarantee data order
2017-04-23,keras predict_generator using custom generators does not guarantee order of images
2017-05-03,put table with larger key group size (total keys/unique keys) on left of join
2017-05-04,$? in bash
2017-05-09,actions > image > create image will produce only 1 snapshot with 0 extra EBS volumes;get new cookies.txt if wget kaggle data fails
2017-05-10,h5py 'w' mode deletes existing datasets! use 'a' mode instead
2017-05-11,COMMIT after inserting updating deleting tables
2017-05-13,imagemagick mogrify
2017-05-15,presto EXPLAIN
2017-05-24,presto has REST API for querying
2017-05-25,RPresto
2017-05-30,scalding Execution
2017-06-02,scalding MultiJoin
2017-06-13,pd.get_dummies;scipy.sparse.csr_matrix
2017-06-14,crud vertica partitions
2017-06-15,hive-cli
2017-06-17,mean average precision map@n
2017-06-22,ag;ggmap
2017-06-26,@tailrec in scala
2017-07-04,LIKE '%' doesn't match NULL in SQL
2017-07-12,solr
2017-07-13,inverted dropout;algebraic reformulation of nesterov momentum
2017-07-14,prophet
2017-07-19,scala collections view;scala value class
2017-07-24,Android Studio;adb devices
2017-07-26,shard(1) in scalding to collect results in a node;scala for comprehension <- works on 1 type only
2017-07-27,enable developer options and usb debugging on android phone for viewing logs with adb;gcc -S -save-temp;stack pointer %rsp
2017-07-31,add mean to ggplot's geom_smooth by specifying formula = y ~ x-1
2017-08-10,generational garbage collection in the JVM
2017-08-11,scala flatMap for unnesting/realizing Option
2017-08-14,.gitignore vs .git/info/exclude
2017-08-22,parquet _common_metadata
2017-08-25,jps;jcmd;jinfo
2017-08-27,lparfor in parC
2017-09-03,mpi_send and mpi_receive not necessarily in order
2017-09-14,git rebase
2017-10-16,GGally
2017-10-23,parquet-tools
2017-11-20,toIterableExecution and await for executing a TypedPipe in Scalding
2017-12-08,pwr
2017-12-12,amp html
2017-12-14,stages in a mapreduce job
2017-12-21,org.apache.hadoop.mapred.MapTask;circular buffer for spilling records
2017-12-22,secondary sorting in mapreduce
2017-12-25,correlation vs convolution filter;unsharp mask;median filter is edge preserving
2017-12-26,sobel filter
2017-12-27,unix cut;xargs;tree;import mvn project using pom.xml;run a mapreduce program in intelliJ with debugger
2018-01-16,markov decision processes
2018-01-17,aurora
2018-01-25,git revert
2018-01-26,react;js destructuring
2018-01-30,radium;css modules
2018-02-07,vim :inoremap
2018-02-08,user-agent
2018-02-09,go
2018-02-19,./configure && make && make install
2018-02-21,scala varargs using *
2018-02-26,short variable assignment := in go
2018-03-26,unimatrix
2018-03-27,hive external table;always include null checks when conditioning CASE on left joined table fields
2018-04-13,lsof
2018-04-16,IP address comprises network and host addresses;Network Address Translation (NAT)
2018-04-30,seleniumJS
2018-05-03,enzyme;git show;
2018-05-04,yarn test:watch
2018-05-18,yarnpkg
2018-05-28,css media query; @keyframes
2018-06-04,scala value classes;presto group by cube;annotation_raster for putting images in ggplot
2018-06-08,Object.assign,axios
2018-06-11,seleniumJS;using XPath to select html elements;/etc/hosts
2018-06-25,artifactory;openssl sha256
2018-06-29,functional component uses props while class Component uses this.props;ggalluvial
2018-07-18,type bounds in scala
2018-08-25,airflow
2018-08-29,can extend multiple traits but only 1 class in scala
2018-09-04,pants jvm_binary; rsync -P
2018-09-06,R text2vec
2018-09-07,finagle;dplyr n_distinct
2018-09-10,how to create a HTTP API server with Finatra
2018-09-13,.R/Makevars
2018-09-14,sudo -E;Ncpus option in install.packages
2018-09-19,scala objects are singletons
2018-09-21,for comprehension with map returns tuples de-duped by key in scala, even if lists are expanded below it
2018-10-09,aurora task run CLUSTER/ROLE/ENV/NAME[/INSTANCES] <cmd>
2018-10-11,instantiate thrift union object using case class for the field
2018-10-24,mockito can't mix values and matchers
2018-10-26,Seq(_) in scala matches a sequence of only 1 item
2018-10-28,type casting void pointer in C
2018-11-16,pthread;gdb;lldb replaces gdb in mac
2018-11-19,navigating folders w vim
2018-11-21,osascript
2018-12-05,git shortlog
2019-01-01,subnet masking
2019-01-09,customizing terminal prompt with PS1
2019-01-18,perl basic syntax;how to disable intelliJ plugins
2019-01-21,last
2019-01-31,vimtutor
2019-02-21,default value for function arguments in bash :-
2019-02-22,zookeeper
2019-02-26,tcpdump
2019-03-19,Semigroup from algebird
2019-04-01,ipy script
2019-04-23,argparse
2019-04-29,git log old..new -- path
2019-05-02,reorder in ggplot2
2019-05-10,python jira package,scala.math.Ordering maxes at 9 entries in the tuple
2019-05-06,tensorflow eager execution
2019-07-24,awk;terminal vs shell
2019-10-09,nslookup
2019-11-03,grouping with (?:) in regex
2019-12-11,ulimit
2019-12-16,dig
2020-01-03,xargs -P
2020-01-07,logback;java.util.logging
2020-02-04,jar manifest
2020-02-05,irssi
2020-02-12,covariance contravariance in scala
2020-03-22,argc arvg in C
2020-04-16,git stash
2020-07-01,java reflection
2020-07-03,ammonite repl;mill;structural sharing
2020-07-04,ClassTag;type erasure in jvm
2020-07-08,remote debugging in jvm w intellij
2020-07-12,directory traversal attack
2020-07-26,Q#
2020-08-13,zeckendorf representation
2020-08-17,function annotations in py3
2020-08-24,docker-compose;ksqldb
2020-08-25,gradle
2020-08-26,websockets
2020-08-29,leveldb
2020-12-07,dtruss
2020-12-23,Aggregator and QTree from algebird
2021-01-11,fzf;vim i f c . :help
2021-01-16,rg
2021-02-05,vim plug :colorscheme
2021-02-06,pbcopy
2021-03-01,vim leader key;ctags;nerdtree
2021-03-02,bazel query deps
2021-03-29,tensorflow_recommenders
2021-04-12,bqstorageapi
2021-04-16,scann
2021-04-20,pyspark mapPartition
2021-05-21,python f-strings
2021-05-24,tensorflow estimator
2021-07-23,java.nio.ByteBuffer
2021-08-03,assignment expressions in python
2021-08-11,java finalize; threadpool needs shutdown
2021-08-12,unrolled linked list
2021-10-15,go routine channel
2021-10-29,zmk
2022-01-04,Scio;DataFlow
2022-03-02,bloom filter
2022-03-26,JIT;method inlining
2022-04-01,sort -h
2022-06-03,beam ScalaTransforms
2022-06-05,uart
2022-06-09,scala class linearization
2022-09-21,python fire
2022-11-25,rust
2023-01-24,golang gin csp atomic
2023-01-27,gdoc slack confluence api
2023-01-31,cpp alignas;disruptor
2023-02-01,rust tokio
2023-02-18,rust pin
2023-02-22,std::thread;send recv
2023-02-23,golang yaml
2023-02-24,cargo bench
2023-02-25,polars
2023-03-06,vue
2023-03-10,capnproto
2023-03-13,base64 url encoding
2023-04-05,fluvio
2023-04-19,route53
2023-04-20,pnpm
2023-04-25,gcloud function
2023-04-26,chalice
2023-05-15,go fibre
2023-05-16,go gin;gke;CIDR
2023-05-18,go gorm
2023-05-24,tiktoken;pg_dump;gorm jsonb should scan into a &str not &[]byte
2023-05-25,solve ImagePullBackOff by giving storage/objectViewer to relevant gs bucket using `gsutil iam ch`
2023-05-26,gcp cloud NAT;apache bench
2023-06-05,go gcflags
2023-06-19,sed
2023-06-21,sqlite
2023-07-03,prometheus
2023-07-04,kubernetes PodMonitoring resource
2023-07-05,gin middleware
2023-07-06,js spread syntax for merging objects;js request.body.getReader()
2023-07-26,spacy ner
2023-07-28,guidance
2023-08-03,huggingface local model cache
2023-08-04,gradio
2023-08-08,vscode remote ssh extension with ~/.ssh/config;install NVIDIA Container Toolkit
2023-08-22,huggingface datasets
2023-08-23,torch DataLoader
2023-08-24,huggingface Trainer;BertForSequenceClassification
2023-08-29,peft
2023-09-04,DPOTrainer
2023-09-06,DataCollatorForLanguageModeling,DataCollatorForCompletionOnlyLM
2023-09-07,gradient checkpointing
2023-09-28,runpod
2023-10-06,pymodule vs package in setup.py
2023-10-09,vscode python test and debugger
2023-10-16,setting up cuda with .run
2023-10-20,multigpu training
2023-10-26,vllm
2023-11-01,llama tokenizer always adds <s>;debug cuda indexSelectLargeIndex error
2023-11-02,volume ops like mkfs, mount, xfs_growfs
2024-01-05,TensorRT-LLM
2024-01-12,triton-inference-server
2024-01-22,nextjs
2024-03-22,accelerate fsdp
2024-04-26,sns.catplot