Skip to content

Instantly share code, notes, and snippets.

View dtheodor's full-sized avatar

Dimitris Theodorou dtheodor

18 followers · 19 following
View GitHub Profile
@dtheodor
dtheodor / profile_table_varchar_lengths.sql
Created October 9, 2022 07:42
Profile table varchar lengths T-SQL
CREATE PROCEDURE profile_table_varchar_lengths @table nvarchar(256)
AS BEGIN
IF OBJECT_ID(@table, 'U') IS NULL
RAISERROR ('Table %s does not exist', 16, 1, @table) WITH NOWAIT;
DECLARE @sql nvarchar(max);
with varchar_cols as (
SELECT c.name, t.name as type, c.max_length
from sys.columns c
join sys.types t on t.system_type_id = c.system_type_id
@dtheodor
dtheodor / session.py
Last active October 4, 2020 21:06
requests.Session, retry on network errors
import requests
from requests.adapters import HTTPAdapter
from urllib3.util.retry import Retry
def create_session(num_hosts: int, num_workers: int, retry: int) -> requests.Session:
session = requests.Session()
adapter = HTTPAdapter(
pool_connections=num_hosts, # number of different hosts we will be talking to
pool_maxsize=num_workers, # number of maximum concurrent requests the session will be doing (i.e. with multiple threads that share it)
@dtheodor
dtheodor / retry.py
Last active April 28, 2020 11:23
Python retry decorator
from decorator import decorator
def retry(retries, delay, backoff, should_retry_fn, jitter=0, max_delay=None,
on_retry_fn=None, logger=_logger, label=None):
@decorator
def _retry(f, *args, **kwargs):
retries_left, current_delay = retries, delay
while retries_left:
@dtheodor
dtheodor / apt.md
Last active January 18, 2024 11:10
Tools, notes

Apt

Missing pubkey

After a error such as

Err:4 https://apt.releases.hashicorp.com focal InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY AA16FCBCA621E701
@dtheodor
dtheodor / ssl_tools.md
Created July 4, 2018 11:41
SSL tools cheatsheet

x509

certificate info

openssl x509 -in <file.pem> -text -noout

certificate subject




  


  




    


          
    

      

        
        

          

              @dtheodor
          

          

            
                dtheodor
                / README.md
            
            

              Last active
              May 23, 2018 14:02
            

              
                confluent-kafka-go Consumer.Close() hangs when having multiple consumers in the same process
              
          

        

      

        

  

      

    
confluent-kafka-go Consumer.Close() hangs


Consumer.Close() blocks indefinately when having multiple consumers in the same process that are
consuming from the same topic and belong to the same consumer group


The go source code contains a minimal test case to reproduce


This is run with


    

  • Debian GNU/Linux 9.4 (stretch)
    • 

  • go version go1.10.1 linux/amd64
    • 




  


  




    


          
    

      

        
        

          

              @dtheodor
          

          

            
                dtheodor
                /  install_mariadb_columnstore_centos_7_2.md
            
            

              Last active
              December 3, 2018 23:48
            

              
                Install MariaDB 1.08 Columnstore on Centos 7.2
              
          

        

      

        

  

      

    
  


  




    


          
    

      

        
        

          

              @dtheodor
          

          

            
                dtheodor
                / install_mariadb_columnstore_ubuntu_16_04.md
            
            

              Last active
              July 25, 2018 13:24
            

              
                Install MariaDB Columnstore on Ubuntu 16.04
              
          

        

      

        

  

      

    
Following instructions at https://mariadb.com/kb/en/mariadb/preparing-for-columnstore-installation/


Install


sudo apt-get -y install libboost-all-dev expect perl openssl file sudo libdbi-perl libreadline-dev libdbd-mysql-perl
wget https://downloads.mariadb.com/ColumnStore/1.0.7/ubuntu/dists/xenial/main/binary_amd64/mariadb-columnstore-1.0.7-1-xenial.x86_64.deb.tar.gz
tar zxf mariadb-columnstore-1.0.7-1-xenial.x86_64.deb.tar.gz
sudo dpkg -i *.deb
sudo /usr/local/mariadb/columnstore/bin/postConfigure



  


  




    


          
    

      

        
        

          

              @dtheodor
          

          

            
                dtheodor
                / install_mariadb_ubuntu_14_04.md
            
            

              Last active
              May 27, 2017 12:21
            

              
                Install MariaDB on Ubuntu 14.04
              
          

        

      

        

  

      

    
Following instructions at https://mariadb.com/kb/en/mariadb/preparing-for-columnstore-installation/ (There's also https://mariadb.com/kb/en/mariadb/installing-mariadb-deb-files/, but I didn't follow that one.)


Install


sudo apt-get -y install libboost-all-dev expect perl openssl file sudo libdbi-perl libreadline-dev libdbd-mysql-perl
cd ~
wget http://downloads.mariadb.com/MariaDB/mariadb-10.1.22/repo/ubuntu/mariadb-10.1.22-ubuntu-trusty-amd64-debs.tar
cd /opt
sudo tar -xf ~/mariadb-columnstore-tars/mariadb-10.1.22-ubuntu-trusty-amd64-debs.tar
sudo ./mariadb-10.1.22-ubuntu-trusty-amd64-debs/setup_repository



  


  




    


          
    

      

        
        

          

              @dtheodor
          

          

            
                dtheodor
                / install_mariadb_columnstore.md
            
            

              Last active
              October 29, 2020 08:59
            

              
                Install MariaDB Columnstore on Centos 6