Skip to content

Instantly share code, notes, and snippets.

View Slach's full-sized avatar
💭
deep diving into kuberntes

Eugene Klimov Slach

💭
deep diving into kuberntes
View GitHub Profile

For try to reproduce run following command in bash

docker-compose down && docker-compose up -d clickhouse && sleep 5 && docker-compose exec clickhouse bash ./reproduce.sh
* ==> Docker <==
* -- Logs begin at Tue 2019-12-24 09:36:37 UTC, end at Tue 2019-12-24 09:41:14 UTC. --
* Dec 24 09:36:55 minikube dockerd[2452]: time="2019-12-24T09:36:55.226032614Z" level=info msg="loading plugin "io.containerd.runtime.v2.task"..." type=io.containerd.runtime.v2
* Dec 24 09:36:55 minikube dockerd[2452]: time="2019-12-24T09:36:55.226276799Z" level=info msg="loading plugin "io.containerd.monitor.v1.cgroups"..." type=io.containerd.monitor.v1
* Dec 24 09:36:55 minikube dockerd[2452]: time="2019-12-24T09:36:55.227344467Z" level=info msg="loading plugin "io.containerd.service.v1.tasks-service"..." type=io.containerd.service.v1
* Dec 24 09:36:55 minikube dockerd[2452]: time="2019-12-24T09:36:55.227435429Z" level=info msg="loading plugin "io.containerd.internal.v1.restart"..." type=io.containerd.internal.v1
* Dec 24 09:36:55 minikube dockerd[2452]: time="2019-12-24T09:36:55.227552987Z" level=info msg="loading plugin "io.containerd.grpc.v1.containers"..." type=io.containerd.grpc.v1
* Dec 24 09:36:55
@Slach
Slach / gramework_go1.13.1.go
Created October 13, 2019 05:59
gramework_go1.13.1.go
package main;
import (
grameworklog "github.com/apex/log"
grameworklog_json "github.com/apex/log/handlers/json"
"github.com/gramework/gramework"
)
func InitGramework() (web *gramework.App) {
web = gramework.New()
logger := &grameworklog.Logger{
@Slach
Slach / proxysql.log
Created April 1, 2018 14:56
Logs when proxysql failed connection over sysbench after running mysqlrpladmin switchover
root@mysql-proxy:/home/vagrant# cat /var/lib/proxysql/proxysql.log
2018-04-01 14:27:30 [INFO] ProxySQL version 1.4.6-1.1
2018-04-01 14:27:30 [INFO] Detected OS: Linux mysql-proxy 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 x86_64
2018-04-01 14:27:30 [INFO] Starting ProxySQL
2018-04-01 14:27:30 [INFO] Sucessfully started
2018-04-01 14:27:30 [INFO] Angel process started ProxySQL process 7834
Standard ProxySQL Cluster rev. 0.1.0702 -- ProxySQL_Cluster.cpp -- Fri Mar 9 07:46:21 2018
Standard ProxySQL Statistics rev. 1.4.1027 -- ProxySQL_Statistics.cpp -- Fri Mar 9 07:46:21 2018
Standard ProxySQL HTTP Server Handler rev. 1.4.1031 -- ProxySQL_HTTP_Server.cpp -- Fri Mar 9 07:46:21 2018
Standard ProxySQL Admin rev. 0.2.0902 -- ProxySQL_Admin.cpp -- Fri Mar 9 07:46:21 2018
@Slach
Slach / .gitignore
Last active February 8, 2018 14:04
Gramework static WTF
.vagrant
*.log
@Slach
Slach / .gitignore
Last active January 22, 2018 03:31
error "Table structure in ZooKeeper is too much different from local table structure." when try create ReplicatedMergeTree
*.log
.vagrant/
.idea/
*.exe
*.dll
*.so
*.dylib
*.pcap
id_rsa
@Slach
Slach / .gitignore
Last active January 28, 2018 13:17
Clickhouse Driver Close TCP Connection before ping https://github.com/kshvakov/clickhouse
config.yml
anomalies/
src/github.com
src/gopkg.in
src/golang.org
src/vendor
vendor/
*.log
pkg/
dist/
@Slach
Slach / helpme.md
Last active November 18, 2017 15:40
Yandex Metrika Logs Api wrong TSV in some fields

Обидно, когда не получается вместе использовать два таких достойных продукта

Суть проблемы: При выгрузке данных из Metrica Logs API, генерируются TSV файлы которые потом не распознаются парсером Clickhouse для TabSeparatedWithNames формата и соответвенно не могут напрямую быть загружены в локальный Clickhouse

вот основные ошибки — одинарные ковычки, которые обрамляют строки в комплексных типах Array (String) эскейпятся через
пример это поля ym:s:goalsDateTime и ym:s:goalsOrder

@Slach
Slach / .gitignore
Last active October 29, 2017 16:43
Why Clickhouse can't load TSV file
.vagrant/
*.log
@Slach
Slach / metrika_visits.1.tsv
Created October 28, 2017 08:22
Metrica Logs API wrong escaping Array(String) fields
ym:s:productsPurchaseID ym:s:productsCategory ym:s:productsCurrency ym:s:visitID ym:s:UTMContent ym:s:openstatCampaign ym:s:impressionsProductCoupon ym:s:dateTime ym:s:lastDirectConditionType ym:s:browserEngineVersion3 ym:s:browserEngineVersion1 ym:s:browserEngineVersion2 ym:s:UTMMedium ym:s:hasGCLID ym:s:productsCategory1 ym:s:impressionsProductCategory4 ym:s:productsID ym:s:productsVariant ym:s:screenColors ym:s:windowClientHeight ym:s:impressionsProductID ym:s:impressionsProductName ym:s:lastReferalSource ym:s:browserEngine ym:s:physicalScreenHeight ym:s:watchIDs ym:s:screenHeight ym:s:purchaseRevenue ym:s:purchaseShipping ym:s:productsCategory3 ym:s:networkType ym:s:deviceCategory ym:s:screenWidth ym:s:lastSearchEngine ym:s:UTMSource ym:s:operatingSystem ym:s:flashMajor ym:s:windowClientWidth ym:s:productsPrice ym:s:isNewUser ym:s:goalsID ym:s:impressionsProductCategory1 ym:s:impressionsProductCurrency ym:s:ipAddress ym:s:productsBrand ym:s:impressionsURL ym:s:lastSocialNetworkProfile ym:s:browserLanguage