Skip to content

Instantly share code, notes, and snippets.

View tavplubix's full-sized avatar

Alexander Tokmakov tavplubix

55 followers · 6 following
View GitHub Profile
@tavplubix
tavplubix / 0001-fix.patch
Created March 15, 2023 16:41
From 6734c7226d4caaf34eb825c36ca64cb375284cf0 Mon Sep 17 00:00:00 2001
From: Alexander Tokmakov <tavplubix@clickhouse.com>
Date: Wed, 15 Mar 2023 17:40:57 +0100
Subject: [PATCH] fix
---
src/Access/Common/AccessType.h | 5 +++--
1 file changed, 3 insertions(+), 2 deletions(-)
diff --git a/src/Access/Common/AccessType.h b/src/Access/Common/AccessType.h
@tavplubix
tavplubix / gist:85b28e8f42e10e102df3f501cd94dcb9
Created August 2, 2021 20:26
:) select * from system.zookeeper_log where path='/clickhouse/task_queue/ddl' and event_time < '2021-08-02 19:00:00' order by event_time desc limit 20 \G
SELECT *
FROM system.zookeeper_log
WHERE (path = '/clickhouse/task_queue/ddl') AND (event_time < '2021-08-02 19:00:00')
ORDER BY event_time DESC
LIMIT 20
Query id: 458a4cfa-6bd3-4071-8f49-63a88458f72e
@tavplubix
tavplubix / gist:2617932e7d60e571bbb21b79e15b7974
Created August 2, 2021 20:04
$ zgrep -Fa "DDLWorker: " clickhouse-server1.log.gz | tail -175
2021.08.03 03:39:53.148540 [ 806 ] {} <Debug> DDLWorker: Cleaning queue
2021.08.03 03:39:53.149255 [ 807 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=1116, queue_size=1116, entries=query-0000000076..query-0000001191, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000001190, last_skipped_entry_name=query-0000000928
2021.08.03 03:39:53.149274 [ 807 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000001191
2021.08.03 03:39:53.149297 [ 807 ] {} <Trace> DDLWorker: Checking task query-0000001191
2021.08.03 03:39:53.150138 [ 807 ] {} <Debug> DDLWorker: Processing task query-0000001191 (DROP DATABASE test_xl1nuw ON CLUSTER test_cluster_database_replicated)
2021.08.03 03:39:53.150929 [ 806 ] {} <Information> DDLWorker: Task query-0000000076 is outdated, deleting it
2021.08.03 03:39:53.151715 [ 807 ] {} <Debug> DDLWorker: Executing query: DROP DATABASE test_xl1nuw
2021.08.03
@tavplubix
tavplubix / gist:012244641439238ef9e4bf21f9f57bb0
Created March 22, 2021 13:04
SELECT
min(check_start_time),
substring(test_name, 1, 50) AS n,
count(),
test_status,
pull_request_number,
commit_sha
FROM `gh-data`.checks
WHERE (test_status NOT IN ('OK', 'SKIPPED', 'NOT STARTED')) AND (test_name LIKE '%test_distributed_respect_user_timeouts%')
GROUP BY
@tavplubix
tavplubix / gist:f9d42f3395966eac5aa90f8ab43399cf
Created January 20, 2021 18:04
avtokmakov@avtokmakov-nix:~/ch$ grep -Fa Fatal clickhouse-server.log | grep " 635"
2021.01.20 15:35:46.303483 [ 943 ] {} <Fatal> BaseDaemon: (version 21.1.1.5740, build id: FD4D456E91436EA753062CD532E50D324BFCE4CF) (from thread 635) (no query) Received signal Segmentation fault (11)
avtokmakov@avtokmakov-nix:~/ch$ grep -Fa Fatal clickhouse-server.log | grep " 943"
2021.01.20 15:35:46.301321 [ 943 ] {} <Fatal> BaseDaemon: ########################################
2021.01.20 15:35:46.303483 [ 943 ] {} <Fatal> BaseDaemon: (version 21.1.1.5740, build id: FD4D456E91436EA753062CD532E50D324BFCE4CF) (from thread 635) (no query) Received signal Segmentation fault (11)
2021.01.20 15:35:46.318973 [ 943 ] {} <Fatal> BaseDaemon: Address: 0x7fd52d005d88 Access: write. Address not mapped to object.
2021.01.20 15:35:46.320596 [ 943 ] {} <Fatal> BaseDaemon: Stack trace: 0x108cb9ca 0x108cba2b 0x10b36b8b 0x7fd5c6c603c0
2021.01.20 15:35:46.328710 [ 943 ] {} <Fatal> BaseDaemon: 0. ./obj-x86_64-linux-gnu/../src/Common/StackTrace.cp
@tavplubix
tavplubix / gist:638666056d7a067b8938eb4cccb6a128
Created November 20, 2020 14:35
node_1 | ==================
node_1 | WARNING: ThreadSanitizer: data race (pid=1)
node_1 | Write of size 8 at 0x7f8bcb1fe718 by thread T43:
node_1 | #0 DB::MySQLHandler::comQuery(DB::ReadBuffer&)::$_1::operator()(DB::Progress const&) const /build/obj-x86_64-linux-gnu/../src/Server/MySQLHandler.cpp:332:90 (clickhouse+0x117d7d06)
node_1 | #1 decltype(std::__1::forward<DB::MySQLHandler::comQuery(DB::ReadBuffer&)::$_1&>(fp)(std::__1::forward<DB::Progress const&>(fp0))) std::__1::__invoke<DB::MySQLHandler::comQuery(DB::ReadBuffer&)::$_1&, DB::Progress const&>(DB::MySQLHandler::comQuery(DB::ReadBuffer&)::$_1&, DB::Progress const&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3519:1 (clickhouse+0x117d7d06)
node_1 | #2 void std::__1::__invoke_void_return_wrapper<void>::__call<DB::MySQLHandler::comQuery(DB::ReadBuffer&)::$_1&, DB::Progress const&>(DB::MySQLHandler::comQuery(DB::ReadBuffer&)::$_1&, DB::Progress const&) /build/
@tavplubix
tavplubix / gist:2b536d81d23fc7412a2cf186efda236f
Created November 19, 2020 11:32
node1_1 | =================================================================
node1_1 | ==1==ERROR: AddressSanitizer: stack-use-after-scope on address 0x7fc39c61f3b0 at pc 0x00001c18bec9 bp 0x7fc39c61eb10 sp 0x7fc39c61eb08
node1_1 | READ of size 1 at 0x7fc39c61f3b0 thread T58 (MySQLDBSync)
node1_1 | #0 0x1c18bec8 in std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >::__is_long() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/string:1426:39
node1_1 | #1 0x1c18bec8 in std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >::size() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/string:950:17
node1_1 | #2 0x1c18bec8 in bool std::__1::operator==<std::__1::allocator<char> >(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&
@tavplubix
tavplubix / gist:26022e8f3fbdb9451068ed5c98aeeb75
Created November 9, 2020 10:59
2020.11.07 16:00:57.860421 [ 62 ] {} <Fatal> BaseDaemon: ########################################
2020.11.07 16:00:57.861503 [ 62 ] {} <Fatal> BaseDaemon: (version 20.12.1.5122, build id: F136D3C1320C7349) (from thread 42) (query_id: 61fb1f3a-5842-44bd-abad-b7e7d169e9ea) Received signal Segmentation fault (11)
2020.11.07 16:00:57.862165 [ 62 ] {} <Fatal> BaseDaemon: Address: NULL pointer. Access: read. Unknown si_code.
2020.11.07 16:00:57.862716 [ 62 ] {} <Fatal> BaseDaemon: Stack trace: 0x80b7797 0x107f7c29 0x1177038c 0x11770545 0x1176f790 0x1141199b 0x10c1d590 0x10bcbc00 0x10b75d80 0x11762d57 0x1175e863 0x11769908 0x14459dc3 0x1445a4da 0x145bc812 0x145baee0 0x145b9848 0x80598ad 0x7f806b56a669 0x7f806b4812b3
2020.11.07 16:00:57.908701 [ 62 ] {} <Fatal> BaseDaemon: 5. __tsan_read4 @ 0x80b7797 in /usr/bin/clickhouse
2020.11.07 16:00:57.936987 [ 62 ] {} <Fatal> BaseDaemon: 6. /build/obj-x86_64-linux-gnu/../src/Interpreters/Context.cpp:2069: DB::Context::getApplicationType() const @ 0x107f7c29 in /usr/bin/clickh
@tavplubix
tavplubix / gist:c7362695fb4afde7227c42bbdbaeb370
Created September 24, 2020 17:25
https://clickhouse-test-reports.s3.yandex.net/15003/9000ec0331fe062552590d5b253540e5af039b4f/functional_stateless_tests_(release,_polymorphic_parts_enabled).html#fail1
$ grep -Fa "68ca4fdc-77a8-4a80-81bb-d61ad206d16c" clickhouse-server.log
2020.09.24 17:51:04.371695 [ 44982 ] {2f7f8e82-6c66-4efe-a943-f02f916bd55e} <Debug> test_01193_27222.table_9_164 (68ca4fdc-77a8-4a80-81bb-d61ad206d16c): Loading data parts
2020.09.24 17:51:04.372588 [ 44982 ] {2f7f8e82-6c66-4efe-a943-f02f916bd55e} <Debug> test_01193_27222.table_9_164 (68ca4fdc-77a8-4a80-81bb-d61ad206d16c): Loaded data parts (0 items)
2020.09.24 17:51:04.492700 [ 44982 ] {d3ed15d7-e8f9-4410-b493-eeeb9a5c6ba1} <Trace> test_01193_27222.table_9_164 (68ca4fdc-77a8-4a80-81bb-d61ad206d16c): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0.
2020.09.24 17:54:31.939489 [ 44977 ] {b46fcd47-6b94-4be4-b12c-769d4f7efec1} <Debug> test_01193_27222.table_9_164 (68ca4fdc-77a8-4a80-81bb-d61ad206d16c) (SelectExecutor): Key condition: unknown
2020.09.24 17:54:31.93950
@tavplubix
tavplubix / gist:ee5c2859ae67101296b2056a22629bd4
Created August 20, 2020 13:26
ch1_1 | ==================
ch1_1 | WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=1)
ch1_1 | Cycle in lock order graph: M1029207995302769728 (0x000000000000) => M1029489521819197136 (0x000000000000) => M1029207995302769728
ch1_1 |
ch1_1 | Mutex M1029489521819197136 acquired here while holding mutex M1029207995302769728 in thread T62:
ch1_1 | #0 pthread_mutex_lock <null> (clickhouse+0x2745aa66)
ch1_1 | #1 std::__1::__libcpp_mutex_lock(pthread_mutex_t*) /home/avtokmakov/ch/ClickHouse/build_tsan_debug/../contrib/libcxx/include/__threading_support:322:10 (clickhouse+0x42bfe068)
ch1_1 | #2 std::__1::mutex::lock() /home/avtokmakov/ch/ClickHouse/build_tsan_debug/../contrib/libcxx/src/mutex.cpp:33:14 (clickhouse+0x42bfe188)
ch1_1 | #3 std::__1::unique_lock<std::__1::mutex>::unique_lock(std::__1::mutex&) /home/avtokmakov/ch/ClickHouse/build_tsan_debug/../contrib/libcxx/include/__mutex_base:119:61 (clickhouse+0x2754fd0c)
ch1_1 | #4 DB::StorageDistri