Skip to content

Instantly share code, notes, and snippets.

@filimonov

filimonov/changes_22.3_22.8.md Secret

Last active December 21, 2022 18:00
Show Gist options
  • Save filimonov/d60f749be2581b151e6bdaa830bc8111 to your computer and use it in GitHub Desktop.
Save filimonov/d60f749be2581b151e6bdaa830bc8111 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
changes_22.3_22.8.md 
Version 1: 22.3.11.12
Version 2: 22.8.1.2097
Number of authors
280
Number of commits
7564
Number of PR
2039

Tables in system database

name groupArray(version)
backups ['new']
certificates ['new']
filesystem_cache ['new']
merge_tree_metadata_cache ['new']
remote_data_paths ['new']
schema_inference_cache ['new']
settings_changes ['new']

Table structures in system database

table name groupArray(version) groupArray(type)
backups id ['new'] ['String']
backups name ['new'] ['String']
backups status ['new'] ['Enum8('CREATING_BACKUP' = 0, 'BACKUP_CREATED' = 1, 'BACKUP_FAILED' = 2, 'RESTORING' = 3, 'RESTORED' = 4, 'RESTORE_FAILED' = 5)']
backups num_files ['new'] ['UInt64']
backups uncompressed_size ['new'] ['UInt64']
backups compressed_size ['new'] ['UInt64']
backups error ['new'] ['String']
backups start_time ['new'] ['DateTime']
backups end_time ['new'] ['DateTime']
certificates version ['new'] ['Int32']
certificates serial_number ['new'] ['Nullable(String)']
certificates signature_algo ['new'] ['Nullable(String)']
certificates issuer ['new'] ['Nullable(String)']
certificates not_before ['new'] ['Nullable(String)']
certificates not_after ['new'] ['Nullable(String)']
certificates subject ['new'] ['Nullable(String)']
certificates pkey_algo ['new'] ['Nullable(String)']
certificates path ['new'] ['String']
certificates default ['new'] ['UInt8']
dictionaries hierarchical_index_bytes_allocated ['new'] ['UInt64']
disks cache_path ['new'] ['String']
filesystem_cache cache_base_path ['new'] ['String']
filesystem_cache cache_path ['new'] ['String']
filesystem_cache file_segment_range_begin ['new'] ['UInt64']
filesystem_cache file_segment_range_end ['new'] ['UInt64']
filesystem_cache size ['new'] ['UInt64']
filesystem_cache state ['new'] ['String']
filesystem_cache cache_hits ['new'] ['UInt64']
filesystem_cache references ['new'] ['UInt64']
filesystem_cache downloaded_size ['new'] ['UInt64']
filesystem_cache persistent ['new'] ['UInt8']
grants access_type ['new','old'] ['Enum16('SHOW DATABASES' = 0, 'SHOW TABLES' = 1, 'SHOW COLUMNS' = 2, 'SHOW DICTIONARIES' = 3, 'SHOW' = 4, 'SHOW CACHES' = 5, 'SELECT' = 6, 'INSERT' = 7, 'ALTER UPDATE' = 8, 'ALTER DELETE' = 9, 'ALTER ADD COLUMN' = 10, 'ALTER MODIFY COLUMN' = 11, 'ALTER DROP COLUMN' = 12, 'ALTER COMMENT COLUMN' = 13, 'ALTER CLEAR COLUMN' = 14, 'ALTER RENAME COLUMN' = 15, 'ALTER MATERIALIZE COLUMN' = 16, 'ALTER COLUMN' = 17, 'ALTER MODIFY COMMENT' = 18, 'ALTER ORDER BY' = 19, 'ALTER SAMPLE BY' = 20, 'ALTER ADD INDEX' = 21, 'ALTER DROP INDEX' = 22, 'ALTER MATERIALIZE INDEX' = 23, 'ALTER CLEAR INDEX' = 24, 'ALTER INDEX' = 25, 'ALTER ADD PROJECTION' = 26, 'ALTER DROP PROJECTION' = 27, 'ALTER MATERIALIZE PROJECTION' = 28, 'ALTER CLEAR PROJECTION' = 29, 'ALTER PROJECTION' = 30, 'ALTER ADD CONSTRAINT' = 31, 'ALTER DROP CONSTRAINT' = 32, 'ALTER CONSTRAINT' = 33, 'ALTER TTL' = 34, 'ALTER MATERIALIZE TTL' = 35, 'ALTER SETTINGS' = 36, 'ALTER MOVE PARTITION' = 37, 'ALTER FETCH PARTITION' = 38, 'ALTER FREEZE PARTITION' = 39, 'ALTER DATABASE SETTINGS' = 40, 'ALTER TABLE' = 41, 'ALTER DATABASE' = 42, 'ALTER VIEW REFRESH' = 43, 'ALTER VIEW MODIFY QUERY' = 44, 'ALTER VIEW' = 45, 'ALTER' = 46, 'CREATE DATABASE' = 47, 'CREATE TABLE' = 48, 'CREATE VIEW' = 49, 'CREATE DICTIONARY' = 50, 'CREATE TEMPORARY TABLE' = 51, 'CREATE FUNCTION' = 52, 'CREATE' = 53, 'DROP DATABASE' = 54, 'DROP TABLE' = 55, 'DROP VIEW' = 56, 'DROP DICTIONARY' = 57, 'DROP FUNCTION' = 58, 'DROP' = 59, 'TRUNCATE' = 60, 'OPTIMIZE' = 61, 'BACKUP' = 62, 'KILL QUERY' = 63, 'KILL TRANSACTION' = 64, 'MOVE PARTITION BETWEEN SHARDS' = 65, 'CREATE USER' = 66, 'ALTER USER' = 67, 'DROP USER' = 68, 'CREATE ROLE' = 69, 'ALTER ROLE' = 70, 'DROP ROLE' = 71, 'ROLE ADMIN' = 72, 'CREATE ROW POLICY' = 73, 'ALTER ROW POLICY' = 74, 'DROP ROW POLICY' = 75, 'CREATE QUOTA' = 76, 'ALTER QUOTA' = 77, 'DROP QUOTA' = 78, 'CREATE SETTINGS PROFILE' = 79, 'ALTER SETTINGS PROFILE' = 80, 'DROP SETTINGS PROFILE' = 81, 'SHOW USERS' = 82, 'SHOW ROLES' = 83, 'SHOW ROW POLICIES' = 84, 'SHOW QUOTAS' = 85, 'SHOW SETTINGS PROFILES' = 86, 'SHOW ACCESS' = 87, 'ACCESS MANAGEMENT' = 88, 'SYSTEM SHUTDOWN' = 89, 'SYSTEM DROP DNS CACHE' = 90, 'SYSTEM DROP MARK CACHE' = 91, 'SYSTEM DROP UNCOMPRESSED CACHE' = 92, 'SYSTEM DROP MMAP CACHE' = 93, 'SYSTEM DROP COMPILED EXPRESSION CACHE' = 94, 'SYSTEM DROP FILESYSTEM CACHE' = 95, 'SYSTEM DROP SCHEMA CACHE' = 96, 'SYSTEM DROP CACHE' = 97, 'SYSTEM RELOAD CONFIG' = 98, 'SYSTEM RELOAD SYMBOLS' = 99, 'SYSTEM RELOAD DICTIONARY' = 100, 'SYSTEM RELOAD MODEL' = 101, 'SYSTEM RELOAD FUNCTION' = 102, 'SYSTEM RELOAD EMBEDDED DICTIONARIES' = 103, 'SYSTEM RELOAD' = 104, 'SYSTEM RESTART DISK' = 105, 'SYSTEM MERGES' = 106, 'SYSTEM TTL MERGES' = 107, 'SYSTEM FETCHES' = 108, 'SYSTEM MOVES' = 109, 'SYSTEM DISTRIBUTED SENDS' = 110, 'SYSTEM REPLICATED SENDS' = 111, 'SYSTEM SENDS' = 112, 'SYSTEM REPLICATION QUEUES' = 113, 'SYSTEM DROP REPLICA' = 114, 'SYSTEM SYNC REPLICA' = 115, 'SYSTEM RESTART REPLICA' = 116, 'SYSTEM RESTORE REPLICA' = 117, 'SYSTEM SYNC DATABASE REPLICA' = 118, 'SYSTEM SYNC TRANSACTION LOG' = 119, 'SYSTEM FLUSH DISTRIBUTED' = 120, 'SYSTEM FLUSH LOGS' = 121, 'SYSTEM FLUSH' = 122, 'SYSTEM THREAD FUZZER' = 123, 'SYSTEM UNFREEZE' = 124, 'SYSTEM' = 125, 'dictGet' = 126, 'addressToLine' = 127, 'addressToLineWithInlines' = 128, 'addressToSymbol' = 129, 'demangle' = 130, 'INTROSPECTION' = 131, 'FILE' = 132, 'URL' = 133, 'REMOTE' = 134, 'MONGO' = 135, 'MEILISEARCH' = 136, 'MYSQL' = 137, 'POSTGRES' = 138, 'SQLITE' = 139, 'ODBC' = 140, 'JDBC' = 141, 'HDFS' = 142, 'S3' = 143, 'HIVE' = 144, 'SOURCES' = 145, 'CLUSTER' = 146, 'ALL' = 147, 'NONE' = 148)','Enum16('SHOW DATABASES' = 0, 'SHOW TABLES' = 1, 'SHOW COLUMNS' = 2, 'SHOW DICTIONARIES' = 3, 'SHOW' = 4, 'SELECT' = 5, 'INSERT' = 6, 'ALTER UPDATE' = 7, 'ALTER DELETE' = 8, 'ALTER ADD COLUMN' = 9, 'ALTER MODIFY COLUMN' = 10, 'ALTER DROP COLUMN' = 11, 'ALTER COMMENT COLUMN' = 12, 'ALTER CLEAR COLUMN' = 13, 'ALTER RENAME COLUMN' = 14, 'ALTER MATERIALIZE COLUMN' = 15, 'ALTER COLUMN' = 16, 'ALTER MODIFY COMMENT' = 17, 'ALTER ORDER BY' = 18, 'ALTER SAMPLE BY' = 19, 'ALTER ADD INDEX' = 20, 'ALTER DROP INDEX' = 21, 'ALTER MATERIALIZE INDEX' = 22, 'ALTER CLEAR INDEX' = 23, 'ALTER INDEX' = 24, 'ALTER ADD PROJECTION' = 25, 'ALTER DROP PROJECTION' = 26, 'ALTER MATERIALIZE PROJECTION' = 27, 'ALTER CLEAR PROJECTION' = 28, 'ALTER PROJECTION' = 29, 'ALTER ADD CONSTRAINT' = 30, 'ALTER DROP CONSTRAINT' = 31, 'ALTER CONSTRAINT' = 32, 'ALTER TTL' = 33, 'ALTER MATERIALIZE TTL' = 34, 'ALTER SETTINGS' = 35, 'ALTER MOVE PARTITION' = 36, 'ALTER FETCH PARTITION' = 37, 'ALTER FREEZE PARTITION' = 38, 'ALTER DATABASE SETTINGS' = 39, 'ALTER TABLE' = 40, 'ALTER DATABASE' = 41, 'ALTER VIEW REFRESH' = 42, 'ALTER VIEW MODIFY QUERY' = 43, 'ALTER VIEW' = 44, 'ALTER' = 45, 'CREATE DATABASE' = 46, 'CREATE TABLE' = 47, 'CREATE VIEW' = 48, 'CREATE DICTIONARY' = 49, 'CREATE TEMPORARY TABLE' = 50, 'CREATE FUNCTION' = 51, 'CREATE' = 52, 'DROP DATABASE' = 53, 'DROP TABLE' = 54, 'DROP VIEW' = 55, 'DROP DICTIONARY' = 56, 'DROP FUNCTION' = 57, 'DROP' = 58, 'TRUNCATE' = 59, 'OPTIMIZE' = 60, 'KILL QUERY' = 61, 'MOVE PARTITION BETWEEN SHARDS' = 62, 'CREATE USER' = 63, 'ALTER USER' = 64, 'DROP USER' = 65, 'CREATE ROLE' = 66, 'ALTER ROLE' = 67, 'DROP ROLE' = 68, 'ROLE ADMIN' = 69, 'CREATE ROW POLICY' = 70, 'ALTER ROW POLICY' = 71, 'DROP ROW POLICY' = 72, 'CREATE QUOTA' = 73, 'ALTER QUOTA' = 74, 'DROP QUOTA' = 75, 'CREATE SETTINGS PROFILE' = 76, 'ALTER SETTINGS PROFILE' = 77, 'DROP SETTINGS PROFILE' = 78, 'SHOW USERS' = 79, 'SHOW ROLES' = 80, 'SHOW ROW POLICIES' = 81, 'SHOW QUOTAS' = 82, 'SHOW SETTINGS PROFILES' = 83, 'SHOW ACCESS' = 84, 'ACCESS MANAGEMENT' = 85, 'SYSTEM SHUTDOWN' = 86, 'SYSTEM DROP DNS CACHE' = 87, 'SYSTEM DROP MARK CACHE' = 88, 'SYSTEM DROP UNCOMPRESSED CACHE' = 89, 'SYSTEM DROP MMAP CACHE' = 90, 'SYSTEM DROP COMPILED EXPRESSION CACHE' = 91, 'SYSTEM DROP CACHE' = 92, 'SYSTEM RELOAD CONFIG' = 93, 'SYSTEM RELOAD SYMBOLS' = 94, 'SYSTEM RELOAD DICTIONARY' = 95, 'SYSTEM RELOAD MODEL' = 96, 'SYSTEM RELOAD FUNCTION' = 97, 'SYSTEM RELOAD EMBEDDED DICTIONARIES' = 98, 'SYSTEM RELOAD' = 99, 'SYSTEM RESTART DISK' = 100, 'SYSTEM MERGES' = 101, 'SYSTEM TTL MERGES' = 102, 'SYSTEM FETCHES' = 103, 'SYSTEM MOVES' = 104, 'SYSTEM DISTRIBUTED SENDS' = 105, 'SYSTEM REPLICATED SENDS' = 106, 'SYSTEM SENDS' = 107, 'SYSTEM REPLICATION QUEUES' = 108, 'SYSTEM DROP REPLICA' = 109, 'SYSTEM SYNC REPLICA' = 110, 'SYSTEM RESTART REPLICA' = 111, 'SYSTEM RESTORE REPLICA' = 112, 'SYSTEM FLUSH DISTRIBUTED' = 113, 'SYSTEM FLUSH LOGS' = 114, 'SYSTEM FLUSH' = 115, 'SYSTEM THREAD FUZZER' = 116, 'SYSTEM' = 117, 'dictGet' = 118, 'addressToLine' = 119, 'addressToLineWithInlines' = 120, 'addressToSymbol' = 121, 'demangle' = 122, 'INTROSPECTION' = 123, 'FILE' = 124, 'URL' = 125, 'REMOTE' = 126, 'MONGO' = 127, 'MYSQL' = 128, 'POSTGRES' = 129, 'SQLITE' = 130, 'ODBC' = 131, 'JDBC' = 132, 'HDFS' = 133, 'S3' = 134, 'SOURCES' = 135, 'ALL' = 136, 'NONE' = 137)']
merge_tree_metadata_cache key ['new'] ['String']
merge_tree_metadata_cache value ['new'] ['String']
parts visible ['new'] ['UInt8']
parts creation_tid ['new'] ['Tuple(UInt64, UInt64, UUID)']
parts removal_tid_lock ['new'] ['UInt64']
parts removal_tid ['new'] ['Tuple(UInt64, UInt64, UUID)']
parts creation_csn ['new'] ['UInt64']
parts removal_csn ['new'] ['UInt64']
parts_columns subcolumns.bytes_on_disk ['new'] ['Array(UInt64)']
parts_columns subcolumns.data_compressed_bytes ['new'] ['Array(UInt64)']
parts_columns subcolumns.data_uncompressed_bytes ['new'] ['Array(UInt64)']
parts_columns subcolumns.marks_bytes ['new'] ['Array(UInt64)']
privileges privilege ['new','old'] ['Enum16('SHOW DATABASES' = 0, 'SHOW TABLES' = 1, 'SHOW COLUMNS' = 2, 'SHOW DICTIONARIES' = 3, 'SHOW' = 4, 'SHOW CACHES' = 5, 'SELECT' = 6, 'INSERT' = 7, 'ALTER UPDATE' = 8, 'ALTER DELETE' = 9, 'ALTER ADD COLUMN' = 10, 'ALTER MODIFY COLUMN' = 11, 'ALTER DROP COLUMN' = 12, 'ALTER COMMENT COLUMN' = 13, 'ALTER CLEAR COLUMN' = 14, 'ALTER RENAME COLUMN' = 15, 'ALTER MATERIALIZE COLUMN' = 16, 'ALTER COLUMN' = 17, 'ALTER MODIFY COMMENT' = 18, 'ALTER ORDER BY' = 19, 'ALTER SAMPLE BY' = 20, 'ALTER ADD INDEX' = 21, 'ALTER DROP INDEX' = 22, 'ALTER MATERIALIZE INDEX' = 23, 'ALTER CLEAR INDEX' = 24, 'ALTER INDEX' = 25, 'ALTER ADD PROJECTION' = 26, 'ALTER DROP PROJECTION' = 27, 'ALTER MATERIALIZE PROJECTION' = 28, 'ALTER CLEAR PROJECTION' = 29, 'ALTER PROJECTION' = 30, 'ALTER ADD CONSTRAINT' = 31, 'ALTER DROP CONSTRAINT' = 32, 'ALTER CONSTRAINT' = 33, 'ALTER TTL' = 34, 'ALTER MATERIALIZE TTL' = 35, 'ALTER SETTINGS' = 36, 'ALTER MOVE PARTITION' = 37, 'ALTER FETCH PARTITION' = 38, 'ALTER FREEZE PARTITION' = 39, 'ALTER DATABASE SETTINGS' = 40, 'ALTER TABLE' = 41, 'ALTER DATABASE' = 42, 'ALTER VIEW REFRESH' = 43, 'ALTER VIEW MODIFY QUERY' = 44, 'ALTER VIEW' = 45, 'ALTER' = 46, 'CREATE DATABASE' = 47, 'CREATE TABLE' = 48, 'CREATE VIEW' = 49, 'CREATE DICTIONARY' = 50, 'CREATE TEMPORARY TABLE' = 51, 'CREATE FUNCTION' = 52, 'CREATE' = 53, 'DROP DATABASE' = 54, 'DROP TABLE' = 55, 'DROP VIEW' = 56, 'DROP DICTIONARY' = 57, 'DROP FUNCTION' = 58, 'DROP' = 59, 'TRUNCATE' = 60, 'OPTIMIZE' = 61, 'BACKUP' = 62, 'KILL QUERY' = 63, 'KILL TRANSACTION' = 64, 'MOVE PARTITION BETWEEN SHARDS' = 65, 'CREATE USER' = 66, 'ALTER USER' = 67, 'DROP USER' = 68, 'CREATE ROLE' = 69, 'ALTER ROLE' = 70, 'DROP ROLE' = 71, 'ROLE ADMIN' = 72, 'CREATE ROW POLICY' = 73, 'ALTER ROW POLICY' = 74, 'DROP ROW POLICY' = 75, 'CREATE QUOTA' = 76, 'ALTER QUOTA' = 77, 'DROP QUOTA' = 78, 'CREATE SETTINGS PROFILE' = 79, 'ALTER SETTINGS PROFILE' = 80, 'DROP SETTINGS PROFILE' = 81, 'SHOW USERS' = 82, 'SHOW ROLES' = 83, 'SHOW ROW POLICIES' = 84, 'SHOW QUOTAS' = 85, 'SHOW SETTINGS PROFILES' = 86, 'SHOW ACCESS' = 87, 'ACCESS MANAGEMENT' = 88, 'SYSTEM SHUTDOWN' = 89, 'SYSTEM DROP DNS CACHE' = 90, 'SYSTEM DROP MARK CACHE' = 91, 'SYSTEM DROP UNCOMPRESSED CACHE' = 92, 'SYSTEM DROP MMAP CACHE' = 93, 'SYSTEM DROP COMPILED EXPRESSION CACHE' = 94, 'SYSTEM DROP FILESYSTEM CACHE' = 95, 'SYSTEM DROP SCHEMA CACHE' = 96, 'SYSTEM DROP CACHE' = 97, 'SYSTEM RELOAD CONFIG' = 98, 'SYSTEM RELOAD SYMBOLS' = 99, 'SYSTEM RELOAD DICTIONARY' = 100, 'SYSTEM RELOAD MODEL' = 101, 'SYSTEM RELOAD FUNCTION' = 102, 'SYSTEM RELOAD EMBEDDED DICTIONARIES' = 103, 'SYSTEM RELOAD' = 104, 'SYSTEM RESTART DISK' = 105, 'SYSTEM MERGES' = 106, 'SYSTEM TTL MERGES' = 107, 'SYSTEM FETCHES' = 108, 'SYSTEM MOVES' = 109, 'SYSTEM DISTRIBUTED SENDS' = 110, 'SYSTEM REPLICATED SENDS' = 111, 'SYSTEM SENDS' = 112, 'SYSTEM REPLICATION QUEUES' = 113, 'SYSTEM DROP REPLICA' = 114, 'SYSTEM SYNC REPLICA' = 115, 'SYSTEM RESTART REPLICA' = 116, 'SYSTEM RESTORE REPLICA' = 117, 'SYSTEM SYNC DATABASE REPLICA' = 118, 'SYSTEM SYNC TRANSACTION LOG' = 119, 'SYSTEM FLUSH DISTRIBUTED' = 120, 'SYSTEM FLUSH LOGS' = 121, 'SYSTEM FLUSH' = 122, 'SYSTEM THREAD FUZZER' = 123, 'SYSTEM UNFREEZE' = 124, 'SYSTEM' = 125, 'dictGet' = 126, 'addressToLine' = 127, 'addressToLineWithInlines' = 128, 'addressToSymbol' = 129, 'demangle' = 130, 'INTROSPECTION' = 131, 'FILE' = 132, 'URL' = 133, 'REMOTE' = 134, 'MONGO' = 135, 'MEILISEARCH' = 136, 'MYSQL' = 137, 'POSTGRES' = 138, 'SQLITE' = 139, 'ODBC' = 140, 'JDBC' = 141, 'HDFS' = 142, 'S3' = 143, 'HIVE' = 144, 'SOURCES' = 145, 'CLUSTER' = 146, 'ALL' = 147, 'NONE' = 148)','Enum16('SHOW DATABASES' = 0, 'SHOW TABLES' = 1, 'SHOW COLUMNS' = 2, 'SHOW DICTIONARIES' = 3, 'SHOW' = 4, 'SELECT' = 5, 'INSERT' = 6, 'ALTER UPDATE' = 7, 'ALTER DELETE' = 8, 'ALTER ADD COLUMN' = 9, 'ALTER MODIFY COLUMN' = 10, 'ALTER DROP COLUMN' = 11, 'ALTER COMMENT COLUMN' = 12, 'ALTER CLEAR COLUMN' = 13, 'ALTER RENAME COLUMN' = 14, 'ALTER MATERIALIZE COLUMN' = 15, 'ALTER COLUMN' = 16, 'ALTER MODIFY COMMENT' = 17, 'ALTER ORDER BY' = 18, 'ALTER SAMPLE BY' = 19, 'ALTER ADD INDEX' = 20, 'ALTER DROP INDEX' = 21, 'ALTER MATERIALIZE INDEX' = 22, 'ALTER CLEAR INDEX' = 23, 'ALTER INDEX' = 24, 'ALTER ADD PROJECTION' = 25, 'ALTER DROP PROJECTION' = 26, 'ALTER MATERIALIZE PROJECTION' = 27, 'ALTER CLEAR PROJECTION' = 28, 'ALTER PROJECTION' = 29, 'ALTER ADD CONSTRAINT' = 30, 'ALTER DROP CONSTRAINT' = 31, 'ALTER CONSTRAINT' = 32, 'ALTER TTL' = 33, 'ALTER MATERIALIZE TTL' = 34, 'ALTER SETTINGS' = 35, 'ALTER MOVE PARTITION' = 36, 'ALTER FETCH PARTITION' = 37, 'ALTER FREEZE PARTITION' = 38, 'ALTER DATABASE SETTINGS' = 39, 'ALTER TABLE' = 40, 'ALTER DATABASE' = 41, 'ALTER VIEW REFRESH' = 42, 'ALTER VIEW MODIFY QUERY' = 43, 'ALTER VIEW' = 44, 'ALTER' = 45, 'CREATE DATABASE' = 46, 'CREATE TABLE' = 47, 'CREATE VIEW' = 48, 'CREATE DICTIONARY' = 49, 'CREATE TEMPORARY TABLE' = 50, 'CREATE FUNCTION' = 51, 'CREATE' = 52, 'DROP DATABASE' = 53, 'DROP TABLE' = 54, 'DROP VIEW' = 55, 'DROP DICTIONARY' = 56, 'DROP FUNCTION' = 57, 'DROP' = 58, 'TRUNCATE' = 59, 'OPTIMIZE' = 60, 'KILL QUERY' = 61, 'MOVE PARTITION BETWEEN SHARDS' = 62, 'CREATE USER' = 63, 'ALTER USER' = 64, 'DROP USER' = 65, 'CREATE ROLE' = 66, 'ALTER ROLE' = 67, 'DROP ROLE' = 68, 'ROLE ADMIN' = 69, 'CREATE ROW POLICY' = 70, 'ALTER ROW POLICY' = 71, 'DROP ROW POLICY' = 72, 'CREATE QUOTA' = 73, 'ALTER QUOTA' = 74, 'DROP QUOTA' = 75, 'CREATE SETTINGS PROFILE' = 76, 'ALTER SETTINGS PROFILE' = 77, 'DROP SETTINGS PROFILE' = 78, 'SHOW USERS' = 79, 'SHOW ROLES' = 80, 'SHOW ROW POLICIES' = 81, 'SHOW QUOTAS' = 82, 'SHOW SETTINGS PROFILES' = 83, 'SHOW ACCESS' = 84, 'ACCESS MANAGEMENT' = 85, 'SYSTEM SHUTDOWN' = 86, 'SYSTEM DROP DNS CACHE' = 87, 'SYSTEM DROP MARK CACHE' = 88, 'SYSTEM DROP UNCOMPRESSED CACHE' = 89, 'SYSTEM DROP MMAP CACHE' = 90, 'SYSTEM DROP COMPILED EXPRESSION CACHE' = 91, 'SYSTEM DROP CACHE' = 92, 'SYSTEM RELOAD CONFIG' = 93, 'SYSTEM RELOAD SYMBOLS' = 94, 'SYSTEM RELOAD DICTIONARY' = 95, 'SYSTEM RELOAD MODEL' = 96, 'SYSTEM RELOAD FUNCTION' = 97, 'SYSTEM RELOAD EMBEDDED DICTIONARIES' = 98, 'SYSTEM RELOAD' = 99, 'SYSTEM RESTART DISK' = 100, 'SYSTEM MERGES' = 101, 'SYSTEM TTL MERGES' = 102, 'SYSTEM FETCHES' = 103, 'SYSTEM MOVES' = 104, 'SYSTEM DISTRIBUTED SENDS' = 105, 'SYSTEM REPLICATED SENDS' = 106, 'SYSTEM SENDS' = 107, 'SYSTEM REPLICATION QUEUES' = 108, 'SYSTEM DROP REPLICA' = 109, 'SYSTEM SYNC REPLICA' = 110, 'SYSTEM RESTART REPLICA' = 111, 'SYSTEM RESTORE REPLICA' = 112, 'SYSTEM FLUSH DISTRIBUTED' = 113, 'SYSTEM FLUSH LOGS' = 114, 'SYSTEM FLUSH' = 115, 'SYSTEM THREAD FUZZER' = 116, 'SYSTEM' = 117, 'dictGet' = 118, 'addressToLine' = 119, 'addressToLineWithInlines' = 120, 'addressToSymbol' = 121, 'demangle' = 122, 'INTROSPECTION' = 123, 'FILE' = 124, 'URL' = 125, 'REMOTE' = 126, 'MONGO' = 127, 'MYSQL' = 128, 'POSTGRES' = 129, 'SQLITE' = 130, 'ODBC' = 131, 'JDBC' = 132, 'HDFS' = 133, 'S3' = 134, 'SOURCES' = 135, 'ALL' = 136, 'NONE' = 137)']
privileges parent_group ['new','old'] ['Nullable(Enum16('SHOW DATABASES' = 0, 'SHOW TABLES' = 1, 'SHOW COLUMNS' = 2, 'SHOW DICTIONARIES' = 3, 'SHOW' = 4, 'SHOW CACHES' = 5, 'SELECT' = 6, 'INSERT' = 7, 'ALTER UPDATE' = 8, 'ALTER DELETE' = 9, 'ALTER ADD COLUMN' = 10, 'ALTER MODIFY COLUMN' = 11, 'ALTER DROP COLUMN' = 12, 'ALTER COMMENT COLUMN' = 13, 'ALTER CLEAR COLUMN' = 14, 'ALTER RENAME COLUMN' = 15, 'ALTER MATERIALIZE COLUMN' = 16, 'ALTER COLUMN' = 17, 'ALTER MODIFY COMMENT' = 18, 'ALTER ORDER BY' = 19, 'ALTER SAMPLE BY' = 20, 'ALTER ADD INDEX' = 21, 'ALTER DROP INDEX' = 22, 'ALTER MATERIALIZE INDEX' = 23, 'ALTER CLEAR INDEX' = 24, 'ALTER INDEX' = 25, 'ALTER ADD PROJECTION' = 26, 'ALTER DROP PROJECTION' = 27, 'ALTER MATERIALIZE PROJECTION' = 28, 'ALTER CLEAR PROJECTION' = 29, 'ALTER PROJECTION' = 30, 'ALTER ADD CONSTRAINT' = 31, 'ALTER DROP CONSTRAINT' = 32, 'ALTER CONSTRAINT' = 33, 'ALTER TTL' = 34, 'ALTER MATERIALIZE TTL' = 35, 'ALTER SETTINGS' = 36, 'ALTER MOVE PARTITION' = 37, 'ALTER FETCH PARTITION' = 38, 'ALTER FREEZE PARTITION' = 39, 'ALTER DATABASE SETTINGS' = 40, 'ALTER TABLE' = 41, 'ALTER DATABASE' = 42, 'ALTER VIEW REFRESH' = 43, 'ALTER VIEW MODIFY QUERY' = 44, 'ALTER VIEW' = 45, 'ALTER' = 46, 'CREATE DATABASE' = 47, 'CREATE TABLE' = 48, 'CREATE VIEW' = 49, 'CREATE DICTIONARY' = 50, 'CREATE TEMPORARY TABLE' = 51, 'CREATE FUNCTION' = 52, 'CREATE' = 53, 'DROP DATABASE' = 54, 'DROP TABLE' = 55, 'DROP VIEW' = 56, 'DROP DICTIONARY' = 57, 'DROP FUNCTION' = 58, 'DROP' = 59, 'TRUNCATE' = 60, 'OPTIMIZE' = 61, 'BACKUP' = 62, 'KILL QUERY' = 63, 'KILL TRANSACTION' = 64, 'MOVE PARTITION BETWEEN SHARDS' = 65, 'CREATE USER' = 66, 'ALTER USER' = 67, 'DROP USER' = 68, 'CREATE ROLE' = 69, 'ALTER ROLE' = 70, 'DROP ROLE' = 71, 'ROLE ADMIN' = 72, 'CREATE ROW POLICY' = 73, 'ALTER ROW POLICY' = 74, 'DROP ROW POLICY' = 75, 'CREATE QUOTA' = 76, 'ALTER QUOTA' = 77, 'DROP QUOTA' = 78, 'CREATE SETTINGS PROFILE' = 79, 'ALTER SETTINGS PROFILE' = 80, 'DROP SETTINGS PROFILE' = 81, 'SHOW USERS' = 82, 'SHOW ROLES' = 83, 'SHOW ROW POLICIES' = 84, 'SHOW QUOTAS' = 85, 'SHOW SETTINGS PROFILES' = 86, 'SHOW ACCESS' = 87, 'ACCESS MANAGEMENT' = 88, 'SYSTEM SHUTDOWN' = 89, 'SYSTEM DROP DNS CACHE' = 90, 'SYSTEM DROP MARK CACHE' = 91, 'SYSTEM DROP UNCOMPRESSED CACHE' = 92, 'SYSTEM DROP MMAP CACHE' = 93, 'SYSTEM DROP COMPILED EXPRESSION CACHE' = 94, 'SYSTEM DROP FILESYSTEM CACHE' = 95, 'SYSTEM DROP SCHEMA CACHE' = 96, 'SYSTEM DROP CACHE' = 97, 'SYSTEM RELOAD CONFIG' = 98, 'SYSTEM RELOAD SYMBOLS' = 99, 'SYSTEM RELOAD DICTIONARY' = 100, 'SYSTEM RELOAD MODEL' = 101, 'SYSTEM RELOAD FUNCTION' = 102, 'SYSTEM RELOAD EMBEDDED DICTIONARIES' = 103, 'SYSTEM RELOAD' = 104, 'SYSTEM RESTART DISK' = 105, 'SYSTEM MERGES' = 106, 'SYSTEM TTL MERGES' = 107, 'SYSTEM FETCHES' = 108, 'SYSTEM MOVES' = 109, 'SYSTEM DISTRIBUTED SENDS' = 110, 'SYSTEM REPLICATED SENDS' = 111, 'SYSTEM SENDS' = 112, 'SYSTEM REPLICATION QUEUES' = 113, 'SYSTEM DROP REPLICA' = 114, 'SYSTEM SYNC REPLICA' = 115, 'SYSTEM RESTART REPLICA' = 116, 'SYSTEM RESTORE REPLICA' = 117, 'SYSTEM SYNC DATABASE REPLICA' = 118, 'SYSTEM SYNC TRANSACTION LOG' = 119, 'SYSTEM FLUSH DISTRIBUTED' = 120, 'SYSTEM FLUSH LOGS' = 121, 'SYSTEM FLUSH' = 122, 'SYSTEM THREAD FUZZER' = 123, 'SYSTEM UNFREEZE' = 124, 'SYSTEM' = 125, 'dictGet' = 126, 'addressToLine' = 127, 'addressToLineWithInlines' = 128, 'addressToSymbol' = 129, 'demangle' = 130, 'INTROSPECTION' = 131, 'FILE' = 132, 'URL' = 133, 'REMOTE' = 134, 'MONGO' = 135, 'MEILISEARCH' = 136, 'MYSQL' = 137, 'POSTGRES' = 138, 'SQLITE' = 139, 'ODBC' = 140, 'JDBC' = 141, 'HDFS' = 142, 'S3' = 143, 'HIVE' = 144, 'SOURCES' = 145, 'CLUSTER' = 146, 'ALL' = 147, 'NONE' = 148))','Nullable(Enum16('SHOW DATABASES' = 0, 'SHOW TABLES' = 1, 'SHOW COLUMNS' = 2, 'SHOW DICTIONARIES' = 3, 'SHOW' = 4, 'SELECT' = 5, 'INSERT' = 6, 'ALTER UPDATE' = 7, 'ALTER DELETE' = 8, 'ALTER ADD COLUMN' = 9, 'ALTER MODIFY COLUMN' = 10, 'ALTER DROP COLUMN' = 11, 'ALTER COMMENT COLUMN' = 12, 'ALTER CLEAR COLUMN' = 13, 'ALTER RENAME COLUMN' = 14, 'ALTER MATERIALIZE COLUMN' = 15, 'ALTER COLUMN' = 16, 'ALTER MODIFY COMMENT' = 17, 'ALTER ORDER BY' = 18, 'ALTER SAMPLE BY' = 19, 'ALTER ADD INDEX' = 20, 'ALTER DROP INDEX' = 21, 'ALTER MATERIALIZE INDEX' = 22, 'ALTER CLEAR INDEX' = 23, 'ALTER INDEX' = 24, 'ALTER ADD PROJECTION' = 25, 'ALTER DROP PROJECTION' = 26, 'ALTER MATERIALIZE PROJECTION' = 27, 'ALTER CLEAR PROJECTION' = 28, 'ALTER PROJECTION' = 29, 'ALTER ADD CONSTRAINT' = 30, 'ALTER DROP CONSTRAINT' = 31, 'ALTER CONSTRAINT' = 32, 'ALTER TTL' = 33, 'ALTER MATERIALIZE TTL' = 34, 'ALTER SETTINGS' = 35, 'ALTER MOVE PARTITION' = 36, 'ALTER FETCH PARTITION' = 37, 'ALTER FREEZE PARTITION' = 38, 'ALTER DATABASE SETTINGS' = 39, 'ALTER TABLE' = 40, 'ALTER DATABASE' = 41, 'ALTER VIEW REFRESH' = 42, 'ALTER VIEW MODIFY QUERY' = 43, 'ALTER VIEW' = 44, 'ALTER' = 45, 'CREATE DATABASE' = 46, 'CREATE TABLE' = 47, 'CREATE VIEW' = 48, 'CREATE DICTIONARY' = 49, 'CREATE TEMPORARY TABLE' = 50, 'CREATE FUNCTION' = 51, 'CREATE' = 52, 'DROP DATABASE' = 53, 'DROP TABLE' = 54, 'DROP VIEW' = 55, 'DROP DICTIONARY' = 56, 'DROP FUNCTION' = 57, 'DROP' = 58, 'TRUNCATE' = 59, 'OPTIMIZE' = 60, 'KILL QUERY' = 61, 'MOVE PARTITION BETWEEN SHARDS' = 62, 'CREATE USER' = 63, 'ALTER USER' = 64, 'DROP USER' = 65, 'CREATE ROLE' = 66, 'ALTER ROLE' = 67, 'DROP ROLE' = 68, 'ROLE ADMIN' = 69, 'CREATE ROW POLICY' = 70, 'ALTER ROW POLICY' = 71, 'DROP ROW POLICY' = 72, 'CREATE QUOTA' = 73, 'ALTER QUOTA' = 74, 'DROP QUOTA' = 75, 'CREATE SETTINGS PROFILE' = 76, 'ALTER SETTINGS PROFILE' = 77, 'DROP SETTINGS PROFILE' = 78, 'SHOW USERS' = 79, 'SHOW ROLES' = 80, 'SHOW ROW POLICIES' = 81, 'SHOW QUOTAS' = 82, 'SHOW SETTINGS PROFILES' = 83, 'SHOW ACCESS' = 84, 'ACCESS MANAGEMENT' = 85, 'SYSTEM SHUTDOWN' = 86, 'SYSTEM DROP DNS CACHE' = 87, 'SYSTEM DROP MARK CACHE' = 88, 'SYSTEM DROP UNCOMPRESSED CACHE' = 89, 'SYSTEM DROP MMAP CACHE' = 90, 'SYSTEM DROP COMPILED EXPRESSION CACHE' = 91, 'SYSTEM DROP CACHE' = 92, 'SYSTEM RELOAD CONFIG' = 93, 'SYSTEM RELOAD SYMBOLS' = 94, 'SYSTEM RELOAD DICTIONARY' = 95, 'SYSTEM RELOAD MODEL' = 96, 'SYSTEM RELOAD FUNCTION' = 97, 'SYSTEM RELOAD EMBEDDED DICTIONARIES' = 98, 'SYSTEM RELOAD' = 99, 'SYSTEM RESTART DISK' = 100, 'SYSTEM MERGES' = 101, 'SYSTEM TTL MERGES' = 102, 'SYSTEM FETCHES' = 103, 'SYSTEM MOVES' = 104, 'SYSTEM DISTRIBUTED SENDS' = 105, 'SYSTEM REPLICATED SENDS' = 106, 'SYSTEM SENDS' = 107, 'SYSTEM REPLICATION QUEUES' = 108, 'SYSTEM DROP REPLICA' = 109, 'SYSTEM SYNC REPLICA' = 110, 'SYSTEM RESTART REPLICA' = 111, 'SYSTEM RESTORE REPLICA' = 112, 'SYSTEM FLUSH DISTRIBUTED' = 113, 'SYSTEM FLUSH LOGS' = 114, 'SYSTEM FLUSH' = 115, 'SYSTEM THREAD FUZZER' = 116, 'SYSTEM' = 117, 'dictGet' = 118, 'addressToLine' = 119, 'addressToLineWithInlines' = 120, 'addressToSymbol' = 121, 'demangle' = 122, 'INTROSPECTION' = 123, 'FILE' = 124, 'URL' = 125, 'REMOTE' = 126, 'MONGO' = 127, 'MYSQL' = 128, 'POSTGRES' = 129, 'SQLITE' = 130, 'ODBC' = 131, 'JDBC' = 132, 'HDFS' = 133, 'S3' = 134, 'SOURCES' = 135, 'ALL' = 136, 'NONE' = 137))']
processes is_all_data_sent ['new'] ['UInt8']
quota_limits max_written_bytes ['new'] ['Nullable(UInt64)']
quota_usage written_bytes ['new'] ['Nullable(UInt64)']
quota_usage max_written_bytes ['new'] ['Nullable(UInt64)']
quotas_usage written_bytes ['new'] ['Nullable(UInt64)']
quotas_usage max_written_bytes ['new'] ['Nullable(UInt64)']
remote_data_paths disk_name ['new'] ['String']
remote_data_paths path ['new'] ['String']
remote_data_paths cache_base_path ['new'] ['String']
remote_data_paths local_path ['new'] ['String']
remote_data_paths remote_path ['new'] ['String']
remote_data_paths cache_paths ['new'] ['Array(String)']
schema_inference_cache storage ['new'] ['String']
schema_inference_cache source ['new'] ['String']
schema_inference_cache format ['new'] ['String']
schema_inference_cache additional_format_info ['new'] ['String']
schema_inference_cache registration_time ['new'] ['DateTime']
schema_inference_cache schema ['new'] ['String']
settings_changes version ['new'] ['String']
settings_changes changes ['new'] ['Array(Tuple(name String, previous_value String, new_value String, reason String))']

settings and merge_tree_settings

source name old_value new_value new_description
merge_tree_settings allow_remote_fs_zero_copy_replication 1 0 Don't use this setting in production, because it is not ready.
merge_tree_settings merge_tree_clear_old_broken_detached_parts_ttl_timeout_seconds 2592000 Remove old broken detached parts in the background if they remained intouched for a specified by this setting period of time.
merge_tree_settings merge_tree_enable_clear_old_broken_detached 0 Enable clearing old broken detached parts operation in background.
merge_tree_settings remove_rolled_back_parts_immediately 1 Setting for an incomplete experimental feature.
merge_tree_settings use_metadata_cache 0 Experimental feature to speed up parts loading process by using MergeTree metadata cache
settings additional_result_filter Additional filter expression which would be applied to query result
settings additional_table_filters {} Additional filter expression which would be applied after reading from specified table. Syntax: {'table1': 'expression', 'database.table2': 'expression'}
settings allow_deprecated_database_ordinary 0 Allow to create databases with deprecated Ordinary engine
settings allow_deprecated_syntax_for_merge_tree 0 Allow to create *MergeTree tables with deprecated engine definition syntax
settings allow_experimental_geo_types 0 1 Allow geo data types such as Point, Ring, Polygon, MultiPolygon
settings allow_experimental_hash_functions 0 Enable experimental hash functions (hashid, etc)
settings allow_experimental_lightweight_delete 0 Enable lightweight DELETE mutations for mergetree tables. Work in progress
settings allow_settings_after_format_in_insert 0 Allow SETTINGS after FORMAT, but note, that this is not always safe (note: this is a compatibility setting).
settings backup_threads 16 The maximum number of threads to execute BACKUP requests.
settings collect_hash_table_stats_during_aggregation 1 Enable collecting hash table statistics to optimize memory allocation
settings column_names_for_schema_inference The list of column names to use in schema inference for formats without column names. The format: 'column1,column2,column3,...'
settings compatibility Changes other settings according to provided ClickHouse version. If we know that we changed some behaviour in ClickHouse by changing some settings in some version, this compatibility setting will control these settings
settings compatibility_ignore_auto_increment_in_create_table 0 Ignore AUTO_INCREMENT keyword in column declaration if true, otherwise return error. It simplifies migration from MySQL
settings compatibility_ignore_collation_in_create_table 1 Compatibility ignore collation in create table
settings compile_sort_description 1 Compile sort description to native code.
settings count_distinct_optimization 0 Rewrite count distinct to subquery of group by
settings database_replicated_enforce_synchronous_settings 0 Enforces synchronous waiting for some queries (see also database_atomic_wait_for_drop_and_detach_synchronously, mutation_sync, replication_alter_partitions_sync). Not recommended to enable these settings.
settings distributed_ddl_entry_format_version 1 3 Compatibility version of distributed DDL (ON CLUSTER) queries
settings enable_filesystem_cache 1 Use cache for remote filesystem. This setting does not turn on/off cache for disks (must be done via disk config), but allows to bypass cache for some queries if intended
settings enable_filesystem_cache_log 0 Allows to record the filesystem caching log for each query
settings enable_filesystem_cache_on_lower_level 1 If read buffer supports caching inside threadpool, allow it to do it, otherwise cache outside ot threadpool. Do not use this setting, it is needed for testing
settings enable_filesystem_cache_on_write_operations 0 Write into cache on write operations. To actually work this setting requires be added to disk config too
settings enable_positional_arguments 0 1 Enable positional arguments in ORDER BY, GROUP BY and LIMIT BY
settings enable_s3_requests_logging 0 Enable very explicit logging of S3 requests. Makes sense for debug only.
settings exact_rows_before_limit 0 When enabled, ClickHouse will provide exact value for rows_before_limit_at_least statistic, but with the cost that the data before limit will have to be read completely
settings filesystem_cache_max_wait_sec 5 Allow to wait at most this number of seconds for download of current remote_fs_buffer_size bytes, and skip cache if exceeded
settings format_csv_allow_single_quotes 1 0 If it is set to true, allow strings in single quotes.
settings group_by_use_nulls 0 Treat columns mentioned in ROLLUP, CUBE or GROUPING SETS as Nullable
settings implicit_transaction 0 If enabled and not already inside a transaction, wraps the query inside a full transaction (begin + commit or rollback)
settings input_format_arrow_case_insensitive_column_matching 0 Ignore case when matching Arrow columns with CH columns.
settings input_format_arrow_skip_columns_with_unsupported_types_in_schema_inference 0 Skip columns with unsupported types while schema inference for format Arrow
settings input_format_avro_null_as_default 0 For Avro/AvroConfluent format: insert default in case of null and non Nullable column
settings input_format_capn_proto_skip_fields_with_unsupported_types_in_schema_inference 0 Skip columns with unsupported types while schema inference for format CapnProto
settings input_format_csv_skip_first_lines 0 Skip specified number of lines at the beginning of data in CSV format
settings input_format_csv_use_best_effort_in_schema_inference 1 Use some tweaks and heuristics to infer schema in CSV format
settings input_format_json_read_bools_as_numbers 1 Allow to parse bools as numbers in JSON input formats
settings input_format_json_try_infer_numbers_from_strings 1 Try to infer numbers from string fields while schema inference
settings input_format_max_rows_to_read_for_schema_inference 100 25000 The maximum rows of data to read for automatic schema inference
settings input_format_mysql_dump_map_column_names 1 Match columns from table in MySQL dump and columns from ClickHouse table by names
settings input_format_mysql_dump_table_name Name of the table in MySQL dump from which to read data
settings input_format_orc_case_insensitive_column_matching 0 Ignore case when matching ORC columns with CH columns.
settings input_format_orc_skip_columns_with_unsupported_types_in_schema_inference 0 Skip columns with unsupported types while schema inference for format ORC
settings input_format_parquet_case_insensitive_column_matching 0 Ignore case when matching Parquet columns with CH columns.
settings input_format_parquet_skip_columns_with_unsupported_types_in_schema_inference 0 Skip columns with unsupported types while schema inference for format Parquet
settings input_format_protobuf_flatten_google_wrappers 0 Enable Google wrappers for regular non-nested columns, e.g. google.protobuf.StringValue 'str' for String column 'str'. For Nullable columns empty wrappers are recognized as defaults, and missing as nulls
settings input_format_protobuf_skip_fields_with_unsupported_types_in_schema_inference 0 Skip fields with unsupported types while schema inference for format Protobuf
settings input_format_skip_unknown_fields 0 1 Skip columns with unknown names from input data (it works for JSONEachRow, -WithNames, -WithNamesAndTypes and TSKV formats).
settings input_format_try_infer_dates 1 Try to infer dates from string fields while schema inference in text formats
settings input_format_try_infer_datetimes 1 Try to infer datetimes from string fields while schema inference in text formats
settings input_format_try_infer_integers 1 Try to infer numbers from string fields while schema inference in text formats
settings input_format_tsv_skip_first_lines 0 Skip specified number of lines at the beginning of data in TSV format
settings input_format_tsv_use_best_effort_in_schema_inference 1 Use some tweaks and heuristics to infer schema in TSV format
settings input_format_use_lowercase_column_name 0
settings join_algorithm hash default Specify join algorithm.
settings local_filesystem_read_method pread pread_threadpool Method of reading data from local filesystem, one of: read, pread, mmap, pread_threadpool.
settings log_processors_profiles 0 Log Processors profile events.
settings log_query_threads 1 0 Log query threads into system.query_thread_log table. This setting have effect only when 'log_queries' is true.
settings max_backup_threads 0
settings max_download_buffer_size 10485760 The maximal size of buffer for parallel downloading (e.g. for URL engine) per each thread.
settings max_download_threads 4 The maximum number of threads to download data (e.g. for URL engine).
settings max_entries_for_hash_table_stats 10000 How many entries hash table statistics collected during aggregation is allowed to have
settings max_guaranteed_memory_usage 0
settings max_guaranteed_memory_usage_for_user 0
settings max_insert_delayed_streams_for_parallel_write 0 The maximum number of streams (columns) to delay final part flush. Default - auto (1000 in case of underlying storage supports parallel write, for example S3 and disabled otherwise)
settings max_query_cache_size 137438953472 Max remote filesystem cache size that can be used by a single query
settings max_remote_read_network_bandwidth_for_server 0 The maximum speed of data exchange over the network in bytes per second for read. Zero means unlimited. Only has meaning at server startup.
settings max_remote_write_network_bandwidth_for_server 0 The maximum speed of data exchange over the network in bytes per second for write. Zero means unlimited. Only has meaning at server startup.
settings max_size_to_preallocate_for_aggregation 10000000 For how many elements it is allowed to preallocate space in all hash tables in total before aggregation
settings memory_overcommit_ratio_denominator 1073741824 It represents soft memory limit on the user level. This value is used to compute query overcommit ratio.
settings memory_overcommit_ratio_denominator_for_user 1073741824 It represents soft memory limit on the global level. This value is used to compute query overcommit ratio.
settings memory_usage_overcommit_max_wait_microseconds 0 5000000 Maximum time thread will wait for memory to be freed in the case of memory overcommit. If timeout is reached and memory is not freed, exception is thrown.
settings min_count_to_compile_sort_description 3 The number of identical sort descriptions before they are JIT-compiled
settings multiple_joins_try_to_keep_original_names 0 Do not add aliases to top level expression list on multiple joins rewrite
settings odbc_bridge_use_connection_pooling 1 Use connection pooling in ODBC bridge. If set to false, a new connection is created every time
settings opentelemetry_trace_processors 0 Collect OpenTelemetry spans for processors.
settings optimize_distinct_in_order 1 Enable DISTINCT optimization if some columns in DISTINCT form a prefix of sorting. For example, prefix of sorting key in merge tree or ORDER BY statement
settings optimize_multiif_to_if 1 Replace 'multiIf' with only one condition to 'if'.
settings optimize_or_like_chain 0 Optimize multiple OR LIKE into multiMatchAny. This optimization should not be enabled by default, because it defies index analysis in some cases.
settings optimize_read_in_window_order 1 Enable ORDER BY optimization in window clause for reading data in corresponding order in MergeTree tables.
settings optimize_sorting_by_input_stream_properties 1 Optimize sorting by sorting properties of input stream
settings output_format_arrow_string_as_string 0 Use Arrow String type instead of Binary for String columns
settings output_format_json_named_tuples_as_objects 0 1 Serialize named tuple columns as JSON objects.
settings output_format_orc_string_as_string 0 Use ORC String type instead of Binary for String columns
settings output_format_parquet_string_as_string 0 Use Parquet String type instead of Binary for String columns.
settings output_format_protobuf_nullables_with_google_wrappers 0 When serializing Nullable columns with Google wrappers, serialize default values as empty wrappers. If turned off, default and null values are not serialized
settings output_format_sql_insert_include_column_names 1 Include column names in INSERT query
settings output_format_sql_insert_max_batch_size 65505 The maximum number of rows in one INSERT statement.
settings output_format_sql_insert_quote_names 1 Quote column names with '`' characters
settings output_format_sql_insert_table_name table The name of table in the output INSERT query
settings output_format_sql_insert_use_replace 0 Use REPLACE statement instead of INSERT
settings parts_to_delay_insert 150 If the destination table contains at least that many active parts in a single partition, artificially slow down insert into table.
settings parts_to_throw_insert 300 If more than this number active parts in a single partition of the destination table, throw 'Too many parts ...' exception.
settings postgresql_connection_pool_auto_close_connection 0 Close connection before returning connection to the pool.
settings query_plan_optimize_primary_key 1 Analyze primary key using query plan (instead of AST)
settings read_from_filesystem_cache_if_exists_otherwise_bypass_cache 0
settings remote_fs_cache_max_wait_sec 5
settings remote_fs_enable_cache 1
settings restore_threads 16 The maximum number of threads to execute RESTORE requests.
settings schema_inference_cache_require_modification_time_for_url 1 Use schema from cache for URL with last modification time validation (for urls with Last-Modified header)
settings schema_inference_hints The list of column names and types to use in schema inference for formats without column names. The format: 'column1,column2,column3,...'
settings schema_inference_use_cache_for_file 1 Use cache in schema inference while using file table function
settings schema_inference_use_cache_for_hdfs 1 Use cache in schema inference while using hdfs table function
settings schema_inference_use_cache_for_s3 1 Use cache in schema inference while using s3 table function
settings schema_inference_use_cache_for_url 1 Use cache in schema inference while using url table function
settings send_logs_source_regexp Send server text logs with specified regexp to match log source name. Empty means all sources.
settings skip_download_if_exceeds_query_cache 1 Skip download from remote filesystem if exceeds query cache size
settings sleep_after_receiving_query_ms 0 Time to sleep after receiving query in TCPHandler
settings stream_like_engine_insert_queue When stream like engine reads from multiple queues, user will need to select one queue to insert into when writing. Used by Redis Streams and NATS.
settings throw_if_no_data_to_insert 1 Enables or disables empty INSERTs, enabled by default
settings throw_on_unsupported_query_inside_transaction 1 Throw exception if unsupported query is used inside transaction
settings use_structure_from_insertion_table_in_table_functions 0 Use structure from insertion table instead of schema inference from data
settings wait_changes_become_visible_after_commit_mode wait_unknown Wait for committed changes to become actually visible in the latest snapshot
settings wait_for_window_view_fire_signal_timeout 10 Timeout for waiting for window view fire signal in event time processing
settings window_view_clean_interval 5 60 The clean interval of window view in seconds to free outdated data.
settings zstd_window_log_max 0 Allows you to select the max window log of ZSTD (it will not be used for MergeTree family)

Other

source name groupArray(version)
data_type_families IntervalMicrosecond ['new']
data_type_families IntervalMillisecond ['new']
data_type_families IntervalNanosecond ['new']
errors ACCESS_STORAGE_DOESNT_ALLOW_BACKUP ['new']
errors BACKUP_ELEMENT_DUPLICATE ['old']
errors CANNOT_BACKUP_DATABASE ['new']
errors CANNOT_BACKUP_TABLE ['new']
errors CANNOT_CONNECT_NATS ['new']
errors CANNOT_PARSE_BACKUP_SETTINGS ['new']
errors CANNOT_RESTORE_DATABASE ['new']
errors CANNOT_SEND_SIGNAL ['new']
errors CANNOT_USE_CACHE ['new']
errors CAPN_PROTO_BAD_TYPE ['new']
errors FAILED_TO_SYNC_BACKUP_OR_RESTORE ['new']
errors FS_METADATA_ERROR ['new']
errors HDFS_ERROR ['new']
errors INCONSISTENT_METADATA_FOR_BACKUP ['new']
errors INVALID_TRANSACTION ['new']
errors MEILISEARCH_EXCEPTION ['new']
errors MEILISEARCH_MISSING_SOME_COLUMNS ['new']
errors NUMBER_OF_DIMENSIONS_MISMATCHED ['new']
errors NUMBER_OF_DIMENSIONS_MISMATHED ['old']
errors ONLY_NULLS_WHILE_READING_SCHEMA ['new']
errors QUOTA_EXCEEDED ['new']
errors QUOTA_EXPIRED ['old']
errors SERIALIZATION_ERROR ['new']
errors UNKNOWN_STATUS_OF_TRANSACTION ['new']
errors UNSUPPORTED_MEILISEARCH_TYPE ['new']
errors WRONG_BACKUP_SETTINGS ['new']
errors WRONG_DDL_RENAMING_SETTINGS ['new']
events AggregationHashTablesInitializedAsTwoLevel ['new']
events AggregationPreallocatedElementsInHashTables ['new']
events AsyncInsertBytes ['new']
events CachedReadBufferCacheWriteBytes ['new']
events CachedReadBufferCacheWriteMicroseconds ['new']
events CachedReadBufferReadFromCacheBytes ['new']
events CachedReadBufferReadFromCacheMicroseconds ['new']
events CachedReadBufferReadFromSourceBytes ['new']
events CachedReadBufferReadFromSourceMicroseconds ['new']
events CachedWriteBufferCacheWriteBytes ['new']
events CachedWriteBufferCacheWriteMicroseconds ['new']
events DirectorySync ['new']
events DirectorySyncElapsedMicroseconds ['new']
events ExecuteShellCommand ['new']
events FileSegmentCacheWriteMicroseconds ['new']
events FileSegmentPredownloadMicroseconds ['new']
events FileSegmentReadMicroseconds ['new']
events FileSegmentUsedBytes ['new']
events FileSegmentWaitReadBufferMicroseconds ['new']
events FileSync ['new']
events FileSyncElapsedMicroseconds ['new']
events InsertedCompactParts ['new']
events InsertedInMemoryParts ['new']
events InsertedWideParts ['new']
events KafkaBackgroundReads ['new']
events KafkaCommitFailures ['new']
events KafkaCommits ['new']
events KafkaConsumerErrors ['new']
events KafkaDirectReads ['new']
events KafkaMessagesFailed ['new']
events KafkaMessagesPolled ['new']
events KafkaMessagesProduced ['new']
events KafkaMessagesRead ['new']
events KafkaProducerErrors ['new']
events KafkaProducerFlushes ['new']
events KafkaRebalanceAssignments ['new']
events KafkaRebalanceErrors ['new']
events KafkaRebalanceRevocations ['new']
events KafkaRowsRead ['new']
events KafkaRowsRejected ['new']
events KafkaRowsWritten ['new']
events KafkaWrites ['new']
events KeeperCommits ['new']
events KeeperCommitsFailed ['new']
events KeeperLatency ['new']
events KeeperPacketsReceived ['new']
events KeeperPacketsSent ['new']
events KeeperReadSnapshot ['new']
events KeeperRequestTotal ['new']
events KeeperSaveSnapshot ['new']
events KeeperSnapshotApplys ['new']
events KeeperSnapshotApplysFailed ['new']
events KeeperSnapshotCreations ['new']
events KeeperSnapshotCreationsFailed ['new']
events MemoryOvercommitWaitTimeMicroseconds ['new']
events MergeTreeMetadataCacheDelete ['new']
events MergeTreeMetadataCacheGet ['new']
events MergeTreeMetadataCacheHit ['new']
events MergeTreeMetadataCacheMiss ['new']
events MergeTreeMetadataCachePut ['new']
events MergeTreeMetadataCacheSeek ['new']
events MergedIntoCompactParts ['new']
events MergedIntoInMemoryParts ['new']
events MergedIntoWideParts ['new']
events OtherQueryTimeMicroseconds ['new']
events OverflowAny ['new']
events OverflowBreak ['new']
events OverflowThrow ['new']
events ReadBufferFromS3Bytes ['new']
events ReadBufferFromS3Microseconds ['new']
events ReadBufferFromS3RequestsErrors ['new']
events RemoteFSCacheDownloadBytes ['old']
events RemoteFSCacheReadBytes ['old']
events RemoteFSReadBytes ['old']
events RemoteFSReadMicroseconds ['old']
events S3ReadBytes ['old']
events S3WriteBytes ['old']
events SchemaInferenceCacheEvictions ['new']
events SchemaInferenceCacheHits ['new']
events SchemaInferenceCacheInvalidations ['new']
events SchemaInferenceCacheMisses ['new']
events ThreadpoolReaderReadBytes ['new']
events ThreadpoolReaderTaskMicroseconds ['new']
events WriteBufferFromS3Bytes ['new']
events ZooKeeperSync ['new']
formats JSONColumns ['new']
formats JSONColumnsWithMetadata ['new']
formats JSONCompactColumns ['new']
formats JSONLines ['new']
formats MySQLDump ['new']
formats NDJSON ['new']
formats PrettyCompactNoEscapesMonoBlock ['new']
formats PrettyMonoBlock ['new']
formats PrettyNoEscapesMonoBlock ['new']
formats PrettySpaceMonoBlock ['new']
formats PrettySpaceNoEscapesMonoBlock ['new']
formats Prometheus ['new']
formats ProtobufList ['new']
formats SQLInsert ['new']
functions L2SquaredDistance ['new']
functions L2SquaredNorm ['new']
functions LAST_DAY ['new']
functions addMicroseconds ['new']
functions addMilliseconds ['new']
functions addNanoseconds ['new']
functions arrayFirstOrNull ['new']
functions arrayLastOrNull ['new']
functions base58Decode ['new']
functions base58Encode ['new']
functions distanceL2Squared ['new']
functions flattenTuple ['new']
functions getTypeSerializationStreams ['new']
functions h3Distance ['new']
functions h3GetDestinationIndexFromUnidirectionalEdge ['new']
functions h3GetIndexesFromUnidirectionalEdge ['new']
functions h3GetOriginIndexFromUnidirectionalEdge ['new']
functions h3GetPentagonIndexes ['new']
functions h3GetRes0Indexes ['new']
functions h3GetUnidirectionalEdge ['new']
functions h3GetUnidirectionalEdgeBoundary ['new']
functions h3GetUnidirectionalEdgesFromHexagon ['new']
functions h3HexRing ['new']
functions h3Line ['new']
functions h3PointDistKm ['new']
functions h3PointDistM ['new']
functions h3PointDistRads ['new']
functions h3UnidirectionalEdgeIsValid ['new']
functions hashid ['new']
functions isNullable ['new']
functions kostikConsistentHash ['new']
functions makeDate ['new']
functions makeDate32 ['new']
functions makeDateTime ['new']
functions makeDateTime64 ['new']
functions meiliMatch ['new']
functions minSampleSizeContinous ['new']
functions minSampleSizeConversion ['new']
functions nonNegativeDerivative ['new']
functions normL2Squared ['new']
functions nowInBlock ['new']
functions nth_value ['new']
functions parseDateTime64BestEffortUS ['new']
functions parseDateTime64BestEffortUSOrNull ['new']
functions parseDateTime64BestEffortUSOrZero ['new']
functions parseTimeDelta ['new']
functions revision ['new']
functions showCertificate ['new']
functions subtractMicroseconds ['new']
functions subtractMilliseconds ['new']
functions subtractNanoseconds ['new']
functions toIntervalMicrosecond ['new']
functions toIntervalMillisecond ['new']
functions toIntervalNanosecond ['new']
functions toLastDayOfMonth ['new']
functions toStartOfFiveMinutes ['new']
functions toStartOfMicrosecond ['new']
functions toStartOfMillisecond ['new']
functions toStartOfNanosecond ['new']
functions transactionID ['new']
functions transactionLatestSnapshot ['new']
functions transactionOldestSnapshot ['new']
functions translate ['new']
functions translateUTF8 ['new']
functions wyHash64 ['new']
metrics CacheDetachedFileSegments ['new']
metrics CacheFileSegments ['new']
metrics FilesystemCacheElements ['new']
metrics FilesystemCacheReadBuffers ['new']
metrics FilesystemCacheSize ['new']
metrics KafkaAssignedPartitions ['new']
metrics KafkaBackgroundReads ['new']
metrics KafkaConsumers ['new']
metrics KafkaConsumersInUse ['new']
metrics KafkaConsumersWithAssignment ['new']
metrics KafkaLibrdkafkaThreads ['new']
metrics KafkaProducers ['new']
metrics KafkaWrites ['new']
metrics KeeperAliveConnections ['new']
metrics KeeperOutstandingRequets ['new']
metrics S3Requests ['new']
table_engines MeiliSearch ['new']
table_engines NATS ['new']
table_functions MeiliSearch ['new']
table_functions mongodb ['new']
table_functions viewIfPermitted ['new']
Raw
default_config_changes.txt
SELECT
file_name,
replace(xpath, '/yandex', '/clickhouse') AS x,
groupArray((version, value)),
uniqExact(tuple(value)),
count()
FROM configs
WHERE version IN (22.3, 22.8)
GROUP BY
file_name,
x
HAVING (uniqExact(tuple(value)) > 1) OR (count() < 2)
ORDER BY
file_name ASC,
x ASC
Query id: d159f915-0de8-4472-9ee5-39af629702fb
┌─file_name──┬─x─────────────────────────────────────────────────────────────────────────────────────────────┬─groupArray(tuple(version, value))───────────────────────────────────────────────────────────────────────────────────┬─uniqExact(value)─┬─count()─┐
│ config.xml │ /clickhouse/access_control_improvements │ [(22.8,NULL)] │ 0 │ 1 │
│ config.xml │ /clickhouse/access_control_improvements/on_cluster_queries_require_cluster_grant │ [(22.8,'false')] │ 1 │ 1 │
│ config.xml │ /clickhouse/access_control_improvements/select_from_information_schema_requires_grant │ [(22.8,'false')] │ 1 │ 1 │
│ config.xml │ /clickhouse/access_control_improvements/select_from_system_db_requires_grant │ [(22.8,'false')] │ 1 │ 1 │
│ config.xml │ /clickhouse/access_control_improvements/users_without_row_policies_can_read_rows │ [(22.8,'false')] │ 1 │ 1 │
│ config.xml │ /clickhouse/concurrent_threads_soft_limit │ [(22.8,'0')] │ 1 │ 1 │
│ config.xml │ /clickhouse/graphite_rollup_example/default/retention/age │ [(22.8,'0'),(22.8,'3600'),(22.8,'86400'),(22.3,'0'),(22.3,'3600'),(22.3,'86400')] │ 3 │ 6 │
│ config.xml │ /clickhouse/graphite_rollup_example/default/retention/precision │ [(22.8,'60'),(22.8,'300'),(22.8,'3600'),(22.3,'60'),(22.3,'300'),(22.3,'3600')] │ 3 │ 6 │
│ config.xml │ /clickhouse/graphite_rollup_example/pattern/retention/age │ [(22.8,'0'),(22.8,'86400'),(22.3,'0'),(22.3,'86400')] │ 2 │ 4 │
│ config.xml │ /clickhouse/graphite_rollup_example/pattern/retention/precision │ [(22.8,'3600'),(22.8,'60'),(22.3,'3600'),(22.3,'60')] │ 2 │ 4 │
│ config.xml │ /clickhouse/openSSL/server/certificateFile │ [(22.3,'/etc/clickhouse-server/server.crt')] │ 1 │ 1 │
│ config.xml │ /clickhouse/openSSL/server/privateKeyFile │ [(22.3,'/etc/clickhouse-server/server.key')] │ 1 │ 1 │
│ config.xml │ /clickhouse/processors_profile_log │ [(22.8,NULL)] │ 0 │ 1 │
│ config.xml │ /clickhouse/processors_profile_log/database │ [(22.8,'system')] │ 1 │ 1 │
│ config.xml │ /clickhouse/processors_profile_log/flush_interval_milliseconds │ [(22.8,'7500')] │ 1 │ 1 │
│ config.xml │ /clickhouse/processors_profile_log/partition_by │ [(22.8,'toYYYYMM(event_date)')] │ 1 │ 1 │
│ config.xml │ /clickhouse/processors_profile_log/table │ [(22.8,'processors_profile_log')] │ 1 │ 1 │
│ config.xml │ /clickhouse/remote_servers/test_cluster_one_shard_three_replicas_localhost/shard/replica/host │ [(22.8,'127.0.0.1'),(22.8,'127.0.0.2'),(22.8,'127.0.0.3'),(22.3,'127.0.0.1'),(22.3,'127.0.0.2'),(22.3,'127.0.0.3')] │ 3 │ 6 │
│ config.xml │ /clickhouse/remote_servers/test_cluster_two_shards/shard/replica/host │ [(22.8,'127.0.0.1'),(22.8,'127.0.0.2'),(22.3,'127.0.0.1'),(22.3,'127.0.0.2')] │ 2 │ 4 │
│ config.xml │ /clickhouse/remote_servers/test_cluster_two_shards_internal_replication/shard/replica/host │ [(22.8,'127.0.0.1'),(22.8,'127.0.0.2'),(22.3,'127.0.0.1'),(22.3,'127.0.0.2')] │ 2 │ 4 │
│ config.xml │ /clickhouse/remote_servers/test_unavailable_shard/shard/replica/port │ [(22.8,'9000'),(22.8,'1'),(22.3,'9000'),(22.3,'1')] │ 2 │ 4 │
│ config.xml │ /clickhouse/session_log │ [(22.3,NULL)] │ 0 │ 1 │
│ config.xml │ /clickhouse/session_log/database │ [(22.3,'system')] │ 1 │ 1 │
│ config.xml │ /clickhouse/session_log/flush_interval_milliseconds │ [(22.3,'7500')] │ 1 │ 1 │
│ config.xml │ /clickhouse/session_log/partition_by │ [(22.3,'toYYYYMM(event_date)')] │ 1 │ 1 │
│ config.xml │ /clickhouse/session_log/table │ [(22.3,'session_log')] │ 1 │ 1 │
│ users.xml │ /clickhouse/profiles/default/max_memory_usage │ [(22.3,'10000000000')] │ 1 │ 1 │
└────────────┴───────────────────────────────────────────────────────────────────────────────────────────────┴─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────┴─────────┘
27 rows in set. Elapsed: 0.006 sec.
Raw
gistfile2.txt
http://presentations.clickhouse.com/release_22.4/index.html#4
Gaps Filling With Interpolation
Date and Time Construction:
makeDate / makeDateTime / makeDateTime64 / toLastDayOfMonth
INTERVAL MILLISECOND, MICROSECOND, NANOSECOND:
toStartOfMillisecond, -Microsecond, -Nanosecond
add/subtractMilliseconds, -Microseconds, -Nanoseconds
Full support for H3:
— h3PointDistM;
— h3PointDistKm;
— h3PointDistRads;
— h3GetRes0Indexes;
— h3GetPentagonIndexes.
Security Improvements
Salted Passwords
Usability Improvements
Sanity Checks on server startup.
— displayed in clickhouse-client and in the server log;
— provide checks for common mistakes in server operation;
Examples:
— "Linux is not using fast TSC clock source."
— "Linux memory overcommit is disabled."
— "Linux threads max count is too low."
— "Rotational disk with disabled readahead is in use."
Note: if users are created on version 22.4+, you cannot downgrade to 22.3.
Transactions
ACID. MVCC. Snapshot Isolation.
Functions pull-up after ORDER BY and LIMIT:
Parallel downloads.
— for SELECT FROM URL and S3 tables;
— controlled by max_download_threads and max_download_buffer_size;
Developer: Antonio Anđelić.
Parallel uploads.
— for INSERT INTO FUNCTION s3;
Prediction of hash table size.
For ASOF JOIN*.
For hasAll function for arrays.
https://presentations.clickhouse.com/release_22.5/#
— GROUPING SETS;
MySQLDump as input format:
Prometheus as output format
system.certificates
Flexible Memory Limits
— max_memory_usage is not set by default;
— new settings memory_overcommit_ratio_denominator, memory_overcommit_ratio_denominator_for_user;
in case of memory shortage,
  the most "overcommitted" query will be killed;
— other queries will wait for up to
  memory_usage_overcommit_max_wait_microseconds;
— max_memory_usage and max_memory_usage_for_user
  can act as hard limits;
Heavy query can use as much memory as available
as long as no smaller queries need memory.
22.6
GROUPING
New JSON Formats
— JSONColumns
— JSONCompactColumns
— JSONColumnsWithMetadata
FPC Codec
Non-Constant LIKE and match
INSERT INTO ZooKeeper
Parametric Executable UDF
SELECT my_function('hello')(x)
clickhouse-disks \
--config-file ... \
--disk ... \
list|read|write|remove|link|copy path
A ton of optimizations for AArch64 with ARM NEON!
Cold queries from MergeTree will start faster.
— developer: Anton Kozlov, CloudFlare.
Avoid VFS cache thrashing.
Move cases for condition pushdown into JOIN.
Filtering reads from s3/hdfs/etc with _file and _path.
ClickHouse Go Driver
Official integration with dbt,
Official integration with Airbyte,
22.7
Window Functions Inside Expressions
SQLInsert Format
MongoDB table function
MeiliSearch integration
Streaming import from NATS
New JOIN algorithms direct / parallel_hash / full_sorting_merge
SET additional_result_filter = $$ name = 'Vasya' $$;
Speed-up of SELECT with FINAL modifier.
base58Encode
group_by_use_nulls
multiMatch, multiSearch, ... — support for non-constant needles.
SET compatibility = '21.8'
Updated Benchmark
Self-Extracting Executable
Date32/DateTime64 range: 1900–2300.
Query Parameters In Interactive Mode
SET exact_rows_before_limit = 1
Distributed INSERT SELECT FROM s3Cluster
JSON Server Log Format
SELECT INTO OUTFILE AND STDOUT
DELETE Query
Compatibility Of AggregateFunction States
https://fiddle.clickhouse.com/
ClickHouse release 22.4, 2022-04-19
Backward Incompatible Change
Do not allow SETTINGS after FORMAT for INSERT queries (there is compatibility setting allow_settings_after_format_in_insert to accept such queries, but it is turned OFF by default). #35883 (Azat Khuzhin).
Function yandexConsistentHash (consistent hashing algorithm by Konstantin "kostik" Oblakov) is renamed to kostikConsistentHash. The old name is left as an alias for compatibility. Although this change is backward compatible, we may remove the alias in subsequent releases, that's why it's recommended to update the usages of this function in your apps. #35553 (Alexey Milovidov).
Profiling on Processors level (under log_processors_profiles setting, ClickHouse will write time that processor spent during execution/waiting for data to system.processors_profile_log table). #34355 (Azat Khuzhin).
ProtobufList
Added load balancing setting for [Zoo]Keeper client. Closes #29617. #30325 (小路).
Add a new kind of row policies named simple. Before this PR we had two kinds or row policies: permissive and restrictive. A simple row policy adds a new filter on a table without any side-effects like it was for permissive and restrictive policies. #35345 (Vitaly Baranov).
Experimental Feature
Added support for transactions for simple MergeTree tables.
remote FS cache
An option to store parts metadata in RocksDB. Speed up parts loading process of MergeTree to accelerate starting up of clickhouse-server. With this improvement, clickhouse-server was able to decrease starting up time from 75 minutes to 20 seconds, with 700k mergetree parts. #32928
Multiple improvements for schema inference. Use some tweaks and heuristics to determine numbers, strings, arrays, tuples and maps in CSV, TSV and TSVRaw data formats.
input_format_csv_use_best_effort_in_schema_inference
input_format_tsv_use_best_effort_in_schema_inference
input_format_{parquet|orc|arrow}_skip_columns_with_unsupported_types_in_schema_inference
column_names_for_schema_inference
support ALTER TABLE t DETACH PARTITION (ALL). #35794 (awakeljw).
ALTER TABLE ... RESET SETTING
Add some basic metrics to monitor engine=Kafka tables. #35916 (filimonov).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment