Skip to content

Instantly share code, notes, and snippets.

@systay
Last active April 22, 2021 17:58
Show Gist options
  • Save systay/bf45ace581e1dac7e730939cb7fdb76f to your computer and use it in GitHub Desktop.
Save systay/bf45ace581e1dac7e730939cb7fdb76f to your computer and use it in GitHub Desktop.

Other

Component: Build/CI

  • Github Actions CI Builds: convert matrix strategy for unit and cluster tests to individual tests #7258
  • Descriptive names for CI checks #7289
  • Testing upgrade path from / downgrade path to v8.0.0 #7294
  • Backport: Testing version upgrade/downgrade path from/to 8.0 #7323
  • [vtctld] vtctldclient command pkg #7321
  • Add mysqlctl to docker images #7326
  • update java build versions to vitess 10.0.0 #7383
  • CI: check run analysis to post JSON from file #7386
  • Fix Dockerfiles for vtexplain and vtctlclient #7418
  • CI Tests: Add descriptive names to vrep shards. Update test generator script #7454
  • CI: adding 'go mod tidy' test #7461
  • docker vitess/vtctlclient: Install curl #7466
  • Add VT_BASE_VER to vtexplain/Dockerfile #7467
  • Enable -mysql_server_version in vttestserver, and utilize it in vttestserver container images #7474
  • removed unused tests for Wordpress installation #7516
  • [vtctld | tests only] testtmclient refactor #7518
  • Add tools.go #7517
  • CI: skip some tests on forked repos #7527
  • Fix unit test fail after merge #7550
  • Add mysqlctl docker image #7557
  • Restore CI workflow shard 26, accidentally dropped #7569
  • ci-workflow-gen: turn string to array to reduce conflicts #7582
  • update CODEOWNERS #7586
  • Fuzzing: Add oss-fuzz build script #7591
  • Add percona-toolkit (for pt-osc/pt-online-schema-change) to the docker/lite images #7603
  • CI: Use ubuntu-18.04 in tests #7614
  • tests: disable flaky test until it can be fixed #7623
  • tests: reset stat at the beginning of test #7644
  • Cleanup mysql server_test #7645
  • Make vttestserver compatible with persistent data directories #7718
  • Add vtorc binary for rpm,deb builds #7750
  • examples: source correct shell script in README #7749
  • [Java] Guava update to 31.1.1 #7764
  • update moby/term to fix darwin build issue #7787
  • Removing Linux/amd64 specific subdependencies #7796
  • make: build vitess as static binaries by default #7795
  • Makefile: add cross-build target for cross-compiling client binaries #7806
  • docker/vttestserver: Set max_connections in default-fast.cnf at container build time #7810
  • Bump MySQL version for docker builds to 8.0.23 #7811
  • clean up test #7816

Component: Cluster management

  • fix hang when local topo was down #7278
  • [vtctld] Fix accidentally-broken legacy vtctl output format #7285
  • [vtctld] Fix accidentally-broken legacy vtctl output format #7285
  • [vtctld] Migrate cell getters #7302
  • Expose vtctld gRPC port in local Docker example + update VTAdmin README #7306
  • [vtctld] migrate tablet getters #7311
  • Refresh replicas and rdonly after MigrateServedTypes except on skipRefreshState. #7327
  • [vtctld] Add GetSrvVSchema command #7334
  • [vtctld] Migrate GetSchema #7346
  • [vtctld] Migrate ListBackups as GetBackups in new vtctld server #7352
  • use provided xtrabackup_root_path to find xbstream #7359
  • [vtctld] Migrate GetVSchema to VtctldServer #7360
  • Correctly initialize statsTabletTypeCounts during startup #7390
  • OnlineDDL: update gh-ost binary to v1.1.1 #7394
  • [vtctldclient] Set SilenceErrors on the root command, so we don't double-log #7404
  • [vtctld] Migrate topo management RPCs #7395
  • command line flags: dashes and underscores synonyms #7406
  • Extract the maxReplPosSearch struct out to topotools #7420
  • Add protoutil package, refactor ISP to use it #7421
  • Add ErrorGroup to package concurrency, use in waitOnNMinusOneTablets #7429
  • [vtctld / wrangler] Extract some reparent methods out to functions for shared use between wrangler and VtctldServer #7434
  • more resilient rebuild keyspace graph check, tablet controls not in e… #7442
  • Provide named function for squashing usage errors; start using it #7451
  • [concurrency] Add guard against potentially blocking forever in ErrorGroup.Wait() when NumGoroutines is 0 #7463
  • [vtctld/wrangler] Extract EmergencyReparentShard logic to dedicated struct and add unit tests #7464
  • Fix for Query Serving when Toposerver is Down #7484
  • [reparentutil / ERS] confirm at least one replica succeeded to SetMaster, or fail #7486
  • [reparentutil / wrangler] Extract PlannedReparentShard logic from wrangler to PlannedReparenter struct #7501
  • go/vt/mysqlctl/backup.go: add backup/restore duration stats #7512
  • [reparentutil] ERS should not attempt to WaitForRelayLogsToApply on primary tablets that were not running replication #7523
  • orchestrator: prevent XSS attack via 'orchestrator-msg' params #7526
  • [vtctld] Add remaining reparent commands to VtctldServer #7536
  • Add test with NULL input values for vindexes that did not have any. #7552
  • shutdown vttablet gracefully if tablet record disappears #7563
  • Respect -disable_active_reparents in backup/restore #7576
  • ApplySchema: -skip_preflight #7587
  • Table GC: disable binary logging on best effort basis #7588
  • pprof: allow stopping profiling early with a signal #7594
  • Fuzzing: Add vtctl fuzzer #7605
  • add combine TLS certs feature #7609
  • Addition of waitSig pprof argument to start recording on USR1 #7616
  • Fuzzing: Add more fuzzers #7622
  • Fuzzing: Add 3 fuzzers for mysql endpoints #7639
  • healthcheck: update healthy tablets correctly when a stream returns an error or times out #7654
  • Check error response before attempting to access InitShardPrimary response #7658
  • [vtctld] Migrate GetSrvKeyspace as GetSrvKeyspaces in VtctldServer #7680
  • [reparentutil | ERS] Bind status variable to each goroutine in WaitForRelayLogsToApply #7692
  • [vtctld] Migrate ShardReplicationPositions #7690
  • servenv: fix var shadowing caused by short variable declaration #7702
  • restore: check disable_active_reparents properly before waiting for position update #7703
  • Implements CLI tool for rule management #7712
  • [vtctl|vtctldserver] List/Get Tablets timeouts #7715
  • vtctl ApplySchema supports '-request_context' flag #7777
  • Bump Bootstrap version, per CVE-2018-14040 (orchestrator/vtorc) #7824

Component: Query Serving

  • Support for caching_sha2_password plugin in mysql/client #6716
  • Vault Support #7233
  • Adds Planning and Parsing Support for Truncate, Rename, Drop Index and Flush #7242
  • fix create table format function to include if not exists #7250
  • added default databases when calling 'show databases' #7256
  • Add Update.AddWhere to mirror Select.AddWhere #7277
  • Added some unit test cases for CREATE TABLE parser #7279
  • removed resolver usage from StreamExecute #7281
  • Support for CALL procedures #7287
  • made the default for @@workload to OLTP #7288
  • Addition of @@enable_system_settings to vtgate #7300
  • Gen4: Handling subquery in query graph #7313
  • Gen4: Add Limit clause support #7312
  • Fix VitessAware system variables of type boolean return NULL when MySQL is not involved #7353
  • Gen4 fallback planning #7370
  • Add vtgate stats for RowsAffected similar to RowsReturned #7380
  • Make DROP/CREATE DATABASE pluggable #7381
  • Cached Size Implementation #7387
  • gen4: fail unsupported queries #7409
  • Temporary Table support in unsharded keyspace #7411
  • Add hook for statsd integration #7417
  • Online DDL via VReplication #7419
  • Fix information_schema query with system schema in table_schema filter #7430
  • Fix Set Statement in Tablet when executed with bindvars #7431
  • added information_schema_stats_expiry to allowed list of set vars #7435
  • LFU Cache Implementation #7439
  • Publish table size on schema #7444
  • Describe table to route based on table name and qualifier #7445
  • Olap error message fix #7448
  • plan: remove mutexes #7468
  • Moving Show plan from executor to planbuilder #7475
  • LFU Cache Fixes #7479
  • Report lag stats in poller #7490
  • make sure to add necessary bindvars when preparing queries #7493
  • servenv: provide a global flag for profiling #7496
  • Fix table parsing on VSchema generation #7511
  • mysql/server: add PreHandleFunc hook for connections #7513
  • Change Error Messages In VTGate #7514
  • Show anywhere plan fix to consider default keyspace #7531
  • [9.0] Show anywhere plan fix to consider default keyspace #7530
  • Produce query warnings for using features not supported when sharded #7538
  • Reset Session for Reserved Connection when the connection id is not found #7539
  • [9.0] Reset Session for Reserved Connection when the connection id is not found #7544
  • vttablet: fix flaky tests #7543
  • cache: handle all possible initialization cases #7556
  • Update AST helper generation #7558
  • Remove unused key.Destination.IsUnique() #7565
  • Avoiding addition of redundant unary operators #7579
  • Optimise AST rewriting #7583
  • Allow Select with lock to pass through in vttablet #7584
  • add support for SELECT ALL #7593
  • perf: keyword lookups in the tokenizer #7606
  • empty statement error code change in sql parsing #7618
  • perf: zero-copy tokenizer #7619
  • Online DDL: internal support for eta_seconds #7630
  • Socket system variable to return vitess mysql socket #7637
  • Online DDL: support 'SHOW VITESS_MIGRATIONS' queries #7638
  • Fix for reserved connection usage with transaction #7646
  • Support for REVERT VITESS_MIGRATION statement #7656
  • Fuzzing: Add new mysql fuzzer #7660
  • Support for ALTER VITESS_MIGRATION statements #7663
  • perf: sqlparser yacc codegen #7669
  • AST Equals code generator #7672
  • Solve I_S queries using CNF rewriting #7677
  • tabletserver: more resilient wait for schema changes #7684
  • more system schema queries #7685
  • grpcvtgateconn: Add fuzzer #7689
  • VTGate: support -enable_online_ddl flag #7694
  • fix flush statement planner #7695
  • perf: cache reserved bind variables in queries #7698
  • Make the AST visitor faster #7701
  • Fix MySQL Workbench failure on login with select current_user() #7705
  • perf: sqlparser faster formatting #7710
  • COM_PREPARE - Single TCP response packet with all MySQL Packets #7713
  • Replace the database name in result fields only if needed #7714
  • Speed up AST rewriting #7716
  • Mysql Fuzzer: Add requirement for minimum length of input data #7722
  • declarative Online DDL #7725
  • making fast AST rewriter faster #7726
  • split ast_helper into individual gen files #7727
  • show columns query on system schema #7729
  • Healthcheck: update healthy tablets correctly when a stream returns an error or times out #7732
  • Fix dual table query when system schema is selected database #7734
  • added information_Schema query on prepare statement #7746
  • Tests for numeric_precision and numeric_scale columns in information_schema #7763
  • mysql_fuzzer: Make more calls during each iteration #7766
  • Disallow foreign key constraint on ddl #7780
  • Add support for showing global vgtid executed #7797
  • perf: vttablet/mysql optimizations #7800
  • Fix bug with reserved connections to stale tablets #7879

Component: VReplication

  • VReplication DryRun: Report current dry run results for v2 commands #7255
  • Vreplication V2 Workflows: rename Abort to Cancel #7276
  • VReplication: Miscellaneous improvements #7275
  • VStreamer Events: remove preceding zeroes from decimals in Row Events #7297
  • Tablet throttle: support "/throttle/check-self" available on all tablets #7319
  • vstreamer to throttle on source endpoint #7324
  • Backport #7276: Vreplication V2 Workflows: rename Abort to Cancel #7339
  • Workflow Show: use timeUpdated to calculate vreplication lag #7342
  • VReplication Stats: publish the state of streams #7343
  • Backport #7255: VReplication DryRun: Report current dry run results for v2 commands #7345
  • Backport 7275: VReplication: Miscellaneous improvements #7349
  • Backport 7342: Workflow Show: use timeUpdated to calculate vreplication lag #7354
  • Backport 7361: vtctl: Add missing err checks for VReplication v2 #7363
  • VReplication: throttle on target tablet #7364
  • vtctl: Add missing err checks for VReplication v2 #7361
  • Throttler: fix to client usage in vreplication and table GC #7422
  • MoveTables/Reshard: add flags to start workflows in a stopped state and to stop workflow once copy is completed #7449
  • OnlineDDL: Revert for VReplication based migrations #7478
  • Validate SrvKeyspace during Reshard/SwitchReads #7481
  • MoveTables: Refresh SrvVSchema (for Routing Rules) and source tablets (for Blacklisted Tables) on completion #7505
  • Tablet throttler: support for custom query & threshold #7541
  • VReplication: data migration from another Vitess cluster #7546
  • vttablet: benchmarks and two small optimizations #7560
  • Materialize: Add cells and tablet_types parameters #7562
  • VStream API: allow aligning streams from different shards to minimize skews across the streams #7626
  • VRep JSON Columns: fix bug where vreplication of update statements were failing #7640
  • Make the frequency at which heartbeats update the _vt.vreplication table configurable #7659
  • VReplication: error out if binlog compression is turned on #7670
  • Rowlog: Update rowlog for the API change made for the vstream skew alignment feature #7809
  • VReplicationErrors metric: use . as delimiter instead of _ to behave well with Prometheus #7807

Component: VTAdmin

  • [vtadmin-web] Add React Router + a skeleton /debug page to VTAdmin #7310
  • [vtadmin-web] Add CSS variables + fonts to VTAdmin #7309
  • [vtadmin-web] Add NavRail component #7316
  • [vtadmin-web] Add Button + Icon components #7350
  • [vtadmin-web] Add icons + focus state to NavRail #7365
  • [vtadmin-web] Add TextInput component #7366
  • [vtadmin-web] Add vtadmin-web build flag for configuring fetch credentials #7414
  • [vtadmin-api] Add cluster field to vtadmin-api's /api/gates response #7425
  • [vtadmin-api] Add /api/clusters endpoint to vtadmin-api #7426
  • [vtadmin-api] Add /api/schemas endpoint to vtadmin-api #7432
  • [vtadmin-web] Add routes and simple tables for all entities #7440
  • [vtadmin-web] Set document.title from route components #7450
  • [vtadmin-api] Add shards to /api/keyspaces response #7453
  • [vtadmin-web] Add DataTable component with URL pagination #7487
  • [vtadmin-web] Add replaceQuery + pushQuery to useURLQuery hook #7507
  • [vtadmin-web] An initial pass for tablet filters #7515
  • perf: RPC Serialization #7519
  • [vtadmin-web] Add a Select component #7524
  • [vtadmin-api] Add /vtexplain endpoint #7528
  • [vtadmin-api] Reorganize tablet-related functions into vtadmin/cluster/cluster.go #7553
  • [vtadmin-web] Three small bugfixes in Tablets table around stable sort order, display type lookup, and filtering by type #7568
  • [vtadmin/testutil] Add testutil helper to manage the complexity of recursively calling WithTestServer #7601
  • [vtadmin] Add GetSchema endpoint #7596
  • [vtadmin] Add FindSchema route #7610
  • [vtadmin-web] Add simple /schema view with table definition #7615
  • [vtadmin] vschemas api endpoints #7625
  • [vtadmin] Add support for additional service healthchecks in grpcserver #7635
  • [vtadmin] test refactors #7641
  • [vtadmin] propagate error contexts #7642
  • [vtadmin] tracing refactor #7649
  • [vtadmin] GetWorkflow(s) endpoints #7662
  • [vtadmin] add to local example #7699
  • [vitessdriver|vtadmin] Support Ping in vitessdriver, use in vtadmin to healthcheck connections during Dial #7709
  • [vtadmin] vtexplain lock #7724
  • [vtadmin] Aggregate schema sizes #7751
  • [vtadmin-web] Add comments + 'options' parameter to API hooks #7754
  • [vtadmin-web] Add common max-width to infrastructure table views #7760
  • [vtadmin-web] Add hooks + skeleton view for workflows #7762
  • [vtadmin-web] Add a hasty filter input to the /schemas view #7779
  • Update GetSchema filtering to exclude shards where IsMasterServing but no MasterAlias #7805
  • [vtadmin-api] Reintroduce include_non_serving_shards opt to GetSchema #7814
  • [vtadmin-web] Add DataCell component #7817
  • Rewrite useTableDefinitions hook as getTableDefinitions util #7821
  • [vtadmin-web] Display (approximate) table sizes + row count on /schemas view #7826
  • [vtadmin-web] Add Pip + TabletServingPip components #7827

Other

  • Removing mercurial references. #1
  • examples: update demo #7205
  • Migrate vtctlclient InitShardMaster => vtctldclient InitShardPrimary #7220
  • Planner refactoring #7103
  • Delete select_commerce_data.sql #7245
  • Make dependency install a bit more robust #7260
  • docker images for vttestserver #7262
  • Cherry pick version of #7233 for release-9.0 #7265
  • [vtadmin] Add vtctld proxy to vtadmin API, add GetKeyspaces endpoint #7266
  • Add VTAdmin to list of components in PR template #7267
  • [9.0] don't try to compare varchars in vtgate #7271
  • Gen4 Planner: AxB vs BxA #7274
  • Backport: [vtctld] Fix accidentally-broken legacy vtctl output format #7292
  • docker/vttestserver: Add MYSQL_BIND_HOST env #7293
  • Default to false for system settings to be changed per session at the database connection level #7299
  • Backport 7297: VStreamer Events: remove preceding zeroes from decimals in Row Events #7340
  • fix common select script to work for both local and operator examples #7348
  • Fix some comment typos #7367
  • Update Java version to 9.0 #7369
  • Add new code owners #7497
  • Add option to log queries only when rows returned/affected >= X #7509
  • [vtctld] Add v0 GetWorkflows rpc and workflow/vexec packages #7575
  • Online DDL: code cleanup #7589
  • Add common tags for stats backends that support it #7651
  • [9.0] Fix for reserved connection usage with transaction #7666
  • VReplication: optimize the catchup phases by filtering out rows which not within range of copied pks during inserts #7708
  • [9.0] Fix MySQL Workbench failure on login with select current_user() #7706
  • Use Dba user when Vexec is runAsAdmin #7731
  • Dynamic throttle metric threshold #7742
  • fix select star, col1 orderby col1 bug. #7743
  • Improved error messages (tabletserver) #7747
  • vttablet: stream consolidation #7752
  • [vtadmin-web] Add hooks + skeleton view for workflow details #7767
  • [vttest] disable field caching in vttest #7768
  • [Gen4] Initial Horizon Planning #7775
  • [vtadmin] GetSchema(s) should always check keyspace field when filtering tablets #7773
  • [9.0] make sure to handle subqueries on top of subqueries #7776
  • [9.0] make sure to not log sensitive information #7778
  • Fuzzing: Fixup oss-fuzz build script #7782
  • [tablet, queryrules] Extend query rules to check comments #7784
  • correct several wrong words #7822
  • perf: optimize bind var generation #7828
  • VTExplain: Add support for multi table join query #7829
  • Attempt to fix TLS Server Flaky test #7842
  • TestMakeCommonTags Flaky Test: match elements #7843
  • upgrade tests: test against v9.0.0 #7848
  • tabletserver: fix flaky test #7851
  • git: improve signoff detection #7852
  • Add support for showing global gtid executed per shard #7856
  • FOSSA scan added #7862
  • Wrangler tests: Return a fake tablet in the wrangler test dialer to avoid tablet picker errors spamming the test logs #7863
  • [vtadmin-web] Add useSyncedURLParam hook to persist filter parameter in the URL #7857
  • Minor cleanups around errors on the vtgate #7864
  • CI: run some tests inside docker to workaround GH Actions issue #7868
  • Add missing return in vtctld-* DSN case, and log any flag that gets ignored #7872
  • log unsupported queries #7865
  • [vtadmin-web] Display more data on /gates view and add filtering #7876
  • vreplication: performance & benchmarks (table copying) #7881
  • [vtadmin] Promote ErrNoSchema to a TypedError which returns http 404 #7885
  • add vtctldclient to binary directory #7889
  • Revert "[tablet, queryrules] Extend query rules to check comments" #7897
  • Planbuilder: Add fuzzer #7902
  • Memory Sort to close the goroutines when callback returns error #7903
  • mysql: Small adjustments to fuzzer #7907
  • ci: fix all racy tests #7904
  • MAINTAINERS.md: Update enisoc's email. #7909
  • Check tablet alias before removing after error stream #7915
  • [vtadmin-web] Display vindex data on Schema view #7917
  • vtctl: return error on invalid ddl_strategy #7923
  • Fix flaky race condition in vtexplain #7930

Type: Bug

Component: Build/CI

  • Fixes bug that prevents creation of logs directory #7761

Component: Query Serving

  • Fixes the error messages in drop, create and alter database commands #7397
  • Allows any ordering of generic options in column definitions #7459
  • Removes printing of ENFORCED word so that statements remain compatible with mysql 5.7 #7458
  • Adds another case to merge routes for information_schema queries #7504
  • Corrects the comment handling in vitess #7581
  • Fixes ordering in SELECT INTO and printing of strings #7655
  • fix regression - should be able to plan subquery on top of subquery #7682
  • Nullable Timestamp Column Fix #7740
  • Constraint names and database names with spaces. #7745
  • make sure to not log sensitive information #7774
  • Routing of Information Schema Queries #7841
  • Panic when EOF after @ symbol #7925

Other

  • Don't turn varchar vindex queries into IN #7268
  • [9.0] fix regression - should be able to plan subquery on top of subquery #7683
  • make sure to handle subqueries on top of subqueries #7730

Type: Documentation

Component: Build/CI

  • Update version for latest snapshot #7801

Other

  • Pull Request template: link to contribution guide #7314
  • examples/operator: fix tags and add vtorc example #7357
  • Backport and fix tags for examples/operator #7358
  • 9.0.0 Release Notes #7385
  • 9.0.0 Release Notes #7384
  • Add Severity Labels document #7542
  • Update to remove Google Groups #7664
  • Move some commas around in README.md :) #7671
  • Add Andrew Mason to Maintainers List #7757
  • 10_0_RC1 Release Notes #7786

Type: Enhancement

Component: Build/CI

  • Workflow to check make sizegen #7535
  • Add Show Status query to vtexplain and make asthelpergen/sizegen quiet #7590
  • Fixes vttestserver to work with sharded keyspaces #7617

Component: Query Serving

  • added vitess_version as variable #7295
  • Change @@version and @@version_comment #7337
  • Add innodb_read_rows as vttablet metric #7520
  • Fix Metadata in SHOW queries #7540
  • Adds support for Show variables #7547
  • Adds support for ordering on character fields for sharded keyspace queries #7678

Type: Feature Request

Component: Query Serving

  • Use the emulated MySQL version for special comments #7510
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment