Skip to content

Instantly share code, notes, and snippets.

@matthewdarwin

matthewdarwin/tikv-backup.log Secret

Created May 4, 2022 19:08
Show Gist options
  • Save matthewdarwin/e9267ff900a44b511915b686dbc83783 to your computer and use it in GitHub Desktop.
Save matthewdarwin/e9267ff900a44b511915b686dbc83783 to your computer and use it in GitHub Desktop.
Download ZIP
tikv-backup failed
Raw
tikv-backup.log
[2022/05/04 17:38:19.479 +00:00] [INFO] [client.go:896] ["try backup"] [startKey=74727864623B00FFFF3A14D6BEBABB6DFBC0128B656504E14837E614744D15CA7981586163F77B0939A37AA73064E1F9836986F096618B026ADCA0F1C7EB0CA9C2A075A4418DA9] [endKey=74727864623B01F16A2706A2140D46779368D753B72975EA2D98D1A9067185FF6DE94931CC446C] [storeID=649575725] ["retry time"=0]
[2022/05/04 17:38:24.135 +00:00] [WARN] [client.go:859] ["reset the connection in handleFineGrained"] [storeID=649575725]
[2022/05/04 17:38:24.135 +00:00] [INFO] [conn.go:277] ["Reset backup client"] [storeID=649575725]
[2022/05/04 17:38:54.136 +00:00] [WARN] [conn.go:291] ["failed to reset grpc connection, retry it"] ["retry time"=0] [error="[BR:Common:ErrFailedToConnect]failed to make connection to store 649575725"]
[2022/05/04 17:39:09.362 +00:00] [INFO] [client.go:896] ["try backup"] [startKey=74727864623B00FFFF3A14D6BEBABB6DFBC0128B656504E14837E614744D15CA7981586163F77B0939A37AA73064E1F9836986F096618B026ADCA0F1C7EB0CA9C2A075A4418DA9] [endKey=74727864623B01F16A2706A2140D46779368D753B72975EA2D98D1A9067185FF6DE94931CC446C] [storeID=649575725] ["retry time"=1]
[2022/05/04 17:39:09.401 +00:00] [INFO] [client.go:951] ["backup streaming finish"] [StoreID=649575725] ["retry time"=1]
[2022/05/04 17:39:09.415 +00:00] [INFO] [client.go:713] ["handle fine grained"] [backoffMs=10000]
[2022/05/04 17:39:09.438 +00:00] [WARN] [backoff.go:329] ["txnLock backoffer.maxSleep 80000ms is exceeded, errors:\n[BR:Common:ErrUnknown]internal error at 2022-05-04T17:37:18.643773397Z\n[BR:Common:ErrUnknown]internal error at 2022-05-04T17:38:16.265197102Z\n[BR:Common:ErrUnknown]internal error at 2022-05-04T17:39:09.415374193Z"]
[2022/05/04 17:39:09.448 +00:00] [INFO] [client.go:511] ["backup range finished"] [take=51h16m53.518837989s]
[2022/05/04 17:39:09.670 +00:00] [INFO] [collector.go:195] ["Raw backup failed summary"] [total-ranges=1] [ranges-succeed=0] [ranges-failed=1] [backup-total-regions=1121414] [unit-name="range start:00 end:ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff"] [error="[tikv:9004]Resolve lock timeout"] [errorVerbose="[tikv:9004]Resolve lock timeout\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/errors.go:174\ngithub.com/pingcap/errors.Trace\n\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/juju_adaptor.go:15\ngithub.com/pingcap/br/pkg/backup.(*Client).fineGrainedBackup\n\tgithub.com/pingcap/br@/pkg/backup/client.go:718\ngithub.com/pingcap/br/pkg/backup.(*Client).BackupRange\n\tgithub.com/pingcap/br@/pkg/backup/client.go:544\ngithub.com/pingcap/br/pkg/task.RunBackupRaw\n\tgithub.com/pingcap/br@/pkg/task/backup_raw.go:202\nmain.runBackupRawCommand\n\tgithub.com/pingcap/br@/cmd/br/backup.go:44\nmain.newRawBackupCommand.func1\n\tgithub.com/pingcap/br@/cmd/br/backup.go:136\ngithub.com/spf13/cobra.(*Command).execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:842\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\tgithub.com/spf13/cobra@v1.0.0/command.go:950\ngithub.com/spf13/cobra.(*Command).Execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:887\nmain.main\n\tgithub.com/pingcap/br@/cmd/br/main.go:56\nruntime.main\n\truntime/proc.go:203\nruntime.goexit\n\truntime/asm_amd64.s:1357"]
[2022/05/04 17:39:09.714 +00:00] [ERROR] [backup.go:45] ["failed to backup raw kv"] [error="[tikv:9004]Resolve lock timeout"] [errorVerbose="[tikv:9004]Resolve lock timeout\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/errors.go:174\ngithub.com/pingcap/errors.Trace\n\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/juju_adaptor.go:15\ngithub.com/pingcap/br/pkg/backup.(*Client).fineGrainedBackup\n\tgithub.com/pingcap/br@/pkg/backup/client.go:718\ngithub.com/pingcap/br/pkg/backup.(*Client).BackupRange\n\tgithub.com/pingcap/br@/pkg/backup/client.go:544\ngithub.com/pingcap/br/pkg/task.RunBackupRaw\n\tgithub.com/pingcap/br@/pkg/task/backup_raw.go:202\nmain.runBackupRawCommand\n\tgithub.com/pingcap/br@/cmd/br/backup.go:44\nmain.newRawBackupCommand.func1\n\tgithub.com/pingcap/br@/cmd/br/backup.go:136\ngithub.com/spf13/cobra.(*Command).execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:842\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\tgithub.com/spf13/cobra@v1.0.0/command.go:950\ngithub.com/spf13/cobra.(*Command).Execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:887\nmain.main\n\tgithub.com/pingcap/br@/cmd/br/main.go:56\nruntime.main\n\truntime/proc.go:203\nruntime.goexit\n\truntime/asm_amd64.s:1357"] [stack="main.runBackupRawCommand\n\tgithub.com/pingcap/br@/cmd/br/backup.go:45\nmain.newRawBackupCommand.func1\n\tgithub.com/pingcap/br@/cmd/br/backup.go:136\ngithub.com/spf13/cobra.(*Command).execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:842\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\tgithub.com/spf13/cobra@v1.0.0/command.go:950\ngithub.com/spf13/cobra.(*Command).Execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:887\nmain.main\n\tgithub.com/pingcap/br@/cmd/br/main.go:56\nruntime.main\n\truntime/proc.go:203"]
[2022/05/04 17:39:09.730 +00:00] [ERROR] [main.go:58] ["br failed"] [error="[tikv:9004]Resolve lock timeout"] [errorVerbose="[tikv:9004]Resolve lock timeout\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/errors.go:174\ngithub.com/pingcap/errors.Trace\n\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/juju_adaptor.go:15\ngithub.com/pingcap/br/pkg/backup.(*Client).fineGrainedBackup\n\tgithub.com/pingcap/br@/pkg/backup/client.go:718\ngithub.com/pingcap/br/pkg/backup.(*Client).BackupRange\n\tgithub.com/pingcap/br@/pkg/backup/client.go:544\ngithub.com/pingcap/br/pkg/task.RunBackupRaw\n\tgithub.com/pingcap/br@/pkg/task/backup_raw.go:202\nmain.runBackupRawCommand\n\tgithub.com/pingcap/br@/cmd/br/backup.go:44\nmain.newRawBackupCommand.func1\n\tgithub.com/pingcap/br@/cmd/br/backup.go:136\ngithub.com/spf13/cobra.(*Command).execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:842\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\tgithub.com/spf13/cobra@v1.0.0/command.go:950\ngithub.com/spf13/cobra.(*Command).Execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:887\nmain.main\n\tgithub.com/pingcap/br@/cmd/br/main.go:56\nruntime.main\n\truntime/proc.go:203\nruntime.goexit\n\truntime/asm_amd64.s:1357"] [stack="main.main\n\tgithub.com/pingcap/br@/cmd/br/main.go:58\nruntime.main\n\truntime/proc.go:203"]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment