Skip to content

Instantly share code, notes, and snippets.

@y-ken

y-ken/mroonga-table-disappear.md Secret

Last active December 18, 2015 01:39
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save y-ken/9a5d564d37a58e810abe to your computer and use it in GitHub Desktop.
Save y-ken/9a5d564d37a58e810abe to your computer and use it in GitHub Desktop.
Download ZIP
Raw
mroonga-table-disappear.md

環境

$ rpm -qa | grep oon | sort
groonga-3.0.4-0.el6.x86_64
groonga-devel-3.0.4-0.el6.x86_64
groonga-libs-3.0.4-0.el6.x86_64
groonga-normalizer-mysql-1.0.4-1.el6.x86_64
groonga-plugin-suggest-3.0.4-0.el6.x86_64
groonga-tokenizer-mecab-3.0.4-0.el6.x86_64
mysql-mroonga-3.04-0.el6.mysql56.x86_64

現象

create table foo_new like foo;してテーブルを削除するという類いのバッチを頻繁に実行しております。
このとき、mysqldが落ちるという現象が発生しました。
これは、TokenMecab, InnoDBラッパーモードのmroongaテーブルです。

再現方法

利用したスキーマ

-- test, test2, test3という名前でそれぞれ作成します
CREATE TABLE `test` (
  `id` int(10) unsigned NOT NULL,
  `data` text NOT NULL,
  PRIMARY KEY (`id`),
  FULLTEXT KEY `data` (`data`) COMMENT 'parser "TokenMecab"'
) ENGINE=mroonga DEFAULT CHARSET=utf8 COMMENT='engine "innodb"'

以下のスクリプトをそれぞれ同時に実行したまま放置すると発生します。

$ cat createtable1.sh
while :
do
  mysql -uroot wiki -e "create table test_new like test;"
  mysql -uroot wiki -e "rename table test to test_old,  test_new to test;"
  mysql -uroot wiki -e "DROP TABLE IF EXISTS test_new;"
  mysql -uroot wiki -e "DROP TABLE IF EXISTS test_old;"
done

$ cat createtable2.sh
while :
do
  mysql -uroot wiki -e "create table test2_new like test2;"
  mysql -uroot wiki -e "rename table test2 to test2_old,  test2_new to test2;"
  mysql -uroot wiki -e "DROP TABLE IF EXISTS test2_new;"
  mysql -uroot wiki -e "DROP TABLE IF EXISTS test2_old;"
done

$ cat createtable3.sh
while :
do
  mysql -uroot wiki -e "create table test3_new like test3;"
  mysql -uroot wiki -e "rename table test3 to test3_old,  test3_new to test3;"
  mysql -uroot wiki -e "DROP TABLE IF EXISTS test3_new;"
  mysql -uroot wiki -e "DROP TABLE IF EXISTS test3_old;"
done

ログ

groonga.log

2013-06-03 05:17:51.892925|n|676ac700|nterms=1069 chunk=175711 total=67069
2013-06-03 05:17:51.893998|n|676ac700|d0=593 d1=476
2013-06-03 05:17:57.250233|n|676ac700|nterms=643 chunk=697834 total=67309
2013-06-03 05:17:57.251146|n|676ac700|d0=236 d1=407
2013-06-03 05:18:00.483884|n|676ac700|nterms=435 chunk=702192 total=67636
2013-06-03 05:18:00.484516|n|676ac700|d0=239 d1=196
2013-06-03 05:45:04.589594|n|676ac700|DDL:table_create ********_work_search_new
2013-06-03 05:45:04.630594|n|676ac700|DDL:table_create ********_work_search_new-data

mysqld.log

Thread pointer: 0x7fcb3c0046d0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7fcb676ab7e0 thread_stack 0x40000
/usr/sbin/mysqld(my_print_stacktrace+0x35)[0x8c4655]
/usr/sbin/mysqld(handle_fatal_signal+0x4a4)[0x65c004]
/lib64/libpthread.so.0[0x3c3240f500]
/usr/lib64/libgroonga.so.0(grn_hash_add+0xe07)[0x34fa905417]
/usr/lib64/libgroonga.so.0[0x34fa9301b8]
/usr/lib64/libgroonga.so.0(grn_io_create+0x389)[0x34fa930c49]
/usr/lib64/libgroonga.so.0(grn_io_create_with_array+0xc6)[0x34fa935946]
/usr/lib64/libgroonga.so.0(grn_pat_create+0x130)[0x34fa986d10]
/usr/lib64/libgroonga.so.0(grn_table_create+0x1636)[0x34fa8533d6]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga29wrapper_create_index_fulltextEPKciP6st_keyPP8_grn_objS6_P16st_mroonga_share+0x168)[0x7fd0ba5e7da8]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga20wrapper_create_indexEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_shareS1_+0x2b0)[0x7fd0ba5e8250]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga14wrapper_createEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_share+0x9c)[0x7fd0ba5e83dc]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga6createEPKcP5TABLEP24st_ha_create_information+0xc4)[0x7fd0ba5f2614]
/usr/sbin/mysqld(_Z15ha_create_tableP3THDPKcS2_S2_P24st_ha_create_informationbb+0x231)[0x5a6b21]
/usr/sbin/mysqld(_Z16rea_create_tableP3THDPKcS2_S2_P24st_ha_create_informationR4ListI12Create_fieldEjP6st_keyP7handlerb+0x146)[0x76f076]
/usr/sbin/mysqld[0x720826]
/usr/sbin/mysqld(_Z26mysql_create_table_no_lockP3THDPKcS2_P24st_ha_create_informationP10Alter_infojPb+0x118)[0x720ee8]
/usr/sbin/mysqld(_Z23mysql_create_like_tableP3THDP10TABLE_LISTS2_P24st_ha_create_information+0x308)[0x721278]
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x45f5)[0x6d8955]
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x32f)[0x6d902f]
/usr/sbin/mysqld(_ZN15Query_log_event14do_apply_eventEPK14Relay_log_infoPKcj+0x5d7)[0x867077]
/usr/sbin/mysqld(_ZN9Log_event11apply_eventEP14Relay_log_info+0x74)[0x86aff4]
/usr/sbin/mysqld(_Z26apply_event_and_update_posPP9Log_eventP3THDP14Relay_log_info+0x25e)[0x89410e]
/usr/sbin/mysqld[0x899f21]
/usr/sbin/mysqld(handle_slave_sql+0xbca)[0x89d12a]
/usr/sbin/mysqld(pfs_spawn_thread+0x139)[0x9470e9]
/lib64/libpthread.so.0[0x3c32407851]
/lib64/libc.so.6(clone+0x6d)[0x3c31ce890d]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7fca99c75e8b): is an invalid pointer
Connection ID (thread ID): 781
Status: NOT_KILLED
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
130603 05:45:06 mysqld_safe Number of processes running now: 0
130603 05:45:06 mysqld_safe mysqld restarted

対策後のnightly版を用いた再現可否

以下の環境で負荷試験を開始しました。しかし、約1時間後、再度発生しました。

$ rpm -qa | grep oon | sort
groonga-3.0.4.2013.06.06-0.el6.x86_64
groonga-devel-3.0.4.2013.06.06-0.el6.x86_64
groonga-libs-3.0.4.2013.06.06-0.el6.x86_64
groonga-normalizer-mysql-1.0.4-1.el6.x86_64
groonga-plugin-suggest-3.0.4.2013.06.06-0.el6.x86_64
groonga-tokenizer-mecab-3.0.4.2013.06.06-0.el6.x86_64
mysql-mroonga-3.04-0.el6.mysql56.x86_64

mysqld.log

Thread pointer: 0x13764f90
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f5241b87e18 thread_stack 0x40000
/usr/sbin/mysqld(my_print_stacktrace+0x35)[0x8c4655]
/usr/sbin/mysqld(handle_fatal_signal+0x4a4)[0x65c004]
/lib64/libpthread.so.0[0x30f9c0f500]
/usr/lib64/libgroonga.so.0(grn_hash_add+0xe07)[0x3739505417]
/usr/lib64/libgroonga.so.0[0x37395301b8]
/usr/lib64/libgroonga.so.0(grn_io_create+0x389)[0x3739530c49]
/usr/lib64/libgroonga.so.0[0x373951f0ed]
/usr/lib64/libgroonga.so.0(grn_ii_create+0xc4)[0x373951f7d4]
/usr/lib64/libgroonga.so.0(grn_column_create+0xa68)[0x3739451588]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga29wrapper_create_index_fulltextEPKciP6st_keyPP8_grn_objS6_P16st_mroonga_share+0x2ab)[0x7f5510383eeb]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga20wrapper_create_indexEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_shareS1_+0x2b0)[0x7f5510384250]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga14wrapper_createEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_share+0x9c)[0x7f55103843dc]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga6createEPKcP5TABLEP24st_ha_create_information+0xc4)[0x7f551038e614]
/usr/sbin/mysqld(_Z15ha_create_tableP3THDPKcS2_S2_P24st_ha_create_informationbb+0x231)[0x5a6b21]
/usr/sbin/mysqld(_Z16rea_create_tableP3THDPKcS2_S2_P24st_ha_create_informationR4ListI12Create_fieldEjP6st_keyP7handlerb+0x146)[0x76f076]
/usr/sbin/mysqld[0x720826]
/usr/sbin/mysqld(_Z26mysql_create_table_no_lockP3THDPKcS2_P24st_ha_create_informationP10Alter_infojPb+0x118)[0x720ee8]
/usr/sbin/mysqld(_Z23mysql_create_like_tableP3THDP10TABLE_LISTS2_P24st_ha_create_information+0x308)[0x721278]
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x45f5)[0x6d8955]
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x32f)[0x6d902f]
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xe28)[0x6d9f48]
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0xcf)[0x6a7aef]
/usr/sbin/mysqld(handle_one_connection+0x47)[0x6a7c17]
/usr/sbin/mysqld(pfs_spawn_thread+0x139)[0x9470e9]
/lib64/libpthread.so.0[0x30f9c07851]
/lib64/libc.so.6(clone+0x6d)[0x30f94e890d]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7f51cb4e92d0): is an invalid pointer
Connection ID (thread ID): 12896
Status: NOT_KILLED

groonga.log

2013-06-06 02:45:21.985010|n|3a888700|DDL:obj_remove test_old-data.index
2013-06-06 02:45:21.986044|n|3a888700|DDL:obj_remove test_old
2013-06-06 02:45:22.052002|n|3e3f0700|DDL:table_create test3_new
2013-06-06 02:45:22.079722|n|3e3f0700|DDL:table_create test3_new-data
2013-06-06 02:45:22.104073|n|3e3f0700|DDL:column_create test3_new-data index
2013-06-06 02:45:22.110654|n|41b88700|DDL:table_create test_new
2013-06-06 02:45:22.140283|n|41b88700|DDL:table_create test_new-data
2013-06-06 02:45:22.176645|n|41b88700|DDL:column_create test_new-data index
2013-06-06 02:45:24.641007|n|74d2f720|mroonga 3.04 started.
2013-06-06 02:45:24.641024|n|74d2f720|log level is 'DEBUG'
2013-06-06 02:45:24.711868|d|a46e6700|hash get not found (key=wiki2)
2013-06-06 02:45:24.712865|d|a46e6700|hash put (key=wiki2)
2013-06-06 02:45:25.217510|e|a46e6700|already used name was assigned: <test_new>
2013-06-06 02:45:25.221302|e|a46e6700|/usr/lib64/libgroonga.so.0(grn_obj_register+0x26e) [0x37394383ce]
2013-06-06 02:45:25.221320|e|a46e6700|/usr/lib64/libgroonga.so.0(grn_table_create+0xbcf) [0x373945296f]
2013-06-06 02:45:25.221327|e|a46e6700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga20wrapper_create_indexEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_shareS1_+0xde) [0x7fdf4ebe207e]
2013-06-06 02:45:25.221332|e|a46e6700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga14wrapper_createEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_share+0x9c) [0x7fdf4ebe23dc]
2013-06-06 02:45:25.221337|e|a46e6700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga6createEPKcP5TABLEP24st_ha_create_information+0xc4) [0x7fdf4ebec614]
2013-06-06 02:45:25.221343|e|a46e6700|/usr/sbin/mysqld(_Z15ha_create_tableP3THDPKcS2_S2_P24st_ha_create_informationbb+0x231) [0x5a6b21]
2013-06-06 02:45:25.221348|e|a46e6700|/usr/sbin/mysqld(_Z16rea_create_tableP3THDPKcS2_S2_P24st_ha_create_informationR4ListI12Create_fieldEjP6st_keyP7handlerb+0x146) [0x76f076]
2013-06-06 02:45:25.221353|e|a46e6700|/usr/sbin/mysqld() [0x720826]
2013-06-06 02:45:25.221358|e|a46e6700|/usr/sbin/mysqld(_Z26mysql_create_table_no_lockP3THDPKcS2_P24st_ha_create_informationP10Alter_infojPb+0x118) [0x720ee8]
2013-06-06 02:45:25.221363|e|a46e6700|/usr/sbin/mysqld(_Z23mysql_create_like_tableP3THDP10TABLE_LISTS2_P24st_ha_create_information+0x308) [0x721278]
2013-06-06 02:45:25.221369|e|a46e6700|/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x45f5) [0x6d8955]
2013-06-06 02:45:25.221374|e|a46e6700|/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x32f) [0x6d902f]
2013-06-06 02:45:25.221379|e|a46e6700|/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xe28) [0x6d9f48]
2013-06-06 02:45:25.221384|e|a46e6700|/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0xcf) [0x6a7aef]
2013-06-06 02:45:25.221396|e|a46e6700|/usr/sbin/mysqld(handle_one_connection+0x47) [0x6a7c17]
2013-06-06 02:45:25.221403|e|a46e6700|/usr/sbin/mysqld(pfs_spawn_thread+0x139) [0x9470e9]
2013-06-06 02:45:25.243885|e|a4f88700|already used name was assigned: <test3_new>
2013-06-06 02:45:25.248454|e|a4f88700|/usr/lib64/libgroonga.so.0(grn_obj_register+0x26e) [0x37394383ce]
2013-06-06 02:45:25.248467|e|a4f88700|/usr/lib64/libgroonga.so.0(grn_table_create+0xbcf) [0x373945296f]
2013-06-06 02:45:25.248473|e|a4f88700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga20wrapper_create_indexEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_shareS1_+0xde) [0x7fdf4ebe207e]
2013-06-06 02:45:25.248478|e|a4f88700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga14wrapper_createEPKcP5TABLEP24st_ha_create_informationP16st_mroonga_share+0x9c) [0x7fdf4ebe23dc]
2013-06-06 02:45:25.248484|e|a4f88700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga6createEPKcP5TABLEP24st_ha_create_information+0xc4) [0x7fdf4ebec614]
2013-06-06 02:45:25.248489|e|a4f88700|/usr/sbin/mysqld(_Z15ha_create_tableP3THDPKcS2_S2_P24st_ha_create_informationbb+0x231) [0x5a6b21]
2013-06-06 02:45:25.248494|e|a4f88700|/usr/sbin/mysqld(_Z16rea_create_tableP3THDPKcS2_S2_P24st_ha_create_informationR4ListI12Create_fieldEjP6st_keyP7handlerb+0x146) [0x76f076]
2013-06-06 02:45:25.248499|e|a4f88700|/usr/sbin/mysqld() [0x720826]
2013-06-06 02:45:25.248504|e|a4f88700|/usr/sbin/mysqld(_Z26mysql_create_table_no_lockP3THDPKcS2_P24st_ha_create_informationP10Alter_infojPb+0x118) [0x720ee8]
2013-06-06 02:45:25.248509|e|a4f88700|/usr/sbin/mysqld(_Z23mysql_create_like_tableP3THDP10TABLE_LISTS2_P24st_ha_create_information+0x308) [0x721278]
2013-06-06 02:45:25.248514|e|a4f88700|/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x45f5) [0x6d8955]
2013-06-06 02:45:25.248519|e|a4f88700|/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x32f) [0x6d902f]
2013-06-06 02:45:25.248524|e|a4f88700|/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xe28) [0x6d9f48]
2013-06-06 02:45:25.248529|e|a4f88700|/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0xcf) [0x6a7aef]
2013-06-06 02:45:25.248534|e|a4f88700|/usr/sbin/mysqld(handle_one_connection+0x47) [0x6a7c17]
2013-06-06 02:45:25.248544|e|a4f88700|/usr/sbin/mysqld(pfs_spawn_thread+0x139) [0x9470e9]

追記

2013年6月9日の朝方にmysqldが落ちた際の、mysqld.logを追加します。
こちらも同様にcreate table like 文を使うテーブルです。
なお、こちらのマシンはnightlyではなく5月末リリース版を利用しております。
また、MyISAMのラッパーモードにして動作の違いを検証していたテーブルでした。

$ rpm -qa | grep oon
groonga-libs-3.0.4-0.el6.x86_64
groonga-devel-3.0.4-0.el6.x86_64
groonga-3.0.4-0.el6.x86_64
mysql-mroonga-3.04-0.el6.mysql56.x86_64
groonga-tokenizer-mecab-3.0.4-0.el6.x86_64
groonga-plugin-suggest-3.0.4-0.el6.x86_64
groonga-normalizer-mysql-1.0.4-1.el6.x86_64

Thread pointer: 0x242dfc50
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7fab573fbe18 thread_stack 0x40000
/usr/sbin/mysqld(my_print_stacktrace+0x35)[0x8c4655]
/usr/sbin/mysqld(handle_fatal_signal+0x4a4)[0x65c004]
/lib64/libpthread.so.0[0x3c3240f500]
/usr/lib64/libgroonga.so.0(grn_hash_add+0xe07)[0x34fa905417]
/usr/lib64/libgroonga.so.0[0x34fa9301b8]
/usr/lib64/libgroonga.so.0(grn_io_create+0x389)[0x34fa930c49]
/usr/lib64/libgroonga.so.0[0x34fa91f178]
/usr/lib64/libgroonga.so.0(grn_ii_truncate+0x157)[0x34fa91f407]
/usr/lib64/libgroonga.so.0(grn_column_truncate+0xdb)[0x34fa83519b]
/usr/lib64/libgroonga.so.0(grn_table_truncate+0x2e9)[0x34fa857129]
/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga22wrapper_truncate_indexEv+0x167)[0x7fb0a05e0a97]
/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table16handler_truncateEP3THDP10TABLE_LISTb+0xb4)[0x84c804]
/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table14truncate_tableEP3THDP10TABLE_LIST+0x2a8)[0x84cf68]
/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table7executeEP3THD+0x5e)[0x84d05e]
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0xdf1)[0x6d5151]
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x32f)[0x6d902f]
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xe28)[0x6d9f48]
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0xcf)[0x6a7aef]
/usr/sbin/mysqld(handle_one_connection+0x47)[0x6a7c17]
/usr/sbin/mysqld(pfs_spawn_thread+0x139)[0x9470e9]
/lib64/libpthread.so.0[0x3c32407851]
/lib64/libc.so.6(clone+0x6d)[0x3c31ce890d]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7fab30036bb0): is an invalid pointer
Connection ID (thread ID): 19449
Status: NOT_KILLED

The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
130609 07:09:03 mysqld_safe Number of processes running now: 0
130609 07:09:03 mysqld_safe mysqld restarted
...snip...
-- 手動でstart slaveを実行したところ、クラッシュ時に更新していたテーブルが利用不能になっておりました。
2013-06-09 15:07:27 31008 [Warning] Slave: Table 'suggest_*******' is marked as crashed and should be repaired Error_code: 1194
2013-06-09 15:07:27 31008 [Warning] Slave: Table '****.#sql-7920_3c0' doesn't exist Error_code: 1146
2013-06-09 15:07:27 31008 [ERROR] Error running query, slave SQL thread aborted. Fix the problem, and restart the slave SQL thread with "SLAVE START". We stopped at log 'mysqld-bin.004318' position 132193907

2013-06-08 07:00:05.859057|n|4faac700|DDL:table_create suggest_*******_new
2013-06-08 07:00:05.860207|n|4faac700|DDL:table_create suggest_*******_new-text
2013-06-08 07:00:05.861003|n|4faac700|DDL:column_create suggest_*******_new-text index
2013-06-08 07:00:07.933632|d|4faac700|flushing a[0]=4016 seg=0(0x7faada274000) free=0
2013-06-08 07:00:07.935621|d|4faac700|flushed  a[0]=4016 seg=0(0x7faada0b4000) free=0->246048 nterms=1005 v=0
2013-06-08 07:00:08.280780|n|4faac700|nterms=1506 chunk=47873 total=46
2013-06-08 07:00:08.282233|n|4faac700|d0=675 d1=831
2013-06-08 07:00:08.284834|i|4faac700|<0x7fab0c003a20:0> expired i=0x7fa9f08254b0 max=1 (1/2)
2013-06-08 07:00:08.489992|d|4faac700|flushing a[0]=131300 seg=2(0x7faada1f4000) free=4
2013-06-08 07:00:08.490029|n|4faac700|nterms=1041 chunk=0 total=90
2013-06-08 07:00:08.491172|n|4faac700|d0=521 d1=520
2013-06-08 07:00:08.492732|i|4faac700|<0x7fab0c003a20:0> expired i=0x7fa9f08254b0 max=3 (2/3)
2013-06-08 07:00:08.942974|n|4faac700|nterms=1193 chunk=48245 total=120
2013-06-08 07:00:08.944137|n|4faac700|d0=669 d1=524
2013-06-08 07:00:08.946909|i|4faac700|<0x7fab0c003a20:0> expired i=0x7fa9f08254b0 max=3 (1/2)
2013-06-08 07:00:09.002678|n|4faac700|DDL:obj_remove suggest_*******_old-text
2013-06-08 07:00:09.002713|n|4faac700|DDL:obj_remove suggest_*******_old-text.index
2013-06-08 07:00:09.047238|n|4faac700|DDL:obj_remove suggest_*******_old
2013-06-08 07:00:09.303955|n|4faac700|DDL:table_create #sql-2065_3786
2013-06-08 07:00:09.304771|n|4faac700|DDL:table_create #sql-2065_3786-text
2013-06-08 07:00:09.305533|n|4faac700|DDL:column_create #sql-2065_3786-text index
2013-06-09 07:09:06.854991|n|35730720|mroonga 3.04 started.
2013-06-09 07:09:06.855015|n|35730720|log level is 'DEBUG'
-- file type unmatchというログがこれ以降、1分間隔で継続出力されていました。
2013-06-09 07:10:01.386187|d|8c102700|hash get not found (key=******)
2013-06-09 07:10:01.445049|d|8c102700|hash put (key=******)
2013-06-09 07:10:01.464038|e|8c102700|file type unmatch
2013-06-09 07:10:01.473850|e|8c102700|/usr/lib64/libgroonga.so.0(grn_ii_open+0x31a) [0x34fa91eeba]
2013-06-09 07:10:01.473871|e|8c102700|/usr/lib64/libgroonga.so.0(grn_ctx_at+0x7ba) [0x34fa832a0a]
2013-06-09 07:10:01.473878|e|8c102700|/usr/lib64/libgroonga.so.0(grn_ctx_get+0xb6) [0x34fa836ca6]
2013-06-09 07:10:01.473884|e|8c102700|/usr/lib64/libgroonga.so.0() [0x34fa836d3b]
2013-06-09 07:10:01.473889|e|8c102700|/usr/lib64/libgroonga.so.0(grn_obj_column+0xc1) [0x34fa837631]
2013-06-09 07:10:01.473895|e|8c102700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga20wrapper_open_indexesEPKcb+0x376) [0x7f4dd05e4416]
2013-06-09 07:10:01.473900|e|8c102700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga12wrapper_openEPKcij+0x9b) [0x7f4dd05ea7bb]
2013-06-09 07:10:01.473906|e|8c102700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga4openEPKcij+0xaa) [0x7f4dd05eab3a]
2013-06-09 07:10:01.473912|e|8c102700|/usr/sbin/mysqld(_ZN7handler7ha_openEP5TABLEPKcii+0x3e) [0x5a288e]
2013-06-09 07:10:01.473917|e|8c102700|/usr/sbin/mysqld(_Z21open_table_from_shareP3THDP11TABLE_SHAREPKcjjjP5TABLEb+0x624) [0x75de14]
2013-06-09 07:10:01.473923|e|8c102700|/usr/sbin/mysqld(_Z10open_tableP3THDP10TABLE_LISTP18Open_table_context+0x1eb) [0x69170b]
2013-06-09 07:10:01.473928|e|8c102700|/usr/sbin/mysqld(_Z11open_tablesP3THDPP10TABLE_LISTPjjP19Prelocking_strategy+0xcaa) [0x693eda]
2013-06-09 07:10:01.473934|e|8c102700|/usr/sbin/mysqld(_Z20open_and_lock_tablesP3THDP10TABLE_LISTbjP19Prelocking_strategy+0x44) [0x6940a4]
2013-06-09 07:10:01.473939|e|8c102700|/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table16handler_truncateEP3THDP10TABLE_LISTb+0x7c) [0x84c7cc]
2013-06-09 07:10:01.473945|e|8c102700|/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table14truncate_tableEP3THDP10TABLE_LIST+0x2a8) [0x84cf68]
2013-06-09 07:10:01.473950|e|8c102700|/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table7executeEP3THD+0x5e) [0x84d05e]
2013-06-09 07:11:01.514861|n|8c102700|(2 same messages are truncated)
2013-06-09 07:11:01.520614|e|8c102700|file type unmatch
2013-06-09 07:11:01.524637|e|8c102700|/usr/lib64/libgroonga.so.0(grn_ii_open+0x31a) [0x34fa91eeba]
2013-06-09 07:11:01.524656|e|8c102700|/usr/lib64/libgroonga.so.0(grn_ctx_at+0x7ba) [0x34fa832a0a]
2013-06-09 07:11:01.524667|e|8c102700|/usr/lib64/libgroonga.so.0(grn_ctx_get+0xb6) [0x34fa836ca6]
2013-06-09 07:11:01.524677|e|8c102700|/usr/lib64/libgroonga.so.0() [0x34fa836d3b]
2013-06-09 07:11:01.524687|e|8c102700|/usr/lib64/libgroonga.so.0(grn_obj_column+0xc1) [0x34fa837631]
2013-06-09 07:11:01.524697|e|8c102700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga20wrapper_open_indexesEPKcb+0x376) [0x7f4dd05e4416]
2013-06-09 07:11:01.524706|e|8c102700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga12wrapper_openEPKcij+0x9b) [0x7f4dd05ea7bb]
2013-06-09 07:11:01.524712|e|8c102700|/usr/lib64/mysql/plugin/ha_mroonga.so(_ZN10ha_mroonga4openEPKcij+0xaa) [0x7f4dd05eab3a]
2013-06-09 07:11:01.524718|e|8c102700|/usr/sbin/mysqld(_ZN7handler7ha_openEP5TABLEPKcii+0x3e) [0x5a288e]
2013-06-09 07:11:01.524723|e|8c102700|/usr/sbin/mysqld(_Z21open_table_from_shareP3THDP11TABLE_SHAREPKcjjjP5TABLEb+0x624) [0x75de14]
2013-06-09 07:11:01.524729|e|8c102700|/usr/sbin/mysqld(_Z10open_tableP3THDP10TABLE_LISTP18Open_table_context+0x1eb) [0x69170b]
2013-06-09 07:11:01.524735|e|8c102700|/usr/sbin/mysqld(_Z11open_tablesP3THDPP10TABLE_LISTPjjP19Prelocking_strategy+0xcaa) [0x693eda]
2013-06-09 07:11:01.524750|e|8c102700|/usr/sbin/mysqld(_Z20open_and_lock_tablesP3THDP10TABLE_LISTbjP19Prelocking_strategy+0x44) [0x6940a4]
2013-06-09 07:11:01.524755|e|8c102700|/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table16handler_truncateEP3THDP10TABLE_LISTb+0x7c) [0x84c7cc]
2013-06-09 07:11:01.524761|e|8c102700|/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table14truncate_tableEP3THDP10TABLE_LIST+0x2a8) [0x84cf68]
2013-06-09 07:11:01.524766|e|8c102700|/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table7executeEP3THD+0x5e) [0x84d05e]
2013-06-09 07:12:01.569114|n|8c102700|(2 same messages are truncated)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment