Skip to content

Instantly share code, notes, and snippets.

@wlk
Created November 29, 2012 10:21
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save wlk/4168034 to your computer and use it in GitHub Desktop.
Save wlk/4168034 to your computer and use it in GitHub Desktop.
2012-09-19 03:35:04,520 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 4 edits starting from txid 3073005
2012-09-19 03:37:14,673 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode namenode/192.168.1.120:8020
2012-09-19 03:37:24,887 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /mnt/nfs-client/edits/current/edits_0000000000003073010-0000000000003073011 expecting start txid #3073010
2012-09-19 03:37:24,887 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /mnt/nfs-client/edits/current/edits_0000000000003073010-0000000000003073011 of size 30 edits # 2 loaded in 0 seconds.
2012-09-19 03:37:24,892 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 3073009
2012-09-19 03:37:53,771 INFO org.apache.hadoop.hdfs.server.namenode.ha.StandbyCheckpointer: Triggering checkpoint because it has been 3645 seconds since the last checkpoint, which exceeds the configured interval 3600
2012-09-19 03:37:53,788 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Saving image file /srv/0/dfs/nn/current/fsimage.ckpt_0000000000003073011 using no compression
2012-09-19 03:37:53,849 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Saving image file /mnt/nfs-client/hd0-nn/current/fsimage.ckpt_0000000000003073011 using no compression
2012-09-19 03:37:53,872 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Image file of size 3746106 saved in 0 seconds.
2012-09-19 03:42:48,815 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Image file of size 3746106 saved in 295 seconds.
2012-09-19 03:43:00,161 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Going to retain 2 images with txid >= 3072904
2012-09-19 03:43:00,161 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Purging old image FSImageFile(file=/srv/0/dfs/nn/current/fsimage_0000000000003070903, cpktTxId=0000000000003070903)
2012-09-19 03:43:00,178 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Purging old image FSImageFile(file=/mnt/nfs-client/hd0-nn/current/fsimage_0000000000003070903, cpktTxId=0000000000003070903)
2012-09-19 03:43:00,268 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Purging logs older than 2072905
2012-09-19 03:43:03,236 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Opening connection to http://namenode:50070/getimage?putimage=1&txid=3073011&port=50070&storageInfo=-40:1635799361:0:cluster4
2012-09-19 03:44:11,204 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode namenode/192.168.1.120:8020
2012-09-19 03:44:21,335 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /mnt/nfs-client/edits/current/edits_0000000000003073012-0000000000003073013 expecting start txid #3073012
2012-09-19 03:44:21,335 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /mnt/nfs-client/edits/current/edits_0000000000003073012-0000000000003073013 of size 30 edits # 2 loaded in 0 seconds.
2012-09-19 03:44:21,341 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 3073011
2012-09-19 03:46:22,482 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode namenode/192.168.1.120:8020
2012-09-19 03:46:23,528 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /mnt/nfs-client/edits/current/edits_0000000000003073014-0000000000003073015 expecting start txid #3073014
2012-09-19 03:46:23,529 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /mnt/nfs-client/edits/current/edits_0000000000003073014-0000000000003073015 of size 30 edits # 2 loaded in 0 seconds.
2012-09-19 03:46:23,534 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 3073013
2012-09-19 03:46:50,566 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: 78.129.224.51:50010 is added to blk_-3652084412995185710_720545 size 65564093
2012-09-19 03:48:24,021 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode namenode/192.168.1.120:8020
2012-09-19 03:48:25,062 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /mnt/nfs-client/edits/current/edits_0000000000003073016-0000000000003073017 expecting start txid #3073016
2012-09-19 03:48:25,063 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /mnt/nfs-client/edits/current/edits_0000000000003073016-0000000000003073017 of size 30 edits # 2 loaded in 0 seconds.
2012-09-19 03:48:25,068 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 3073015
2012-09-19 03:49:56,833 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.mortbay.jetty.EofException: timeout
2012-09-19 03:49:56,834 WARN org.mortbay.log: Committed before 410 GetImage failed. org.mortbay.jetty.EofException: timeout
at org.mortbay.jetty.AbstractGenerator$Output.blockForOutput(AbstractGenerator.java:548)
at org.mortbay.jetty.AbstractGenerator$Output.flush(AbstractGenerator.java:572)
at org.mortbay.jetty.HttpConnection$Output.flush(HttpConnection.java:1012)
at org.mortbay.jetty.AbstractGenerator$Output.write(AbstractGenerator.java:651)
at org.mortbay.jetty.AbstractGenerator$Output.write(AbstractGenerator.java:580)
at org.apache.hadoop.hdfs.server.namenode.TransferFsImage.getFileServer(TransferFsImage.java:181)
at org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1.run(GetImageServlet.java:131)
at org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1.run(GetImageServlet.java:111)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.hdfs.server.namenode.GetImageServlet.doGet(GetImageServlet.java:111)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
at org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:947)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
2012-09-19 03:50:25,540 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode namenode/192.168.1.120:8020
2012-09-19 03:50:26,820 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /mnt/nfs-client/edits/current/edits_0000000000003073018-0000000000003073019 expecting start txid #3073018
2012-09-19 03:50:26,820 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /mnt/nfs-client/edits/current/edits_0000000000003073018-0000000000003073019 of size 30 edits # 2 loaded in 0 seconds.
2012-09-19 03:50:26,825 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 3073017
2012-09-19 03:52:27,304 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode namenode/192.168.1.120:8020
2012-09-19 03:52:28,089 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /mnt/nfs-client/edits/current/edits_0000000000003073020-0000000000003073021 expecting start txid #3073020
2012-09-19 03:52:28,089 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /mnt/nfs-client/edits/current/edits_0000000000003073020-0000000000003073021 of size 30 edits # 2 loaded in 0 seconds.
2012-09-19 03:52:28,094 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 3073019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment