Birger Kristoffer Lie birgerlie
birgerlie
/ gist:3758869
Created
September 20, 2012 23:04
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /hbase/.logs/datanode19.companybook.no,60020,1348154158624-splitting/datanode19.companybook.no%2C60020%2C1348154158624.1348163222745: CORRUPT blockpool BP-439417958-172.30.0.193-1348078088804 block blk_-8025032397000474112 |
birgerlie
/ gist:2594146
Created
May 4, 2012 11:04
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 12/05/04 12:00:12 ERROR hdfs.DFSClient: Exception closing file /hbase/company_news/3cd80c7feb026a185a4b97ef43ace91f/.tmp/7597324536705082184 : org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /hbase/company_news/3cd80c7feb026a185a4b97ef43ace91f/.tmp/7597324536705082184 could only be replicated to 0 nodes, instead of 1 | |
| at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1490) | |
| at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:653) | |
| at sun.reflect.GeneratedMethodAccessor125.invoke(Unknown Source) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) | |
| at java.lang.reflect.Method.invoke(Method.java:597) | |
| at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557) | |
| at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434) | |
| at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430) | |
| at java.security.AccessController.doPrivileged(Native Method) |
birgerlie
/ gist:2588827
Created
May 3, 2012 19:57
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Number of live region servers: 21 | |
| Number of dead region servers: 0 | |
| ..Number of empty REGIONINFO_QUALIFIER rows in .META.: 0 | |
| ERROR: Region UNKNOWN_REGION on datanode13.companybook.no:60020, key=01d9a859ed9fd310a06900a6fc4fb6da, not on HDFS or in META but deployed on datanode13.companybook.no:60020 | |
| ERROR: Region UNKNOWN_REGION on datanode15.companybook.no:60020, key=01f080b1f6020186ee0739223524df4b, not on HDFS or in META but deployed on datanode15.companybook.no:60020 | |
| ERROR: Region UNKNOWN_REGION on datanode1.companybook.no:60020, key=064e19f1117a228b59e35708075858a8, not on HDFS or in META but deployed on datanode1.companybook.no:60020 | |
| ERROR: Region UNKNOWN_REGION on datanode14.companybook.no:60020, key=0ed0bc8eb4a5cfd662de9b21ad5d05bd, not on HDFS or in META but deployed on datanode14.companybook.no:60020 | |
| ERROR: Region UNKNOWN_REGION on datanode1.companybook.no:60020, key=1894f82b076a59612d507b3f67383eef, not on HDFS or in META but deployed on datanode1.companybook.no:60020 | |
| ERROR: Region UNKNOWN_REGION on da |
birgerlie
/ gist:1194471
Created
September 5, 2011 08:47
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Task Logs: 'attempt_201107280750_0488_m_000000_2' | |
| stdout logs | |
| stderr logs | |
birgerlie
/ gist:1194470
Created
September 5, 2011 08:47
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Task Logs: 'attempt_201107280750_0488_m_000000_2' | |
| stdout logs | |
| stderr logs | |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hadoop jar jobs/web-indexing-1.0-SNAPSHOT-job.jar -conf .hbase-local.xml -D mapred.output.dir=company_splits/2807 -jobId companiesIndexSplitter | |
| <?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration> | |
| <property><!--Loaded from .hbase-local.xml--><name>hbase.zookeeper.quorum</name><value>namenode.companybook.no:2181,sec-namenode.companybook.no:2181,jobtracker.companybook.no:2181</value></property> | |
| <property><!--Loaded from core-default.xml--><name>fs.file.impl</name><value>org.apache.hadoop.fs.LocalFileSystem</value></property> | |
| <property><!--Loaded from core-default.xml--><name>hadoop.logfile.count</name><value>10</value></property> | |
| <property><!--Loaded from core-default.xml--><name>fs.har.impl.disable.cache</name><value>true</value></property> | |
| <property><!--Loaded from core-default.xml--><name>ipc.client.kill.max</name><value>10</value></property> | |
| <property><!--Loaded from core-default.xml--><name>fs.s3n.block.size</name><value>67108864</value></property> | |
| <property><!--Loaded from core-default. |
birgerlie
/ hbase config
Created
June 6, 2011 13:20
hbase configuration, head->hbase-site.xml tail->hbase-env.conf
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <?xml version="1.0"?> | |
| <configuration> | |
| <property> | |
| <name>hbase.cluster.distributed</name> | |
| <value>true</value> | |
| </property> | |
| <property> | |
| <name>hbase.rootdir</name> | |
| <value>hdfs://namenode.companybook.no/hbase</value> | |
| </property> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-05-12 17:17:41,425 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce | |
| 2011-05-12 17:17:41,425 INFO org.apache.hadoop.mapred.Merger: Merging 16 sorted segments | |
| 2011-05-12 17:17:41,430 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 16 segments left of total size: 1261175971 bytes | |
| 2011-05-12 17:17:41,598 INFO org.apache.solr.core.SolrResourceLoader: Solr home set to '/data/c/mapred/taskTracker/hjellum/jobcache/job_201105091831_0038/attempt_201105091831_0038_r_000002_0/work/tmp/temp46206478863371289682501809180346080/' | |
| 2011-05-12 17:17:41,631 INFO org.apache.solr.core.SolrConfig: Adding specified lib dirs to ClassLoader | |
| 2011-05-12 17:17:41,737 INFO org.apache.solr.core.SolrConfig: Using Lucene MatchVersion: LUCENE_40 | |
| 2011-05-12 17:17:41,828 INFO org.apache.solr.core.Config: Loaded SolrConfig: solrconfig.xml | |
| 2011-05-12 17:17:41,828 INFO org.apache.solr.schema.IndexSchema: Reading Solr Schema | |
| 2011-05-12 17:17:41,841 INFO org.apache.solr.schema |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-05-07 11:04:25,159 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Started memstore flush for urls_production,http://no.gratisauksjonen.www/categories.php?start=0&limit=20&parent_id=2665&keywords_cat_search=&buyout_price=&reserve_price=&quantity=&enable_swap= &order_field=a.max_bid&order_type=DESC,1304691823907.b00d5617f3a0500c3c7bf387543d406b., current region memstore size 13.7m | |
| 2011-05-07 11:04:25,159 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting, commencing flushing stores | |
| 2011-05-07 11:04:25,515 INFO org.apache.hadoop.hbase.regionserver.Store: Renaming flushed file at hdfs://namenode.companybook.no/hbase/urls_production/b00d5617f3a0500c3c7bf387543d406b/.tmp/5482077501956480325 to hdfs://namenode.companybook.no/hbase/urls_production/b00d5617f3a0500c3c7bf387543d406b/links/2627865939460445999 | |
| 2011-05-07 11:04:25,534 INFO org.apache.hadoop.hbase.regionserver.Store: Added hdfs://namenode.companybook.no/hbase/urls_production/b00d5617f3a0500c3c7bf387543d406b/links/262786593 |