Skip to content

Instantly share code, notes, and snippets.

@danbri
Created September 7, 2011 12:40
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save danbri/1200455 to your computer and use it in GitHub Desktop.
TellyClub:trunk danbri$ sh spectral.sh
Running on hadoop, using HADOOP_HOME=/Users/danbri/working/hadoop/hadoop-0.20.2
HADOOP_CONF_DIR=/Users/danbri/working/hadoop/hadoop-0.20.2/conf
MAHOUT-JOB: /Users/danbri/working/mahout/trunk/examples/target/mahout-examples-0.6-SNAPSHOT-job.jar
11/09/07 14:37:49 WARN driver.MahoutDriver: No spectralkmeans.props found on classpath, will use command-line arguments only
11/09/07 14:37:49 INFO common.AbstractJob: Command line arguments: {--clusters=2, --convergenceDelta=0.5, --dimensions=37, --distanceMeasure=org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure, --endPhase=2147483647, --input=speccy, --maxIter=10, --output=specout, --startPhase=0, --tempDir=temp}
11/09/07 14:37:50 INFO common.HadoopUtil: Deleting specout/calculations/seqfile-112
11/09/07 14:37:50 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
11/09/07 14:37:51 INFO input.FileInputFormat: Total input paths to process : 2
11/09/07 14:37:52 INFO mapred.JobClient: Running job: job_201109071300_0010
11/09/07 14:37:53 INFO mapred.JobClient: map 0% reduce 0%
11/09/07 14:38:41 INFO mapred.JobClient: map 50% reduce 0%
11/09/07 14:38:43 INFO mapred.JobClient: Task Id : attempt_201109071300_0010_m_000000_0, Status : FAILED
java.io.IOException: Expected input of length 3, received 1. Please make sure you adhere to the structure of (i,j,value) for representing a graph in text. Input line was: ''.
at org.apache.mahout.clustering.spectral.common.AffinityMatrixInputMapper.map(AffinityMatrixInputMapper.java:58)
at org.apache.mahout.clustering.spectral.common.AffinityMatrixInputMapper.map(AffinityMatrixInputMapper.java:43)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
11/09/07 14:38:49 INFO mapred.JobClient: Task Id : attempt_201109071300_0010_m_000000_1, Status : FAILED
java.io.IOException: Expected input of length 3, received 1. Please make sure you adhere to the structure of (i,j,value) for representing a graph in text. Input line was: ''.
at org.apache.mahout.clustering.spectral.common.AffinityMatrixInputMapper.map(AffinityMatrixInputMapper.java:58)
at org.apache.mahout.clustering.spectral.common.AffinityMatrixInputMapper.map(AffinityMatrixInputMapper.java:43)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
11/09/07 14:38:50 INFO mapred.JobClient: map 50% reduce 16%
11/09/07 14:38:55 INFO mapred.JobClient: Task Id : attempt_201109071300_0010_m_000000_2, Status : FAILED
java.io.IOException: Expected input of length 3, received 1. Please make sure you adhere to the structure of (i,j,value) for representing a graph in text. Input line was: ''.
at org.apache.mahout.clustering.spectral.common.AffinityMatrixInputMapper.map(AffinityMatrixInputMapper.java:58)
at org.apache.mahout.clustering.spectral.common.AffinityMatrixInputMapper.map(AffinityMatrixInputMapper.java:43)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
11/09/07 14:39:04 INFO mapred.JobClient: Job complete: job_201109071300_0010
11/09/07 14:39:04 INFO mapred.JobClient: Counters: 11
11/09/07 14:39:04 INFO mapred.JobClient: Job Counters
11/09/07 14:39:04 INFO mapred.JobClient: Launched reduce tasks=1
11/09/07 14:39:04 INFO mapred.JobClient: Launched map tasks=5
11/09/07 14:39:04 INFO mapred.JobClient: Data-local map tasks=4
11/09/07 14:39:04 INFO mapred.JobClient: Failed map tasks=1
11/09/07 14:39:04 INFO mapred.JobClient: FileSystemCounters
11/09/07 14:39:04 INFO mapred.JobClient: FILE_BYTES_WRITTEN=38
11/09/07 14:39:04 INFO mapred.JobClient: Map-Reduce Framework
11/09/07 14:39:04 INFO mapred.JobClient: Combine output records=0
11/09/07 14:39:04 INFO mapred.JobClient: Map input records=0
11/09/07 14:39:04 INFO mapred.JobClient: Spilled Records=0
11/09/07 14:39:04 INFO mapred.JobClient: Map output bytes=0
11/09/07 14:39:04 INFO mapred.JobClient: Combine input records=0
11/09/07 14:39:04 INFO mapred.JobClient: Map output records=0
11/09/07 14:39:05 INFO common.HadoopUtil: Deleting specout/calculations/diagonal
11/09/07 14:39:05 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
11/09/07 14:39:07 INFO input.FileInputFormat: Total input paths to process : 0
11/09/07 14:39:10 INFO mapred.JobClient: Running job: job_201109071300_0011
11/09/07 14:39:11 INFO mapred.JobClient: map 0% reduce 0%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment