Skip to content

Instantly share code, notes, and snippets.

@jedisct1
Last active December 10, 2015 16:59
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jedisct1/4464574 to your computer and use it in GitHub Desktop.
Save jedisct1/4464574 to your computer and use it in GitHub Desktop.
Computing the pagerank of a natural graph with 33.5 million vertices, 1 billion edges with GraphLab, on a 10 nodes cluster: 118 seconds. 29 iterations is what it takes to converge to a tolerance of 1/10000.
INFO: distributed_ingress_base.hpp(exchange_global_info:493): Graph info:
nverts: 33561139
nedges: 983368362
nreplicas: 84780542
replication factor: 2.52615
#vertices: 33561139 #edges:983368362
INFO: synchronous_engine.hpp(synchronous_engine:994): Engine Option: max_iterations = 50
INFO: synchronous_engine.hpp(synchronous_engine:1004): Engine Option: use_cache = 1
INFO: synchronous_engine.hpp(start:1249): Iteration counter will only output every 5 seconds.
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 0
INFO: synchronous_engine.hpp(start:1313): Active vertices: 33561139
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 1
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32917436
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 2
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32376210
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 3
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32699427
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 4
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32630004
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 5
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32675770
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 6
INFO: synchronous_engine.hpp(start:1313): Active vertices: 31750080
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 7
INFO: synchronous_engine.hpp(start:1313): Active vertices: 29606630
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 8
INFO: synchronous_engine.hpp(start:1313): Active vertices: 22865573
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 9
INFO: synchronous_engine.hpp(start:1313): Active vertices: 17566601
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 10
INFO: synchronous_engine.hpp(start:1313): Active vertices: 15563772
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 12
INFO: synchronous_engine.hpp(start:1313): Active vertices: 13546116
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 14
INFO: synchronous_engine.hpp(start:1313): Active vertices: 10057783
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 16
INFO: synchronous_engine.hpp(start:1313): Active vertices: 8450275
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 19
INFO: synchronous_engine.hpp(start:1313): Active vertices: 6079778
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 24
INFO: synchronous_engine.hpp(start:1313): Active vertices: 941198
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1374): 29 iterations completed.
Updates: 420798873
Finished Running engine in 118.5 seconds.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment