Skip to content

Instantly share code, notes, and snippets.

@jedisct1 jedisct1/gist:4464574
Last active Dec 10, 2015

Embed
What would you like to do?
Computing the pagerank of a natural graph with 33.5 million vertices, 1 billion edges with GraphLab, on a 10 nodes cluster: 118 seconds. 29 iterations is what it takes to converge to a tolerance of 1/10000.
INFO: distributed_ingress_base.hpp(exchange_global_info:493): Graph info:
nverts: 33561139
nedges: 983368362
nreplicas: 84780542
replication factor: 2.52615
#vertices: 33561139 #edges:983368362
INFO: synchronous_engine.hpp(synchronous_engine:994): Engine Option: max_iterations = 50
INFO: synchronous_engine.hpp(synchronous_engine:1004): Engine Option: use_cache = 1
INFO: synchronous_engine.hpp(start:1249): Iteration counter will only output every 5 seconds.
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 0
INFO: synchronous_engine.hpp(start:1313): Active vertices: 33561139
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 1
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32917436
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 2
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32376210
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 3
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32699427
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 4
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32630004
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 5
INFO: synchronous_engine.hpp(start:1313): Active vertices: 32675770
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 6
INFO: synchronous_engine.hpp(start:1313): Active vertices: 31750080
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 7
INFO: synchronous_engine.hpp(start:1313): Active vertices: 29606630
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 8
INFO: synchronous_engine.hpp(start:1313): Active vertices: 22865573
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 9
INFO: synchronous_engine.hpp(start:1313): Active vertices: 17566601
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 10
INFO: synchronous_engine.hpp(start:1313): Active vertices: 15563772
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 12
INFO: synchronous_engine.hpp(start:1313): Active vertices: 13546116
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 14
INFO: synchronous_engine.hpp(start:1313): Active vertices: 10057783
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 16
INFO: synchronous_engine.hpp(start:1313): Active vertices: 8450275
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 19
INFO: synchronous_engine.hpp(start:1313): Active vertices: 6079778
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1264): 0: Starting iteration: 24
INFO: synchronous_engine.hpp(start:1313): Active vertices: 941198
INFO: synchronous_engine.hpp(start:1362): Running Aggregators
INFO: synchronous_engine.hpp(start:1374): 29 iterations completed.
Updates: 420798873
Finished Running engine in 118.5 seconds.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.