Mickaël Le Baillif demikl
demikl
/ example_pg_to_cb.py
Last active
December 28, 2015 20:39
Example of data import from PostgreSQL to Couchbase. Used during Couchbase Meetup Number 1, Paris.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import psycopg2, psycopg2.extras, json | |
| import eventlet,eventlet.pools, eventlet.db_pool | |
| from multiprocessing import Process as mps, JoinableQueue | |
| # Import de la lib memcache_client en remplaçant les I/O bloquantes par celles d'eventlet | |
| mc = eventlet.import_patched('memcache_client.memcache') | |
| # Taille des pools : connexions couchbase et processus workers | |
| CB_SIZE = 50 | |
| PS_SIZE = 10 |