Skip to content

Instantly share code, notes, and snippets.

@PharkMillups
Created August 23, 2010 16:00
Show Gist options
  • Select an option

  • Save PharkMillups/545760 to your computer and use it in GitHub Desktop.

Select an option

Save PharkMillups/545760 to your computer and use it in GitHub Desktop.
8:49 <wayneeseguin> bingeldac / seancribbs I have a question about backend data storage with RIak
08:50 <seancribbs1> what do you want to know
08:50 <bingeldac> shoot
08:50 <wayneeseguin> Can Riak handle merging of say 10 partitions each of 200G and
looking as a single data store from without?
08:50 <wayneeseguin> That's a limitation we're trying to figure out a way around
08:50 <seancribbs> that makes no sense
08:50 <seancribbs> care to give more detail?
08:51 <wayneeseguin> Yes, we need to run riak on a VM
08:51 <wayneeseguin> the VM cannot accept a 2TB partition
08:51 <wayneeseguin> but it can mount 10 200G partitions
08:51 <wayneeseguin> We'd like riak to look at all of that as usable by itself even
thought it's separate partitions
08:52 <wayneeseguin> Is that possible
08:52 <seancribbs> use JBOD / LVM
08:53 <wayneeseguin> seancribbs: That can't be done over NFS IIRC
08:53 <seancribbs> that's different
08:54 <wayneeseguin> I was wondering if this 'riak_kv_multi_backend' would be the key
(I haven't read up on it yet)
08:54 <dysinger> wayneeseguin: are you talking about AWS & EBS ?
08:54 <seancribbs> no, that's just for allowing to have different backends per bucket
08:55 <wayneeseguin> dysinger: no this is a private data center infrastructure
running on vSphere
08:55 <dysinger> ah
08:56 <dysinger> well if it's linux you can use LVM to make your 10 200GB look like 1 2TB drive
08:57 <dysinger> the push riak on top
08:57 <wayneeseguin> dysinger: not with NFS though correct?
08:57 <dysinger> s/the/then
08:57 <dysinger> no
08:57 <dysinger> correct
08:57 <dysinger> AFAIK glusterfs can do this though - not nfs but similar
08:57 <dysinger> would hate to run riak on any of those though :/
08:58 <dysinger> slooooooooooow
08:58 <seancribbs> yeah, NFS kind of defeats some of the purpose of Riak
08:58 <wayneeseguin> So basially 'make sure there is the 2TB partition somehow as one
and that's what riak will use'
08:58 <seancribbs> yes
08:58 <wayneeseguin> *one partition
08:58 <seancribbs> or you could have 10 riak nodes
08:58 <seancribbs> ;)
08:59 <wayneeseguin> seancribbs: I think we need to have a call with the company
about this
08:59 <wayneeseguin> and you
08:59 <wayneeseguin> *riak
08:59 <* seancribbs> pawns that off to grant
08:59 <bingeldac> I am on a sabbatical for the next few months
09:02 <seancribbs> anyway - just email riak@basho.com with more detail,
we'll get something set up
09:02 <bingeldac> yep yep
09:02 <bingeldac> sean, dan, or I can help you out and figure out something
09:04 <wayneeseguin> k
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment