Created
August 23, 2010 16:00
-
-
Save PharkMillups/545760 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 8:49 <wayneeseguin> bingeldac / seancribbs I have a question about backend data storage with RIak | |
| 08:50 <seancribbs1> what do you want to know | |
| 08:50 <bingeldac> shoot | |
| 08:50 <wayneeseguin> Can Riak handle merging of say 10 partitions each of 200G and | |
| looking as a single data store from without? | |
| 08:50 <wayneeseguin> That's a limitation we're trying to figure out a way around | |
| 08:50 <seancribbs> that makes no sense | |
| 08:50 <seancribbs> care to give more detail? | |
| 08:51 <wayneeseguin> Yes, we need to run riak on a VM | |
| 08:51 <wayneeseguin> the VM cannot accept a 2TB partition | |
| 08:51 <wayneeseguin> but it can mount 10 200G partitions | |
| 08:51 <wayneeseguin> We'd like riak to look at all of that as usable by itself even | |
| thought it's separate partitions | |
| 08:52 <wayneeseguin> Is that possible | |
| 08:52 <seancribbs> use JBOD / LVM | |
| 08:53 <wayneeseguin> seancribbs: That can't be done over NFS IIRC | |
| 08:53 <seancribbs> that's different | |
| 08:54 <wayneeseguin> I was wondering if this 'riak_kv_multi_backend' would be the key | |
| (I haven't read up on it yet) | |
| 08:54 <dysinger> wayneeseguin: are you talking about AWS & EBS ? | |
| 08:54 <seancribbs> no, that's just for allowing to have different backends per bucket | |
| 08:55 <wayneeseguin> dysinger: no this is a private data center infrastructure | |
| running on vSphere | |
| 08:55 <dysinger> ah | |
| 08:56 <dysinger> well if it's linux you can use LVM to make your 10 200GB look like 1 2TB drive | |
| 08:57 <dysinger> the push riak on top | |
| 08:57 <wayneeseguin> dysinger: not with NFS though correct? | |
| 08:57 <dysinger> s/the/then | |
| 08:57 <dysinger> no | |
| 08:57 <dysinger> correct | |
| 08:57 <dysinger> AFAIK glusterfs can do this though - not nfs but similar | |
| 08:57 <dysinger> would hate to run riak on any of those though :/ | |
| 08:58 <dysinger> slooooooooooow | |
| 08:58 <seancribbs> yeah, NFS kind of defeats some of the purpose of Riak | |
| 08:58 <wayneeseguin> So basially 'make sure there is the 2TB partition somehow as one | |
| and that's what riak will use' | |
| 08:58 <seancribbs> yes | |
| 08:58 <wayneeseguin> *one partition | |
| 08:58 <seancribbs> or you could have 10 riak nodes | |
| 08:58 <seancribbs> ;) | |
| 08:59 <wayneeseguin> seancribbs: I think we need to have a call with the company | |
| about this | |
| 08:59 <wayneeseguin> and you | |
| 08:59 <wayneeseguin> *riak | |
| 08:59 <* seancribbs> pawns that off to grant | |
| 08:59 <bingeldac> I am on a sabbatical for the next few months | |
| 09:02 <seancribbs> anyway - just email riak@basho.com with more detail, | |
| we'll get something set up | |
| 09:02 <bingeldac> yep yep | |
| 09:02 <bingeldac> sean, dan, or I can help you out and figure out something | |
| 09:04 <wayneeseguin> k |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment