Created
December 9, 2010 01:30
-
-
Save PharkMillups/734198 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 21:20 <reiddraper_> i've got a question about setting links on | |
| objects, if anyone's around to answer | |
| 21:20 <drev1> reiddraper_: what's the question? | |
| 21:20 <reiddraper_> is there a way to add a link to an object | |
| without doing http PUT and sending the entire object? | |
| 21:20 <reiddraper_> while adding the link header | |
| 21:20 <drev1> no | |
| 21:21 <reiddraper_> is that a vector clock related reason? | |
| 21:24 <drev1> kind of | |
| 21:27 <reiddraper_> ok, perhaps i can describe my simple schema, | |
| and see if there is another way to accomplish the same thing | |
| 21:27 <reiddraper_> i'd like to store documents that come | |
| from web crawls about a particular resource, let's say a band | |
| 21:28 <reiddraper_> and several documents might gather the | |
| birthdate of the band, and others might have record reviews | |
| 21:28 <reiddraper_> and i was imagining using links from one | |
| "band" document, to all of these crawled documents | |
| 21:29 <reiddraper_> but having to retrieve the band document, | |
| and resend it, adding a new link each time | |
| 21:29 <reiddraper_> doesn't seem elegant | |
| 21:30 <drev1> currently, that is the only method available | |
| 21:31 <drev1> Riak Search, which is currently in Beta, | |
| might be an option | |
| 21:31 <drev1> also, in Riak 0.14 there will be key filters | |
| 21:32 <reiddraper_> key filters? | |
| 21:32 <drev1> so, in Riak 0.13 managing links to multiple | |
| related documents must be done by fetching and storing the | |
| entire list of related documents | |
| 21:33 <drev1> in Riak 0.14, key filters allow you to | |
| perform map/reduce queries against a subset of keys within a bucket | |
| 21:33 <drev1> the subset of keys is defined by a filter | |
| 21:33 <reiddraper_> ah, yes | |
| 21:34 <drev1> for instance; you might prepend all your | |
| keys with band_name | |
| 21:34 <reiddraper_> right | |
| 21:34 <drev1> than filter for that name | |
| 21:34 <drev1> this functionality is available in the master branch | |
| if you want to try it out | |
| 21:35 <reiddraper_> great | |
| 21:35 <reiddraper_> are there architectural changes with how keys | |
| are stored to make the key filtering possible without traversing every key? | |
| 21:36 <reiddraper_> like being stored in a b-tree in bitcask or something? | |
| 21:37 <drev1> there have been improvements to key listing and map/reduce | |
| but I am not familiar with the details | |
| 21:38 <reiddraper_> thanks. riak search might be the way to go. | |
| trying to do something clever with links might end up being more trouble than it's worth | |
| 21:38 <drev1> based on the information given it does not seem | |
| like links would be a good choice | |
| 21:41 <reiddraper_> do you have a feel for how well integrated search is into the mapreduce api? | |
| 21:42 <drev1> https://wiki.basho.com/display/RIAK/Riak+Search+-+Querying#RiakSearch-Querying- | |
| QueryingviatheRiakClientAPI | |
| 21:43 <reiddraper_> thanks |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment