Skip to content

Instantly share code, notes, and snippets.

@PharkMillups
Created December 9, 2010 01:30
Show Gist options
  • Select an option

  • Save PharkMillups/734198 to your computer and use it in GitHub Desktop.

Select an option

Save PharkMillups/734198 to your computer and use it in GitHub Desktop.
21:20 <reiddraper_> i've got a question about setting links on
objects, if anyone's around to answer
21:20 <drev1> reiddraper_: what's the question?
21:20 <reiddraper_> is there a way to add a link to an object
without doing http PUT and sending the entire object?
21:20 <reiddraper_> while adding the link header
21:20 <drev1> no
21:21 <reiddraper_> is that a vector clock related reason?
21:24 <drev1> kind of
21:27 <reiddraper_> ok, perhaps i can describe my simple schema,
and see if there is another way to accomplish the same thing
21:27 <reiddraper_> i'd like to store documents that come
from web crawls about a particular resource, let's say a band
21:28 <reiddraper_> and several documents might gather the
birthdate of the band, and others might have record reviews
21:28 <reiddraper_> and i was imagining using links from one
"band" document, to all of these crawled documents
21:29 <reiddraper_> but having to retrieve the band document,
and resend it, adding a new link each time
21:29 <reiddraper_> doesn't seem elegant
21:30 <drev1> currently, that is the only method available
21:31 <drev1> Riak Search, which is currently in Beta,
might be an option
21:31 <drev1> also, in Riak 0.14 there will be key filters
21:32 <reiddraper_> key filters?
21:32 <drev1> so, in Riak 0.13 managing links to multiple
related documents must be done by fetching and storing the
entire list of related documents
21:33 <drev1> in Riak 0.14, key filters allow you to
perform map/reduce queries against a subset of keys within a bucket
21:33 <drev1> the subset of keys is defined by a filter
21:33 <reiddraper_> ah, yes
21:34 <drev1> for instance; you might prepend all your
keys with band_name
21:34 <reiddraper_> right
21:34 <drev1> than filter for that name
21:34 <drev1> this functionality is available in the master branch
if you want to try it out
21:35 <reiddraper_> great
21:35 <reiddraper_> are there architectural changes with how keys
are stored to make the key filtering possible without traversing every key?
21:36 <reiddraper_> like being stored in a b-tree in bitcask or something?
21:37 <drev1> there have been improvements to key listing and map/reduce
but I am not familiar with the details
21:38 <reiddraper_> thanks. riak search might be the way to go.
trying to do something clever with links might end up being more trouble than it's worth
21:38 <drev1> based on the information given it does not seem
like links would be a good choice
21:41 <reiddraper_> do you have a feel for how well integrated search is into the mapreduce api?
21:42 <drev1> https://wiki.basho.com/display/RIAK/Riak+Search+-+Querying#RiakSearch-Querying-
QueryingviatheRiakClientAPI
21:43 <reiddraper_> thanks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment