AlBaker

What to do when you're knowledge graph seems to know something it shoulnd't? For example when subjects were coming back with a type relationship they shouldn't - stardog reasoning explain to the rescue:

$ stardog reasoning explain decomp "<https://example.org/id/1> a ns:MyType"
INFERRED <example.org/id/1> a ns:MyType
   ASSERTED ns1:linkedFrom rdfs:domain ns1:MyType
   INFERRED <https://example.org/id/1> ns1:linkedFrom i:1_1
      ASSERTED ns1:linkedFrom owl:inverseOf ns1:linkedRequirement
      ASSERTED i:1_1 ns1:linkedRequirement <https://example.org/id/1>

AlBaker

(ns stardog-clojure.core
  (:require
            [stardog.core :refer [insert! remove! update! query create-db-spec make-datasource
                                  with-connection-pool with-transaction]]
            [stardog.values :as values])
  (:gen-class))

(defn db-spec
  [database]
  (create-db-spec database "http://localhost:5820/" "admin" "admin" true))

AlBaker

1. General Background and Overview

• Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
• Models and Issues in Data Stream Systems
• Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
• Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
• [Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep

AlBaker

#!/usr/bin/env boot

(set-env! :dependencies '[[org.clojure/clojure "1.8.0"]
                          [stardog-clj "4.2.1"]])
(require '[stardog.core :refer [insert! remove! query create-db-spec make-datasource
                                  with-connection-pool with-transaction]])

;;; This script can be executed with ./script-name
;;; export BOOT_CLOJURE_VERSION=1.8.0 

AlBaker

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>

	<groupId>com.example</groupId>
	<artifactId>demo</artifactId>
	<version>0.0.1-SNAPSHOT</version>
	<packaging>jar</packaging>

AlBaker

<ivysettings>
  <settings defaultResolver="downloadGrapes"/>
  <resolvers>
    <chain name="downloadGrapes" returnFirst="true">
      <filesystem name="cachedGrapes">
        <ivy pattern="${user.home}/.groovy/grapes/[organisation]/[module]/ivy-[revision].xml"/>
        <artifact pattern="${user.home}/.groovy/grapes/[organisation]/[module]/[type]s/[artifact]-[revision](-[classifier]).[ext]"/>
      </filesystem>

      <!-- todo add 'endorsed groovy extensions' resolver here -->

AlBaker

@GrabResolver(name='stardog', root='http://maven.stardog.com/')
@Grab('com.complexible.stardog:stardog-groovy:3.1.4')
import com.complexible.stardog.ext.groovy.Stardog

def stardog = new Stardog([url: "snarl://localhost:5820/", to:"testdb", username:"admin", password:"admin", reasoning:true])

def list = []
stardog.query("select ?s ?p ?o WHERE { ?s a <http://www.lehigh.edu/~zhp2/2004/0401/univ-bench.owl#Person> }", { list << it } )

println list.size() // 719 using the Lehigh data set

AlBaker

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
		 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
		 xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>
 
	<groupId>stardog-maven</groupId>
	<artifactId>stardog</artifactId>
	<version>0.0.1-SNAPSHOT</version>
 

AlBaker

@Grab('com.complexible.stardog:stardog-groovy:3.0.0')
import com.complexible.stardog.ext.groovy.Stardog
def stardog = new Stardog([url: "snarl://localhost:5820/", to:"testdb", username:"admin", password:"admin", reasoning:true])
stardog.query("select ?x WHERE { ?x a <urn:SomeSubclass> } LIMIT 2", { println it } ) // <- Stardog answers the query with reasoned relationships!

AlBaker

package com.complexible.stardog.ext.spring;

import com.complexible.common.protocols.server.ServerException;
import com.complexible.stardog.Stardog;
import com.complexible.stardog.StardogException;
import com.complexible.stardog.api.admin.AdminConnection;
import com.complexible.stardog.api.admin.AdminConnectionConfiguration;
import com.complexible.stardog.protocols.snarl.SNARLProtocolConstants;

public class EmbeddedProvider implements Provider {