Mentions légales du service

Skip to content
Snippets Groups Projects
Commit a56e9c0b authored by Jérôme Euzenat's avatar Jérôme Euzenat
Browse files

- Added tutorial6 on data interlinking with link keys

parent 2cd7c0c7
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 961 additions and 1 deletion
html/tutorial/index.html
+ 4
− 1
View file @ a56e9c0b
...@@ -69,6 +69,8 @@ through its REST web service API,</li> ...@@ -69,6 +69,8 @@ through its REST web service API,</li>
</ul> </ul>
It is based on Java programming and using various It is based on Java programming and using various
related APIs.</dd> related APIs.</dd>
<dt><a href="tutorial6/index.html">Interlinking data with alignments and link keys</a></dt>
<dd>Explains how RDF data sets may be interlinked from alignments..</dd>
<dt><a href="tutorial3/index.html">Extending the Alignment API with a new matcher</a></dt> <dt><a href="tutorial3/index.html">Extending the Alignment API with a new matcher</a></dt>
<dd>Explains how an ontology matching developer can easily integrate <dd>Explains how an ontology matching developer can easily integrate
its matcher within the Alignment API.</dd> its matcher within the Alignment API.</dd>
...@@ -150,7 +152,7 @@ $ rm */results/* ...@@ -150,7 +152,7 @@ $ rm */results/*
$ setenv CWD `pwd` $ setenv CWD `pwd`
</div> </div>
<p>which puts in variable <tt>$CWD</tt> the name of the current <p>which puts in variable <tt>$CWD</tt> the name of the current
directory (for these using Bourne shell instead of C-shell, this is <tt>CWD=`pwd`</tt>).</p> directory (for these using Bourne shell instead of C-shell, this is <tt>export CWD=`pwd`</tt>).</p>
<p> <p>
Now you can go back to any of the tutorials: Now you can go back to any of the tutorials:
...@@ -160,6 +162,7 @@ Now you can go back to any of the tutorials: ...@@ -160,6 +162,7 @@ Now you can go back to any of the tutorials:
<li><a href="tutorial2/index.html">Manipulating alignments in Java <li><a href="tutorial2/index.html">Manipulating alignments in Java
programs (and embedding the Alignment API within an application)</a></li> programs (and embedding the Alignment API within an application)</a></li>
<li><a href="tutorial4/index.html">Exploiting alignments and reasoning</a></li> <li><a href="tutorial4/index.html">Exploiting alignments and reasoning</a></li>
<li><a href="tutorial6/index.html">Interlinking data with alignments and link keys</a></li>
<li><a href="tutorial3/index.html">Extending the Alignment API with a new matcher</a></li> <li><a href="tutorial3/index.html">Extending the Alignment API with a new matcher</a></li>
<li><a href="tutorial5/index.html">Offering a matcher as a web service</a></li> <li><a href="tutorial5/index.html">Offering a matcher as a web service</a></li>
</ul> </ul>
......
html/tutorial/tutorial5/index.html
+ 1
− 0
View file @ a56e9c0b
...@@ -34,6 +34,7 @@ margin-bottom: 10px; ...@@ -34,6 +34,7 @@ margin-bottom: 10px;
<body style="background-color: #FFFFFF;"> <body style="background-color: #FFFFFF;">
<h1>Exposing a matcher as a web service</h1> <h1>Exposing a matcher as a web service</h1>
<dl> <dl>
<dd>http://alignapi.gforge.inria.fr/tutorial/tutorial5/</dd>
<dt>Authors:</dt> <dt>Authors:</dt>
<dd><a href="http://exmo.inrialpes.fr/people/trojahn/">C&aacute;ssia Trojahn dos <dd><a href="http://exmo.inrialpes.fr/people/trojahn/">C&aacute;ssia Trojahn dos
Santos</a> &amp; <a href="http://exmo.inrialpes.fr/people/euzenat/">Jérôme Euzenat</a>, INRIA &amp; LIG </dd> Santos</a> &amp; <a href="http://exmo.inrialpes.fr/people/euzenat/">Jérôme Euzenat</a>, INRIA &amp; LIG </dd>
......
html/tutorial/tutorial6/bin/fix.sh 0 → 100644
+ 29
− 0
View file @ a56e9c0b
#!/bin/sh
ed -s $1 <<EOF 2>/dev/null
6 a
<xml>yes</xml>
<level>1</level>
<type>**</type>
<onto1>
<Ontology rdf:about="http://rdf.insee.fr/geo/">
<location>file:admin/regions-2010.rdf</location>
<formalism>
<Formalism align:name="OWL1.0" align:uri="http://www.w3.org/2002/07/owl#"/>
</formalism>
</Ontology>
</onto1>
<onto2>
<Ontology rdf:about="http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#">
<location>file:admin/nuts2008_complete.rdf</location>
<formalism>
<Formalism align:name="OWL1.0" align:uri="http://www.w3.org/2002/07/owl#"/>
</formalism>
</Ontology>
</onto2>
.
w
q
EOF
html/tutorial/tutorial6/bin/proc.sh 0 → 100644
+ 10
− 0
View file @ a56e9c0b
#!/bin/sh
for i in 1 2 3 4 5 6
do
Echo Processing $i
java -DconfigFile=admin/basic-script.xml -DlinkSpec=no$i -jar lib/silk/silk.jar 2> /dev/null
sh bin/fix.sh results/Round$i-accepted.rdf
grep entity1 results/Round$i-accepted.rdf | wc -l
java -cp lib/procalign.jar fr.inrialpes.exmo.align.cli.EvalAlign -i fr.inrialpes.exmo.align.impl.eval.PRecEvaluator file:admin/reflinks.rdf file:results/Round$i-accepted.rdf
done
html/tutorial/tutorial6/browser.html 0 → 100644
+ 148
− 0
View file @ a56e9c0b
<?xml version="1.0"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<title>Interlinking data with alignments and link keys (in triple stores)</title>
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1" />
<link rel="stylesheet" type="text/css" href="../../base.css" />
<link rel="stylesheet" type="text/css" href="../../style.css" />
<script type="text/javascript">
<!--
function show(id) {
var element = document.getElementById(id);
element.style.display = "block";
}
function hide(id) {
var element = document.getElementById(id);
element.style.display = "none";
}
-->
</script>
<style type="text/css">
<!--
div.logic {
padding-left: 5px;
padding-right: 5px;
margin-top: 10px;
margin-bottom: 10px;
}
-->
</style>
</head>
<body style="background-color: #FFFFFF;">
<h1>Interlinking data with alignments and link keys (in triple stores)</h1>
<p>This shows the use of queries generated in the <a href="index.html">Data interlinking tutorial</a>
in online triple stores.
</p>
<h2>Sesame</h2>
<p>We are using <a href="http://openrdf.org/">Sesame</a>.
</p>
<h3>Evaluating the query in data sets loaded in different name graphs</h3>
<p>Data sets are loaded in two different name graphs.</p>
<img src="img/sesame/step3.png" />
<img src="img/sesame/step5.png" />
<img src="img/sesame/step6.png" />
<p>
For this test a new query is generated by naming the graphs:
<div class="terminal">
$ java -cp $CLASSPATH fr.inrialpes.exmo.align.cli.ParserPrinter file:linkkey4.rdf -r fr.inrialpes.exmo.align.impl.renderer.SPARQLLinkkerRendererVisitor -DgraphName1=http://example.com/insee -DgraphName2=http://example.com/nuts
</div>
which provides the query:
<div class="result">
PREFIX rdf:&lt;http://www.w3.org/1999/02/22-rdf-syntax-ns#>
PREFIX ns1:&lt;http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#>
PREFIX owl:&lt;http://www.w3.org/2002/07/owl#>
PREFIX ns2:&lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/>
PREFIX ns0:&lt;http://rdf.insee.fr/geo/>
PREFIX xsd:&lt;http://www.w3.org/2001/XMLSchema#>
CONSTRUCT { ?s1 owl:sameAs ?s2 }
WHERE {
GRAPH &lt;http://example.com/insee> {
?s1 rdf:type ns0:Departement .
}
GRAPH &lt;http://example.com/nuts> {
?s2 rdf:type ns1:NUTSRegion .
?s2 ns1:level ?o2 .
FILTER (?o2=3)
?s2 ns1:hasParentRegion ?o4 .
?o4 ns1:hasParentRegion ?o5 .
?o5 ns1:hasParentRegion ?o6 .
FILTER (?o6=ns2:FR)
}
GRAPH &lt;http://example.com/insee> {
?s1 ns0:nom ?o7 .
}
GRAPH &lt;http://example.com/nuts> {
?s2 ns1:name ?o8 .
}
FILTER( lcase(str(?o7)) = lcase(str(?o8)) )
MINUS { GRAPH &lt;http://example.com/insee> {
?s1 ns0:nom ?o2 .
}
FILTER NOT EXISTS { GRAPH &lt;http://example.com/nuts> {
?s2 ns1:name ?o2 .
}
} }
MINUS { GRAPH &lt;http://example.com/nuts> {
?s2 ns1:name ?o2 .
}
FILTER NOT EXISTS { GRAPH &lt;http://example.com/insee> {
?s1 ns0:nom ?o2 .
}
} }
}
</div>
</p>
<img src="img/sesame/step9.png" />
<img src="img/sesame/step10.png" />
<p>Similar results may be obtained by loading the data in the same
graph</p>
<img src="img/sesame/step7.png" />
<img src="img/sesame/step8.png" />
<h2>Virtuoso</h2>
<h3>Evaluating the query in data sets loaded the same name graphs</h3>
<p>We are
using <a href="http://virtuoso.openlinksw.com/rdf-quad-store/">Virtuoso</a>.
Everything has been loaded in a single named graph (identified by http://exmo)...
</p>
<img src="img/virtuoso/eval-1-graph-1.png" />
<img src="img/virtuoso/eval-1-graph-2.png" />
<h3>Evaluating the query in data sets loaded in different name graphs</h3>
<p>Here is how to load the graphs:</p>
<img src="img/virtuoso/eval-2-graph-1.png" />
<p>Here is how to evaluate the same query as generated for Sesame.</p>
<img src="img/virtuoso/eval-2-graph-2.png" />
<p>The result is the same as previously.</p>
<hr />
<small>
<div style="text-align: center;">http://alignapi.gforge.inria.fr/tutorial/tutorial6/browser.html</div>
<hr />
<div>$Id$</div>
</small>
</body>
</html>
html/tutorial/tutorial6/geo-script.xml 0 → 100644
+ 105
− 0
View file @ a56e9c0b
<?xml version="1.0" encoding="utf-8" ?>
<!-- Works with Silk 2.5.4 (but not 2.6.1, but maybe 2.6.2) -->
<Silk>
<Prefixes>
<Prefix id="rdf" namespace="http://www.w3.org/1999/02/22-rdf-syntax-ns#" />
<Prefix id="owl" namespace="http://www.w3.org/2002/07/owl#" />
<Prefix id="gn" namespace="http://www.geonames.org/ontology#" />
<Prefix id="id1" namespace="http://rdf.insee.fr/geo/" />
<Prefix id="insee" namespace="http://rdf.insee.fr/def/geo#" />
</Prefixes>
<DataSources>
<DataSource id="id1" type="file">
<Param name="file" value="insee-communes.ttl"/>
<Param name="format" value="TTL" />
</DataSource>
<DataSource id="id2" type="file">
<Param name="file" value="communes_gn.ttl"/>
<Param name="format" value="TTL" />
</DataSource>
</DataSources>
<Interlinks>
<Interlink id="no1">
<LinkType>owl:sameAs</LinkType>
<SourceDataset dataSource="id1" var="e1">
<RestrictTo>
?e1 rdf:type insee:Commune .
</RestrictTo>
</SourceDataset>
<TargetDataset dataSource="id2" var="e2">
<RestrictTo>
?e2 rdf:type gn:Feature . ?e2 gn:countryCode "FR" .
</RestrictTo>
</TargetDataset>
<LinkageRule>
<Compare metric="equality">
<Input path="?e1/insee:nom" />
<Input path="?e2/gn:name" />
</Compare>
</LinkageRule>
<Filter />
<Outputs>
<Output minConfidence="1." type="file">
<Param name="file" value="results/NewRound1-accepted.rdf"/>
<Param name="format" value="alignment"/>
</Output>
</Outputs>
</Interlink>
<Interlink id="no2">
<LinkType>owl:sameAs</LinkType>
<SourceDataset dataSource="id1" var="e1">
<RestrictTo>
?e1 rdf:type insee:Commune .
</RestrictTo>
</SourceDataset>
<TargetDataset dataSource="id2" var="e2">
<RestrictTo>
?e2 rdf:type gn:Feature . ?e2 gn:countryCode "FR" .
</RestrictTo>
</TargetDataset>
<LinkageRule>
<Aggregate type="max">
<Compare metric="jaccard" threshold=".2">
<TransformInput function="tokenize">
<Input path="?e1/insee:nom" />
</TransformInput>
<TransformInput function="tokenize">
<Input path="?e2/gn:name" />
</TransformInput>
</Compare>
<Compare metric="levenshtein">
<Input path="?e1/insee:nom" />
<Input path="?e2/gn:name" />
</Compare>
</Aggregate>
</LinkageRule>
<Filter />
<Outputs>
<Output minConfidence=".7" type="file">
<Param name="file" value="results/NewRound2-accepted.rdf"/>
<Param name="format" value="alignment"/>
</Output>
<Output maxConfidence=".7" minConfidence=".2" type="file">
<Param name="file" value="results/NewRound2-tocheck.nt"/>
<Param name="format" value="ntriples"/>
</Output>
</Outputs>
</Interlink>
</Interlinks>
</Silk>
html/tutorial/tutorial6/img/sesame/step10.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/sesame/step10.png

103 KiB

html/tutorial/tutorial6/img/sesame/step3.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/sesame/step3.png

66.7 KiB

html/tutorial/tutorial6/img/sesame/step5.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/sesame/step5.png

65.6 KiB

html/tutorial/tutorial6/img/sesame/step6.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/sesame/step6.png

54.9 KiB

html/tutorial/tutorial6/img/sesame/step7.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/sesame/step7.png

114 KiB

html/tutorial/tutorial6/img/sesame/step8.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/sesame/step8.png

107 KiB

html/tutorial/tutorial6/img/sesame/step9.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/sesame/step9.png

131 KiB

html/tutorial/tutorial6/img/virtuoso/eval-1-graph-1.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/virtuoso/eval-1-graph-1.png

102 KiB

html/tutorial/tutorial6/img/virtuoso/eval-1-graph-2.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/virtuoso/eval-1-graph-2.png

112 KiB

html/tutorial/tutorial6/img/virtuoso/eval-2-graph-1.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/virtuoso/eval-2-graph-1.png

77 KiB

html/tutorial/tutorial6/img/virtuoso/eval-2-graph-2.png 0 → 100644
+ 0
− 0
View file @ a56e9c0b
html/tutorial/tutorial6/img/virtuoso/eval-2-graph-2.png

110 KiB

html/tutorial/tutorial6/index.html 0 → 100644
+ 521
− 0
View file @ a56e9c0b
<?xml version="1.0"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<title>Interlinking data with alignments and link keys</title>
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1" />
<link rel="stylesheet" type="text/css" href="../../base.css" />
<link rel="stylesheet" type="text/css" href="../../style.css" />
<script type="text/javascript">
<!--
function show(id) {
var element = document.getElementById(id);
element.style.display = "block";
}
function hide(id) {
var element = document.getElementById(id);
element.style.display = "none";
}
-->
</script>
<style type="text/css">
<!--
div.logic {
padding-left: 5px;
padding-right: 5px;
margin-top: 10px;
margin-bottom: 10px;
}
-->
</style>
</head>
<body style="background-color: #FFFFFF;">
<h1>Interlinking data with alignments and link keys</h1>
<dl>
<dt>This version:</dt>
<dd>http://alignapi.gforge.inria.fr/tutorial/tutorial6/</dd>
<dt>Author:</dt>
<dd><a href="http://exmo.inrialpes.fr/people/euzenat">J&eacute;r&ocirc;me Euzenat</a>, INRIA &amp; LIG
</dd>
</dl>
<p style="border-top: 2px solid #AAAAAA; padding-top: 15px;">This tutorial explains how it is possible to generate links between
datasets from EDOAL alignments with <a href="../../edoal.html">link
keys</a>.
It optionally illustrates similar taks with Silk.</p>
<p style="padding-top: 15px;border-top: 2px solid #AAAAAA;"></p>
<h2>Requirements</h2>
<p>
The tutorial works simply with software embedded in the Alignment API.
However, making is work with <!--LinkKeyDisco and-->Silk or a triple store requires
additional software.
<ul>
<!--li>"<a href="http://exmo.inrialpes.fr/~jdavid/linkrule-extraction/">LinkKeyDisco</a>" for extracting link keys</li-->
<li><a href="http://silk-framework.com/">Silk</a> for generating links from similarity specification</li>
<li><a href="http://openrdf.org/">Sesame</a> or <a href="http://virtuoso.openlinksw.com/rdf-quad-store/">Virtuoso</a> as a triple store (optional)</li>
<!--li>Note that we may also use <a href="http://openrefine.org/">OpenRefine</a></li-->
</ul>
As usual, the whole tutorial is performed through command line.
</p>
<p>
The evaluation of such queries under a triple store, and using named graphs, are illustrated
<a href="browser.html">here</a>.
</p>
<h2>Set up</h2>
<p>
First start by cleaning up your environment:
<div class="terminal">
$ cd tutorial6
$ mkdir results
</div>
</p>
<h2>Data sets</h2>
<p>
We are using two different data sets in files.
<ul>
<li><a href="nuts2008_complete.rdf">nuts2008_complete.rdf</a>:
The <a href="http://simap.europa.eu/codes-and-nomenclatures/codes-nuts/codes-nuts-table_fr.htm">Eurostat administrative decomposition of Europe up to level 3</a>
in the Nomenclature of Territorial Units for Statistics (NUTS);</a>
<li><a href="regions-2010.rdf">regions-2010.rdf</a>: the
French statistical institue (INSEE) administrative circumscription
in France.</a>
<li><a href="reflinks.rdf">reflinks.rdf</a>: an alignment containing all links between these
two data sets (for evaluation purposes only).
</ul>
Of course, the tutorial can be adapted with your own data sets.
</p>
<!-- Data:
NUTS vs. insee .
insee vs geoname .
bnf-person vs. bne-author
-->
<!--h2>Extracting link keys</h2>
<p>
From the data set stored in files, it generates an alignment comprising
link keys.
</p>
<p style="background-color: yellow;">(1) Try to extract with DiscoLinkKey on insee/nuts</p>
<p style="background-color: yellow;">(2) Try to extract with DiscoLinkKey on insee/geonames</p-->
<h2>Generating links from link keys</h2>
<p>
From an alignment comprising link keys, it is possible to generate
sameAs links.
We have several such alignments here:
<ul>
<li><a href="linkkey1.rdf">linkkey1.rdf</a> to <a href="linkkey4.rdf">linkkey4.rdf</a>: a series of alignments which contains linkkeys and can be used for generating links;</li>
<!--li>align.rdf: An edoal alignment which may be used for generating Silk script</li-->
</ul>
The goal of the tutorial is that you apply them one after the other, i.e., replacing the number in
the instructions below to see what these link keys do.
</p>
<div class="button">
<input type="button" onclick="show('qu0cli')" value="See alignment"/>
<input type="button" onclick="hide('qu0cli');" value="Hide"/>
</div>
<div class="explain" id="qu0cli">
This corresponds to <a href="linkkey3.rdf">linkkey3.rdf</a>:
<div class="result">
&lt;map>
&lt;Cell>
&lt;entity1>
&lt;edoal:Class rdf:about="&insee;Departement"/>
&lt;/entity1>
&lt;entity2>
&lt;edoal:Class>
&lt;edoal:and rdf:parseType="Collection">
&lt;edoal:Class rdf:about="&eurostat;NUTSRegion"/>
&lt;edoal:AttributeValueRestriction>
&lt;edoal:onAttribute>
&lt;edoal:Property rdf:about="&eurostat;level"/>
&lt;/edoal:onAttribute>
&lt;edoal:comparator rdf:resource="&edoal;equals"/>
&lt;edoal:value>&lt;edoal:Literal edoal:type="&xsd;integer" edoal:string="3" />&lt;/edoal:value>
&lt;/edoal:AttributeValueRestriction>
&lt;edoal:AttributeValueRestriction>
&lt;edoal:onAttribute>
&lt;edoal:Relation>
&lt;edoal:compose rdf:parseType="Collection">
&lt;edoal:Relation rdf:about="&eurostat;hasParentRegion" />
&lt;edoal:Relation rdf:about="&eurostat;hasParentRegion" />
&lt;edoal:Relation rdf:about="&eurostat;hasParentRegion" />
&lt;/edoal:compose>
&lt;/edoal:Relation>
&lt;/edoal:onAttribute>
&lt;edoal:comparator rdf:resource="&edoal;equals"/>
&lt;edoal:value>&lt;edoal:Instance rdf:about="&esdata;FR" />&lt;/edoal:value>
&lt;/edoal:AttributeValueRestriction>
&lt;/edoal:and>
&lt;/edoal:Class>
&lt;/entity2>
&lt;relation>equivalence&lt;/relation>
&lt;measure>1.0&lt;/measure>
&lt;edoal:linkkey>
&lt;edoal:Linkkey>
&lt;edoal:binding>
&lt;edoal:Intersects>
&lt;edoal:property1>
&lt;edoal:Property rdf:about="&insee;nom" />&lt;!-- xml:lang="fr"-->
&lt;/edoal:property1>
&lt;edoal:property2>
&lt;edoal:Property rdf:about="&eurostat;name" />
&lt;/edoal:property2>
&lt;/edoal:Intersects>
&lt;/edoal:binding>
&lt;/edoal:Linkkey>
&lt;/edoal:linkkey>
&lt;/Cell>
&lt;/map>
</div>
<p>The full alignment is available at: <a href="linkkey3.rdf">linkkey3.rdf</a></p>
</div>
<p>
This is processed by:
<div class="terminal">
$ java -cp $CLASSPATH fr.inrialpes.exmo.align.cli.ParserPrinter file:linkkey1.rdf -r fr.inrialpes.exmo.align.impl.renderer.SPARQLLinkkerRendererVisitor -o results/query.sparql
</div>
</p>
to generate a set of SPARQL queries.
<div class="button">
<input type="button" onclick="show('qu1cli')" value="See generated query"/>
<input type="button" onclick="hide('qu1cli');" value="Hide"/>
</div>
<div class="explain" id="qu1cli">
<div class="result">
PREFIX rdf:&lt;http://www.w3.org/1999/02/22-rdf-syntax-ns#>
PREFIX ns1:&lt;http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#>
PREFIX owl:&lt;http://www.w3.org/2002/07/owl#>
PREFIX ns2:&lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/>
PREFIX ns0:&lt;http://rdf.insee.fr/geo/>
PREFIX xsd:&lt;http://www.w3.org/2001/XMLSchema#>
CONSTRUCT { ?s1 owl:sameAs ?s2 }
WHERE {
?s1 rdf:type ns0:Departement .
?s2 rdf:type ns1:NUTSRegion .
?s2 ns1:level ?o2 .
FILTER (?o2=3)
?s2 ns1:hasParentRegion ?o4 .
?o4 ns1:hasParentRegion ?o5 .
?o5 ns1:hasParentRegion ?o6 .
FILTER (?o6=ns2:FR)
?s1 ns0:nom ?o7 .
?s2 ns1:name ?o8 .
FILTER( lcase(str(?o7)) = lcase(str(?o8)) ) }
</div>
Think about what you could do to improve this query?
</div>
<p>
Processing any of these SPARQL queries, will generate links.
<div class="terminal">
$ java -cp $CLASSPATH arq.query --query results/query.sparql --data regions-2010.rdf --data nuts2008_complete.rdf > results/links.ttl
</div>
<div class="button">
<input type="button" onclick="show('qu3cli')" value="See generated links"/>
<input type="button" onclick="hide('qu3cli');" value="Hide"/>
</div>
<div class="explain" id="qu3cli">
<div class="result">
@prefix geo: &lt;http://rdf.insee.fr/geo/> .
@prefix cc: &lt;http://creativecommons.org/ns#> .
@prefix : &lt;http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#> .
@prefix rdf: &lt;http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix owl: &lt;http://www.w3.org/2002/07/owl#> .
@prefix dcterms: &lt;http://purl.org/dc/terms/> .
@prefix rdfs: &lt;http://www.w3.org/2000/01/rdf-schema#> .
@prefix ns0: &lt;http://rdf.insee.fr/geo/> .
@prefix ns1: &lt;http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#> .
@prefix dc: &lt;http://purl.org/dc/elements/1.1/> .
&lt;http://rdf.insee.fr/geo/2010/DEP_67>
owl:sameAs &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/FR421> .
&lt;http://rdf.insee.fr/geo/2010/DEP_39>
owl:sameAs &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/CH025> , &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/FR432> .
&lt;http://rdf.insee.fr/geo/2010/DEP_2A>
owl:sameAs &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/FR831> .
&lt;http://rdf.insee.fr/geo/2010/DEP_61>
owl:sameAs &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/FR253> .
&lt;http://rdf.insee.fr/geo/2010/DEP_33>
owl:sameAs &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/FR612> .
&lt;http://rdf.insee.fr/geo/2010/DEP_05>
owl:sameAs &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/FR822> .
&lt;http://rdf.insee.fr/geo/2010/DEP_74>
owl:sameAs &lt;http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/FR718> .
...
</div>
<p>The full link set is available at: <a href="links.ttl">results/links.ttl</a></p>
</div>
Can you spot a problem? Where does it come from? How can it be solved?
</p>
<!--h2>Generating links with OpenRefine</h2>
<p>
OpenRefine is an interface for publishing data as linked data.
One of its capability is to declare linking services to preform
interlinking.
Unfortunatelly such services are so simple that they only allow to
link with one condition, i.e., there is no way to express link rules
beyond nom&equiv;name.
</p-->
<h2>Generating links from similarity measures</h2>
<p>
We use Silk 2.6.1 in order to generate links based on the similarity
between resources.
Silk is driven by scripts which express such similarity.
The scripts are expressed in the <a href="https://www.assembla.com/wiki/show/silk/Link_Specification_Language">Link Specification Language</a>
</p>
<p>
We have several linkkage rules available they are all in the same
script (identified by no1...no6):
<ul>
<!--li><a href="align.rdf">align.rdf</a>: A simple alignment that can generate a skeleton Silk script;</li-->
<li><a href="script.xml">script.xml</a>: A script ready to use.</li>
</ul>
<!--Unfortunately <span style="background-color: yellow;">the script must
be updated to set the paths (/Skratch/TutoLinking/)
correctly</span>.-->
Again, your goal is to process the linkage rules provided in this
script from n1 to n6 and to understand what they do.
</p>
<p>
Here is the example of a part of <a href="script.xml">script.xml</a>
<div class="button">
<input type="button" onclick="show('scr1cli')" value="See prefixes"/>
<input type="button" onclick="show('scr2cli')" value="See sources"/>
<input type="button" onclick="show('scr3cli')" value="See linkage rules"/>
<input type="button" onclick="show('scr4cli')" value="See filters"/>
<input type="button" onclick="show('scr5cli')" value="See output"/>
<input type="button" onclick="hide('scr1cli');hide('scr2cli');hide('scr3cli');hide('scr4cli');hide('scr5cli');" value="Hide"/>
</div>
<div class="explain" id="scr1cli">
<div class="result">
&lt;?xml version="1.0" encoding="utf-8" ?>
&lt;Silk>
&lt;Prefixes>
&lt;Prefix id="rdf" namespace="http://www.w3.org/1999/02/22-rdf-syntax-ns#" />
&lt;Prefix id="owl" namespace="http://www.w3.org/2002/07/owl#" />
&lt;Prefix id="id2" namespace="http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#" />
&lt;Prefix id="id1" namespace="http://rdf.insee.fr/geo/" />
&lt;/Prefixes>
</div>
</div>
<div class="explain" id="scr2cli">
<div class="result">
&lt;DataSources>
&lt;DataSource id="id1" type="file">
&lt;Param name="file" value="regions-2010.rdf"/>
&lt;Param name="format" value="RDF/XML" />
&lt;/DataSource>
&lt;DataSource id="id2" type="file">
&lt;Param name="file" value="nuts2008_complete.rdf"/>
&lt;Param name="format" value="RDF/XML" />
&lt;/DataSource>
&lt;/DataSources>
</div>
</div>
<div class="explain" id="scr3cli">
<div class="result">
&lt;Interlinks>
&lt;Interlink id="no1">
&lt;LinkType>owl:sameAs&lt;/LinkType>
&lt;SourceDataset dataSource="id1" var="e1">
&lt;RestrictTo>
?e1 rdf:type id1:Departement .
&lt;/RestrictTo>
&lt;/SourceDataset>
&lt;TargetDataset dataSource="id2" var="e2">
&lt;RestrictTo>
?e2 rdf:type id2:NUTSRegion .
&lt;/RestrictTo>
&lt;/TargetDataset>
&lt;LinkageRule>
&lt;Aggregate type="max">
&lt;Compare metric="jaccard">
&lt;TransformInput function="tokenize">
&lt;Input path="?e1\id1:subdivision/id1:nom" />
&lt;/TransformInput>
&lt;TransformInput function="tokenize">
&lt;Input path="?e2/id2:name" />
&lt;/TransformInput>
&lt;/Compare>
&lt;Compare metric="jaccard">
&lt;TransformInput function="tokenize">
&lt;Input path="?e1/id1:nom" />
&lt;/TransformInput>
&lt;TransformInput function="tokenize">
&lt;Input path="?e2/id2:name" />
&lt;/TransformInput>
&lt;/Compare>
&lt;/Aggregate>
&lt;/LinkageRule>
</div>
</div>
<div class="explain" id="scr4cli">
<div class="result">
&lt;Filter />
</div>
</div>
<div class="explain" id="scr5cli">
<div class="result">
&lt;Outputs>
&lt;Output type="file">
&lt;Param name="file" value="results/Round1.rdf"/>
&lt;Param name="format" value="alignment"/>
&lt;/Output>
&lt;/Outputs>
&lt;/Interlink>
&lt;/Interlinks>
&lt;/Silk>
</div>
</div>
</p>
<!--p>
<p style="background-color: yellow;">Align->Silk insee/nuts: does not work correctly</p>
Note that a skeleton for Silk scripts can already be obtained from an
alignment through a renderer:
<div class="terminal">
$ java -cp $CLASSPATH fr.inrialpes.exmo.align.cli.ParserPrinter file:test-align-no-pc.xml -r fr.inrialpes.exmo.align.impl.renderer.SILKRendererVisitor -o results/script.lsl
</div>
</p-->
<p>
<!--pre>
java -DconfigFile=script.lsl [-DlinkSpec=<Interlink ID>] [-Dthreads=<threads>] [-DlogQueries=(true/false)] [-Dreload=(true/false)] -jar silk.jar
</pre-->
<div class="terminal">
$ java -DconfigFile=script.xml -DlinkSpec=no1 -jar silk.jar
</div>
The result is provided as a set of links in a format which is supposed to be the
Alignment format. However, it is not correct. This is fixed here by
applyng the patch:
<div class="terminal">
$ sh bin/fix.sh results/Round1-accepted.rdf
</div>
on resulting file (here results/Round1-accepted.rdf).
It is possible to count the number of answers provided by the
evaluation through:
<div class="terminal">
$ grep entity1 results/Round1-accepted.rdf | wc -l
103
</div>
</p>
<!--p style="background-color: yellow;">(8) Proceed to correct evaluations of Silk, have silk output as links or alignments</p-->
<p>
Link quality can be tested by comparison with the reference alignment
<a href="reflinks.rdf">reflinks.rdf</a>:
<div class="terminal">
$ java -cp $CLASSPATH fr.inrialpes.exmo.align.cli.EvalAlign -i fr.inrialpes.exmo.align.impl.eval.PRecEvaluator file:reflinks.rdf file:results/Round1-accepted.rdf
</div>
which answers:
<div class="result">
&lt;?xml version='1.0' encoding='utf-8' standalone='yes'?>
&lt;rdf:RDF xmlns:rdf='http://www.w3.org/1999/02/22-rdf-syntax-ns#'
xmlns:map='http://www.atl.external.lmco.com/projects/ontology/ResultsOntology.n3#'>
&lt;map:output rdf:about=''>
&lt;map:input1 rdf:resource="http://rdf.insee.fr/geo/"/>
&lt;map:input2 rdf:resource="http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#"/>
&lt;map:precision>0.9611650485436893&lt;/map:precision>
&lt;map:recall>1.0&lt;/map:recall>
&lt;map:fMeasure>0.9801980198019802&lt;/map:fMeasure>
&lt;map:oMeasure>0.9595959595959596&lt;/map:oMeasure>
&lt;result>1.0404040404040404&lt;/result>
&lt;/map:output>
&lt;/rdf:RDF>
</div>
It provides all valid links (recall=100%) but not all the links
it found are correct (precision=96%). Could you improve on this?
</p>
<!--p>
Also have a look at the .nt
</p-->
<p>
Try the other proposed linked rule and/or try to improve the linkage
used.
<div class="button">
<input type="button" onclick="show('silkcli')" value="See evaluation results"/>
<input type="button" onclick="hide('silkcli');" value="Hide"/>
</div>
<div class="explain" id="silkcli">
<table border="0">
<tr><td>rule</td><td>&equiv;</td><td>comparison</td><td>#links</td><td>prec.</td><td>rec.</td></tr>
<tr><td>no1</td><td>dpt &equiv; NR</td><td>name=nom</td><td>103</td><td>.96</td><td>1.0</td></tr>
<tr><td>no2</td><td>dpt &equiv; NR&amp;level=3</td><td>tok(name)~tok(nom)</td><td>100</td><td>.99</td><td>1.0</td></tr>
<tr><td>no3</td><td>dpt &equiv; NR</td><td>AVG(tok(name)~tok(nom), tok(hasParentRegion/name)~tok(\subdivision/name))</td><td>89</td><td>1.0</td><td>.90</td></tr>
<tr><td>no4</td><td>dpt &equiv; NR&amp;level=3&amp;hasParentRegion<sup>3</sup>=FR</td><td>AVG(tok(name)~tok(nom), tok(hasParentRegion/name)~tok(\subdivision/name))</td><td>89</td><td>1.0</td><td>.90</td></tr>
<tr><td>no5</td><td>dpt &equiv; NR&amp;level=3&amp;hasParentRegion<sup>3</sup>=FR</td><td>name=nom</td><td>99</td><td>1.0</td><td>1.0</td></tr>
<tr><td>no6</td><td>dpt &equiv; NR&amp;level=3&amp;hasParentRegion<sup>3</sup>=FR</td><td>MAX(tok(name)~tok(nom), tok(hasParentRegion/name)~tok(\subdivision/name))</td><td>439</td><td>.23</td><td>1.0</td></tr>
<tr><td>no7</td><td>dpt &equiv; NR&amp;level=3&amp;hasParentRegion<sup>3</sup>=FR</td><td>MIN(tok(name)~tok(nom), tok(hasParentRegion/name)~tok(\subdivision/name))</td><td>89</td><td>1.0</td><td>.90</td></tr>
</table>
</div>
</p>
<h2>Extra work</h2>
<p>
For the curious, we have a larger example, between the
French communes
in <a href="http://exmo.inria.fr/~jdavid/linkrule-extraction/files/communes_insee.ttl">insee-communes.ttl</a> and
those of geonames
(<a href="http://exmo.inria.fr/~jdavid/linkrule-extraction/files/communes_gn.ttl">communes_gn.ttl</a>).
A starting script is <a href="geo-script.xml">geo-script.xml</a>.
This sample data comes from
the <a href="http://exmo.inria.fr/~jdavid/linkrule-extraction/">LinkKeyDisco</a>
system experiments.
</p>
<hr />
<small>
<div style="text-align: center;">http://alignapi.gforge.inria.fr/tutorial/tutorial6/</div>
<hr />
<div>$Id$</div>
</small>
</body>
</html>
html/tutorial/tutorial6/linkkey1.rdf 0 → 100644
+ 65
− 0
View file @ a56e9c0b
<?xml version="1.0" encoding="utf-8" standalone="no"?>
<!DOCTYPE rdf:RDF [
<!ENTITY xsd "http://www.w3.org/2001/XMLSchema#">
<!ENTITY eurostat "http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#">
<!ENTITY insee "http://rdf.insee.fr/geo/">
<!ENTITY proton "http://proton.semanticweb.org/">
<!ENTITY edoal "http://ns.inria.org/edoal/1.0/#">
]>
<rdf:RDF xmlns="http://knowledgeweb.semanticweb.org/heterogeneity/alignment#"
xmlns:eurostat="http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#"
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:xsd="http://www.w3.org/2001/XMLSchema#"
xmlns:insee="http://rdf.insee.fr/geo/"
xmlns:align="http://knowledgeweb.semanticweb.org/heterogeneity/alignment#"
xmlns:edoal="http://ns.inria.org/edoal/1.0/#">
<Alignment>
<xml>yes</xml>
<level>2EDOAL</level>
<type>**</type>
<align:method>manual</align:method>
<onto1>
<Ontology rdf:about="http://rdf.insee.fr/geo/">
<location>insee/regions-2010.rdf</location>
<formalism>
<Formalism align:name="OWL1.0" align:uri="http://www.w3.org/2002/07/owl#"/>
</formalism>
</Ontology>
</onto1>
<onto2>
<Ontology rdf:about="http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#">
<location>insee/nuts2008_complete.rdf</location>
<formalism>
<Formalism align:name="OWL1.0" align:uri="http://www.w3.org/2002/07/owl#"/>
</formalism>
</Ontology>
</onto2>
<map>
<Cell>
<entity1>
<edoal:Class rdf:about="&insee;Departement"/>
</entity1>
<entity2>
<edoal:Class rdf:about="&eurostat;NUTSRegion"/>
</entity2>
<relation>equivalence</relation>
<measure>1.0</measure>
<edoal:linkkey>
<edoal:Linkkey>
<edoal:binding>
<edoal:Intersects>
<edoal:property1>
<edoal:Property rdf:about="&insee;nom" /><!-- xml:lang="fr"-->
</edoal:property1>
<edoal:property2>
<edoal:Property rdf:about="&eurostat;name" />
</edoal:property2>
</edoal:Intersects>
</edoal:binding>
</edoal:Linkkey>
</edoal:linkkey>
</Cell>
</map>
</Alignment>
</rdf:RDF>
html/tutorial/tutorial6/linkkey2.rdf 0 → 100644
+ 78
− 0
View file @ a56e9c0b
<?xml version="1.0" encoding="utf-8" standalone="no"?>
<!DOCTYPE rdf:RDF [
<!ENTITY xsd "http://www.w3.org/2001/XMLSchema#">
<!ENTITY eurostat "http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#">
<!ENTITY esdata "http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/">
<!ENTITY insee "http://rdf.insee.fr/geo/">
<!ENTITY proton "http://proton.semanticweb.org/">
<!ENTITY edoal "http://ns.inria.org/edoal/1.0/#">
]>
<rdf:RDF xmlns="http://knowledgeweb.semanticweb.org/heterogeneity/alignment#"
xmlns:eurostat="http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#"
xmlns:esdata="http://ec.europa.eu/eurostat/ramon/rdfdata/nuts2008/"
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:xsd="http://www.w3.org/2001/XMLSchema#"
xmlns:insee="http://rdf.insee.fr/geo/"
xmlns:align="http://knowledgeweb.semanticweb.org/heterogeneity/alignment#"
xmlns:edoal="http://ns.inria.org/edoal/1.0/#">
<Alignment>
<xml>yes</xml>
<level>2EDOAL</level>
<type>**</type>
<align:method>manual</align:method>
<onto1>
<Ontology rdf:about="http://rdf.insee.fr/geo/">
<location>admin/regions-2010.rdf</location>
<formalism>
<Formalism align:name="OWL1.0" align:uri="http://www.w3.org/2002/07/owl#"/>
</formalism>
</Ontology>
</onto1>
<onto2>
<Ontology rdf:about="http://ec.europa.eu/eurostat/ramon/ontologies/geographic.rdf#">
<location>admin/nuts2008_complete.rdf</location>
<formalism>
<Formalism align:name="OWL1.0" align:uri="http://www.w3.org/2002/07/owl#"/>
</formalism>
</Ontology>
</onto2>
<map>
<Cell>
<entity1>
<edoal:Class rdf:about="&insee;Departement"/>
</entity1>
<entity2>
<edoal:Class>
<edoal:and rdf:parseType="Collection">
<edoal:Class rdf:about="&eurostat;NUTSRegion"/>
<edoal:AttributeValueRestriction>
<edoal:onAttribute>
<edoal:Property rdf:about="&eurostat;level"/>
</edoal:onAttribute>
<edoal:comparator rdf:resource="&edoal;equals"/>
<edoal:value><edoal:Literal edoal:type="&xsd;integer" edoal:string="3" /></edoal:value>
</edoal:AttributeValueRestriction>
</edoal:and>
</edoal:Class>
</entity2>
<relation>equivalence</relation>
<measure>1.0</measure>
<edoal:linkkey>
<edoal:Linkkey>
<edoal:binding>
<edoal:Intersects>
<edoal:property1>
<edoal:Property rdf:about="&insee;nom" /><!-- xml:lang="fr"-->
</edoal:property1>
<edoal:property2>
<edoal:Property rdf:about="&eurostat;name" />
</edoal:property2>
</edoal:Intersects>
</edoal:binding>
</edoal:Linkkey>
</edoal:linkkey>
</Cell>
</map>
</Alignment>
</rdf:RDF>
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment