Das semantische Web, SS 2008, 2008-06-17, AG Wissensbasierte System, TU KL. 1 AG Wissensbasierte...

Das semantische Web, SS 2008, 2008-06-17, AG Wissensbasierte System, TU KL. 1

AGWissensbasierteSysteme

© 2008 AGD

The Semantic Desktop

Leo SauermannDFKI GmbH

Universität Kaiserslautern

[email protected]



Bringen sie das zusammen?



Der Desktop nicht,aber das Web.



<rdf:RDF xmlns:out="http://www.gnowsis.org/ont/msoutlook/0.1#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > <rdf:Description rdf:about="outlook:contact/00000000ECD4B99358B9814B9DAFE2255CD8AE9A24EF2700 "> <out:name>Leo Sauermann</out:name> </rdf:Description></rdf:RDF>



Personal Information Management

Trivial: Es geht um Termine, Kontakte und E-Mails

Definition von Richard Boardman PIM can be defined as the management of personal information (information owned by an individual, and under their direct control) as performed by the owning individual.

in mehreren Anwendungen

der Kontext geht verloren



Persönliches Informationsmanagement (PIM)

Problem: Ein Thema ist über viele Dateien und Anwendungen verteilt

Menschen haben mentale Modelle ihrer Umgebung

Dokumente sind mit den Themen im persönlichen Informationsmodell verbunden

Jeder macht PIM Warum weiß das Window Manager/Betriebssystem das nicht?

the CID project

Documents

Papers

Projects

CID

Research

files emails

Inbox

Todo

SAP

CID-proj

Karlsruhe

contacts

Claudia Stern

Dirk Hagemann

Klaus Nord

CID

Topic

Claudia

Project

Who

Karlsruhe

Task Management

Where

Dirk

CID slides

Document



This is an old idea

Memex (Vannevar Bush)1945: A memex is "a device in which an individualstores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility" (“As we may think”)

Open Hypertext System (Doug Engelbart)The open hyperdocument system (OHS) is a standards-based, open source frameworkfor developing collaborative, knowledge management applications. Its primary objective is to support the creation, organization, and maintenance of Dynamic Knowledge Repositories (DKR).

XANADU: DEEP INTERCONNECTION, INTERCOMPARISON AND RE-USE. Since 1960, we have fought for aworld of deep electronic documents– with side-by-side intercomparison and frictionless re-use of copyrighted material. WE FIGHT ON.



Semantic Web als enabler

Datensumpf eines Desktop Arbeitsplatzes

Semantic Desktop



Definition

A Semantic Desktop is a device in which an individual stores all her digital information like documents, multimedia and messages. These are interpreted as Semantic Web resources, each is identified by a Uniform Resource Identifier (URI) and all data is accessible and queryable as RDF graph. Resources from the web can be stored and authored content can be shared with others. Ontologies allow the user to express personal mental models and form the semantic glue interconnecting information and systems. Applications respect this and store, read and communicate via ontologies and Semantic Web protocols. The Semantic Desktop is an enlarged supplement to the user's memory.

Leo Sauermann, Ansgar Bernardi, Andreas Dengel: Overview and Outlook on the Semantic Desktop. Proceedings of the 1st Workshop on The Semantic Desktop at the ISWC 2005 Conference.



Ziele eines Semantic Desktop

Bereitstellung von Information über Anwendungsgrenzen hinwegAufbauend auf Semantic Web StandardsURIRDFRDF/SHTTP

Integriertes InformationsmanagementSemantische Kommunikation und Zusammenarbeit



Resources on the Semantic Desktop

Every resource is identified by a URIfile file:///C:/Dokumente%20und

%20Einstellungen/

email imap://[email protected]/INBOX/;UID=3



All is RDF

Example: me

Note: URI, Structured

<outlook:contact/0000000ECD4B99358B9814B9DAFE2255CD8AE9A048F2900> a foaf:Person;

foaf:currentProject <http://www.gnowsis.org/>;foaf:family_name "Sauermann";foaf:firstName "Leo";foaf:workInfoHomepage <http://www.dfki.de/~sauermann>;

vcard:address [ a vcard:AddressPostal ; vcard:streetAddress "Pirmasenser Strasse 18" vcard:locality "Kaiserslautern" ; vcard:postalcode "67655" ; vcard:country "Deutschland" ; ] ; kiss:kissed <outlook:contact/00000000ECD4B99358B9814B9DAFE2255CD8AE9AC4612000>;.



implementations



gnowsis 0.9

gnowsis is an open source project

led by DFKI

www.gnowsis.org

gnowsis.opendfki.de

Is used by several researchers inside and outside DFKI to run experiments

Can be used and extended as part of your diploma, bachelor or PhD thesis.



Semantic Applications

Desktop Search

GnowsisServer Aperture

Crawlers OutlookOutlook

e-mail server

e-mail server

filesystemfilesystem

OutlookOutlook

PIMO Editor

Crawler

Ont. Matching

FilesFiles

e-maile-mail

Gui invocationTagging

Clustering

Desktop ApplicationsApplication Plugins

Sesame2 Repository

Resource Store

PIMO Store

Configuration Store

Service Store

Domain Ontologies

Lucene Index

Personal Wiki

Web Interfaces



Data-flow between services

DataPerson‘s files and e-mails

RDF

adapting to RDF

matchingto PIMO

PIMO

Aperture.sf.net• crawling framework • converts all data to RDF

Alignment• analyzes files and e-mails (and more)• matching to existing things• creating new things

User Interfaces

read/write PIMO

Documents

Papers

Projects

CID

Research

Files E-Mails

Inbox

Todo

SAP

CID-proj

Karlsruhe

Contacts

Claudia Stern

Dirk Hagemann

Klaus Nord



Convert Leo from Address-Book to RDF

<rdf:RDF xmlns:nco="http://www.semanticdesktop.org/ontologies/2007/03/22/nco#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > <nco:PersonContact rdf:about="desktop://outlook/contact/ECD4B993"> <nco:fullname>Leo Sauermann</nco:fullname> </nco:PersonContact ></rdf:RDF>

adapting to RDF

desktop://outlook/contact/ECD4B993

PersonContact

is a

“Leo Sauermann”fullname

Microsoft Outlook

done with http://aperture.sourceforge.net



Integrate data

desktop://outlook/contact/ECD4B993 “Leo Sauermann”fullname

attends

High probability that <desktop://outlook/contact/ECD4B993> is depicted on <file://home/photos/DSC0042.jpg>.

desktop://outlook/appointment/744A05

2004-08-20T09:00:00

2004-08-20T17:00:00

“FOAF Camp”title

dtstart

dtend

file://home/photos/DSC0042.jpg 2004-08-20T11:24:00dateTimeOriginal

between

Is Leo depicted?

Yes No



Example: Semantic Desktop Photo Archive

Leo

Leo with Mobile_phone,Laptop near Enschede. During FoafCamp.

Leo Sauermanndesktop://outlook/contact/ECD4B993a Person

Enschedehttp://www.dbpedia.org/resource/Enschede

a City



NepomukNepomuk is an EU

project . It’s topic is the

Social Semantic Desktop .

DFKI coordinates .

NepomukNepomuk is an EU

project . It’s topic is the

Social Semantic Desktop .

DFKI coordinates .

Personal Semantic Wiki for note-taking

Terms

Types

Relation types

Relations

RDF

We can use a personal semantic wiki everywhere: comments, notes, documents, websites, blogs, e-mails, …



Semantic Wiki – User Interface

Kaukoluwiki

open source

•Assistance system•Automatic annotation

Malte Kiesel, Kaukolu: Hub of the Semantic Corporate Intranethttp://www.dfki.uni-kl.de/~kiesel/2006-06-12-Kaukolu-SemWikiESWC2006.pdf

http://kaukoluwiki.opendfki.de/

Express thoughts using free text



Application plugins, mini-applications, mashups

tagging e-mails

Idea: Let people use their existing applications to get their knowledge work done

drop-box



Application: Drop Box

Helps filing informationuses PIMO structures concepts and foldersKnows the users model and istrained by using itprocess flow

files are stored into a Drop-Box folderfiles are text-analysed and possible

target folders are suggestedDrop-Box user interface showsuser selects a folder, classifyfiles are moved and classified

Learns from the user

doc:… EPOS …

Project:EposEPOS, DFKI,Maus, …

PIMO of Paul

=



search



Data Enrichment through Alignment

Entity LinkageExample for identity matching

<file:///425.pdf> rdf:type Publication<file:///425.pdf/person_1> ...author “Steven Kean”<file:///425.pdf/person_2> ...author “Mark Schroeder”

<file:///686.pdf> rdf:type Publication<file:///686.pdf/person_1> author “Steaven Kean”<file:///686.pdf/person_2> author “James Derrick”<file:///686.pdf/person_3> author “Mark Schroeder”

results infile:///425.pdf/person_1 ...similar_to file:///686.pdf/person_1

similar based on use,but different writing

Probabilistic entity linkage for heterogeneous information spaces.Ekaterini Ioannou, Claudia Niederee, Wolfgang Nejdl. In CAiSE, (2008). (to appear)



Learning from the user’s behavior

Plugins gather user actions

Elicitation of task concepts

Notification of GUI

Applicationsshows documents, people, projects, topics

relevant to current work

search documents via context: “I saw it after working with Dirk”

pro-active non-obtrusive assistance

Bayesian Network

UA UA

Domain

Wf Task

NOP NOP NOP NOP

Wf Task

TaCo

Domain

UA

NOP

PIMMaus

PIM MidDFKI KM

PIM Upper

PIM Basic

A Context Model for Personal Knowledge Management ApplicationsSven Schwarz (2006)



SeMouse

Annotation of documents using the middle mouse button

Works with Word, Browser, PDF, …

Can be integrated with other frameworks (gnowsis)

Sergio F.Anzuola

click!



EU ProjektDauer 1.1.2006 – 31.12.2008Förderung 11.5 M€Gesamtbudget 17.1 M€

ZieleStandardisierung

innerhalb EuropasBeitrag zur Vision Europas

als wettbewerbsfähigste Wissensgesellschaft

Kombiniert alle vorgestellten AnsätzeKontakt

Webseite http://nepomuk.semanticdesktop.orgE-mail [email protected] Dr. Ansgar Bernardi

Die Zukunft des Semantic Desktop



KDE4.0 has this technology built in

http://nepomuk.kde.org

Tagging of files, e-mails,contacts, …System-wide taggingDesktop search engine is based on RDF and semantic web

You can do much more than tagging with this!http://nepomuk.kde.org/discover/user



Beagle++

Semantische Desktop-SuchmaschineIndex enthält Metadaten und Kontext

Optimiertes Ranking der Ergebnisse

Relationen

Forschungsprojekt von L3SOpen Source, Java und C#

Sesame DB

Für Linux/Gnome/Beagle

sehr zu empfehlen:der VM download

http://beagle.kbs.uni-hannover.de/



DBin

ein verteilter Semantic Desktop

Suche nach Information

Kollektiv arbeiten



Open IRIS

verwandte Daten



Haystack

Very good user interface

Much research done



data extraction



Extracting Information

<rdf:RDF xmlns:out="http://www.gnowsis.org/ont/msoutlook/0.1#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > <rdf:Description rdf:about=" rdfp://leo.gnowsis.com/msoutlook/contact/00000000ECD4B99358B9814B9DAFE2255CD8AE9A24EF2700 "> <out:name>Leo Sauermann</out:name> </rdf:Description></rdf:RDF>



structured files – quite simple

.doc (author, title).xml.oomp3 (album, ..).jpg

more file formats

•time

•aperture

•camera



structured data sources

address books

e-mail server using IMAPe-mail system likecalendar

weird idea:all of them: data extracted using API

two approaches:1) crawl everything2) access data sources live – virtual graphs



crawl everything

Microsoft Outlook

convert



Microsoft Outlook

adapter

virtual graph

user asks question

query language

graph only answers the question



Microsoft Outlook

adapter

rdf query languages

find ( s, p, o)

cbd (s)

SPARQL (…)



rdf query languages

are your glasses



query languages

SeRQL

RDQL

….

SPARQL is a superset



the virtual graph is never stored

it is created on demand when a query is fired

virtual?



known subject querying - easy

SPARQLSELECT ?name, ?email WHERE(<uri:leo123> x:name ?name).(<uri:leo123> x:email ?email).

Jena – query engine does thisfind (<uri:leo123> x:name ?name).

find (<uri:leo123> x:email ?email).



logic behind



Java implementation

using the Jena framework by HPfind (<uri:leo123> x:name ?name).

find (<uri:leo123> x:email ?email).



search for subject

Problem

SELECT ?uri WHERE(?uri x:name “Leo”).

use an index to lookup

if this index is not in your datasource -bad thing



reordering

SELECT ?email WHERE

(?who x:email ?email). (?who x:name “Leo”).

query reordering – evaluate unbound triples lastJena ARQfind ( ?who x:name “Leo”)?who = <uri:leo>find (<uri:12112> x:email ?email).



complex queries

Email Addresses of all Austrians SELECT ?email WHERE

(?who x:address ?adress).(?address x:country “Austria”).(?who x:email ?email).

reordering, index, ??code??

performance problems

some queries are not possible to run



summary on virtual graphs

invest much time

sit it outwait until big company ( )

implements SPARQL

Leo Sauermann, Sven Schwarz Gnowsis Adapter Framework: Treating Structured Data Sources as Virtual RDF Graphs.

or use a simpler query language: cbd/DESCRIBE



cbd or describe – a simpler way to query

cbd ( “urn:leo:kaiserslautern” , someoptions )

also part of SPARQL:DESCRIBE <urn:leo:kaiserslautern>

return graph<rdf:RDF xmlns:out="http://www.gnowsis.org/ont/msoutlook/0.1#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > <rdf:Description rdf:about=" rdfp://leo.gnowsis.com/msoutlook/contact/00000000ECD4B99358B9814B9DAFE2255CD8AE9A24EF2700 "> <out:name>Leo Sauermann</out:name> </rdf:Description></rdf:RDF>



Concise Bounded Resource Descriptions

CBDThe subgraph around a resource

“A concise bounded description of a resource is a body of knowledge about a named resource which does not include any explicit knowledge about any other named resource.”

[Patrick Stickler http://sw.nokia.com/uriqa/URIQA.html ]

The URIQA concise bounded description of a resource includes:all statements where the resource is subject

Recursively for all statements already found, if there is an anonymous node, include the statements about it, too

Recursively for all statements already found, include the CBRD of any reifications.



User Context

Observe User behaviour

Resources that were accessed

Inspired by the Human Mind ModelIncoming Perceptions (Actions)

Short Term Memory

Display of the recent Resources

Enables good default values

Future use for user support



stack

pre - Semantic Desktop Semantic Desktop

Application

CORBA LDAP ActiveX

http ...SQL

HTML

interface

data

semantics

Relationaldatabases

XML .pdf.xls

Manuals UML

SOAP

RDF

ontologies

Application

...

text

SPARQL

RDF/S, OWL



Experimental Projects at TU Kaiserlsautern



Diploma Thesis and Research Projects

Diploma ThesisConTag by Benjamin Horak

Semantic Wikis in Knowledge Management by Dominik Heim

Cognitive Aspects by Danish Nadeem

Semantic Meeting Management by Man Luo

Trend Analysis of use Shingo Kubo

Research Projects at DFKIEPOS – Evolving Personal to Organizational Knowledge Spaces

MyMory

Nepomuk EU Project



Literature

Bush, V.As We May ThinkThe Atlantic Monthly, 1945, 176(1)

Nelson, T.As We Will Think (“Xanadu”)On-line 72 Conference Proceedings, 1972, vol. 1

Sauermann, L.; Bernardi, A. & Dengel, A.Overview and Outlook on the Semantic Desktop 2005 Leo Sauermann, Gunnar AAstrand Grimnes, Malte Kiesel, Christiaan Fluit, Heiko Maus, Dominik Heim, Danish Nadeem, Benjamin Horak, Andreas Dengel

Semantic Desktop 2.0: The Gnowsis Experience 2006



Questions?

Das semantische Web, SS 2008, 2008-06-17, AG Wissensbasierte System, TU KL. 61


© 2008 AGD

•d•d•d jjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjj•djjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjj•d•asd•asfd•asdfasfd•asdf•asfd•sadf•asfd•asdf•sadf•asdf•asdf•asdf•asdf•asdf•asdf•asdf•asdf•sda•fd•dfs•dfs•sda•df•da•sfd•asdf•f•fad

•dsfsfd

•fds•d•sfd•dfs•fds

mash it up!

</SemanticWeb></rdf:RDF>

Leo Sauermann

[email protected]://www.dfki.de/~sauermann/

Danke an Jesus, Ingrid Brunner-Sauermann, Heiko Maus, Sven Schwarz, Ansgar Bernardi, Andreas Dengel, Frank Osterfeld, Dominik Heim, Man Luo, Jeen Broekstra, Giovanni Tummarello, Michael Zeltner, Stephan Baumann, Gunnar A Grimnes, Ludger Van Elst, Harald Holz, Stefan Decker, Malte Kiesel, und alle anderen auf #swig

paid internshipsdiploma theses

open source

Das semantische Web, SS 2008, 2008-06-17, AG Wissensbasierte System, TU KL. 1 AG Wissensbasierte...

Documents

Transcript of Das semantische Web, SS 2008, 2008-06-17, AG Wissensbasierte System, TU KL. 1 AG Wissensbasierte...