Multisensor Linked Data and Ontologies

Vladimir Alexiev, Ontotext Corp

Multisensor Linked Data and Ontologies

Navigating This Presentation

  • Ext links shown icon, eg http://www.ontotext.com
  • This web-based presentation is made with S5 and plain text
  • Press F11 for full-screen now (on small screen or Opera)
  • Navigating:
    • Click, Right, Down, PageDown: next slide (Opera: only PageDown)
    • Left, Up, PageUp: prev slide (Opera: only PageUp)
    • Home: first slide
    • End: last slide
    • nn Enter: go to slide nn
    • t: toggle between slide view and single-page HTML view (for printing)
    • c (or hover at bottom-right corner): show control panel
      ./img/s5-control-panel.png
      • toggle, prev, next icons
      • table of contents listbox

Outline

2014-05-19 Mon

  • General linked data
    • FactForge and the datasets that it integrates
    • Possible changes/additions
  • Use-case specific linked data
    • Energy Simulation; comparison to 2 automatic extractions
    • Energy Thesauri
    • Energy Datasets
    • Use-case specific DBpedia subsets
    • Household appliances
  • Linguistic Linked Data in FactForge
    • WordNet, Lingvo, Lexvo

2014-05-21 Wed

  • Linguistic ontologies
    • NIF
    • OLIA and its constituents
    • LEMON, GOLD, ISOcat??
  • New Linguistic Linked Data
    • WordNet RDF
    • Wiktionary
    • BabelNet
    • UBYlemon
  • News ontology

General linked data

FactForge

  • DBpedia
  • GeoNames
  • FreeBase
  • New York Times
  • CIA World FactBook
  • MusicBrainz (irrelevant)
  • WordNet, Lingvoj, Lexvo

Possible changes/additions

  • Update datasets
  • BaseKB instead of FreeBase
  • OpenStreetMap

FactForge

factforge-large.png

  • An RDF warehouse of the 9 most central LOD datasets (red below)
    ./img/lod-datasets-2009-03-27-FactForge-LLD.jpg
  • A reason-able view over the web of data, which allows efficient linking and reasoning.
  • Exposed to Multisensor as http://render.ontotext.com/ (allows writing).
  • Dataset statistics

PROTON

Problem: each of the LOD datasets comes with its own ontology.

  • Freebase isn't even structured according to RDF/RDFS principles.

Our approach:

  • PROTON (PROTo ONtology): a lightweight upper-level ontology
  • Serves as a reference mapping layer so you can access the integrated LOD datasets in a uniform manner
  • Examples at http://factforge.net/sparql (contrasts access throuh PROTON vs DBpedia and GeoNames ontologies)
  • RENDER Repository page in the wiki, including presentation from Sofia meeting

References:

DBpedia

dbpedia_logo.png
DBpedia is the central LOD dataset, serving as a source of stable URLs and a "crystallization point" for other LD.

  • English version: 4M things, 3.22M classified in a consistent ontology:
    • 832k persons
    • 209k organizations (49k companies, 45k educational institutions)
    • 639k places (427k populated places)
    • 372k creative works (116k music albums, 78k films, 18.5k video games)
    • 226k species, 5.6k diseases
  • Localized versions (119 languages): 24.9M things
    • 16.8M overlap (interlinked) with English Dbpedia, 8.1M (32%) are new
  • 12.6M unique things with labels and abstracts
  • 24.6M links to images
  • 27.6M links to external web pages, 45M links into other RDF datasets
  • 67M links to Wikipedia categories, 41.2M to YAGO categories
  • 2.46B triples
    • 470M from English Wikipedia
    • 1.98B from other language editions
    • 45M from links to external datasets
  • Detailed statistics

DBpedia English-German example

http://dbpedia.org/resource/Wuppertal_Institute_for_Climate,_Environment_and_Energy

propobjectcomment
dbpprop:leitungdbpedia:Brigitte_Mutert-Breidbachresource (has own data)
Presidentsay what?
Vice Presidentsay what?
Business Managersay what?
Prof. Dr. Manfred Fischedickstring (no own data)
Prof. Dr. Uwe Schneidewindstring (no own data)
owl:sameAshttp://de.dbpedia.org/resource/Wuppertal_Institut_fР“С˜r_Klima,_Umwelt,_Energieidentity link to DE resource
To use owl:sameAs effectively, must use a powerful repo (eg OWLIM)

http://de.dbpedia.org/resource/Wuppertal_Institut_fР“С˜r_Klima,_Umwelt,_Energie

  • (click "Back to old DBpedia" to see all data, this "NEW DBpedia" is no good)
propobjectcomment
dbpedia-owl:individualisedGnd2133644-1Nice, link to DNB GND
dbpedia-owl:leaderdbpedia-de:Uwe_SchneidewindOk, all 3 are resources
dbpedia-de:Manfred_Fischedick
dbpedia-de:Brigitte_Mutert-Breidbach
prop-de:leitung* Uwe Schneidewind * Manfred Fischedick * Brigitte Mutert-BreidbachAll 3 in one string??
owl:sameAsdbpedia-de:Wuppertal Institut fР“С˜r Klima, Umwelt, Energiesame as itself? Very useful ;-)

FreeBase

freebase-logo.png

  • 43.7M "topics": like WikiPedia pages or DBpedia resources, typically lists of things (albums of a band, battles of a war, ingredients of a recipe…). 2.5B facts (triples)
  • 3.5x bigger coverage than English DBpedia, 2.3x bigger than all DBpedias
  • Human-curated fact creation, so supposedly higher quality than DBpedia:
    (WikiPedia is curated, DBpedia mappings are curated, but DBpedia is automatically extracted)
  • Doesn't use RDFS modeling (e.g. no rdf:type). We've done significant work in mapping to RDFS and PROTON

./img/freebase-numbers.png

GeoNames

globe.gif GeoNames

  • 8M place names (compare to 0.64M English DBpedia, estimated 1M all DBpedias, 1M FreeBase)
  • Includes place names and alternate names in many languages
  • Includes administrative hierarchy
  • Includes coordinates (points only)
  • I expect that most are interlinked to DBpedia
  • Covers all countries, and a rich range of features

./img/geonames-feature-counts.png

New York Times, CIA World FactBook

New York Times data

  • 5k people, 3k organizations, 2k locations, 0.5k concepts
  • Other factual data
  • Strong US bias
  • (?) Explore deeper for useful News patterns/ontologies?

CIA World FactBook

  • General geopolitical data: history, people, government, economy, geography, communications, transportation, military, and transnational
  • Covers most countries: 267 world entities
  • Don't know whether the LD is kept up to date

Much smaller but still important resources

Possible Changes/Additions to FactForge

Although FactForge integrates the above described datasets, it has some disadvantages

  • Most importantly, it has not been updated in the last couple of years
  • Eg DBpedia Live mirrors the minutely changes of Wikipedia.
    But this is hard to implement, since we make corrections and mappings on top of DBpedia
  • Potentially it can be extended with new datasets, if needed by the project:
    OpenStreetMap/LinkedGeoData, WikiData, and Linguistic LD

BaseKB Lime instead of FreeBase

  • Removes some 13M erroneous and 100M redundant triples
  • Resilient towards errors in NTriples format: skips the line instead of rejecting the whole file ("parallelSuperEyeball" module)
  • Infovore Framework: allows to transform a more recent Freebase RDF dump (Last one is from 201303)

OpenStreetMap and LinkedGeoData

openstreetmap.png OpenStreetMap

  • An open manually curated map of the world
  • Thousands of types of features, ways and areas; from the monumental to the micro scale:
    continents, oceans, mountains,
    cities, monuments, power stations,
    roads, power lines, rivers, parks, areas,
    pharmacies, stores, phone boxes, recycling bins…
  • Integration of GPS tracks and easy editors for adding annotations

linkedgeodata.png

  • Conversion of OSM to RDF: 15B triples
  • Links to DBpedia, GeoNames, UN FAO Geopolitical data
  • Last updated: just now (13 May 2014)

WikiData

wikidata.png

  • Provides atomic facts taht can be referenced in various WikiMedia sites
  • Thus it is quite amenable to RDF use
  • However, the data is still in its inception
  • Furthermore, the facts can presumably be used from the WikiMedia sites, eg DBpedia

Use-case specific linked data

For the specific use cases, we'll need to assemble specific datasets

  • The depth, breadth, content interlinking etc will be dictated by the needs of the use cases

We can elaborate, assemble and complement this only together!

  • Both to be goal-driven (what data do you need)
  • And to find the data (what data you have stumbled upon)
  • Ontotext will assess the data found and look at interlinking (also related to T4.3 alignment)
  • Maybe some "crowd-sourcing" will be needed (eg DBpedia subsets)

Energy Simulation

Identified all named entities and concepts in an Energy article by hand

  • Compared with REEGLE Tagging API (automatic annotation from a thesaurus dedicated to energy) and DBpedia Spotlight
  • Shows the manual annotation is much richer & precise. Would require very powerful tools. Probably overly ambitious: this is a "programme maximum"
  • Once we decide what is a feasible set of features to extract, we could write up Annotation Guidelines that can be used by manual annotators to build a Gold Standard corpus to be used for Machine Learning. What do you think (?)

Article: "TheGuardian_Goodbye nuclear power.docx"

  • Goodbye nuclear power: Germany's renewable energy revolution
  • Tim Smedley - Guardian Professional, Friday 10 May 2013 17.58 BST

./img/energy-simulation.png

Simulation: Article Metadata/Attribution/Credits

"Standard" metadata, which doesn't mean it will be easy to extract.

  • DCTerms provides properties for a lot of these
  • Added MARC Relators, esp. where there's no DCTerms field
fieldvalueURL/canonic value
creatorTim Smedley
creator.affiliationGuardian Professional
creator.roleAuthorhttp://id.loc.gov/vocabulary/relators/aut
createdFriday 10 May 2013 17.58 BST"20130510T17:58:00"^^xsd:dateTime
contributorSean Gallup
contributor.affiliationGetty Images
contributor.rolePhotograph byhttp://id.loc.gov/vocabulary/relators/pht
contributorAccenture
contributor.rolepaid for by
publisherGuardian Sustainable Business
editorialThe Guardian
editorial.rolecontrolled and overseen by (responsible party)http://id.loc.gov/vocabulary/relators/rpy
rights-holderGuardian News and Media Limited
rights-holder.rolecopyright holderhttp://id.loc.gov/vocabulary/relators/cph
copyright date2014"2014"^^xsd:gYear

Energy Simulation: Concepts (1)

  • altLabels separated with ";". See "DBpedia Subsets re Energy" later on.

Generation, Transfer

  • nuclear power; nuclear capability (altLabel but only in the Energy context, else means nuclear weapons)
  • renewable energy; renewables; Renewable Energy Sources; renewable-energy capacity
  • wind power
  • wind turbine
  • wind farms; wind plants
  • offshore wind farms; offshore wind plants
  • intermittent wind energy
  • biogas plant; plant [that] processes natural waste; biomass plants
  • biomass facilities
  • power lines, power cables
  • electricity grid
  • transportation [of energy]
  • storage [of energy]
  • micro-generation
  • PV; photovoltaic
  • photovoltaic plants
  • co-generation; cogeneration

Energy Simulation: Concepts (2)

Economics

  • renewable energy surcharge
  • energy bill
  • micro-ownership
  • prosumer model; 'prosumer' model; prosumer (eg "the prosumer aspect")
  • incentive systems
  • ecological taxes

Other energy concepts

  • electricity
  • heat
  • environmentally-friendly
  • insulation of buildings
  • fertiliser
  • greenhouse-gas (GHG) emissions
  • energy consumption; consumption of energy
  • consumer behaviour
  • Energiewende, Energy Transformation, alternative energy transformation
  • utility companies
  • battery

Other

  • local farms
  • houses
  • Herculean task; Herculean

Energy Simulation: Events, Places, Orgs, Persons

Events (from thesaurus)

  • Fukushima disaster
    • Fukushima: in this case is event not place: can be recognized by: "July 2011 (only three months after …)"

Places

  • Germany; Germany's; economic powerhouse of Europe (alias)
  • Lower Saxony
  • Ebendorf, Germany

Organizations

  • German government
  • Wuppertal Institute; Wuppertal Institute for Climate, Environment and Energy
  • Big Four energy companies
  • RWE

Persons

  • Angela Merkel
  • Professor Dr Manfred Fischedick
    • Fischedick: requires coreference resolution

Roles/positions

  • Professor Dr
  • vice president
  • scientific adviser

Energy Simulation: Quantified Events

Quantities & Dates from text. Would be hard to recognize, but if possible will enable some quite interesting quantitative analyses.

subjectactionquantityobjectdate
Nuclear powerproducesnearly 20%Germany's energynow
German governmentvowed toshut downJuly 2011
German governmentshut downnuclear capabilitywithin 10 years
German governmentcutby 40%greenhouse-gas (GHG) emissionsby 2020
German governmentcutand 80%greenhouse-gas (GHG) emissionsby 2050
renewablescontribute80%Germany's energyby 2050
drop20%energy consumptionby 2020
drop50%energy consumptionby 2050
Discussions aboutEnergiewendestarted already in the 1980s
renewable energy surchargeincreaseby 47%average family's energy billin the past two years
wind powercontributehalf of the 80%renewable energy targetby 2050
individuals or farmers in GermanyINV is owned byover 50%renewable-energy capacity
Big Four energy companiesownjust 6.5%renewable-energy capacity(according to 2010 figures)
Reducingby halfenergy consumption
discussnew forms of incentive systemsin the next couple of years
economic powerhouse of Europedecommission17nuclear power plantsseven years left
economic powerhouse of Europecutby 40%GHG emissionsseven years left
economic powerhouse of Europecutby 20%energy consumptionseven years left
Annotations for such event networks can be visualized and manually created by Brat Rapid Annotation Tool (BRAT)

Compare with REEGLE Tagging API

How much can be recognized with a single glossary dedicated to energy (REEGLE)?

  • Paste the article text at REEGLE Tagging API and compare the results to these above.
  • Extracted Concepts: keywords from REEGLE thesaurus. Semantic info available, including synonyms, related concepts, higher level concepts
  • Terms: Plain keywords extracted using statistical algorithms (frequency, position in text)
    ConceptScoreTermScore
    energy74fischedick41
    wind32nuclear36
    renewable energies20germany's35
    electricity generation14energiewende28
    wind farms10germany22
    wind turbines9farms19
    emissions9
    biogas9
    biomass9
    natural disasters9
  • Locations: Cities/countries, include latitude / longitude
    DE : Federal Republic of Germany (Country)

Conclusion: REEGLE covers perhaps 45% of the concepts and 1% of the entities.

  • Doesn't know specifics. Eg it sees the word "nuclear" is used often in the article, but doesn't know about nuclear energy

DBpedia Spotlight Annotate Service

dbpedia-spotlight.jpg
Web services

  • /annotate: just the top candidates. Supported formats:
    • HTML: text/html
    • XML: text/xml (or no accept header; application/xml returns empty file)
    • JSON: application/json
    • RDFa: don't know how to invoke this since RDFa by itself doesn't have a mime type
    • NIF: application/rdf+xml. This comes to 3Mb since it uses the full text as part of every URL and is therefore unusable: the text must be deployed on a web server before this format can be used
  • /candidates: returns more data about potential enrichments (with score)

Annotations below are obtained with:

curl -H accept:text/html http://spotlight.dbpedia.org/rest/annotate
  --data-urlencode text@EN_Guardian_nuclear_power.txt > Spotlight-Guardian.htm

Compare with DBpedia Spotlight

./img/Spotlight-performance.png

Energy Datasets

Keeping the Energy article simulation in mind, what are possible sources for those entities and concepts?

Named entities:

  • I think we'll cover quite a lot of the domain of interest by using datasets already integrated in FactForge: DBPedia, GeoNames, FreeBase and NY Times
  • There are better sources for energy-specific entities (e.g. Power Plants)

Concepts:

  • Below are examples from various thesauri
  • When a resource is present in several thesauri, we can often find interlinks (alignments), and then enlarge the scope by exploring around the hierarchy.
  • A potential problem in general theasuri is coverage: I don't know how much of the desired terms are covered, so we may have to pick and choose from various thesauri

DBPedia

General Thesauri

Example concept: "Wind Energy"

Energy Thesauri

Search Google for "renewable energy vocabulary", there are some matches.

Enipedia

Enipedia at TU Delft, Next Generation Infrastructures

  • Covers power generation (power plants, fuel type, emissions, geography, etc) and other energy topics
  • Developed with Semantic Media Wiki. Hand-curated, includes data imported from other sources
  • Eg power plants and power lines from LinkedGeoData (filtering by specific feature types)
  • Developed SparqlQuery extension to SMW so content can be explored with SPARQL
  • Enipedia: exploration into applications of wikis and semantic web for energy and industry issues, Christopher Davis, Apr 2014
    • I also have the PhD thesis of this guy, nice work

Interesting statistical/ecological/economic analyses
./img/enipedia-homepage.png

OpenEI

Open Energy Information: knowledge-sharing online community for energy information and data.

  • Geographic discovery, visualizations, apps, topic-oriented gateways.
  • Built with Semantic MediaWiki, the data is crowd-sourced
  • Numerous articles and datasets: Articles 135k, Images 5k, Documents 2k, Datasets 2k, Maps 2k, etc
  • Faceted by: Countries (211), Programs (1153), Tools (1586)
  • US centric: States (50), Congressional Districts (437), Counties (3142), Cities (27937), Clean Energy Economy Regions (7)
  • Categories (folksonomy), hopefully better organized than DBpedia. Eg 5k energy companies
  • Developer (hackaton) resources
  • Provides LOD

Example:

REEGLE, REEP, REN21

reegle_logo.gif Clean Energy Info Portal

  • Eg REEGLE Profile for Bulgaria
  • Reegle tagging API (compared above)
    • Automated Tagging: extraction is based on the custom-built reegle clean energy thesaurus, with a wide range of additional information available.
    • This service is accessible in English, Spanish, Portuguese, French and German. The API returns the formats RDF/XML and JSON.
    • Content Pool: Related documents are suggested based on matching keywords and geographical regions. Includes REEEP documents, policy reports and project outcome documents.
  • REEGLE thesaurus/glossary, SPARQL access

Renewable Energy and Energy Efficiency Partnership (REEEP)

Renewable Energy Policy Network for the 21st Century (REN21)

  • Global renewable energy policy multi-stakeholder network
  • Connects key actors from Governments, International organisations, Industry associations, Science and academia, Civil society

Other Possible Energy Data Sources

Use-case specific DBpedia subsets

DBpedia is a rich source of concepts and stable URLs with universal coverage.

  • Most of the energy Concepts I outlined can also be found in DBpedia
  • Wikipedia has a lot of synonyms (wiki redirect links, disambiguation pages), categories, lateral hierarchies/topic guides
  • These can help to fish out the concepts

Because it's a folksonomy (not curated according to ISO thesaurus construction precepts), one cannot use hierarchical structure directly, and needs to pick and choose. How to find useful groupings for a specific use case?

  • It requires manual curation & crowdsourcing
  • Can complement manual & automated effort (machine learning, clusterization)

Example: Film Genres

  • Explore one genre: http://en.wikipedia.org/wiki/Horror_movie
  • And you find Categories: Film genres (other genres), Horror films (instances of horror films)
  • http://en.wikipedia.org/wiki/Category:Film_genres includes 239!
  • Including "Mexploitation" (think El Mariachi, Desperado), "Mafia comedy", etc
  • "Mexploitation" is a subkind of "Exploitation film", which also includes:
    • Blaxploitation Bruceploitation Cannibal Eurospy Giallo Hixploitation Martial arts Mexploitation Mockbuster Mondo Nazi exploitation Nunsploitation Outlaw biker Ozploitation Poliziotteschi Pornochanchada Rape and revenge Sexploitation Slasher Spaghetti Western Splatter Sword-and-sandal Women in prison
  • "Bruceploitation" isn't really about exploitation: it involves the use of Bruce Lee look-alike actors
  • So it really takes intellectual effort to explore these facsinating networks of meaning

DBpedia Example re Energy

http://en.wikipedia.org/wiki/Electricity_delivery: useful portal with links
./img/dbpedia-Electricity-delivery.png

  • Includes main processes: Generation Transmission Distribution Retailing (with their own categories and links)
  • Includes Sources (type of power):
    • Nonrenewable: Coal Fossil-fuel power station Natural gas Petroleum Nuclear Oil shale
    • Renewable: Biomass Biofuel Geothermal Hydro Marine (Current Osmotic Thermal Tidal Wave) Solar Wind

How about its LD representation?

Other Useful DBpedia Lists

Lists about Energy:

Lists about Telecom Standards:

Household appliances

I haven't dug deep enough on this topic, but here are a few leads:

  • Amazon and eBay product lists/category trees. Are they downloadable somehow?
  • GoodRelations, LinkedOpenCommerce, IceCat, eClass, PCS, etc
  • Semantics3

GoodRelations, Product Catalogs, Product Features

The GoodRelations ontology is the clear leader for eCommerce

  • Martin Hepp is active both in conferences and with commercial entities
  • Uptake by Google, Yahoo, WalMart…

General approaches for converting product catalogs to RDF (links available):

  • Servant, F.-P., Chevalier, E.: Describing Customizable Products on the Web of Data.
  • Hepp, M., de Bruijn, J.: GenTax: A generic methodology for deriving OWL and RDF-S ontologies from hierarchical classifications, thesauri, and inconsistent taxonomies. The Semantic Web: Research and Applications. pp. 129–144. Springer (2007).
  • Ozacar, T.: IRIS: A ProtГ©gГ© Plug-in to Extract and Serialize Product Attribute Name-Value Pairs.
  • Stolz, A., Rodriguez-Castro, B., Radinger, A., Hepp, M.: PCS2OWL: A Generic Approach for Deriving Web Ontologies from Product Classification Systems. The Semantic Web: Trends and Challenges. pp. 644–658. Springer (2014).

Datasets:

Semantics3 Product Data

https://www.semantics3.com/#sampleapi

  • Startup company affiliated with National University of Singapore
  • Web mining of big product sites (TechCrunch article says 250Gb per day on a 250-node cluster)
  • Excellent way of presenting the data. Convenient API, signup (eg with Github account), excellent web presentation
  • They get product and dynamic pricing data
  • They charge for the pricing data, but maybe they'll give us the brand name list for free, since we're a research project?