wiki:WikidataSearchPlugin

Version 10 (modified by Malte, 10 years ago) (diff)

Added new research notes and updates about state of development

The DeepaMehta 4 Wikidata Plugin enables you to search, explore and map the "shared structures of meaning" (Janet Murray, New Media Reader, 2003) of wikidata-communities from all around the globe.

In particular this plugin currently enables you to build on wikidata in your personal information work through:

  • Search Wikidata Items and Properties
  • Turn any "Wikidata Search Result Entity" of type "property" into a DeepaMehta AssocationType?
  • "Import claims" of any "Item" and thus navigate through wikidata along "properties" and "items"

Motivation

Why I find it interesting to connect Wikidata and DeepaMehta folks is, because I think we share some points-of-view. Especially:

  1. The success of Wikidata is not measured by the amount of data it stores, but by the creation of a healthy community and its usefulness for Wikipedia and other applications.
  1. Wikidata will not be about the truth, but about statements and their references. These can be contradictory.
  1. Wikidata is a socio-technical system. Instead of trying to be overly intelligent, we rely on the Wikimedia communities.
  1. Let's be pragmatic. Finished is better than perfect.
  1. Wikidata will provide a lot of data that can support research. We want to ensure that it is easily usable.
  1. Wikidata will provide an API interface to create alternative UIs which are more intelligent than the standard Wikidata one.


Wider goal:
To enable users and researchers from both communities.

Goals

  1. Enable users of DeepaMehta to add a "Statement" about entities in wikidata.
  2. Enable systematic exploration of the languages spoken by the wikidata communities., Accomplished on 8th July 2014
  3. Enabling users of DM to re-use global entities, e.g. the city of "Berlin" (or other obvious global entities alike) instead of creating them manually in every installation over and over again.
  4. Make it widely available on a WMFLabs-Server., Accomplished on 8th July 2014

Goal 1 Details

Enable users of DeepaMehta to add a "Statement" about entities in wikidata.

Some references to the WD-Documentation:

Statements consist of a claim and a (special, multi-value) source-reference snak, and a rank.

Source-Reference is a (special) snak of statements, with a reference record as a data type.

Each Source-Reference is a ordered list of snaks, e.g. book (a reference to an item) and page (a number)

Blockers: 1. RelationType? Core-Implementation, 2. Research: Is Wikipedia/wikidata-User authentication for edits necessary?

Goal 2 Details: Accomplished, 08.07.2014

Enable systematic exploration of the languages spoken by the wikidata communities.

Find the latest 4.3 compatible plugin release on http://download.deepamehta.de/nightly

Drawbacks: No glob-coordinates, qualifiers, ranges and no commons-media-files browsable. "Just" text and item-data is navigatable via the Wikidata Topicmaps UI.

Goal 3 Details

Enabling users of DM to re-use global entities, e.g. the city of "Berlin"

See Query-API at http://wikidata-wdq-mm.instance-proxy.wmflabs.org/api_documentation.html resp. wait for the upcoming Query API

Blockers: Realization of the the Wikidata Query API.

News: Try out Wikidata Toolkit (Java, Maven), try to process Wikidata Dumps (Full Weekly, Incremental)

Goal 4 Details: Accomplished, 08.07.2014

Make it widely available on a WMFLabs-Server.

Therefore consider the https://wikitech.wikimedia.org/wiki/Wikitech:Labs_Terms_of_use once and https://wikitech.wikimedia.org/wiki/Help:Access

See http://wikidata-topicmaps.wmflabs.org/

Developers Roadmap

Major issues which cristallized when mapping wikidata to DeepaMehta 4

  • Multilingual values (Missing: Concept for Model, Queries, Rendering)
  • Temporality values (Missing: Concept for Model, Queries, Rendering)
  • User Authentication (Missing: Concept & Implementation)

0.0.4-SNAPSHOT, UPCOMING

  • Processing "Wikimedia Commons"-values (and possible more)
  • Extend the available languages in the search-widget

Release Notes

Download dm4-wikidata bundle from http://download.deepamehta.de/nightly/

0.0.3, Jul 08 2014

  • Custom Item Page Renderer (for the better look and read of wikidata-items)
  • More accurate labelling of topic command: "Import claims" instead of "Show claims"
  • Simple updating mechanism for all values of involved
  • Added license rendering for data provided by wikidata wikidata-items (on every "Import claims"-command)
  • Introduced custom rendering for all imported "Wikidata properties"
  • New wikidata-service method to navigate to all associated associations (of a property-entity)
  • HTTP Optimization: Just one GET request per "property" (during "Import claims")

0.0.2, May 5, 2014

  • Introduced "Wikidata Items", "Claims" and processing of "Wikidata Text"-values
  • Adding "Show claims" to navigate along "items" and "properties" through WD
  • Multi-language support across all queries works (see exemplary attachments to this wikipage)
  • A Simple fix to display resultsets of a wikidata-search in order
  • Quite a few fixes related to setting (url and language) references
  • Added some graphics and credits (powered by Wikidata Logo)

Download http://download.deepamehta.de/nightly/dm42-wikidata-search-0.0.2.jar (compatible with DeepaMehta4.2)

0.0.1, Feb 28, 2014

  • Search for Wikidata Properties
  • Turn Wikidata Properties in DM4 Association Types

Source Code and Issue Tracker

The source code repository is https://github.com/mukil/dm4-wikidata

Please report any problems, feature requests and issues you have directly at the projects issue tracker https://github.com/mukil/dm4-wikidata/issues

References:

https://meta.wikimedia.org/wiki/Wikidata/Notes/Requirements

https://meta.wikimedia.org/wiki/Wikidata/Data_model#Properties

https://www.wikidata.org/wiki/Wikidata:List_of_properties

https://meta.wikimedia.org/wiki/Wikidata/Notes/Entities_and_Snaks

Contributions =

Thanks to JuergeN, Jri, Silke and the whole WD-Team for your support in research and thinking about this out loud.

Attachments