Conducting and reporting on empirical user studies in Semantic Web contexts

1 people like this post.

Our colleague Catia Pesquita from Lisbon University is presenting a paper, co-authored by Valentina Ivanova and Patrick Lambrix of our group and Steffen Lohmann from Fraunhofer, at EKAW 2018 – 21st International Conference on Knowledge Engineering and Knowledge Management, on a framework to conduct and report on empirical user studies in Semantic Web contexts. As organizers of the VOILA workshops on Visualization and Interaction for Ontologies and Linked Data  at the recent ISWC conferences, we noticed that both the assessment of interactive Semantic Web approaches as well as the reporting on conducted user studies still suffer from weaknesses.
Empirical evaluations are essential to compare different approaches, demonstrate their benefits and reveal their drawbacks, and thus to facilitate further adoption of Semantic Web technologies. In our paper, we review empirical user studies of user interfaces, visualizations and interaction techniques recently published at several Semantic Web venues, assessing both the user studies themselves and their reporting. We then chart the design space of available methods for user studies in Semantic Web contexts. Finally, we propose a framework for their comprehensive reporting, taking into consideration user expertise, experimental setup, task design, experimental procedures and results analysis.

The original publication is at doi. A self-archived postprint version of the article is available at Linköping University Institutional Repository (DiVA).

LiU Semantic Web research at The Web Conference 2018

1 people like this post.

Next week, the 27th edition of The Web Conference (earlier called International World Wide Web Conference – WWW) will take place in Lyon, France, and different results of Semantic Web research at LiU will be present at the conference.

First, there is a research paper in the main research track of the conference by our Olaf Hartig and Jorge Pérez from the Universidad de Chile. The title of the paper is “Semantics and Complexity of GraphQL.

Additionally, Olaf will give an invited talk in the Web Stream Processing workshop at the conference. While the exact title of the talk is yet to be decided, the talk will present recent work about the RDF*/SPARQL* Approach to Statement-Level Metadata in RDF.

Find Olaf and talk to him if you also happen to be in the conference; he will be happy to tell you more about his research, as well as our other Semantic Web related research at LiU.

Survey on Ontology Engineering tooling

1 people like this post.

Karl Hammar is running a survey on user preferences with regard to ontology tooling, specifically tooling supporting Ontology Design Patterns. As an incentive to take part, a lottery will be held in a few weeks, at which Amazon gift cards to the amount of 50 USD each (or the equivalent in local currency for local Amazon sites), will be awarded to one out of every ten participants in this survey.

Any SemWeb people who are interested in participating in the survey and the lottery are welcome to do so: just follow the instructions below.

Survey Instructions

  1. Surf to http://wp.xd-protege.com, where a customized WebProtégé environment awaits. Register for an account and start a new project.
  2. Look at the scenario described at https://goo.gl/5cXeUP and the corresponding data sets at http://karlhammar.com/ontologies/2016/10/ISWC2016TutorialData.zip
  3. In the WebProtégé install mentioned above, under the tab ”Design Patterns”, check out the listed ontology design patterns from the scenario description.
  4. Try to model a couple of the competency questions from that scenario by way of instantiating ontology design patterns. To do so, find a pattern that you wish to use in the browser, and click the ”Use this pattern” button at the top of the pattern description page, which starts up a pattern instantiation wizard. It should be enough if you run through this wizard once or twice.
  5. Finally, once you’ve run through the wizard once or twice (which should hopefully take no more than 10-15 minutes), please fill out the survey at https://goo.gl/I1MWT4.