ORE2013ORE2013 - OWL Reasoner Evaluation Workshop http://ore2013.cs.manchester.ac.uk OWL Reasoner Evaluation Workshop Thu, 27 Mar 2014 16:53:16 +0000 en-US hourly 1 http://wordpress.org/?v=3.4.2 ORE 2014 Announced http://ore2013.cs.manchester.ac.uk/ore-2014-announced/ http://ore2013.cs.manchester.ac.uk/ore-2014-announced/#comments Wed, 27 Nov 2013 18:54:24 +0000 ernesto http://ore2013.cs.manchester.ac.uk/?p=474 ORE 2014 will be collocated with the Vienna Summer of Logic 2014 (VSL). The workshop will take place on the 13th July 2014 in Vienna, Austria. More information about the workshop and the reasoner competition can be found here.


http://ore2013.cs.manchester.ac.uk/ore-2014-announced/feed/ 0
CEUR proceedings, DBLP index, detailed results, and datasets published http://ore2013.cs.manchester.ac.uk/ceur-proceedings-detailed-results-and-datasets-published/ http://ore2013.cs.manchester.ac.uk/ceur-proceedings-detailed-results-and-datasets-published/#comments Mon, 19 Aug 2013 15:03:01 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=457 We’re very pleased to announce that we have published the CEUR proceedings of the ORE 2013 workshop, including a short report written by us outlining the most important competition results.

>> You can access the proceedings here.

>> The proceedings have also been indexed in DBLP.

In addition, we’ve also release the spreadsheets containing the detailed results, as well as the ontologies we’ve used for the competition (offline and live competition). We also have more detailed results (i.e. outputs and error messages) for each reasoner, but it’s a large amount of messy data, so we’ll only make them available on request for each individual reasoner — if needed.

>> You can find the datasets and results here.

Thanks again to everyone who participated in this year’s workshop and competition. We’ve been taking notes with all the feedback we’ve received from you, and we’re really looking forward to next year’s workshop, which we’re hoping to organise as part of the Vienna Summer of Logic. If you’re interested in joining next year’s workshop programme committee or become a competition organiser, please contact us by email (ore2013@easychair.org).

We’ll keep updating this website with information about next year’s workshop until we’ve set up a new page for ORE 2014.

See you next year!

http://ore2013.cs.manchester.ac.uk/ceur-proceedings-detailed-results-and-datasets-published/feed/ 0
Results, slides, and links to reasoners available http://ore2013.cs.manchester.ac.uk/results-slides-and-links-to-reasoners-available/ http://ore2013.cs.manchester.ac.uk/results-slides-and-links-to-reasoners-available/#comments Thu, 25 Jul 2013 17:43:29 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=443 First of all: we hope you all enjoyed ORE  this week, along with the live competition and the prize giving at the DL social dinner last night! We think the workshop was a great success, and we’re absolutely pleased that so many people participated and expressed their interest in the OWL reasoner competition. We will be publishing all datasets, raw results and photos in the next few days.

For now, you can find online

Well done to all winners!

http://ore2013.cs.manchester.ac.uk/results-slides-and-links-to-reasoners-available/feed/ 0
ORE Programme http://ore2013.cs.manchester.ac.uk/ore-programme/ http://ore2013.cs.manchester.ac.uk/ore-programme/#comments Thu, 04 Jul 2013 15:58:50 +0000 ernesto http://ore2013.cs.manchester.ac.uk/?p=386 A tentative programme for ORE is already available. The workshop has been organised in 4 sessions and each paper has been given a 15 minutes slot (12 min presentation + 3 min questions). Note that, on Wednesday at DL workshop, there will also be a session devoted to ORE where we will run a “live” reasoner competition. Furthermore, the ORE Award Ceremony will take place during the DL social dinner.

The pdf of accepted papers and the list of participating system in the ORE competition are also available.

We also plan to organise a social dinner after the workshop (not included within the registration fee). Please indicate if you are planning to attend the dinner in this poll, so that we have an approximate number of diners.

http://ore2013.cs.manchester.ac.uk/ore-programme/feed/ 0
ORE 2013 paper notifications and call for competition submissions http://ore2013.cs.manchester.ac.uk/ore-2013-paper-notifications/ http://ore2013.cs.manchester.ac.uk/ore-2013-paper-notifications/#comments Fri, 07 Jun 2013 17:19:34 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=336 We had some great submissions to ORE 2013 covering a broad range of OWL reasoning related topics – reasoner system descriptions, challenging ontologies, performance evaluations, OWL reasoners on mobile devices (!), and reasoner tips&tricks. We’re very pleased to announce that we accepted nearly 20 papers to be presented at this year’s workshop. The final list of papers will be announced on this site soon.

The camera-ready versions of the papers are due on the 27th June. We kindly invite all authors and interested researchers to participate in the OWL Reasoner Evaluation workshop in Ulm on the 22nd July 2013. More information about registration for the workshop can be found here. And finally, please consider submitting your reasoner or ontology for use in the OWL reasoner competition, even if you didn’t submit a paper. Deadline for system submissions is the 27th June, more information about competition submissions can be found on the Competition page.

We would like to thank the authors for their work and their interesting submissions, and the programme committee for their effort in reviewing the papers in a very short time span. See you in Ulm!

http://ore2013.cs.manchester.ac.uk/ore-2013-paper-notifications/feed/ 0
Registration for ORE 2013 and DL 2013 now open! http://ore2013.cs.manchester.ac.uk/registration-for-ore-2013-and-dl-2013-now-open/ http://ore2013.cs.manchester.ac.uk/registration-for-ore-2013-and-dl-2013-now-open/#comments Tue, 14 May 2013 14:57:19 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=323 Registration for the Description Logic workshop is now open, and the same registration system is used to register for the OWL Reasoner Evaluation workshop. To register for ORE (or both DL and ORE):

  • Visit https://www.conftool.net/dl2013/ and sign up for an account.
  • Continue to the registration page  “Step 2 of 4: Event and Item Selection” and select the appropriate checkboxes.
  • Complete the registration and payment.

The registration fees for the ORE workshop day on the 22nd July are as follows:

  • Early (before June 25th): 50 EUR regular / 30 EUR students
  • Late (on or after 25th June): 70 EUR regular / 50 EUR students
Registration fees include coffee breaks and lunch.
If you would like to additionally register for the DL workshop, the early fees are 250 EUR regular / 150 EUR students, late fees 300 EUR regular / 200 EUR students. DL also has a limited number of student grants available for attending the DL workshop. Please check the DL website for details.

We’re looking forward to seeing you in Ulm!

http://ore2013.cs.manchester.ac.uk/registration-for-ore-2013-and-dl-2013-now-open/feed/ 1
Deadline extended (to 12th May) http://ore2013.cs.manchester.ac.uk/deadline-extended-to-12th-may/ http://ore2013.cs.manchester.ac.uk/deadline-extended-to-12th-may/#comments Fri, 03 May 2013 08:37:03 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=311 We have had some requests for deadline extensions, so the deadline for paper submissions has been extended to Sunday the 12th May. 

We invite submission of short papers (6 pages) describing:

  • System descriptions describing the architecture, implementation, and expected performance of the reasoner.
  • Reasoner implementation details, usage reports, implementation “tips and tricks”.
  • Challenging ontologies and/or benchmark proposals for OWL reasoners.

For more information, please see the full Call for Papers.

http://ore2013.cs.manchester.ac.uk/deadline-extended-to-12th-may/feed/ 0
Benchmarking framework available for testing http://ore2013.cs.manchester.ac.uk/benchmarking-framework-available-for-testing/ http://ore2013.cs.manchester.ac.uk/benchmarking-framework-available-for-testing/#comments Mon, 29 Apr 2013 11:50:45 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=305 We’ve released a test-ready version of the benchmarking framework we’re planning to use for the reasoner evaluation competition. Reasoner developers may download the scripts, jars and examples from our repository.

In order to use the benchmarking framework, participates need to create a simple reasoner wrapper and edit the execReasoner shell script in the framework to execute various reasoner tasks. More information can be found along with the code on https://bitbucket.org/spbail/ore-benchmark. If you have any questions or suggestions, please contact the organisers.

Please note that the internals of the benchmarking framework may change. The purpose of the current release is mainly to test the interface and ensure that the reasoners can be executed from the framework.

System description submissions

If you are planning to participate in the competition, we strongly encourage you to submit a system description of your system. Please submit via Easychair by 3rd May 2013 (extension is possible if requested). Details about paper submissions can be found on the Call for papers page.

System submissions

The submission deadline for the reasoner competition is the 27th June 2013. Details can be found on the Competition page.

http://ore2013.cs.manchester.ac.uk/benchmarking-framework-available-for-testing/feed/ 0
Call for Papers and Competition Submissions http://ore2013.cs.manchester.ac.uk/call-for-papers-and-competition-submissions/ http://ore2013.cs.manchester.ac.uk/call-for-papers-and-competition-submissions/#comments Wed, 13 Feb 2013 09:03:22 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=258 Call for Systems (Challenge)

We invite reasoner developers to submit their reasoners for participation in the OWL reasoner performance competition. The outline for the competition is as follows:
The test sets will include OWL ontologies from all OWL 2 profiles and of varying sizes, randomly sampled from the NCBO BioPortal, a web crawl, and user-submitted hard ontologies. The tested tasks will include consistency checking, classification, entailment checking, and query answering. Developers should send a JAR file of their systems to the competition organizers who will then carry out the benchmarks.

More information about the competition can be found on the competition page.

We also strongly encourage challenge participants to submit a system description paper, describing

  • architecture
  • implementation
  • expected performance

of their system.

Details of the competition and the submission procedure can be found on the ORE 2013 website: http://ore2013.cs.manchester.ac.uk/competition/

In parallel with the OWL Reasoner Competition, we invite submission of papers describing:

  • System descriptions describing the architecture, implementation, and expected performance of the reasoner.
  • Reasoner implementation details, usage reports, implementation “tips and tricks”.
  • Challenging ontologies and/or benchmark proposals for OWL reasoners.

Submissions and review process

Papers should be formatted according to the Springer LNCS guidelines (http://www.springer.de/comp/lncs/authors.html) and should not be longer than 6 pages.

Submissions must be in PDF through the EasyChair conference system: https://www.easychair.org/conferences/?conf=ore2013.

All submissions will be peer-reviewed by the program committee. Selected papers will be presented during the workshop and published as a volume of CEUR workshop proceedings (http://ceur-ws.org/).

Important dates

  • Paper submission deadline: May 3rd, 2013
  • Notification of acceptance: May 31st, 2013
  • System submission deadline for competition: June 27th, 2013
  • Workshop: July 22nd, 2013
  • Competitions: July 22-26, 2013

For enquiries, please contact the organisers at ore2013@easychair.org

http://ore2013.cs.manchester.ac.uk/call-for-papers-and-competition-submissions/feed/ 0
ORE 2013 announced http://ore2013.cs.manchester.ac.uk/ore-2013-announced/ http://ore2013.cs.manchester.ac.uk/ore-2013-announced/#comments Thu, 06 Dec 2012 19:34:08 +0000 bails http://ore2013.cs.manchester.ac.uk/?p=156 ORE 2013 will be collocated with the 26th International Workshop on Description Logics (DL). The workshop will take place on the 22nd July 2012 in Ulm, Germany. More information about the workshop and the reasoner competition will be announced here soon.


http://ore2013.cs.manchester.ac.uk/ore-2013-announced/feed/ 0