TY - JOUR
T1 - The OWL Reasoner Evaluation (ORE) 2015 Competition Report
AU - Matentzoglu, Nicolas
AU - Parsia, Bijan
AU - Gonçalves, Rafael S.
AU - Glimm, Birte
AU - Steigmiller, Andreas
PY - 2017
Y1 - 2017
N2 - The OWL Reasoner Evaluation competition is an annual competition (with an associated workshop) that pits OWL 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. The 2015 competition was the third of its sort and had 14 reasoners competing in six tracks comprising three tasks (consistency, classification, and realisation) over two profiles (OWL 2 DL and EL). In this paper, we discuss the design, execution and results of the 2015 competition with particular attention to lessons learned for benchmarking, comparative experiments, and future competitions.
AB - The OWL Reasoner Evaluation competition is an annual competition (with an associated workshop) that pits OWL 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. The 2015 competition was the third of its sort and had 14 reasoners competing in six tracks comprising three tasks (consistency, classification, and realisation) over two profiles (OWL 2 DL and EL). In this paper, we discuss the design, execution and results of the 2015 competition with particular attention to lessons learned for benchmarking, comparative experiments, and future competitions.
U2 - 10.1007/s10817-017-9406-8
DO - 10.1007/s10817-017-9406-8
M3 - Article
SN - 1573-0670
JO - Journal of Automated Reasoning
JF - Journal of Automated Reasoning
ER -