Call for Challenge Proposals

ISWC 2019 will run multiple Challenges (SWCs) with the aim to evaluate and compare software solutions for the Semantic Web in a systematic way. Each SWC will

1. Define a task to be addressed,
2. Provide a training and a test dataset and
3. Define evaluation measures to compare the performance of participating systems.

The organizers of each SWC will be responsible for the selection of the participants who will be invited to present their solutions at ISWC 2019.

For ISWC 2019, SWC proposals are invited for any challenge involving Semantic Web tasks, including but not limited to:

• Ontology alignment
• Fact checking
• Sentiment and Emotion analysis
• Entity resolution
• Link prediction
• Attribute prediction and validation
• Query and reasoning scalability
• Energy efficiency of computation (e.g. green processing)
• Stream processing

The ISWC 2019 conference will be located at The University of Auckland, New Zealand, October 26 – 30, 2019. Selected SWC systems will be presented at ISWC 2019 on October 30, 2019.

Recent SWC examples include the SWC 2018 and the SWC 2017.

Proposal Submission Guidelines

The contents of a proposal should include the following (in 2–4 pages):

• Names and affiliations of the members of the SWC organizing committee (including the name of the designated challenge chair who will also serve as main contact point)
• Description of the challenge, including its relevance to the Semantic Web community
• Description of the process for selecting, acquiring and preparing the data for training and evaluation, including conditions of availability
• Description of the procedure for evaluating the performance of participating systems, including the availability of evaluation software
• A timeline based on the template for all SWCs provided below
• Number of expected participants with supporting evidence (expression of interests, discussions in fora/mailing lists, attendance in previous editions, etc.)
• Any other relevant information, including previous evaluations for the proposed challenge

We recommend prospective SWC organizers to follow the timeline outlined below to allow sufficient development time for the participants.

Challenge proposal submissions should be carried out here.

Selection criteria:

• Relevance for the Semantic Web community
• Potential number to interested participants
• Rigor and transparency of task description and evaluation procedure

Important Dates

The timeline template for organizing the Challenge is as follows:

All deadlines are midnight Hawaii time. (GMT-10)

Program Chairs

Contact: iswc2019-challenge@inria.fr

• Gianluca Demartini, The University of Queensland, Brisbane, Australia
• Valentina Presutti, STLab-ISTC, National Research Council, Rome, Italy
• Axel Ngonga, Paderborn University, Paderborn, Germany