All The Agents Challenge

In conjunction with the International Semantic Web Conference (ISWC) 2021 (October 24-28, 2021)

Motivation

Agents on the Web have been a part of the vision for the Semantic Web. While it has been noted that the original Semantic Web vision has not yet fully materialised, recent progress seems to indicate that we may now be at a stage where:

  1. developments such as the Web of Things may unlock new practical use cases for agents on the Web, and
  2. the substrate provided by recent Semantic Web technologies (e.g., Linked Data Platform, Linked Data Notifications, SoLiD PODs) may open new perspectives on the integration of Semantic Web with agent technologies.

This bridging of technologies and communities has also been the topic of the Dagstuhl seminar “Autonomous Agents on the Web” held in Feburary 2021. Therefore, for the 20th edition of the ISWC conference and in spirit of Jim Hendler’s op-ed that asked “Where are all the agents?”, we want to pose the All-the-Agents-Challenge (ATAC) to the Semantic Web community:

The challenge to build agents that do things on Linked Data

Environments

Submissions to the challenge can make use of one of those environments – or bring their own.

  • The Autonomous Maze Environment Explorer Project (AMEE) provides an environment for agents that have to escape a maze by following hypermedia affordances. AMEE can simulate mazes of different sizes. We provide a RDF version of AMEE.

  • The Building on Linked Data (BOLD) environment is a description of a large real-world building (2 floors, over 250 rooms) with simulated occupancy and sunlight. Web agents can read occupancy and light level in rooms values through sensors. Agents can also actuate light switches located in the rooms. On this basis, participants to the challenge could implement several energy saving scenarios by interacting with the building’s lighting system. The building and all sensors and actuators are modeled using the Brick and Semantic Sensor Network (SSN) ontologies. Participants can experiment with BOLD and program their agents against it by downloading the BOLD server.

  • Your amazing agent environment. If you have a cool agent environment that provides Linked Data and maybe Web of Things Thing Descriptions, like your SoLiD POD, or your semantic IoT deployment, why not submit an agent that uses it?

Important Dates

Event Date
Release of environments: May 22, 2021
Submission deadline: July 22, 2021
Notifications: August 27, 2021
Challenge presentations: October 24-28, 2021

Process and Judging Criteria

Submissions should contain:

  • 1-2 pages of text
  • A short demo video
  • A link to code

Accepted submissions (finalists) will be invited to extend their paper to 5 pages to appear in the challenge’s proceedings.

While there are no established metrics for evaluating the performance of agents on the Semantic Web, and as we want to foster creativity, the committee will evaluate submissions according to the criteria we describe in the following. The authors should make sure that adhering to these criteria does not lead to excessive complexity that is not warranted by the use case.

Clarity (hard criterion)

As we aim to attract a diverse set of submissions, we expect an accompanying short paper and demonstrator video that describe the use-case and the agent-based system. We expect the submission to be clear and understandable to the evaluation committee.

To raise the clarity you may want to say how you position yourself in well-established classifications for agent-based systems, e.g., the Russell/Norvig and (Genesereth/Nilsson) taxonomy to classify agents into Simple Reflex (tropistic) agents, Model-based (hysteretic) agents, and Goal-based (deliberate) agents.

Linked Data (hard criterion)

A hard constraint we apply is that we expect agents to operate on Linked Data on the Web, i.e. to make HTTP requests, to process RDF, and to follow links.

Support for heterogeneity

To take an existing (multi-)agent system and make it interoperable with multiple sources/external data gives submissions some points in this category. The better a submission can cope with heterogeneous environments, the more points we award.

Support for dynamicity

During the execution, an agent should exhibit adaptive behaviour (e.g., to cope with dynamic environments, if the environment is dynamic), i.e. we award points for submissions if agents:

  • react to changes in the environment
  • enact change in the environment
  • update their state or evolve at runtime

Support for interaction and coordination

Next to single-agent submissions, we also appreciate agents with a form of social ability, i.e., agents that can interact and coordinate with other agents (e.g., direct message exchange, stigmergy, organisations, policies and norms, automated negotiation, interaction with humans).

Organization

Challenge Jury

  • Jim Hendler, Rensselaer Polytechnic Institute (USA)
  • Jomi Hübner, Federal University of Santa Catarina (BR)
  • Simon Mayer, University of St. Gallen (CH)
  • Alessandro Ricci, University of Bologna (IT)
  • Munindar Singh, North Carolina State University (USA)

Challenge Organizers