juliareach / arch2022_ainncs_re

Repeatability evaluation package for the ARCH2022 AINNCS competition

ARCH2022 AINNCS

This is the JuliaReach repeatability evaluation (RE) package for the ARCH-COMP 2022 category report: Artificial Intelligence and Neural Network Control Systems (AINNCS) for Continuous and Hybrid Systems Plants of the 6th International Competition on Verifying Continuous and Hybrid Systems (ARCH-COMP '22).

To cite the work, you can use:

@inproceedings{LopezABCFFHJLLSZ22,
  author    = {Diego Manzanas Lopez and
               Matthias Althoff and
               Luis Benet and
               Xin Chen and
               Jiameng Fan and
               Marcelo Forets and
               Chao Huang and
               Taylor T. Johnson and
               Tobias Ladner and
               Wenchao Li and
               Christian Schilling and
               Qi Zhu},
  editor    = {Goran Frehse and
               Matthias Althoff},
  title     = {{ARCH-COMP22} Category Report: Artificial Intelligence and Neural
               Network Control Systems {(AINNCS)} for Continuous and Hybrid Systems
               Plants},
  booktitle = {{ARCH}},
  series    = {EPiC Series in Computing},
  volume    = {90},
  pages     = {142--184},
  publisher = {EasyChair},
  year      = {2022},
  url       = {https://doi.org/10.29007/wfgr},
  doi       = {10.29007/wfgr}
}

Installation

Note: Running the full benchmark suite should take no more than two hours with a reasonable internet connection.

There are two ways to install and run this RE: either using the Julia script or using the Docker script. In both cases, first clone this repository.

Using the Julia script. First install the Julia compiler following the instructions here. Once you have installed Julia, execute

$ julia startup.jl

to run all the benchmarks.

Using the Docker container. To build the container, you need the program docker. For installation instructions on different platforms, consult the Docker documentation. For general information about Docker, see this guide. Once you have installed Docker, start the measure_all script:

$ ./measure_all

---

The Docker container can also be run interactively:

$ docker run -it juliareach bash

$ julia

julia> include("startup.jl")

Outputs

After the benchmark runs have finished, the results will be stored in the folder result and plots are generated in your working directory.

---

How the Julia environment was created

julia> ]

(@v1.7) pkg> activate .
  Activating new environment at `.../ARCH2022_AINNCS/Project.toml`

pkg> add ClosedLoopReachability
pkg> add DifferentialEquations
pkg> add LinearAlgebra
pkg> add MAT
pkg> add Plots
pkg> add Symbolics
pkg> add YAML