The Reactive Synthesis Competition (SYNTCOMP) is a competition for reactive synthesis tools and is inspired by the tradition of competitions in related fields, like the SAT Competition or the Hardware Model Checking Competition. The competition’s goal is to collect benchmarks in a publicly available library and foster research in new tools for automatic synthesis of systems. SYNTCOMP was organized as a satellite event of CAV in 2014, 2015, and 2016.
SYNTCOMP 2016 extended the competition to specifications in full LTL. 6 synthesis tools competed in the existing track based on AIGER/safety specifications, and 3 tools competed in the new track based on specifications in TLSF/LTL. Results and further information can be found here.
For SYNTCOMP 2015, we have added more than 2000 problem instances to our benchmark library, and improved the ranking system and evaluation process. 4 synthesis tools competed on the new set of benchmarks, showing significant progress over last year’s implementations. Results and further information can be found here.
In the inaugural SYNTCOMP 2014, 5 synthesis tools competed on a set of 569 problem instances, collected in the new benchmark format of the competition. Results and further information can be found here.