The following will provide material to reproduce our research.
Experiments have been performed using learning rates of 1.0, 0.6, 0.3, 0.1, and 0.01. See the Usage document for details on how to set the learning rate.
To reproduce our experiments, you will need the following problem instances.
The Single and Multi Fault instances for the partner units problem are available here in the following variations:
The stream version of the instances follows the naming convention enc-<size>-<logtype> and partnerunits-dbl-<size>-<alpha>-<logtype>. Note that the encoding is independent from the Alpha value.
The restart version follows the naming convention partnerunits-dbl-<size>-<alpha>-<logtype>-<instance>.lp.
Switch Mutation instances are available here and are denoted by a logtype of 7. The naming convention is the same as for the standard PUP instances.
The N-Queens completion instances can be found here and follow a different naming convention. The stream instances are denoted as end-<size> and log-<size>, whereas the restart instances are denoted as nqueens-<size>-<instance>.
You can find a download link, build instructions, and usage information for our prototype in the Prototype section of this website. For the Restart benchmarks, we used WASP (as this is what our prototype is based on), which is available on GitHub, where you can also find build instructions.