A good collection of links to various software is given on Neumaier’s webpage.

GENOPT is running generalization-based contest in global optimization. To avoid the negative data mining effect, the GENOPT contest is based on randomized function generators, with fixed statistical characteristics but individual variation of the generated instances. The generators are available to the participants to test offline and online tuning schemes, but the final competition is based on random seeds communicated in the last phase.