The Results of Sugar in CSP Solver Competitions
Table of Contents
2009 CSP Solver Competition
Two solvers "Sugar v1.14.6+minisat" and "Sugar v1.14.6+picosat" participated to this competition.
Category | Sugar v1.14.6+minisat | Sugar v1.14.6+picosat |
---|---|---|
2-ARY-EXT | 8 / 13 | 9 / 13 |
2-ARY-INT | 7 / 13 | 6 / 13 |
N-ARY-EXT | 12 / 14 | 13 / 14 |
N-ARY-INT | 9 / 13 | 10 / 13 |
Alldiff | 3 / 11 | 1 / 11 |
Alldiff+Elt+Wsum | 2 / 8 | 1 / 8 |
Alldiff+Cumul+Elt+Wsum | 1 / 6 | 2 / 6 |
- Alldiff, Alldiff+Elt+Wsum, and Alldiff+Cumul+Elt+Wsum are global constraint categories.
- In these categories, each instance may include constraints in other categories, that is, binary extensional (2-ARY-EXT), n-ary extensional (N-ARY-EXT), binary intensional (2-ARY-INT), and n-ary intensional constraints (N-ARY-INT) in addition to global constraints, such as alldifferent, cumulative, element, and weightedsum.
- Short Report on the Results of the Fourth International Constraint Solver Competition (PDF slide) describes our report.
- Please check 2009 the Fourth International CSP Solver Competition for the detailed results.
PUREINT Instances
The following table shows the number of solved instances of purely intensional (that is, no extensional constraints) and satisfiable instances by different solvers at CSC 2009.
Series | Sugar+minisat | Sugar+picosat | Choco | Mistral | bpsolver |
---|---|---|---|---|---|
All Interval Series ( 15) | 9 | 9 | 11 | 12 | 15 |
BIBD ( 79) | 76 | 77 | 58 | 76 | 35 |
Chessboard Coloration ( 4) | 4 | 4 | 3 | 4 | 2 |
Costas Array ( 9) | 8 | 8 | 9 | 9 | 9 |
Domino ( 10) | 10 | 10 | 10 | 10 | 10 |
Golomb Ruler ( 10) | 10 | 9 | 10 | 10 | 10 |
Langford ( 10) | 10 | 10 | 10 | 10 | 10 |
Latin Square ( 3) | 3 | 2 | 2 | 2 | 2 |
Magic Square ( 15) | 8 | 8 | 15 | 13 | 11 |
NengFa ( 8) | 8 | 8 | 8 | 8 | 8 |
Perfect Square Packing ( 32) | 32 | 31 | 18 | 21 | 18 |
Quasigroup Existence ( 12) | 12 | 12 | 12 | 12 | 12 |
Queen Attacking ( 3) | 2 | 2 | 2 | 2 | 0 |
Queens ( 12) | 10 | 10 | 11 | 10 | 10 |
Ramsey ( 10) | 10 | 9 | 10 | 10 | 4 |
Schurr's Lemma ( 2) | 1 | 1 | 1 | 1 | 2 |
Social Golfers ( 6) | 6 | 5 | 5 | 6 | 0 |
Pseudo-Boolean ( 238) | 187 | 208 | 190 | 201 | 184 |
2D Strip Packing ( 9) | 7 | 7 | 3 | 5 | 4 |
BQWH ( 20) | 20 | 20 | 20 | 20 | 20 |
Cumulative Job-Shop ( 2) | 2 | 2 | 1 | 1 | 0 |
Fischer ( 5) | 4 | 4 | 4 | 4 | 4 |
Graph Coloring ( 35) | 35 | 35 | 35 | 35 | 34 |
Job-Shop ( 63) | 62 | 62 | 58 | 48 | 46 |
Multi Knapsack ( 6) | 4 | 4 | 6 | 5 | 6 |
Open-Shop ( 47) | 47 | 47 | 47 | 47 | 25 |
Primes ( 70) | 43 | 44 | 70 | 70 | 64 |
RCPSP ( 40) | 40 | 40 | 40 | 40 | 40 |
Rader Surveillance ( 42) | 42 | 42 | 42 | 42 | 35 |
Super-solutions ( 37) | 35 | 36 | 24 | 29 | 18 |
BMC ( 11) | 11 | 11 | 11 | 11 | 11 |
Cabinet ( 20) | 20 | 20 | 20 | 20 | 20 |
FAPP ( 57) | 15 | 23 | 11 | 23 | 0 |
RLFAP ( 23) | 23 | 23 | 23 | 23 | 20 |
Timetabling ( 42) | 25 | 42 | 14 | 39 | 1 |
Total (1007) | 841 | 885 | 814 | 879 | 690 |
2008 CSP Solver Competition
Two solvers "Sugar v1.13+minisat" and "Sugar v1.13+picosat" participated to this competition.
Category | Sugar v1.13+minisat | Sugar v1.13+picosat |
---|---|---|
2-ARY-EXT | 14 / 22 | 15 / 22 |
2-ARY-INT | 11 / 17 | 10 / 17 |
N-ARY-EXT | 15 / 22 | 16 / 22 |
N-ARY-INT | 12 / 18 | 13 / 18 |
GLOBAL | 4 / 17 | 1 / 17 |
- In the GLOBAL categories, each instance may include constraints in other categories, that is, binary extensional (2-ARY-EXT), n-ary extensional (N-ARY-EXT), binary intensional (2-ARY-INT), and n-ary intensional constraints (N-ARY-INT) in addition to global constraints, such as alldifferent, cumulative, element, and weightedsum.
- Sugar: A SAT-based CSP Solver —Results summary of the 3rd intertional CSP solver competition--- (PDF slide) describes our report.
- Please check 2008 the Third International CSP and Max-CSP Solver Competitions for the detailed results.
2008 Max-CSP Solver Competition
Two solvers "Sugar v1.13+minisat" and "Sugar++ v1.13+minisat-inc" participated to this competition.
Category | Sugar v1.13+minisat | Sugar v1.13+minisat-inc |
---|---|---|
2-ARY-EXT | 2 / 7 | 3 / 7 |
2-ARY-INT | 1 / 6 | 2 / 6 |
N-ARY-EXT | 2 / 7 | 3 / 7 |
N-ARY-INT | 1 / 6 | 2 / 6 |
GLOBAL | 1 / 2 | 2 / 2 |
- Sugar: A SAT-based CSP Solver —Results summary of the 3rd intertional CSP solver competition--- (PDF slide) describes our report.
- Please check 2008 the Third International CSP and Max-CSP Solver Competitions for the detailed results.
Links
- Christophe Lecoutre, Olivier Roussel, and M. R. C. van Dongen: Promoting robust black-box solvers through competitions, Constraints, July 2010, Volume 15, Issue 3, pp 317-326.
- XCSP Benchmark Instances
- 2009 the Fourth International CSP Solver Competition
- 2008 the Third International CSP and Max-CSP Solver Competitions
- 2006 the Second International CSP and Max-CSP Solver Competitions
- 2005 the First International CSP and Max-CSP Solver Competitions (PDF)
- MiniZinc Challenge