generated from satcompetition/template
-
Notifications
You must be signed in to change notification settings - Fork 1
/
benchmarks.html
61 lines (56 loc) · 2.75 KB
/
benchmarks.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title class='tpl-name'></title>
<link rel="stylesheet" href="main.css" type="text/css">
<link rel="stylesheet" href="template.css" type="text/css">
<link rel="icon" type="image/x-icon" href="doge2.ico">
<script src="https://www.w3schools.com/lib/w3.js"></script>
<style>a#benchmarks { color:#c20114; }</style>
</head>
<body>
<div class="main">
<div class="navigation" w3-include-html="navigation.html"></div>
<script>w3.includeHTML();</script>
<div class="content">
<h1 class='tpl-name'></h1>
<h2>Benchmarks</h2>
<h4>Benchmark Submission</h4>
<p>
We would like to invite and encourage submissions of benchmarks and benchmark generators for all the tracks of the competition.
</p>
<p>
Each Main Track participant (team) is required to submit 20 new benchmark instances (not seen in previous competitions).
At least 10 of those benchmarks should be "interesting": not too easy (solvable by MiniSat in a minute) or
too hard (unsolvable by the participants own solver within one hour on a computer similar to the nodes of the
<a href="https://www.starexec.org/starexec/public/machine-specs.txt">StarExec cluster</a>).
</p>
<p>
Participants should submit benchmarks by emailing them to "organizers@satcompetition.org" with the
subject "<span class='tpl-name'></span> Benchmark Submission" and either a URL link or attachment of a single zip file containing the benchmarks.
</p>
<h4>Input and Output Format</h4>
<p>
Benchmarks have to be formatted according to the
<a href="http://www.satcompetition.org/2011/format-benchmarks2011.html">SAT Competition 2011 Benchmark Submission Guidelines</a>.
A benchmark description, using the <a href="http://www.ieee.org/conferences_events/conferences/publishing/templates.html">IEEE Proceedings style</a>,
should be submitted with each submitted benchmark family, following the instructions for solver descriptions.
The benchmark descriptions will be made available similarly as the solver descriptions (see <a href="rules.html">general rules</a>).
</p>
<h4>Benchmark Selection</h4>
<p>
The benchmark problems will be selected randomly from the set of benchmarks submitted by the participants and by the organizers. The bechnmarks submitted by the participants will be scrambled.
</p>
<p>
The benchmarks for the Incremental Library Track are applications using a SAT solver in an
incremental fashion. See the <a href="incremental.html">Incremental Library Track Rules</a> section for more information.
</p>
<h4>Selected Benchmarks</h4>
<p>
To get the benchmarks used in the competition go to the <a href="downloads.html">downloads page</a>
</p>
</div>
</div>
</body>
</html>