weaselab/conflict-set
2
0
Fork 0
Code Issues 4 Packages Releases 13 Activity

Update readme benchmarks

Browse Source
This commit is contained in:
Andrew Noyes
2024-03-07 15:53:39 -08:00
parent 1519216d08
commit 8a36e72640
1 changed files with 81 additions and 50 deletions
Download Patch File Download Diff File Expand all files Collapse all files

131
README.md
View File

@@ -7,66 +7,97 @@ Intended to replace FoundationDB's skip list.
## Skip list ## Skip list
``` ```
New conflict set: 4.189 sec New conflict set: 2.404 sec
0.298 Mtransactions/sec 0.520 Mtransactions/sec
1.194 Mkeys/sec 2.080 Mkeys/sec
Detect only: 3.990 sec Detect only: 2.266 sec
0.313 Mtransactions/sec 0.552 Mtransactions/sec
1.253 Mkeys/sec 2.207 Mkeys/sec
Skiplist only: 2.849 sec Skiplist only: 1.594 sec
0.439 Mtransactions/sec 0.784 Mtransactions/sec
1.755 Mkeys/sec 3.137 Mkeys/sec
Performance counters: Performance counters:
Build: 0.0913 Build: 0.071
Add: 0.0998 Add: 0.0641
Detect: 3.99 Detect: 2.27
D.Sort: 0.808 D.Sort: 0.44
D.Combine: 0.0309 D.Combine: 0.018
D.CheckRead: 1.67 D.CheckRead: 0.855
D.CheckIntraBatch: 0.0305 D.CheckIntraBatch: 0.00903
D.MergeWrite: 1.18 D.MergeWrite: 0.739
D.RemoveBefore: 0.265 D.RemoveBefore: 0.201
``` ```
## Radix tree (this implementation) ## Radix tree (this implementation)
``` ```
New conflict set: 2.965 sec New conflict set: 1.743 sec
0.422 Mtransactions/sec 0.717 Mtransactions/sec
1.686 Mkeys/sec 2.869 Mkeys/sec
Detect only: 2.761 sec Detect only: 1.611 sec
0.453 Mtransactions/sec 0.776 Mtransactions/sec
1.811 Mkeys/sec 3.103 Mkeys/sec
Skiplist only: 1.580 sec Skiplist only: 0.919 sec
0.791 Mtransactions/sec 1.360 Mtransactions/sec
3.165 Mkeys/sec 5.440 Mkeys/sec
Performance counters: Performance counters:
Build: 0.0902 Build: 0.0657
Add: 0.107 Add: 0.0628
Detect: 2.76 Detect: 1.61
D.Sort: 0.809 D.Sort: 0.442
D.Combine: 0.0309 D.Combine: 0.0178
D.CheckRead: 0.658 D.CheckRead: 0.395
D.CheckIntraBatch: 0.0294 D.CheckIntraBatch: 0.00776
D.MergeWrite: 0.921 D.MergeWrite: 0.524
D.RemoveBefore: 0.305 D.RemoveBefore: 0.221
``` ```
# Our benchmark # Our benchmark
## Skip list
| ns/op | op/s | err% | total | benchmark | ns/op | op/s | err% | total | benchmark
|--------------------:|--------------------:|--------:|----------:|:---------- |--------------------:|--------------------:|--------:|----------:|:----------
| 325.60 | 3,071,225.77 | 4.8% | 0.77 | `skip list (point reads)` | 270.07 | 3,702,706.03 | 0.4% | 0.01 | `point reads`
| 297.15 | 3,365,278.10 | 1.7% | 0.72 | `skip list (prefix reads)` | 285.76 | 3,499,437.03 | 1.5% | 0.01 | `prefix reads`
| 408.79 | 2,446,222.23 | 1.0% | 1.03 | `skip list (range reads)` | 532.54 | 1,877,794.90 | 0.7% | 0.01 | `range reads`
| 261.88 | 3,818,471.08 | 1.3% | 0.73 | `skip list (point writes)` | 528.50 | 1,892,132.94 | 0.7% | 0.01 | `point writes`
| 253.54 | 3,944,191.08 | 0.1% | 0.61 | `skip list (prefix writes)` | 516.53 | 1,935,978.22 | 0.9% | 0.01 | `prefix writes`
| 258.73 | 3,865,078.52 | 0.8% | 0.62 | `skip list (range writes)` | 303.34 | 3,296,630.84 | 3.6% | 0.05 | `range writes`
| 489.56 | 2,042,648.19 | 1.8% | 0.01 | `skip list (monotonic increasing point writes)` | 502.88 | 1,988,553.24 | 2.0% | 0.01 | `monotonic increasing point writes`
| 14.83 | 67,446,579.75 | 0.1% | 0.04 | `radix tree (point reads)`
| 59.68 | 16,756,917.37 | 0.1% | 0.14 | `radix tree (prefix reads)` ## Radix tree (this implementation)
| 287.32 | 3,480,485.22 | 1.2% | 0.69 | `radix tree (range reads)`
| 46.59 | 21,461,855.59 | 0.2% | 0.12 | `radix tree (point writes)` | ns/op | op/s | err% | total | benchmark
| 83.70 | 11,946,755.99 | 0.1% | 0.20 | `radix tree (prefix writes)` |--------------------:|--------------------:|--------:|----------:|:----------
| 100.75 | 9,925,723.26 | 0.6% | 0.25 | `radix tree (range writes)` | 14.52 | 68,850,842.99 | 1.2% | 0.01 | `point reads`
| 118.37 | 8,448,345.29 | 0.6% | 0.01 | `radix tree (monotonic increasing point writes)` | 60.89 | 16,422,538.22 | 1.5% | 0.01 | `prefix reads`
| 226.89 | 4,407,362.98 | 0.5% | 0.01 | `range reads`
| 22.99 | 43,498,198.49 | 0.2% | 0.01 | `point writes`
| 50.51 | 19,799,864.54 | 1.0% | 0.01 | `prefix writes`
| 82.50 | 12,121,212.12 | 2.6% | 0.03 | `range writes`
| 119.94 | 8,337,354.54 | 2.1% | 0.01 | `monotonic increasing point writes`
# "Real data" test
Point queries only, best of three runs. Gc ratio is the ratio of time spent doing garbage collection to time spent adding writes or doing garbage collection. Lower is better.
## skip list
```
Check: 12.7863 seconds, 292.384 MB/s, Add: 19.8276 seconds, 35.4071 MB/s, Gc ratio: 23.5314%
```
## radix tree
```
Check: 3.60187 seconds, 1037.94 MB/s, Add: 3.03958 seconds, 230.966 MB/s, Gc ratio: 52.3876%
```
## hash table
(The hash table implementation doesn't work on range queries, and its purpose is to provide an idea of how fast point queries can be)
```
Check: 2.15925 seconds, 1731.4 MB/s, Add: 1.08519 seconds, 646.926 MB/s, Gc ratio: 52.1526%
```