Изменения

Ceph performance

2593 байта добавлено, 09:52, 24 июля 2019
Нет описания правки
P.S: Bluestore uses fsync. Filestore uses O_SYNC.
 
=== Server SSDs ===
 
Disabling cache is not a joke!
 
<tt>fio -ioengine=libaio -name=test -filename=/dev/sdb -(sync|fsync)=1 -direct=1 -bs=(4k|4M) -iodepth=(1|32|128) -rw=(write|randwrite)</tt>
 
'''Micron 5100 Eco 960GB'''
 
<div style="float: left">
<div>'''Write'''</div>
<tab sep="bar" head="top" class="wikitable">
sync or fsync | bs | iodepth | rw | hdparm -W 1 | hdparm -W 0
sync | 4k | 1 | write | 612 iops | 22200 iops
sync | 4k | 1 | randwrite | 612 iops | 22200 iops
sync | 4k | 32 | randwrite | 6430 iops | 59100 iops
sync | 4k | 128 | randwrite | 6503 iops | 59100 iops
sync | 4M | 32 | write | 469 MB/s | 485 MB/s
fsync | 4k | 1 | write | 659 iops | 25100 iops
fsync | 4k | 1 | randwrite | 671 iops | 25100 iops
fsync | 4k | 32 | randwrite | 695 iops | 59100 iops
fsync | 4k | 128 | randwrite | 701 iops | 59100 iops
fsync | 4M | 32 | write | 384 MB/s | 486 MB/s
</tab>
</div>
<div style="float: left; margin-left: 10px">
<div>'''Read'''</div>
<tab sep="bar" head="top" class="wikitable">
bs | iodepth | rw | результат
4k | 1 | randread | 6000 iops
4k | 4 | randread | 15900 iops
4k | 8 | randread | 18500 iops
4k | 16 | randread | 24800 iops
4k | 32 | randread | 37400 iops
4M | 1 | read | 460 MB/s
4M | 16 | read | 514 MB/s
</tab>
</div>
<div style="clear:both"></div>
 
Reads don't differ for hdparm -W 0 and 1.
 
'''Seagate Nytro 1351 XA3840LE10063'''
 
Disk was filled 90-100 % before the test.
 
<div style="float: left">
<div>'''Write'''</div>
<tab sep="bar" head="top" class="wikitable">
sync or fsync | bs | iodepth | rw | hdparm -W 1 | hdparm -W 0
sync | 4k | 1 | randwrite | 18700 iops | 18700 iops
sync | 4k | 4 | randwrite | 49400 iops | 54700 iops
sync | 4k | 32 | randwrite | 51800 iops | 65700 iops
sync | 4M | 32 | write | 516 MB/s | 516 MB/s
fsync=1 | 4k | 1 | randwrite | {{red|288 iops}} | 18100 iops
fsync=1 | 4k | 4 | randwrite | {{red|288 iops}} | 52800 iops
fsync=4 | 4k | 4 | randwrite | 1124 iops | 53500 iops
fsync=1 | 4k | 32 | randwrite | {{red|288 iops}} | 65700 iops
fsync=32 | 4k | 32 | randwrite | 7802 iops | 65700 iops
fsync=1 | 4M | 32 | write | 336 MB/s | 516 MB/s
</tab>
</div>
<div style="float: left; margin-left: 10px">
<div>'''Read'''</div>
<tab sep="bar" head="top" class="wikitable">
bs | iodepth | rw | результат
4k | 1 | randread | 8600 iops
4k | 4 | randread | 21900 iops
4k | 8 | randread | 30500 iops
4k | 16 | randread | 39200 iops
4k | 32 | randread | 50000 iops
4M | 1 | read | 508 MB/s
4M | 16 | read | 536 MB/s
</tab>
</div>
<div style="clear:both"></div>
 
'''Disable the cache if you want more than 288 iops.'''
== RAID WRITE HOLE ==