DRBD (Distributed Replicated Block Device) 実測ベンチマーク

測定環境

  • 測定日時:2020年 10月 8日 木曜日 18:22:18 JST
  • ハードウェア:Intel Core i7-9700K 3.60GHz
  • ホストOS:Windows10 Home
  • 仮想マシン:VirtualBox 6.1.14 r140239 (Qt5.6.2)
  • クライアント:CentOS Linux release 8.2.2004 (Core)
  • DRBD:kmod-drbd90.x86_64 9.0.23-1.el8_2.elrepo
  • primary , secondary 2台構成
  • 内部ネットワーク速度:3.71 Gbit/s (別途スループット測定)

定義

cat > /etc/drbd.d/r1.res

resource r1 {
    floating ipv4 192.168.32.1:7788 {
        volume 0 {
            device       /dev/drbd0 minor 0;
            disk         /dev/cl/drdb-1;
            meta-disk    internal;
        }
    }
    floating ipv4 192.168.32.2:7788 {
        volume 0 {
            device       /dev/drbd0 minor 0;
            disk         /dev/cl/drdb-1;
            meta-disk    internal;
        }
    }
    net {
        protocol           C;
        max-buffers      8000;
        max-epoch-size   8000;
    }
    disk {
        al-extents       3389;
        disk-barrier      no;
        disk-flushes      no;
    }
}

結果

ランダムライト LOCAL xfs

[root@centos1 /]# fio -filename=/tmp/benchmark -direct=1 -rw=randwrite -bs=4k -size=512M -numjobs=64 -runtime=10 -group_reporting -name=file1
file1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.7
Starting 64 processes

Jobs: 64 (f=64): [w(64)][30.0%][r=0KiB/s,w=155MiB/s][r=0,w=39.7k IOPS][eta 00m:0
Jobs: 64 (f=64): [w(64)][40.0%][r=0KiB/s,w=160MiB/s][r=0,w=40.0k IOPS][eta 00m:0
Jobs: 64 (f=64): [w(64)][50.0%][r=0KiB/s,w=151MiB/s][r=0,w=38.6k IOPS][eta 00m:0
Jobs: 64 (f=64): [w(64)][70.0%][r=0KiB/s,w=95.0MiB/s][r=0,w=24.3k IOPS][eta 00m:
Jobs: 64 (f=64): [w(64)][80.0%][r=0KiB/s,w=155MiB/s][r=0,w=39.6k IOPS][eta 00m:0
Jobs: 64 (f=64): [w(64)][90.0%][r=0KiB/s,w=152MiB/s][r=0,w=38.0k IOPS][eta 00m:0
Jobs: 64 (f=64): [w(64)][100.0%][r=0KiB/s,w=154MiB/s][r=0,w=39.4k IOPS][eta 00m:00s]
file1: (groupid=0, jobs=64): err= 0: pid=5680: Thu Oct  8 18:10:33 2020
  write: IOPS=37.5k, BW=147MiB/s (154MB/s)(1468MiB/10007msec)
    clat (usec): min=40, max=532953, avg=1699.64, stdev=11235.49
     lat (usec): min=41, max=532953, avg=1699.87, stdev=11235.51
    clat percentiles (usec):
     |  1.00th=[    69],  5.00th=[    91], 10.00th=[   139], 20.00th=[   269],
     | 30.00th=[   379], 40.00th=[   482], 50.00th=[   594], 60.00th=[   742],
     | 70.00th=[  1004], 80.00th=[  1500], 90.00th=[  3032], 95.00th=[  6128],
     | 99.00th=[ 16712], 99.50th=[ 19268], 99.90th=[ 26608], 99.95th=[291505],
     | 99.99th=[513803]
   bw (  KiB/s): min=    7, max=10108, per=1.35%, avg=2028.47, stdev=1197.32, samples=1266
   iops        : min=    1, max= 2527, avg=506.90, stdev=299.37, samples=1266
  lat (usec)   : 50=0.02%, 100=6.23%, 250=12.20%, 500=23.36%, 750=18.48%
  lat (usec)   : 1000=9.57%
  lat (msec)   : 2=15.17%, 4=7.27%, 10=4.77%, 20=2.51%, 50=0.36%
  lat (msec)   : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.04%
  cpu          : usr=0.05%, sys=2.03%, ctx=382202, majf=0, minf=545
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,375694,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=147MiB/s (154MB/s), 147MiB/s-147MiB/s (154MB/s-154MB/s), io=1468MiB (1539MB), run=10007-10007msec

Disk stats (read/write):
    dm-0: ios=0/370306, merge=0/0, ticks=0/380993, in_queue=380993, util=79.17%, aggrios=0/375660, aggrmerge=0/34, aggrticks=0/378876, aggrin_queue=281126, aggrutil=79.11%
  sda: ios=0/375660, merge=0/34, ticks=0/378876, in_queue=281126, util=79.11%

シーケンシャルライト LOCAL xfs

[root@centos1 /]# fio -filename=/tmp/benchmark -direct=1 -rw=write -bs=4k -size=512M -numjobs=64 -runtime=10 -group_reporting -name=file1
file1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.7
Starting 64 processes
file1: Laying out IO file (1 file / 512MiB)

Jobs: 64 (f=64): [W(64)][30.0%][r=0KiB/s,w=157MiB/s][r=0,w=40.2k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][50.0%][r=0KiB/s,w=145MiB/s][r=0,w=37.0k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][54.5%][r=0KiB/s,w=150MiB/s][r=0,w=38.3k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][63.6%][r=0KiB/s,w=148MiB/s][r=0,w=37.0k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][72.7%][r=0KiB/s,w=144MiB/s][r=0,w=36.9k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][81.8%][r=0KiB/s,w=147MiB/s][r=0,w=37.5k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][90.9%][r=0KiB/s,w=146MiB/s][r=0,w=37.5k IOPS][eta 00m:0
Jobs: 63 (f=63): [W(11),E(1),W(52)][100.0%][r=0KiB/s,w=137MiB/s][r=0,w=35.0k IOPS][eta 00m:00s]
file1: (groupid=0, jobs=64): err= 0: pid=5520: Thu Oct  8 18:09:13 2020
  write: IOPS=37.8k, BW=148MiB/s (155MB/s)(1550MiB/10491msec)
    clat (usec): min=43, max=515606, avg=1634.38, stdev=7420.51
     lat (usec): min=43, max=515606, avg=1634.61, stdev=7420.60
    clat percentiles (usec):
     |  1.00th=[    84],  5.00th=[   117], 10.00th=[   221], 20.00th=[   379],
     | 30.00th=[   498], 40.00th=[   594], 50.00th=[   676], 60.00th=[   766],
     | 70.00th=[   873], 80.00th=[  1074], 90.00th=[  2737], 95.00th=[  8225],
     | 99.00th=[ 15139], 99.50th=[ 20055], 99.90th=[ 31065], 99.95th=[ 39584],
     | 99.99th=[505414]
   bw (  KiB/s): min=   44, max= 5360, per=1.63%, avg=2467.58, stdev=831.20, samples=1278
   iops        : min=   11, max= 1340, avg=616.72, stdev=207.81, samples=1278
  lat (usec)   : 50=0.01%, 100=4.06%, 250=7.47%, 500=18.74%, 750=28.35%
  lat (usec)   : 1000=18.57%
  lat (msec)   : 2=11.05%, 4=3.44%, 10=4.04%, 20=3.75%, 50=0.47%
  lat (msec)   : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.02%
  cpu          : usr=0.02%, sys=2.36%, ctx=396763, majf=0, minf=809
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,396742,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=148MiB/s (155MB/s), 148MiB/s-148MiB/s (155MB/s-155MB/s), io=1550MiB (1625MB), run=10491-10491msec

Disk stats (read/write):
    dm-0: ios=0/396742, merge=0/0, ticks=0/358015, in_queue=358015, util=79.06%, aggrios=0/395179, aggrmerge=0/1537, aggrticks=0/361835, aggrin_queue=288639, aggrutil=75.40%
  sda: ios=0/395179, merge=0/1537, ticks=0/361835, in_queue=288639, util=75.40%

シーケンシャルライト DRBD PROTOCOL A ext4

[root@centos1 /]# fio -filename=/share/benchmark2 -direct=1 -rw=write -bs=4k -size=512M -numjobs=64 -runtime=10 -group_reporting -name=file1
file1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.7
Starting 64 processes

Jobs: 64 (f=64): [W(64)][27.3%][r=0KiB/s,w=14.7MiB/s][r=0,w=3765 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][36.4%][r=0KiB/s,w=21.1MiB/s][r=0,w=5404 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][45.5%][r=0KiB/s,w=8677KiB/s][r=0,w=2169 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][50.0%][r=0KiB/s,w=8705KiB/s][r=0,w=2176 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][60.0%][r=0KiB/s,w=28.0MiB/s][r=0,w=7416 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][70.0%][r=0KiB/s,w=11.5MiB/s][r=0,w=2947 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][81.8%][r=0KiB/s,w=4296KiB/s][r=0,w=1074 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][90.9%][r=0KiB/s,w=6838KiB/s][r=0,w=1709 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][100.0%][r=0KiB/s,w=7290KiB/s][r=0,w=1822 IOPS][eta 00m:00s]
file1: (groupid=0, jobs=64): err= 0: pid=5312: Thu Oct  8 18:00:35 2020
  write: IOPS=3194, BW=12.5MiB/s (13.1MB/s)(125MiB/10021msec)
    clat (usec): min=54, max=567158, avg=20013.42, stdev=57528.75
     lat (usec): min=54, max=567158, avg=20013.66, stdev=57528.77
    clat percentiles (usec):
     |  1.00th=[    71],  5.00th=[    78], 10.00th=[    83], 20.00th=[    97],
     | 30.00th=[   124], 40.00th=[   153], 50.00th=[ 14222], 60.00th=[ 15533],
     | 70.00th=[ 16319], 80.00th=[ 22676], 90.00th=[ 39060], 95.00th=[ 70779],
     | 99.00th=[337642], 99.50th=[530580], 99.90th=[557843], 99.95th=[557843],
     | 99.99th=[566232]
   bw (  KiB/s): min=    8, max=  568, per=1.61%, avg=205.22, stdev=146.58, samples=1233
   iops        : min=    2, max=  142, avg=51.07, stdev=36.75, samples=1233
  lat (usec)   : 100=21.03%, 250=26.99%, 500=0.52%, 750=0.05%, 1000=0.01%
  lat (msec)   : 2=0.03%, 4=0.02%, 10=0.04%, 20=29.45%, 50=14.27%
  lat (msec)   : 100=5.57%, 250=0.82%, 500=0.20%, 750=1.00%
  cpu          : usr=0.01%, sys=0.76%, ctx=64572, majf=0, minf=761
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,32014,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=12.5MiB/s (13.1MB/s), 12.5MiB/s-12.5MiB/s (13.1MB/s-13.1MB/s), io=125MiB (131MB), run=10021-10021msec

Disk stats (read/write):
    drbd0: ios=1/31924, merge=0/0, ticks=0/2971, in_queue=2971, util=46.29%, aggrios=1/32026, aggrmerge=0/0, aggrticks=0/2398, aggrin_queue=2398, aggrutil=45.70%
    dm-2: ios=1/32026, merge=0/0, ticks=0/2398, in_queue=2398, util=45.70%, aggrios=1/32021, aggrmerge=0/5, aggrticks=0/2458, aggrin_queue=59, aggrutil=45.70%
  sdb: ios=1/32021, merge=0/5, ticks=0/2458, in_queue=59, util=45.70%

シーケンシャルライト DRBD PROTOCOL C ext4

[root@centos1 /]# fio -filename=/share/benchmark2 -direct=1 -rw=write -bs=4k -size=1G -numjobs=64 -runtime=10 -group_reporting -name=file1
file1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.7
Starting 64 processes
file1: Laying out IO file (1 file / 1024MiB)

Jobs: 64 (f=64): [W(64)][30.0%][r=0KiB/s,w=10.7MiB/s][r=0,w=2726 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][40.0%][r=0KiB/s,w=11.0MiB/s][r=0,w=2825 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][54.5%][r=0KiB/s,w=6895KiB/s][r=0,w=1723 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][63.6%][r=0KiB/s,w=6174KiB/s][r=0,w=1543 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][72.7%][r=0KiB/s,w=6140KiB/s][r=0,w=1535 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][81.8%][r=0KiB/s,w=4412KiB/s][r=0,w=1103 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][90.9%][r=0KiB/s,w=5494KiB/s][r=0,w=1373 IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][100.0%][r=0KiB/s,w=5499KiB/s][r=0,w=1374 IOPS][eta 00m:00s]
file1: (groupid=0, jobs=64): err= 0: pid=5133: Thu Oct  8 17:52:02 2020
  write: IOPS=1809, BW=7238KiB/s (7411kB/s)(70.9MiB/10028msec)
    clat (usec): min=238, max=167893, avg=35309.35, stdev=40145.12
     lat (usec): min=238, max=167893, avg=35309.55, stdev=40145.12
    clat percentiles (usec):
     |  1.00th=[   277],  5.00th=[   297], 10.00th=[   310], 20.00th=[   326],
     | 30.00th=[   347], 40.00th=[   400], 50.00th=[ 39060], 60.00th=[ 41157],
     | 70.00th=[ 50594], 80.00th=[ 78119], 90.00th=[ 95945], 95.00th=[108528],
     | 99.00th=[139461], 99.50th=[147850], 99.90th=[164627], 99.95th=[166724],
     | 99.99th=[166724]
   bw (  KiB/s): min=   39, max=  208, per=1.56%, avg=112.94, stdev=45.49, samples=1278
   iops        : min=    9, max=   52, avg=28.15, stdev=11.40, samples=1278
  lat (usec)   : 250=0.04%, 500=45.24%, 750=3.55%, 1000=0.14%
  lat (msec)   : 2=0.15%, 4=0.06%, 10=0.09%, 20=0.05%, 50=20.03%
  lat (msec)   : 100=22.97%, 250=7.68%
  cpu          : usr=0.01%, sys=0.62%, ctx=36442, majf=0, minf=718
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,18145,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=7238KiB/s (7411kB/s), 7238KiB/s-7238KiB/s (7411kB/s-7411kB/s), io=70.9MiB (74.3MB), run=10028-10028msec

Disk stats (read/write):
    drbd0: ios=0/17875, merge=0/0, ticks=0/6082, in_queue=6082, util=71.37%, aggrios=0/18190, aggrmerge=0/0, aggrticks=0/1589, aggrin_queue=1589, aggrutil=70.21%
    dm-2: ios=0/18190, merge=0/0, ticks=0/1589, in_queue=1589, util=70.21%, aggrios=0/18155, aggrmerge=0/35, aggrticks=0/1441, aggrin_queue=54, aggrutil=70.21%
  sdb: ios=0/18155, merge=0/35, ticks=0/1441, in_queue=54, util=70.21%
[root@centos1 /]#

シーケンシャルライト DRBD PROTOCOL C xfs

[root@centos1 share]# fio -filename=/share/benchmark2 -direct=1 -rw=write -bs=4k -size=512M -numjobs=64 -runtime=10 -group_reporting -name=file1
file1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.7
Starting 64 processes
file1: Laying out IO file (1 file / 512MiB)

Jobs: 64 (f=64): [W(64)][30.0%][r=0KiB/s,w=63.6MiB/s][r=0,w=16.3k IOPS][eta 00m:
Jobs: 64 (f=64): [W(64)][40.0%][r=0KiB/s,w=64.0MiB/s][r=0,w=16.4k IOPS][eta 00m:
Jobs: 64 (f=64): [W(64)][50.0%][r=0KiB/s,w=65.9MiB/s][r=0,w=16.9k IOPS][eta 00m:
Jobs: 64 (f=64): [W(64)][60.0%][r=0KiB/s,w=63.6MiB/s][r=0,w=16.3k IOPS][eta 00m:
Jobs: 64 (f=64): [W(64)][70.0%][r=0KiB/s,w=63.1MiB/s][r=0,w=16.1k IOPS][eta 00m:
Jobs: 64 (f=64): [W(64)][80.0%][r=0KiB/s,w=61.4MiB/s][r=0,w=15.7k IOPS][eta 00m:
Jobs: 64 (f=64): [W(64)][90.0%][r=0KiB/s,w=65.3MiB/s][r=0,w=16.7k IOPS][eta 00m:
Jobs: 64 (f=64): [W(64)][100.0%][r=0KiB/s,w=63.2MiB/s][r=0,w=16.2k IOPS][eta 00m:00s]
file1: (groupid=0, jobs=64): err= 0: pid=69958: Fri Oct  9 16:10:15 2020
  write: IOPS=16.2k, BW=63.4MiB/s (66.5MB/s)(635MiB/10007msec)
    clat (usec): min=340, max=107156, avg=3936.31, stdev=1842.69
     lat (usec): min=340, max=107156, avg=3936.63, stdev=1842.68
    clat percentiles (usec):
     |  1.00th=[ 1991],  5.00th=[ 2442], 10.00th=[ 2704], 20.00th=[ 3032],
     | 30.00th=[ 3294], 40.00th=[ 3556], 50.00th=[ 3785], 60.00th=[ 4047],
     | 70.00th=[ 4293], 80.00th=[ 4555], 90.00th=[ 4948], 95.00th=[ 5473],
     | 99.00th=[ 8586], 99.50th=[13042], 99.90th=[27132], 99.95th=[31589],
     | 99.99th=[67634]
   bw (  KiB/s): min=  712, max= 1440, per=1.56%, avg=1015.03, stdev=52.44, samples=1271
   iops        : min=  178, max=  360, avg=253.70, stdev=13.13, samples=1271
  lat (usec)   : 500=0.01%, 750=0.01%, 1000=0.03%
  lat (msec)   : 2=1.01%, 4=57.59%, 10=40.57%, 20=0.58%, 50=0.20%
  lat (msec)   : 100=0.01%, 250=0.01%
  cpu          : usr=0.04%, sys=1.39%, ctx=322624, majf=0, minf=570
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,162525,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=63.4MiB/s (66.5MB/s), 63.4MiB/s-63.4MiB/s (66.5MB/s-66.5MB/s), io=635MiB (666MB), run=10007-10007msec

Disk stats (read/write):
    drbd0: ios=0/160667, merge=0/0, ticks=0/610046, in_queue=610046, util=95.81%, aggrios=0/162529, aggrmerge=0/0, aggrticks=0/24455, aggrin_queue=24455, aggrutil=95.48%
    dm-2: ios=0/162529, merge=0/0, ticks=0/24455, in_queue=24455, util=95.48%, aggrios=0/162093, aggrmerge=0/362, aggrticks=0/21962, aggrin_queue=5331, aggrutil=95.49%
  sdb: ios=0/162093, merge=0/362, ticks=0/21962, in_queue=5331, util=95.49%

シーケンシャルライト DRBD PROTOCOL A xfs

[root@centos1 share]# fio -filename=/share/benchmark2 -direct=1 -rw=write -bs=4k -size=512M -numjobs=64 -runtime=10 -group_reporting -name=file1
file1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.7
Starting 64 processes

Jobs: 64 (f=64): [W(64)][30.0%][r=0KiB/s,w=113MiB/s][r=0,w=28.9k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][40.0%][r=0KiB/s,w=113MiB/s][r=0,w=28.9k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][50.0%][r=0KiB/s,w=112MiB/s][r=0,w=28.6k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][60.0%][r=0KiB/s,w=111MiB/s][r=0,w=28.5k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][70.0%][r=0KiB/s,w=107MiB/s][r=0,w=27.4k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][80.0%][r=0KiB/s,w=109MiB/s][r=0,w=27.9k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][90.0%][r=0KiB/s,w=109MiB/s][r=0,w=27.0k IOPS][eta 00m:0
Jobs: 64 (f=64): [W(64)][100.0%][r=0KiB/s,w=109MiB/s][r=0,w=27.9k IOPS][eta 00m:00s]
file1: (groupid=0, jobs=64): err= 0: pid=70115: Fri Oct  9 16:11:42 2020
  write: IOPS=28.2k, BW=110MiB/s (115MB/s)(1101MiB/10008msec)
    clat (usec): min=81, max=65167, avg=2267.34, stdev=1453.24
     lat (usec): min=81, max=65168, avg=2267.59, stdev=1453.24
    clat percentiles (usec):
     |  1.00th=[  857],  5.00th=[ 1237], 10.00th=[ 1385], 20.00th=[ 1549],
     | 30.00th=[ 1663], 40.00th=[ 1778], 50.00th=[ 1893], 60.00th=[ 2057],
     | 70.00th=[ 2311], 80.00th=[ 2671], 90.00th=[ 3326], 95.00th=[ 4293],
     | 99.00th=[ 7570], 99.50th=[11338], 99.90th=[17957], 99.95th=[20317],
     | 99.99th=[22676]
   bw (  KiB/s): min= 1184, max= 2227, per=1.56%, avg=1761.55, stdev=128.67, samples=1270
   iops        : min=  296, max=  556, avg=440.39, stdev=32.16, samples=1270
  lat (usec)   : 100=0.01%, 250=0.09%, 500=0.22%, 750=0.39%, 1000=0.98%
  lat (msec)   : 2=54.94%, 4=37.38%, 10=5.38%, 20=0.56%, 50=0.05%
  lat (msec)   : 100=0.01%
  cpu          : usr=0.06%, sys=2.65%, ctx=434663, majf=0, minf=629
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,281964,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=110MiB/s (115MB/s), 110MiB/s-110MiB/s (115MB/s-115MB/s), io=1101MiB (1155MB), run=10008-10008msec

Disk stats (read/write):
    drbd0: ios=0/278192, merge=0/0, ticks=0/545442, in_queue=545442, util=91.65%, aggrios=0/281968, aggrmerge=0/0, aggrticks=0/42690, aggrin_queue=42690, aggrutil=91.71%
    dm-2: ios=0/281968, merge=0/0, ticks=0/42690, in_queue=42690, util=91.71%, aggrios=0/281538, aggrmerge=0/376, aggrticks=0/41970, aggrin_queue=12313, aggrutil=91.70%
  sdb: ios=0/281538, merge=0/376, ticks=0/41970, in_queue=12313, util=91.70%

結果まとめ

  • シーケンシャルライト 512MB
    • ローカル xfs:155 MB/s
    • DRBD PROTOCOL C ext4:7.2 MB/s
    • DRBD PROTOCOL A ext4:13.1 MB/s
    • DRBD PROTOCOL C xfs:66.5 MB/s
    • DRBD PROTOCOL A xfs:115 MB/s

DRBDで利用するファイルシステムはext4ではなくxfsを利用すること。

昨今コロナ禍で人々の密な状態を避ける為の対策が重要視されることとなりました。
例えば店舗運営において、お客様からみると空いているようであれば来店したいという要望があり、お店側からすると少しでもお客様を入れたいというご希望があるかと考えます。
大きな費用や手間を掛けず、お客様のスマートフォンやPC、デジタルサイネージなどで混雑状況をリアルタイムでご案内することで、お店側にとってもお客様にとってもより最適なご来店・集客が行えることを目的としたソフトウェアです。