[DRBD-user] Fast write performance on backing device, slow write Performance on DRBD

Tom Fernandes anyaddress at gmx.net
Tue Dec 18 10:58:55 CET 2012

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hello everybody,

I get around 430 MB/s write performance on the backing device and only 60 MB/s 
on DRBD. The DRBD-link is 2xGigabit in rr-bonding back-to-back and iperf shows 
1.98 Gbits/sec throughput.

We have a second cluster with similar hardware and the same software 
configuration. I/O on the backing device and Network performance is similar on 
both clusters, but writes on the DRBD-partition of the other cluster go at 
200MB/s. That is the maximum performance of the network link - which makes 
sense.

I tried different settings for the NICs (rx, tx, sg, tso, gso, gro) to 
increase performance. As changing those settings didn't make any great 
difference I set them back to the default settings. I also tried switching the 
e1000e cards with igb cards and to set the NIC settings as equal as possible 
as the ones on the fast cluster. No real speed difference. Performance also 
does not change whether I use two NICs in rr-bonding or just a single link. It 
stays at around 60 MB/s.

Sebastian Riemer guided me through tracing the IOs in the blkio layer. IOs 
enter the backing device and the DRBD partition as 128 KiB. The stripe size of 
the underlying RAID 6 is 256 KB - I'm not sure if this is a problem. The 
controller supports either 256 KB or 64 KB stripes. I'd rather not install the 
two machines new - but if you guys think it makes sense to try with a 64 KB 
strip-size I'll do it :-) .
Sebastian was wondering about not seeing completions of the IOs in the DRBD-
blktrace, which seem to be needed for DRBD to send new data eventually (when 
using protocol C). The reason for that may be the latency on my ethernet 
connection. I hope I quoted Sebastian correctly - thanks so far for the help! 
I also tried with protocol A, but got the same performance results. 

MTU is 9000
protocol C
drbd-utils 8.3.13
kernel: 3.2.32
OS and all software-versions are stock debian-wheezy

The above speed-values have been produced like suggested on
	http://www.drbd.org/users-guide-8.3/ch-benchmark.html

Below there are settings from DRBD, the RAID controller the output of ethtool 
for one of the physical bonding devices (they are all 4 the same) and the 
output of the blktrace for the DRBD-partition and for the backing-device.

warm regards,


Tom


------------------------------- DRBD -----------------------------------------
tom at hydra04 [1526]:~$ sudo drbdadm dump
# /etc/drbd.conf
common {                                                                                                                                        
    protocol               C;                                                                                                                   
    syncer {
        rate             150M;
    }
}

# resource leela on hydra04: not ignored, not stacked
resource leela {
    on hydra04 {
        device           minor 0;
        disk             /dev/vg0/leela;
        address          ipv4 10.0.0.1:7788;
        meta-disk        internal;
    }
    on hydra05 {
        device           minor 0;
        disk             /dev/vg0/leela;
        address          ipv4 10.0.0.2:7788;
        meta-disk        internal;
    }
}

[...]

------------------------------- RAID -----------------------------------------
tom at hydra04 [1527]:~$ sudo tw_cli /c0 show all
/c0 Driver Version = 3.26.02.000
/c0 Model = 9750-8i
/c0 Available Memory = 488MB
/c0 Firmware Version = FH9X 5.12.00.007
/c0 Bios Version = BE9X 5.11.00.006
/c0 Boot Loader Version = BT9X 6.00.00.004
/c0 Serial Number = SV22906335
/c0 PCB Version = Rev 001
/c0 PCHIP Version = B4
/c0 ACHIP Version = 05000e00
/c0 Controller Phys = 8
/c0 Connections = 6 of 128
/c0 Drives = 6 of 127
/c0 Units = 1 of 127
/c0 Active Drives = 6 of 127
/c0 Active Units = 1 of 32
/c0 Max Drives Per Unit = 32
/c0 Total Optimal Units = 1
/c0 Not Optimal Units = 0 
/c0 Disk Spinup Policy = 1
/c0 Spinup Stagger Time Policy (sec) = 1
/c0 Auto-Carving Policy = off
/c0 Auto-Carving Size = 2048 GB
/c0 Auto-Rebuild Policy = on
/c0 Rebuild Mode = Adaptive
/c0 Rebuild Rate = 1
/c0 Verify Mode = Adaptive
/c0 Verify Rate = 1
/c0 Controller Bus Type = PCIe
/c0 Controller Bus Width = 8 lanes
/c0 Controller Bus Speed = 5.0 Gbps/lane

Unit  UnitType  Status         %RCmpl  %V/I/M  Stripe  Size(GB)  Cache  AVrfy
------------------------------------------------------------------------------
u0    RAID-6    OK             -       -       256K    1862.61   RiW    ON     

VPort Status         Unit Size      Type  Phy Encl-Slot    Model
------------------------------------------------------------------------------
p0    OK             u0   465.76 GB SAS   0   -            SEAGATE ST500NM0001 
p1    OK             u0   465.76 GB SAS   1   -            SEAGATE ST500NM0001 
p2    OK             u0   465.76 GB SAS   2   -            SEAGATE ST500NM0001 
p3    OK             u0   465.76 GB SAS   3   -            SEAGATE ST500NM0001 
p4    OK             u0   465.76 GB SAS   4   -            SEAGATE ST500NM0001 
p5    OK             u0   465.76 GB SAS   5   -            SEAGATE ST500NM0001 


----------------------------- ethtool ---------------------------------------
tom at hydra04 [1528]:~$ sudo ethtool -k eth5
Features for eth5:
rx-checksumming: on
tx-checksumming: on
        tx-checksum-ipv4: off [fixed]
        tx-checksum-unneeded: off [fixed]
        tx-checksum-ip-generic: on
        tx-checksum-ipv6: off [fixed]
        tx-checksum-fcoe-crc: off [fixed]
        tx-checksum-sctp: off [fixed]
scatter-gather: on
        tx-scatter-gather: on
        tx-scatter-gather-fraglist: off [fixed]
tcp-segmentation-offload: on
        tx-tcp-segmentation: on
        tx-tcp-ecn-segmentation: off [fixed]
        tx-tcp6-segmentation: on
udp-fragmentation-offload: off [fixed]
generic-segmentation-offload: on
generic-receive-offload: on
large-receive-offload: off [fixed]
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off [fixed]
receive-hashing: off [fixed]
highdma: on [fixed]
rx-vlan-filter: on [fixed]
vlan-challenged: off [fixed]
tx-lockless: off [fixed]
netns-local: off [fixed]
tx-gso-robust: off [fixed]
tx-fcoe-segmentation: off [fixed]
fcoe-mtu: off [fixed]
tx-nocache-copy: on
loopback: off [fixed]

----------------------- blkparse on DRBD ---------------------------------
tom at hydra04 [1642]:~/blkparse_drbd5_drbd$ sudo kill -2 $pid
tom at hydra04 [1643]:~/blkparse_drbd5_drbd$ === drbd5 ===
  CPU  0:                   82 events,        4 KiB data
  CPU  1:                    0 events,        0 KiB data
  CPU  2:                    0 events,        0 KiB data
  CPU  3:                    0 events,        0 KiB data
  CPU  4:                    0 events,        0 KiB data
  CPU  5:                    0 events,        0 KiB data
  CPU  6:                    0 events,        0 KiB data
  CPU  7:                    0 events,        0 KiB data
  CPU  8:                    1 events,        1 KiB data
  CPU  9:                    0 events,        0 KiB data
  CPU 10:                    0 events,        0 KiB data
  CPU 11:                    0 events,        0 KiB data
  CPU 12:                    0 events,        0 KiB data
  CPU 13:                    0 events,        0 KiB data
  CPU 14:                    2 events,        1 KiB data
  CPU 15:                    0 events,        0 KiB data
  CPU 16:                    0 events,        0 KiB data
  CPU 17:                    0 events,        0 KiB data
  CPU 18:                  401 events,       19 KiB data
  CPU 19:                    0 events,        0 KiB data
  CPU 20:                    0 events,        0 KiB data
  CPU 21:                    0 events,        0 KiB data
  CPU 22:                    0 events,        0 KiB data
  CPU 23:                    0 events,        0 KiB data
  Total:                   486 events (dropped 0),       23 KiB data

[1]+  Done                    sudo blktrace /dev/drbd/by-res/test-io -b 4096
tom at hydra04 [1643]:~/blkparse_drbd5_drbd$ blkparse drbd5
Input file drbd5.blktrace.0 added
Input file drbd5.blktrace.8 added
Input file drbd5.blktrace.14 added
Input file drbd5.blktrace.18 added
147,5   18        1     0.000000000 26951  Q  WS 0 + 256 [dd]
147,5   18        2     0.028636737 26951  Q  WS 256 + 256 [dd]
147,5   18        3     0.028670426 26951  Q  WS 512 + 256 [dd]
147,5   18        4     0.028720133 26951  Q  WS 768 + 256 [dd]
147,5   18        5     0.028757754 26951  Q  WS 1024 + 256 [dd]
147,5   18        6     0.028804979 26951  Q  WS 1280 + 256 [dd]
147,5   18        7     0.028851599 26951  Q  WS 1536 + 256 [dd]
147,5   18        8     0.028897784 26951  Q  WS 1792 + 256 [dd]
147,5   18        9     0.034684496 26951  Q  WS 2048 + 256 [dd]
147,5   18       10     0.034755094 26951  Q  WS 2304 + 256 [dd]
147,5   18       11     0.034785027 26951  Q  WS 2560 + 256 [dd]
147,5   18       12     0.034838159 26951  Q  WS 2816 + 256 [dd]
147,5   18       13     0.034880271 26951  Q  WS 3072 + 256 [dd]
147,5   18       14     0.034929120 26951  Q  WS 3328 + 256 [dd]
147,5   18       15     0.034969795 26951  Q  WS 3584 + 256 [dd]
147,5   18       16     0.035010407 26951  Q  WS 3840 + 256 [dd]
147,5   18       17     0.063282029 26951  Q  WS 4096 + 256 [dd]
147,5   18       18     0.063330644 26951  Q  WS 4352 + 256 [dd]
147,5   18       19     0.063349745 26951  Q  WS 4608 + 256 [dd]
147,5   18       20     0.063377596 26951  Q  WS 4864 + 256 [dd]
147,5   18       21     0.063409997 26951  Q  WS 5120 + 256 [dd]
147,5   18       22     0.063441861 26951  Q  WS 5376 + 256 [dd]
147,5   18       23     0.063463354 26951  Q  WS 5632 + 256 [dd]
147,5   18       24     0.063489991 26951  Q  WS 5888 + 256 [dd]
147,5   18       25     0.093518707 26951  Q  WS 6144 + 256 [dd]
147,5   18       26     0.093559935 26951  Q  WS 6400 + 256 [dd]
147,5   18       27     0.093578087 26951  Q  WS 6656 + 256 [dd]
147,5   18       28     0.093606978 26951  Q  WS 6912 + 256 [dd]
147,5   18       29     0.093627421 26951  Q  WS 7168 + 256 [dd]
147,5   18       30     0.093655470 26951  Q  WS 7424 + 256 [dd]
147,5   18       31     0.093704305 26951  Q  WS 7680 + 256 [dd]
147,5   18       32     0.093731645 26951  Q  WS 7936 + 256 [dd]
147,5   18       33     0.123438099 26951  Q  WS 8192 + 256 [dd]
147,5   18       34     0.166062805 26951  Q  WS 8448 + 256 [dd]
147,5   18       35     0.166082476 26951  Q  WS 8704 + 256 [dd]
147,5   18       36     0.166111341 26951  Q  WS 8960 + 256 [dd]
147,5   18       37     0.166133112 26951  Q  WS 9216 + 256 [dd]
147,5   18       38     0.166160129 26951  Q  WS 9472 + 256 [dd]
147,5   18       39     0.166181687 26951  Q  WS 9728 + 256 [dd]
147,5   18       40     0.166210929 26951  Q  WS 9984 + 256 [dd]
147,5   18       41     0.171620768 26951  Q  WS 10240 + 256 [dd]
147,5   18       42     0.171663883 26951  Q  WS 10496 + 256 [dd]
147,5   18       43     0.171683989 26951  Q  WS 10752 + 256 [dd]
147,5   18       44     0.171713557 26951  Q  WS 11008 + 256 [dd]
147,5   18       45     0.171739481 26951  Q  WS 11264 + 256 [dd]
147,5   18       46     0.171772969 26951  Q  WS 11520 + 256 [dd]
147,5   18       47     0.171795109 26951  Q  WS 11776 + 256 [dd]
147,5   18       48     0.171820879 26951  Q  WS 12032 + 256 [dd]
147,5   18       49     0.203360809 26951  Q  WS 12288 + 256 [dd]
147,5   18       50     0.203402076 26951  Q  WS 12544 + 256 [dd]
147,5   18       51     0.203421922 26951  Q  WS 12800 + 256 [dd]
147,5   18       52     0.203452924 26951  Q  WS 13056 + 256 [dd]
147,5   18       53     0.203472345 26951  Q  WS 13312 + 256 [dd]
147,5   18       54     0.203502347 26951  Q  WS 13568 + 256 [dd]
147,5   18       55     0.203529001 26951  Q  WS 13824 + 256 [dd]
147,5   18       56     0.203549501 26951  Q  WS 14080 + 256 [dd]
147,5   18       57     0.233523429 26951  Q  WS 14336 + 256 [dd]
147,5   18       58     0.233564584 26951  Q  WS 14592 + 256 [dd]
147,5   18       59     0.233586718 26951  Q  WS 14848 + 256 [dd]
147,5   18       60     0.233614378 26951  Q  WS 15104 + 256 [dd]
147,5   18       61     0.233633285 26951  Q  WS 15360 + 256 [dd]
147,5   18       62     0.233689078 26951  Q  WS 15616 + 256 [dd]
147,5   18       63     0.233714502 26951  Q  WS 15872 + 256 [dd]
147,5   18       64     0.233740403 26951  Q  WS 16128 + 256 [dd]
147,5   18       65     0.263396091 26951  Q  WS 16384 + 256 [dd]
147,5   18       66     0.316045055 26951  Q  WS 16640 + 256 [dd]
147,5   18       67     0.316068337 26951  Q  WS 16896 + 256 [dd]
147,5   18       68     0.316105101 26951  Q  WS 17152 + 256 [dd]
147,5   18       69     0.316131743 26951  Q  WS 17408 + 256 [dd]
147,5   18       70     0.316188424 26951  Q  WS 17664 + 256 [dd]
147,5   18       71     0.316226909 26951  Q  WS 17920 + 256 [dd]
147,5   18       72     0.316257584 26951  Q  WS 18176 + 256 [dd]
147,5   18       73     0.321706119 26951  Q  WS 18432 + 256 [dd]
147,5   18       74     0.321781354 26951  Q  WS 18688 + 256 [dd]
147,5   18       75     0.321808627 26951  Q  WS 18944 + 256 [dd]
147,5   18       76     0.321863888 26951  Q  WS 19200 + 256 [dd]
147,5   18       77     0.321907634 26951  Q  WS 19456 + 256 [dd]
147,5   18       78     0.321969344 26951  Q  WS 19712 + 256 [dd]
147,5   18       79     0.322006347 26951  Q  WS 19968 + 256 [dd]
147,5   18       80     0.322053237 26951  Q  WS 20224 + 256 [dd]
147,5   18       81     0.353428364 26951  Q  WS 20480 + 256 [dd]
147,5   18       82     0.353492203 26951  Q  WS 20736 + 256 [dd]
147,5   18       83     0.353521150 26951  Q  WS 20992 + 256 [dd]
147,5   18       84     0.353575675 26951  Q  WS 21248 + 256 [dd]
147,5   18       85     0.353616424 26951  Q  WS 21504 + 256 [dd]
147,5   18       86     0.353702226 26951  Q  WS 21760 + 256 [dd]
147,5   18       87     0.353749001 26951  Q  WS 22016 + 256 [dd]
147,5   18       88     0.353773416 26951  Q  WS 22272 + 256 [dd]
147,5   18       89     0.383362598 26951  Q  WS 22528 + 256 [dd]
147,5   18       90     0.383404170 26951  Q  WS 22784 + 256 [dd]
147,5   18       91     0.383423219 26951  Q  WS 23040 + 256 [dd]
147,5   18       92     0.383449765 26951  Q  WS 23296 + 256 [dd]
147,5   18       93     0.383470983 26951  Q  WS 23552 + 256 [dd]
147,5   18       94     0.383498408 26951  Q  WS 23808 + 256 [dd]
147,5   18       95     0.383527303 26951  Q  WS 24064 + 256 [dd]
147,5   18       96     0.383548103 26951  Q  WS 24320 + 256 [dd]
147,5   18       97     0.413252609 26951  Q  WS 24576 + 256 [dd]
147,5   18       98     0.486831996 26951  Q  WS 24832 + 256 [dd]
147,5   18       99     0.486850135 26951  Q  WS 25088 + 256 [dd]
147,5   18      100     0.486875404 26951  Q  WS 25344 + 256 [dd]
147,5   18      101     0.486894740 26951  Q  WS 25600 + 256 [dd]
147,5   18      102     0.486921660 26951  Q  WS 25856 + 256 [dd]
147,5   18      103     0.486940444 26951  Q  WS 26112 + 256 [dd]
147,5   18      104     0.486958691 26951  Q  WS 26368 + 256 [dd]
147,5   18      105     0.492394406 26951  Q  WS 26624 + 256 [dd]
147,5   18      106     0.492434497 26951  Q  WS 26880 + 256 [dd]
147,5   18      107     0.492456528 26951  Q  WS 27136 + 256 [dd]
147,5   18      108     0.492483439 26951  Q  WS 27392 + 256 [dd]
147,5   18      109     0.492511347 26951  Q  WS 27648 + 256 [dd]
147,5   18      110     0.492539780 26951  Q  WS 27904 + 256 [dd]
147,5   18      111     0.492564637 26951  Q  WS 28160 + 256 [dd]
147,5   18      112     0.492590599 26951  Q  WS 28416 + 256 [dd]
147,5   18      113     0.523345442 26951  Q  WS 28672 + 256 [dd]
147,5   18      114     0.523390514 26951  Q  WS 28928 + 256 [dd]
147,5   18      115     0.523409836 26951  Q  WS 29184 + 256 [dd]
147,5   18      116     0.523438084 26951  Q  WS 29440 + 256 [dd]
147,5   18      117     0.523459424 26951  Q  WS 29696 + 256 [dd]
147,5   18      118     0.523485371 26951  Q  WS 29952 + 256 [dd]
147,5   18      119     0.523521199 26951  Q  WS 30208 + 256 [dd]
147,5   18      120     0.523544580 26951  Q  WS 30464 + 256 [dd]
147,5   18      121     0.553418312 26951  Q  WS 30720 + 256 [dd]
147,5   18      122     0.553461723 26951  Q  WS 30976 + 256 [dd]
147,5   18      123     0.553481242 26951  Q  WS 31232 + 256 [dd]
147,5   18      124     0.553506744 26951  Q  WS 31488 + 256 [dd]
147,5   18      125     0.553524910 26951  Q  WS 31744 + 256 [dd]
147,5   18      126     0.553550357 26951  Q  WS 32000 + 256 [dd]
147,5   18      127     0.553583811 26951  Q  WS 32256 + 256 [dd]
147,5   18      128     0.553606671 26951  Q  WS 32512 + 256 [dd]
147,5   18      129     0.583406748 26951  Q  WS 32768 + 256 [dd]
147,5   18      130     0.624274712 26951  Q  WS 33024 + 256 [dd]
147,5   18      131     0.624292929 26951  Q  WS 33280 + 256 [dd]
147,5   18      132     0.624318355 26951  Q  WS 33536 + 256 [dd]
147,5   18      133     0.624338121 26951  Q  WS 33792 + 256 [dd]
147,5   18      134     0.624364568 26951  Q  WS 34048 + 256 [dd]
147,5   18      135     0.624383338 26951  Q  WS 34304 + 256 [dd]
147,5   18      136     0.624402494 26951  Q  WS 34560 + 256 [dd]
147,5   18      137     0.629741829 26951  Q  WS 34816 + 256 [dd]
147,5   18      138     0.629805146 26951  Q  WS 35072 + 256 [dd]
147,5   18      139     0.629834163 26951  Q  WS 35328 + 256 [dd]
147,5   18      140     0.629870465 26951  Q  WS 35584 + 256 [dd]
147,5   18      141     0.629918291 26951  Q  WS 35840 + 256 [dd]
147,5   18      142     0.629969656 26951  Q  WS 36096 + 256 [dd]
147,5   18      143     0.630009593 26951  Q  WS 36352 + 256 [dd]
147,5   18      144     0.630039221 26951  Q  WS 36608 + 256 [dd]
147,5   18      145     0.653545094 26951  Q  WS 36864 + 256 [dd]
147,5   18      146     0.653608197 26951  Q  WS 37120 + 256 [dd]
147,5   18      147     0.653639439 26951  Q  WS 37376 + 256 [dd]
147,5   18      148     0.653716754 26951  Q  WS 37632 + 256 [dd]
147,5   18      149     0.653762276 26951  Q  WS 37888 + 256 [dd]
147,5   18      150     0.653789012 26951  Q  WS 38144 + 256 [dd]
147,5   18      151     0.653817154 26951  Q  WS 38400 + 256 [dd]
147,5   18      152     0.653836243 26951  Q  WS 38656 + 256 [dd]
147,5   18      153     0.683404087 26951  Q  WS 38912 + 256 [dd]
147,5   18      154     0.683445202 26951  Q  WS 39168 + 256 [dd]
147,5   18      155     0.683464124 26951  Q  WS 39424 + 256 [dd]
147,5   18      156     0.683490459 26951  Q  WS 39680 + 256 [dd]
147,5   18      157     0.683510691 26951  Q  WS 39936 + 256 [dd]
147,5   18      158     0.683544818 26951  Q  WS 40192 + 256 [dd]
147,5   18      159     0.683568248 26951  Q  WS 40448 + 256 [dd]
147,5   18      160     0.683585908 26951  Q  WS 40704 + 256 [dd]
147,5   18      161     0.713444017 26951  Q  WS 40960 + 256 [dd]
147,5   18      162     0.753420605 26951  Q  WS 41216 + 256 [dd]
147,5   18      163     0.753440244 26951  Q  WS 41472 + 256 [dd]
147,5   18      164     0.753465364 26951  Q  WS 41728 + 256 [dd]
147,5   18      165     0.753484769 26951  Q  WS 41984 + 256 [dd]
147,5   18      166     0.753512407 26951  Q  WS 42240 + 256 [dd]
147,5   18      167     0.753532078 26951  Q  WS 42496 + 256 [dd]
147,5   18      168     0.753563871 26951  Q  WS 42752 + 256 [dd]
147,5   18      169     0.758696072 26951  Q  WS 43008 + 256 [dd]
147,5   18      170     0.758736838 26951  Q  WS 43264 + 256 [dd]
147,5   18      171     0.758755792 26951  Q  WS 43520 + 256 [dd]
147,5   18      172     0.758783389 26951  Q  WS 43776 + 256 [dd]
147,5   18      173     0.758813726 26951  Q  WS 44032 + 256 [dd]
147,5   18      174     0.758843035 26951  Q  WS 44288 + 256 [dd]
147,5   18      175     0.758862248 26951  Q  WS 44544 + 256 [dd]
147,5   18      176     0.758897508 26951  Q  WS 44800 + 256 [dd]
147,5   18      177     0.783489578 26951  Q  WS 45056 + 256 [dd]
147,5   18      178     0.783530745 26951  Q  WS 45312 + 256 [dd]
147,5   18      179     0.783551845 26951  Q  WS 45568 + 256 [dd]
147,5   18      180     0.783578687 26951  Q  WS 45824 + 256 [dd]
147,5   18      181     0.783597264 26951  Q  WS 46080 + 256 [dd]
147,5   18      182     0.783622821 26951  Q  WS 46336 + 256 [dd]
147,5   18      183     0.783651385 26951  Q  WS 46592 + 256 [dd]
147,5   18      184     0.783673755 26951  Q  WS 46848 + 256 [dd]
147,5   18      185     0.813475301 26951  Q  WS 47104 + 256 [dd]
147,5   18      186     0.813517074 26951  Q  WS 47360 + 256 [dd]
147,5   18      187     0.813536258 26951  Q  WS 47616 + 256 [dd]
147,5   18      188     0.813561755 26951  Q  WS 47872 + 256 [dd]
147,5   18      189     0.813580688 26951  Q  WS 48128 + 256 [dd]
147,5   18      190     0.813605495 26951  Q  WS 48384 + 256 [dd]
147,5   18      191     0.813641916 26951  Q  WS 48640 + 256 [dd]
147,5   18      192     0.813686161 26951  Q  WS 48896 + 256 [dd]
147,5   18      193     0.843438097 26951  Q  WS 49152 + 256 [dd]
147,5   18      194     0.886708359 26951  Q  WS 49408 + 256 [dd]
147,5   18      195     0.886733698 26951  Q  WS 49664 + 256 [dd]
147,5   18      196     0.886765589 26951  Q  WS 49920 + 256 [dd]
147,5   18      197     0.886790510 26951  Q  WS 50176 + 256 [dd]
147,5   18      198     0.886823203 26951  Q  WS 50432 + 256 [dd]
147,5   18      199     0.886858962 26951  Q  WS 50688 + 256 [dd]
147,5   18      200     0.886890340 26951  Q  WS 50944 + 256 [dd]
147,5   18      201     0.892248052 26951  Q  WS 51200 + 256 [dd]
147,5   18      202     0.892297957 26951  Q  WS 51456 + 256 [dd]
147,5   18      203     0.892321114 26951  Q  WS 51712 + 256 [dd]
147,5   18      204     0.892352741 26951  Q  WS 51968 + 256 [dd]
147,5   18      205     0.892386505 26951  Q  WS 52224 + 256 [dd]
147,5   18      206     0.892425047 26951  Q  WS 52480 + 256 [dd]
147,5   18      207     0.892455914 26951  Q  WS 52736 + 256 [dd]
147,5   18      208     0.892489842 26951  Q  WS 52992 + 256 [dd]
147,5   18      209     0.923435247 26951  Q  WS 53248 + 256 [dd]
147,5   18      210     0.923487414 26951  Q  WS 53504 + 256 [dd]
147,5   18      211     0.923511146 26951  Q  WS 53760 + 256 [dd]
147,5   18      212     0.923541120 26951  Q  WS 54016 + 256 [dd]
147,5   18      213     0.923576686 26951  Q  WS 54272 + 256 [dd]
147,5   18      214     0.923616979 26951  Q  WS 54528 + 256 [dd]
147,5   18      215     0.923649487 26951  Q  WS 54784 + 256 [dd]
147,5   18      216     0.923682578 26951  Q  WS 55040 + 256 [dd]
147,5   18      217     0.953466154 26951  Q  WS 55296 + 256 [dd]
147,5   18      218     0.953517228 26951  Q  WS 55552 + 256 [dd]
147,5   18      219     0.953539795 26951  Q  WS 55808 + 256 [dd]
147,5   18      220     0.953570162 26951  Q  WS 56064 + 256 [dd]
147,5   18      221     0.953592600 26951  Q  WS 56320 + 256 [dd]
147,5   18      222     0.953626346 26951  Q  WS 56576 + 256 [dd]
147,5   18      223     0.953659271 26951  Q  WS 56832 + 256 [dd]
147,5   18      224     0.953743875 26951  Q  WS 57088 + 256 [dd]
147,5   18      225     0.983496550 26951  Q  WS 57344 + 256 [dd]
147,5   18      226     1.024131125 26951  Q  WS 57600 + 256 [dd]
147,5   18      227     1.024159254 26951  Q  WS 57856 + 256 [dd]
147,5   18      228     1.024199795 26951  Q  WS 58112 + 256 [dd]
147,5   18      229     1.024230072 26951  Q  WS 58368 + 256 [dd]
147,5   18      230     1.024289603 26951  Q  WS 58624 + 256 [dd]
147,5   18      231     1.024329958 26951  Q  WS 58880 + 256 [dd]
147,5   18      232     1.024370193 26951  Q  WS 59136 + 256 [dd]
147,5   18      233     1.029763671 26951  Q  WS 59392 + 256 [dd]
147,5   18      234     1.029828672 26951  Q  WS 59648 + 256 [dd]
147,5   18      235     1.029856981 26951  Q  WS 59904 + 256 [dd]
147,5   18      236     1.029893991 26951  Q  WS 60160 + 256 [dd]
147,5   18      237     1.029938873 26951  Q  WS 60416 + 256 [dd]
147,5   18      238     1.029990743 26951  Q  WS 60672 + 256 [dd]
147,5   18      239     1.030023983 26951  Q  WS 60928 + 256 [dd]
147,5   18      240     1.030064535 26951  Q  WS 61184 + 256 [dd]
147,5   18      241     1.053404913 26951  Q  WS 61440 + 256 [dd]
147,5   18      242     1.053472681 26951  Q  WS 61696 + 256 [dd]
147,5   18      243     1.053503683 26951  Q  WS 61952 + 256 [dd]
147,5   18      244     1.053555970 26951  Q  WS 62208 + 256 [dd]
147,5   18      245     1.053596285 26951  Q  WS 62464 + 256 [dd]
147,5   18      246     1.053644277 26951  Q  WS 62720 + 256 [dd]
147,5   18      247     1.053711320 26951  Q  WS 62976 + 256 [dd]
147,5   18      248     1.053753744 26951  Q  WS 63232 + 256 [dd]
147,5   18      249     1.083578832 26951  Q  WS 63488 + 256 [dd]
147,5   18      250     1.083619696 26951  Q  WS 63744 + 256 [dd]
147,5   18      251     1.083638600 26951  Q  WS 64000 + 256 [dd]
147,5   18      252     1.083664341 26951  Q  WS 64256 + 256 [dd]
147,5   18      253     1.083682431 26951  Q  WS 64512 + 256 [dd]
147,5   18      254     1.083707205 26951  Q  WS 64768 + 256 [dd]
147,5   18      255     1.083733705 26951  Q  WS 65024 + 256 [dd]
147,5   18      256     1.083756607 26951  Q  WS 65280 + 256 [dd]
147,5   18      257     1.113501169 26951  Q  WS 65536 + 256 [dd]
147,5   18      258     1.153264627 26951  Q  WS 65792 + 256 [dd]
147,5   18      259     1.153284253 26951  Q  WS 66048 + 256 [dd]
147,5   18      260     1.153308333 26951  Q  WS 66304 + 256 [dd]
147,5   18      261     1.153325693 26951  Q  WS 66560 + 256 [dd]
147,5   18      262     1.153352031 26951  Q  WS 66816 + 256 [dd]
147,5   18      263     1.153371151 26951  Q  WS 67072 + 256 [dd]
147,5   18      264     1.153390587 26951  Q  WS 67328 + 256 [dd]
147,5   18      265     1.158506255 26951  Q  WS 67584 + 256 [dd]
147,5   18      266     1.158547707 26951  Q  WS 67840 + 256 [dd]
147,5   18      267     1.158568163 26951  Q  WS 68096 + 256 [dd]
147,5   18      268     1.158594832 26951  Q  WS 68352 + 256 [dd]
147,5   18      269     1.158621683 26951  Q  WS 68608 + 256 [dd]
147,5   18      270     1.158649485 26951  Q  WS 68864 + 256 [dd]
147,5   18      271     1.158673999 26951  Q  WS 69120 + 256 [dd]
147,5   18      272     1.158697599 26951  Q  WS 69376 + 256 [dd]
147,5   18      273     1.183500104 26951  Q  WS 69632 + 256 [dd]
147,5   18      274     1.183544546 26951  Q  WS 69888 + 256 [dd]
147,5   18      275     1.183573419 26951  Q  WS 70144 + 256 [dd]
147,5   18      276     1.183599952 26951  Q  WS 70400 + 256 [dd]
147,5   18      277     1.183625640 26951  Q  WS 70656 + 256 [dd]
147,5   18      278     1.183657562 26951  Q  WS 70912 + 256 [dd]
147,5   18      279     1.183677402 26951  Q  WS 71168 + 256 [dd]
147,5   18      280     1.183703112 26951  Q  WS 71424 + 256 [dd]
147,5   18      281     1.213448926 26951  Q  WS 71680 + 256 [dd]
147,5   18      282     1.213489737 26951  Q  WS 71936 + 256 [dd]
147,5   18      283     1.213508376 26951  Q  WS 72192 + 256 [dd]
147,5   18      284     1.213532789 26951  Q  WS 72448 + 256 [dd]
147,5   18      285     1.213548978 26951  Q  WS 72704 + 256 [dd]
147,5   18      286     1.213572538 26951  Q  WS 72960 + 256 [dd]
147,5   18      287     1.213594908 26951  Q  WS 73216 + 256 [dd]
147,5   18      288     1.213620075 26951  Q  WS 73472 + 256 [dd]
147,5   18      289     1.243612468 26951  Q  WS 73728 + 256 [dd]
147,5   18      290     1.286530050 26951  Q  WS 73984 + 256 [dd]
147,5   18      291     1.286548174 26951  Q  WS 74240 + 256 [dd]
147,5   18      292     1.286572675 26951  Q  WS 74496 + 256 [dd]
147,5   18      293     1.286592125 26951  Q  WS 74752 + 256 [dd]
147,5   18      294     1.286618553 26951  Q  WS 75008 + 256 [dd]
147,5   18      295     1.286636603 26951  Q  WS 75264 + 256 [dd]
147,5   18      296     1.286656445 26951  Q  WS 75520 + 256 [dd]
147,5   18      297     1.292041510 26951  Q  WS 75776 + 256 [dd]
147,5   18      298     1.292081618 26951  Q  WS 76032 + 256 [dd]
147,5   18      299     1.292101623 26951  Q  WS 76288 + 256 [dd]
147,5   18      300     1.292127464 26951  Q  WS 76544 + 256 [dd]
147,5   18      301     1.292147059 26951  Q  WS 76800 + 256 [dd]
147,5   18      302     1.292178859 26951  Q  WS 77056 + 256 [dd]
147,5   18      303     1.292204892 26951  Q  WS 77312 + 256 [dd]
147,5   18      304     1.292223092 26951  Q  WS 77568 + 256 [dd]
147,5   18      305     1.323465759 26951  Q  WS 77824 + 256 [dd]
147,5   18      306     1.323507498 26951  Q  WS 78080 + 256 [dd]
147,5   18      307     1.323525884 26951  Q  WS 78336 + 256 [dd]
147,5   18      308     1.323549788 26951  Q  WS 78592 + 256 [dd]
147,5   18      309     1.323568094 26951  Q  WS 78848 + 256 [dd]
147,5   18      310     1.323593799 26951  Q  WS 79104 + 256 [dd]
147,5   18      311     1.323629738 26951  Q  WS 79360 + 256 [dd]
147,5   18      312     1.323651248 26951  Q  WS 79616 + 256 [dd]
147,5   18      313     1.353440114 26951  Q  WS 79872 + 256 [dd]
147,5   18      314     1.353481448 26951  Q  WS 80128 + 256 [dd]
147,5   18      315     1.353499996 26951  Q  WS 80384 + 256 [dd]
147,5   18      316     1.353524399 26951  Q  WS 80640 + 256 [dd]
147,5   18      317     1.353542537 26951  Q  WS 80896 + 256 [dd]
147,5   18      318     1.353566096 26951  Q  WS 81152 + 256 [dd]
147,5   18      319     1.353585840 26951  Q  WS 81408 + 256 [dd]
147,5   18      320     1.353611368 26951  Q  WS 81664 + 256 [dd]
147,5   18      321     1.383395427 26951  Q  WS 81920 + 256 [dd]
147,5   18      322     1.423962089 26951  Q  WS 82176 + 256 [dd]
147,5   18      323     1.423980428 26951  Q  WS 82432 + 256 [dd]
147,5   18      324     1.424006647 26951  Q  WS 82688 + 256 [dd]
147,5   18      325     1.424024628 26951  Q  WS 82944 + 256 [dd]
147,5   18      326     1.424049184 26951  Q  WS 83200 + 256 [dd]
147,5   18      327     1.424066865 26951  Q  WS 83456 + 256 [dd]
147,5   18      328     1.424082372 26951  Q  WS 83712 + 256 [dd]
147,5   18      329     1.429055627 26951  Q  WS 83968 + 256 [dd]
147,5   18      330     1.429096375 26951  Q  WS 84224 + 256 [dd]
147,5   18      331     1.429114625 26951  Q  WS 84480 + 256 [dd]
147,5   18      332     1.429140144 26951  Q  WS 84736 + 256 [dd]
147,5   18      333     1.429159423 26951  Q  WS 84992 + 256 [dd]
147,5   18      334     1.429183952 26951  Q  WS 85248 + 256 [dd]
147,5   18      335     1.429219383 26951  Q  WS 85504 + 256 [dd]
147,5   18      336     1.429241255 26951  Q  WS 85760 + 256 [dd]
147,5   18      337     1.453360848 26951  Q  WS 86016 + 256 [dd]
147,5   18      338     1.453402076 26951  Q  WS 86272 + 256 [dd]
147,5   18      339     1.453420844 26951  Q  WS 86528 + 256 [dd]
147,5   18      340     1.453446675 26951  Q  WS 86784 + 256 [dd]
147,5   18      341     1.453466038 26951  Q  WS 87040 + 256 [dd]
147,5   18      342     1.453496822 26951  Q  WS 87296 + 256 [dd]
147,5   18      343     1.453525401 26951  Q  WS 87552 + 256 [dd]
147,5   18      344     1.453543151 26951  Q  WS 87808 + 256 [dd]
147,5   18      345     1.483472248 26951  Q  WS 88064 + 256 [dd]
147,5   18      346     1.483526597 26951  Q  WS 88320 + 256 [dd]
147,5   18      347     1.483549798 26951  Q  WS 88576 + 256 [dd]
147,5   18      348     1.483582410 26951  Q  WS 88832 + 256 [dd]
147,5   18      349     1.483606642 26951  Q  WS 89088 + 256 [dd]
147,5   18      350     1.483648097 26951  Q  WS 89344 + 256 [dd]
147,5   18      351     1.483673023 26951  Q  WS 89600 + 256 [dd]
147,5   18      352     1.483695364 26951  Q  WS 89856 + 256 [dd]
147,5   18      353     1.513480844 26951  Q  WS 90112 + 256 [dd]
147,5   18      354     1.553105845 26951  Q  WS 90368 + 256 [dd]
147,5   18      355     1.553130789 26951  Q  WS 90624 + 256 [dd]
147,5   18      356     1.553163214 26951  Q  WS 90880 + 256 [dd]
147,5   18      357     1.553187567 26951  Q  WS 91136 + 256 [dd]
147,5   18      358     1.553221521 26951  Q  WS 91392 + 256 [dd]
147,5   18      359     1.553257551 26951  Q  WS 91648 + 256 [dd]
147,5   18      360     1.553291522 26951  Q  WS 91904 + 256 [dd]
147,5   18      361     1.558492947 26951  Q  WS 92160 + 256 [dd]
147,5   18      362     1.558551481 26951  Q  WS 92416 + 256 [dd]
147,5   18      363     1.558577415 26951  Q  WS 92672 + 256 [dd]
147,5   18      364     1.558611082 26951  Q  WS 92928 + 256 [dd]
147,5   18      365     1.558644272 26951  Q  WS 93184 + 256 [dd]
147,5   18      366     1.558681210 26951  Q  WS 93440 + 256 [dd]
147,5   18      367     1.558712586 26951  Q  WS 93696 + 256 [dd]
147,5   18      368     1.558743427 26951  Q  WS 93952 + 256 [dd]
147,5   18      369     1.583431048 26951  Q  WS 94208 + 256 [dd]
147,5   18      370     1.583486503 26951  Q  WS 94464 + 256 [dd]
147,5   18      371     1.583512005 26951  Q  WS 94720 + 256 [dd]
147,5   18      372     1.583543865 26951  Q  WS 94976 + 256 [dd]
147,5   18      373     1.583568522 26951  Q  WS 95232 + 256 [dd]
147,5   18      374     1.583612108 26951  Q  WS 95488 + 256 [dd]
147,5   18      375     1.583640797 26951  Q  WS 95744 + 256 [dd]
147,5   18      376     1.583669958 26951  Q  WS 96000 + 256 [dd]
147,5   18      377     1.613366958 26951  Q  WS 96256 + 256 [dd]
147,5   18      378     1.613422947 26951  Q  WS 96512 + 256 [dd]
147,5   18      379     1.613448634 26951  Q  WS 96768 + 256 [dd]
147,5   18      380     1.613484790 26951  Q  WS 97024 + 256 [dd]
147,5   18      381     1.613523805 26951  Q  WS 97280 + 256 [dd]
147,5   18      382     1.613559463 26951  Q  WS 97536 + 256 [dd]
147,5   18      383     1.613591363 26951  Q  WS 97792 + 256 [dd]
147,5   18      384     1.613623258 26951  Q  WS 98048 + 256 [dd]
147,5   18      385     1.643568808 26951  Q  WS 98304 + 256 [dd]
147,5   18      386     1.686333247 26951  Q  WS 98560 + 256 [dd]
147,5   18      387     1.686358989 26951  Q  WS 98816 + 256 [dd]
147,5   18      388     1.686394528 26951  Q  WS 99072 + 256 [dd]
147,5   18      389     1.686416516 26951  Q  WS 99328 + 256 [dd]
147,5   18      390     1.686450286 26951  Q  WS 99584 + 256 [dd]
147,5   18      391     1.686485531 26951  Q  WS 99840 + 256 [dd]
147,5   18      392     1.686519940 26951  Q  WS 100096 + 256 [dd]
147,5   18      393     1.691691986 26951  Q  WS 100352 + 256 [dd]
147,5   18      394     1.691745509 26951  Q  WS 100608 + 256 [dd]
147,5   18      395     1.691771354 26951  Q  WS 100864 + 256 [dd]
147,5   18      396     1.691804161 26951  Q  WS 101120 + 256 [dd]
147,5   18      397     1.691839788 26951  Q  WS 101376 + 256 [dd]
147,5   18      398     1.691883238 26951  Q  WS 101632 + 256 [dd]
147,5   18      399     1.691915151 26951  Q  WS 101888 + 256 [dd]
147,5   18      400     1.691946444 26951  Q  WS 102144 + 256 [dd]
147,5   14        1     1.725729693 26952  Q   R 2096768 + 8 [blkid]
147,5    0        1     1.734652049 26952  Q   R 2097000 + 8 [blkid]
147,5    0        2     1.735356600 26952  Q   R 0 + 8 [blkid]
147,5    0        3     1.735469434 26952  Q   R 8 + 8 [blkid]
147,5    0        4     1.735565126 26952  Q   R 2097008 + 8 [blkid]
147,5    0        5     1.735828646 26952  Q   R 2096752 + 8 [blkid]
147,5    0        6     1.736330962 26952  Q   R 2096952 + 8 [blkid]
147,5    0        7     1.736458488 26952  Q   R 2096760 + 8 [blkid]
147,5    0        8     1.736532264 26952  Q   R 2096616 + 8 [blkid]
147,5    0        9     1.736692049 26952  Q   R 2048 + 8 [blkid]
147,5    0       10     1.736768314 26952  Q   R 24 + 8 [blkid]
147,5    0       11     1.736822649 26952  Q   R 56 + 8 [blkid]
147,5    0       12     1.736885722 26952  Q   R 120 + 8 [blkid]
147,5    0       13     1.736941267 26952  Q   R 16 + 8 [blkid]
147,5    0       14     1.736990961 26952  Q   R 128 + 8 [blkid]
147,5    0       15     1.737038774 26952  Q   R 64 + 8 [blkid]
147,5    0       16     1.737086928 26952  Q   R 256 + 8 [blkid]
147,5    0       17     1.737133066 26952  Q   R 264 + 8 [blkid]
147,5    0       18     1.737178065 26952  Q   R 272 + 8 [blkid]
147,5    0       19     1.737224866 26952  Q   R 280 + 8 [blkid]
147,5    0       20     1.737269785 26952  Q   R 288 + 8 [blkid]
147,5    0       21     1.737314577 26952  Q   R 296 + 8 [blkid]
147,5    0       22     1.737358941 26952  Q   R 304 + 8 [blkid]
147,5    0       23     1.737402968 26952  Q   R 312 + 8 [blkid]
147,5    0       24     1.737447012 26952  Q   R 320 + 8 [blkid]
147,5    0       25     1.737491807 26952  Q   R 328 + 8 [blkid]
147,5    0       26     1.737536129 26952  Q   R 336 + 8 [blkid]
147,5    0       27     1.737579991 26952  Q   R 344 + 8 [blkid]
147,5    0       28     1.737626284 26952  Q   R 352 + 8 [blkid]
147,5    0       29     1.737689598 26952  Q   R 360 + 8 [blkid]
147,5    0       30     1.737739520 26952  Q   R 368 + 8 [blkid]
147,5    0       31     1.737784950 26952  Q   R 376 + 8 [blkid]
147,5    0       32     1.737828760 26952  Q   R 384 + 8 [blkid]
147,5    0       33     1.737873021 26952  Q   R 392 + 8 [blkid]
147,5    0       34     1.737922307 26952  Q   R 400 + 8 [blkid]
147,5    0       35     1.737967964 26952  Q   R 408 + 8 [blkid]
147,5    0       36     1.738012677 26952  Q   R 416 + 8 [blkid]
147,5    0       37     1.738058110 26952  Q   R 424 + 8 [blkid]
147,5    0       38     1.738102535 26952  Q   R 432 + 8 [blkid]
147,5    0       39     1.738147290 26952  Q   R 440 + 8 [blkid]
147,5    0       40     1.738191885 26952  Q   R 448 + 8 [blkid]
147,5    0       41     1.738236941 26952  Q   R 456 + 8 [blkid]
147,5    0       42     1.738283885 26952  Q   R 464 + 8 [blkid]
147,5    0       43     1.738329275 26952  Q   R 472 + 8 [blkid]
147,5    0       44     1.738374020 26952  Q   R 480 + 8 [blkid]
147,5    0       45     1.738418177 26952  Q   R 488 + 8 [blkid]
147,5    0       46     1.738463164 26952  Q   R 496 + 8 [blkid]
147,5    0       47     1.738508019 26952  Q   R 504 + 8 [blkid]
147,5    0       48     1.738552734 26952  Q   R 768 + 8 [blkid]
147,5    0       49     1.738597630 26952  Q   R 776 + 8 [blkid]
147,5    0       50     1.738643110 26952  Q   R 784 + 8 [blkid]
147,5    0       51     1.738688213 26952  Q   R 792 + 8 [blkid]
147,5    0       52     1.738732390 26952  Q   R 800 + 8 [blkid]
147,5    0       53     1.738776979 26952  Q   R 808 + 8 [blkid]
147,5    0       54     1.738821717 26952  Q   R 816 + 8 [blkid]
147,5    0       55     1.738866733 26952  Q   R 824 + 8 [blkid]
147,5    0       56     1.738913975 26952  Q   R 832 + 8 [blkid]
147,5    0       57     1.738959328 26952  Q   R 840 + 8 [blkid]
147,5    0       58     1.739004294 26952  Q   R 848 + 8 [blkid]
147,5    0       59     1.739048702 26952  Q   R 856 + 8 [blkid]
147,5    0       60     1.739094259 26952  Q   R 864 + 8 [blkid]
147,5    0       61     1.739141063 26952  Q   R 872 + 8 [blkid]
147,5    0       62     1.739187202 26952  Q   R 880 + 8 [blkid]
147,5    0       63     1.739232695 26952  Q   R 888 + 8 [blkid]
147,5    0       64     1.739277845 26952  Q   R 896 + 8 [blkid]
147,5    0       65     1.739322490 26952  Q   R 904 + 8 [blkid]
147,5    0       66     1.739367179 26952  Q   R 912 + 8 [blkid]
147,5    0       67     1.739411917 26952  Q   R 920 + 8 [blkid]
147,5    0       68     1.739457187 26952  Q   R 928 + 8 [blkid]
147,5    0       69     1.739502520 26952  Q   R 936 + 8 [blkid]
147,5    0       70     1.739549795 26952  Q   R 944 + 8 [blkid]
147,5    0       71     1.739596335 26952  Q   R 952 + 8 [blkid]
147,5    0       72     1.739641384 26952  Q   R 960 + 8 [blkid]
147,5    0       73     1.739686357 26952  Q   R 968 + 8 [blkid]
147,5    0       74     1.739731266 26952  Q   R 976 + 8 [blkid]
147,5    0       75     1.739776048 26952  Q   R 984 + 8 [blkid]
147,5    0       76     1.739821071 26952  Q   R 992 + 8 [blkid]
147,5    0       77     1.739870919 26952  Q   R 1000 + 8 [blkid]
147,5    0       78     1.739917227 26952  Q   R 1008 + 8 [blkid]
147,5    0       79     1.739962213 26952  Q   R 1016 + 8 [blkid]
147,5    0       80     1.740020618 26952  Q   R 512 + 8 [blkid]
147,5    0       81     1.740072311 26952  Q   R 32 + 8 [blkid]
147,5    0       82     1.740130950 26952  Q   R 4096 + 8 [blkid]
CPU0 (drbd5):
 Reads Queued:          82,      328KiB  Writes Queued:           0,        
0KiB
 Read Dispatches:        0,        0KiB  Write Dispatches:        0,        
0KiB
 Reads Requeued:         0               Writes Requeued:         0
 Reads Completed:        0,        0KiB  Writes Completed:        0,        
0KiB
 Read Merges:            0,        0KiB  Write Merges:            0,        
0KiB
 Read depth:             0               Write depth:             0
 IO unplugs:             0               Timer unplugs:           0
CPU14 (drbd5):
 Reads Queued:           1,        4KiB  Writes Queued:           0,        
0KiB
 Read Dispatches:        0,        0KiB  Write Dispatches:        0,        
0KiB
 Reads Requeued:         0               Writes Requeued:         0
 Reads Completed:        0,        0KiB  Writes Completed:        0,        
0KiB
 Read Merges:            0,        0KiB  Write Merges:            0,        
0KiB
 Read depth:             0               Write depth:             0
 IO unplugs:             0               Timer unplugs:           0
CPU18 (drbd5):
 Reads Queued:           0,        0KiB  Writes Queued:         400,    
51200KiB
 Read Dispatches:        0,        0KiB  Write Dispatches:        0,        
0KiB
 Reads Requeued:         0               Writes Requeued:         0
 Reads Completed:        0,        0KiB  Writes Completed:        0,        
0KiB
 Read Merges:            0,        0KiB  Write Merges:            0,        
0KiB
 Read depth:             0               Write depth:             0
 IO unplugs:             0               Timer unplugs:           0

Total (drbd5):
 Reads Queued:          83,      332KiB  Writes Queued:         400,    
51200KiB
 Read Dispatches:        0,        0KiB  Write Dispatches:        0,        
0KiB
 Reads Requeued:         0               Writes Requeued:         0
 Reads Completed:        0,        0KiB  Writes Completed:        0,        
0KiB
 Read Merges:            0,        0KiB  Write Merges:            0,        
0KiB
 IO unplugs:             0               Timer unplugs:           0

Throughput (R/W): 0KiB/s / 0KiB/s
Events (drbd5): 483 entries
Skips: 0 forward (0 -   0.0%)

------------------- blkparse on backing device ------------------------------
tom at hydra04 [1634]:~/blkparse_dm-4_local$ sudo kill -2 $pid
tom at hydra04 [1635]:~/blkparse_dm-4_local$ === dm-4 ===
  CPU  0:                    0 events,        0 KiB data
  CPU  1:                    0 events,        0 KiB data
  CPU  2:                    0 events,        0 KiB data
  CPU  3:                    0 events,        0 KiB data
  CPU  4:                    0 events,        0 KiB data
  CPU  5:                    0 events,        0 KiB data
  CPU  6:                  793 events,       38 KiB data
  CPU  7:                    0 events,        0 KiB data
  CPU  8:                    1 events,        1 KiB data
  CPU  9:                    0 events,        0 KiB data
  CPU 10:                    0 events,        0 KiB data
  CPU 11:                    0 events,        0 KiB data
  CPU 12:                    0 events,        0 KiB data
  CPU 13:                    0 events,        0 KiB data
  CPU 14:                    0 events,        0 KiB data
  CPU 15:                    0 events,        0 KiB data
  CPU 16:                    0 events,        0 KiB data
  CPU 17:                    0 events,        0 KiB data
  CPU 18:                    0 events,        0 KiB data
  CPU 19:                    9 events,        1 KiB data
  CPU 20:                    0 events,        0 KiB data
  CPU 21:                    0 events,        0 KiB data
  CPU 22:                    0 events,        0 KiB data
  CPU 23:                    0 events,        0 KiB data
  Total:                   803 events (dropped 0),       38 KiB data
blkparse dm-4 | less
[1]+  Done                    sudo blktrace /dev/vg0/test-io -b 4096
tom at hydra04 [1636]:~/blkparse_dm-4_local$ blkparse dm-4
Input file dm-4.blktrace.6 added
Input file dm-4.blktrace.8 added
Input file dm-4.blktrace.19 added
254,4   19        1     0.000000000 26163  Q  WS 0 + 256 [dd]
254,4   19        2     0.000056700 26163  Q  WS 256 + 256 [dd]
254,4   19        3     0.000073744 26163  Q  WS 512 + 256 [dd]
254,4   19        4     0.000090568 26163  Q  WS 768 + 256 [dd]
254,4   19        5     0.000105575 26163  Q  WS 1024 + 256 [dd]
254,4   19        6     0.000122920 26163  Q  WS 1280 + 256 [dd]
254,4   19        7     0.000138250 26163  Q  WS 1536 + 256 [dd]
254,4   19        8     0.000153206 26163  Q  WS 1792 + 256 [dd]
254,4    6        1     0.000313349     0  C  WS 0 + 256 [0]
254,4    6        2     0.000336125     0  C  WS 256 + 256 [0]
254,4    6        3     0.000340482     0  C  WS 512 + 256 [0]
254,4    6        4     0.000465108     0  C  WS 768 + 256 [0]
254,4    6        5     0.000474618     0  C  WS 1024 + 256 [0]
254,4    6        6     0.000479095     0  C  WS 1280 + 256 [0]
254,4    6        7     0.000558682     0  C  WS 1536 + 256 [0]
254,4    6        8     0.000568713     0  C  WS 1792 + 256 [0]
254,4    6        9     0.000791213 26163  Q  WS 2048 + 256 [dd]
254,4    6       10     0.000832540 26163  Q  WS 2304 + 256 [dd]
254,4    6       11     0.000855716 26163  Q  WS 2560 + 256 [dd]
254,4    6       12     0.000882458 26163  Q  WS 2816 + 256 [dd]
254,4    6       13     0.000903566 26163  Q  WS 3072 + 256 [dd]
254,4    6       14     0.000928570 26163  Q  WS 3328 + 256 [dd]
254,4    6       15     0.000958730 26163  C  WS 2048 + 256 [0]
254,4    6       16     0.000964965 26163  C  WS 2304 + 256 [0]
254,4    6       17     0.000977268 26163  C  WS 2560 + 256 [0]
254,4    6       18     0.000985157 26163  Q  WS 3584 + 256 [dd]
254,4    6       19     0.001007812 26163  Q  WS 3840 + 256 [dd]
254,4    6       20     0.001053176     0  C  WS 2816 + 256 [0]
254,4    6       21     0.001058496     0  C  WS 3072 + 256 [0]
254,4    6       22     0.001154953     0  C  WS 3328 + 256 [0]
254,4    6       23     0.001164663     0  C  WS 3584 + 256 [0]
254,4    6       24     0.001203280     0  C  WS 3840 + 256 [0]
254,4    6       25     0.001420247 26163  Q  WS 4096 + 256 [dd]
254,4    6       26     0.001461347 26163  Q  WS 4352 + 256 [dd]
254,4    6       27     0.001484761 26163  Q  WS 4608 + 256 [dd]
254,4    6       28     0.001510363 26163  Q  WS 4864 + 256 [dd]
254,4    6       29     0.001531861 26163  Q  WS 5120 + 256 [dd]
254,4    6       30     0.001556408 26163  Q  WS 5376 + 256 [dd]
254,4    6       31     0.001589822 26163  C  WS 4096 + 256 [0]
254,4    6       32     0.001595666 26163  C  WS 4352 + 256 [0]
254,4    6       33     0.001599533 26163  Q  WS 5632 + 256 [dd]
254,4    6       34     0.001623691 26163  C  WS 4608 + 256 [0]
254,4    6       35     0.001631563 26163  Q  WS 5888 + 256 [dd]
254,4    6       36     0.001763040     0  C  WS 4864 + 256 [0]
254,4    6       37     0.001769602     0  C  WS 5120 + 256 [0]
254,4    6       38     0.001773886     0  C  WS 5376 + 256 [0]
254,4    6       39     0.001864790     0  C  WS 5632 + 256 [0]
254,4    6       40     0.001871169     0  C  WS 5888 + 256 [0]
254,4    6       41     0.002091340 26163  Q  WS 6144 + 256 [dd]
254,4    6       42     0.002138354 26163  Q  WS 6400 + 256 [dd]
254,4    6       43     0.002162146 26163  Q  WS 6656 + 256 [dd]
254,4    6       44     0.002188145 26163  Q  WS 6912 + 256 [dd]
254,4    6       45     0.002209484 26163  Q  WS 7168 + 256 [dd]
254,4    6       46     0.002234347 26163  Q  WS 7424 + 256 [dd]
254,4    6       47     0.002253043 26163  C  WS 6144 + 256 [0]
254,4    6       48     0.002258596 26163  C  WS 6400 + 256 [0]
254,4    6       49     0.002277081 26163  Q  WS 7680 + 256 [dd]
254,4    6       50     0.002298841 26163  C  WS 6656 + 256 [0]
254,4    6       51     0.002308130 26163  Q  WS 7936 + 256 [dd]
254,4    6       52     0.002345454     0  C  WS 6912 + 256 [0]
254,4    6       53     0.002365149     0  C  WS 7168 + 256 [0]
254,4    6       54     0.002403953     0  C  WS 7424 + 256 [0]
254,4    6       55     0.002441347     0  C  WS 7680 + 256 [0]
254,4    6       56     0.002477201     0  C  WS 7936 + 256 [0]
254,4    6       57     0.002672986 26163  Q  WS 8192 + 256 [dd]
254,4    6       58     0.002706287 26163  Q  WS 8448 + 256 [dd]
254,4    6       59     0.002729196 26163  Q  WS 8704 + 256 [dd]
254,4    6       60     0.002754678 26163  Q  WS 8960 + 256 [dd]
254,4    6       61     0.002779939 26163  C  WS 8192 + 256 [0]
254,4    6       62     0.002786572 26163  Q  WS 9216 + 256 [dd]
254,4    6       63     0.002811352 26163  C  WS 8448 + 256 [0]
254,4    6       64     0.002820758 26163  Q  WS 9472 + 256 [dd]
254,4    6       65     0.002843182 26163  Q  WS 9728 + 256 [dd]
254,4    6       66     0.002854751 26163  C  WS 8704 + 256 [0]
254,4    6       67     0.002875030 26163  Q  WS 9984 + 256 [dd]
254,4    6       68     0.002894898 26163  C  WS 8960 + 256 [0]
254,4    6       69     0.002931818     0  C  WS 9216 + 256 [0]
254,4    6       70     0.002968875     0  C  WS 9472 + 256 [0]
254,4    6       71     0.003007124     0  C  WS 9728 + 256 [0]
254,4    6       72     0.003040204     0  C  WS 9984 + 256 [0]
254,4    6       73     0.003234443 26163  Q  WS 10240 + 256 [dd]
254,4    6       74     0.003267693 26163  Q  WS 10496 + 256 [dd]
254,4    6       75     0.003290358 26163  Q  WS 10752 + 256 [dd]
254,4    6       76     0.003316425 26163  Q  WS 11008 + 256 [dd]
254,4    6       77     0.003338622 26163  C  WS 10240 + 256 [0]
254,4    6       78     0.003348172 26163  Q  WS 11264 + 256 [dd]
254,4    6       79     0.003368355 26163  C  WS 10496 + 256 [0]
254,4    6       80     0.003382285 26163  Q  WS 11520 + 256 [dd]
254,4    6       81     0.003404913 26163  Q  WS 11776 + 256 [dd]
254,4    6       82     0.003410634 26163  C  WS 10752 + 256 [0]
254,4    6       83     0.003436139 26163  Q  WS 12032 + 256 [dd]
254,4    6       84     0.003462650     0  C  WS 11008 + 256 [0]
254,4    6       85     0.003498033     0  C  WS 11264 + 256 [0]
254,4    6       86     0.003534665     0  C  WS 11520 + 256 [0]
254,4    6       87     0.003573335     0  C  WS 11776 + 256 [0]
254,4    6       88     0.003606613     0  C  WS 12032 + 256 [0]
254,4    6       89     0.003802595 26163  Q  WS 12288 + 256 [dd]
254,4    6       90     0.003835903 26163  Q  WS 12544 + 256 [dd]
254,4    6       91     0.003858160 26163  Q  WS 12800 + 256 [dd]
254,4    6       92     0.003883749 26163  Q  WS 13056 + 256 [dd]
254,4    6       93     0.003903354 26163  C  WS 12288 + 256 [0]
254,4    6       94     0.003916148 26163  Q  WS 13312 + 256 [dd]
254,4    6       95     0.003935682 26163  C  WS 12544 + 256 [0]
254,4    6       96     0.003951266 26163  Q  WS 13568 + 256 [dd]
254,4    6       97     0.003973304 26163  C  WS 12800 + 256 [0]
254,4    6       98     0.003982091 26163  Q  WS 13824 + 256 [dd]
254,4    6       99     0.004004309 26163  Q  WS 14080 + 256 [dd]
254,4    6      100     0.004020585 26163  C  WS 13056 + 256 [0]
254,4    6      101     0.004057755     0  C  WS 13312 + 256 [0]
254,4    6      102     0.004095072     0  C  WS 13568 + 256 [0]
254,4    6      103     0.004133639     0  C  WS 13824 + 256 [0]
254,4    6      104     0.004167074     0  C  WS 14080 + 256 [0]
254,4    6      105     0.004361677 26163  Q  WS 14336 + 256 [dd]
254,4    6      106     0.004394797 26163  Q  WS 14592 + 256 [dd]
254,4    6      107     0.004417034 26163  Q  WS 14848 + 256 [dd]
254,4    6      108     0.004443000 26163  Q  WS 15104 + 256 [dd]
254,4    6      109     0.004464580 26163  C  WS 14336 + 256 [0]
254,4    6      110     0.004475018 26163  Q  WS 15360 + 256 [dd]
254,4    6      111     0.004495822 26163  C  WS 14592 + 256 [0]
254,4    6      112     0.004509893 26163  Q  WS 15616 + 256 [dd]
254,4    6      113     0.004535415 26163  C  WS 14848 + 256 [0]
254,4    6      114     0.004540711 26163  Q  WS 15872 + 256 [dd]
254,4    6      115     0.004563259 26163  Q  WS 16128 + 256 [dd]
254,4    6      116     0.004578082 26163  C  WS 15104 + 256 [0]
254,4    6      117     0.004622256     0  C  WS 15360 + 256 [0]
254,4    6      118     0.004660425     0  C  WS 15616 + 256 [0]
254,4    6      119     0.004700222     0  C  WS 15872 + 256 [0]
254,4    6      120     0.004734365     0  C  WS 16128 + 256 [0]
254,4    6      121     0.004928894 26163  Q  WS 16384 + 256 [dd]
254,4    6      122     0.004961386 26163  Q  WS 16640 + 256 [dd]
254,4    6      123     0.004984469 26163  Q  WS 16896 + 256 [dd]
254,4    6      124     0.005009874 26163  Q  WS 17152 + 256 [dd]
254,4    6      125     0.005029705 26163  C  WS 16384 + 256 [0]
254,4    6      126     0.005042286 26163  Q  WS 17408 + 256 [dd]
254,4    6      127     0.005062091 26163  C  WS 16640 + 256 [0]
254,4    6      128     0.005077428 26163  Q  WS 17664 + 256 [dd]
254,4    6      129     0.005099876 26163  C  WS 16896 + 256 [0]
254,4    6      130     0.005108323 26163  Q  WS 17920 + 256 [dd]
254,4    6      131     0.005130965 26163  Q  WS 18176 + 256 [dd]
254,4    6      132     0.005136795 26163  C  WS 17152 + 256 [0]
254,4    6      133     0.005180926     0  C  WS 17408 + 256 [0]
254,4    6      134     0.005221525     0  C  WS 17664 + 256 [0]
254,4    6      135     0.005259964     0  C  WS 17920 + 256 [0]
254,4    6      136     0.005294361     0  C  WS 18176 + 256 [0]
254,4    6      137     0.005488503 26163  Q  WS 18432 + 256 [dd]
254,4    6      138     0.005522218 26163  Q  WS 18688 + 256 [dd]
254,4    6      139     0.005544733 26163  Q  WS 18944 + 256 [dd]
254,4    6      140     0.005570646 26163  Q  WS 19200 + 256 [dd]
254,4    6      141     0.005591707 26163  C  WS 18432 + 256 [0]
254,4    6      142     0.005602265 26163  Q  WS 19456 + 256 [dd]
254,4    6      143     0.005622832 26163  C  WS 18688 + 256 [0]
254,4    6      144     0.005636913 26163  Q  WS 19712 + 256 [dd]
254,4    6      145     0.005663658 26163  C  WS 18944 + 256 [0]
254,4    6      146     0.005667414 26163  Q  WS 19968 + 256 [dd]
254,4    6      147     0.005689992 26163  Q  WS 20224 + 256 [dd]
254,4    6      148     0.005701791 26163  C  WS 19200 + 256 [0]
254,4    6      149     0.005740354     0  C  WS 19456 + 256 [0]
254,4    6      150     0.005777752     0  C  WS 19712 + 256 [0]
254,4    6      151     0.005823192     0  C  WS 19968 + 256 [0]
254,4    6      152     0.005856733     0  C  WS 20224 + 256 [0]
254,4    6      153     0.006062139 26163  Q  WS 20480 + 256 [dd]
254,4    6      154     0.006083861 26163  Q  WS 20736 + 256 [dd]
254,4    6      155     0.006117200 26163  Q  WS 20992 + 256 [dd]
254,4    6      156     0.006142404 26163  Q  WS 21248 + 256 [dd]
254,4    6      157     0.006163067 26163  C  WS 20480 + 256 [0]
254,4    6      158     0.006175798 26163  Q  WS 21504 + 256 [dd]
254,4    6      159     0.006196703 26163  C  WS 20736 + 256 [0]
254,4    6      160     0.006212875 26163  Q  WS 21760 + 256 [dd]
254,4    6      161     0.006232389 26163  C  WS 20992 + 256 [0]
254,4    6      162     0.006243927 26163  Q  WS 22016 + 256 [dd]
254,4    6      163     0.006265797 26163  Q  WS 22272 + 256 [dd]
254,4    6      164     0.006270695 26163  C  WS 21248 + 256 [0]
254,4    6      165     0.006310986     0  C  WS 21504 + 256 [0]
254,4    6      166     0.006347275     0  C  WS 21760 + 256 [0]
254,4    6      167     0.006393293     0  C  WS 22016 + 256 [0]
254,4    6      168     0.006426420     0  C  WS 22272 + 256 [0]
254,4    6      169     0.006620849 26163  Q  WS 22528 + 256 [dd]
254,4    6      170     0.006653896 26163  Q  WS 22784 + 256 [dd]
254,4    6      171     0.006676230 26163  Q  WS 23040 + 256 [dd]
254,4    6      172     0.006702547 26163  Q  WS 23296 + 256 [dd]
254,4    6      173     0.006723341 26163  C  WS 22528 + 256 [0]
254,4    6      174     0.006734161 26163  Q  WS 23552 + 256 [dd]
254,4    6      175     0.006754554 26163  C  WS 22784 + 256 [0]
254,4    6      176     0.006768942 26163  Q  WS 23808 + 256 [dd]
254,4    6      177     0.006793358 26163  C  WS 23040 + 256 [0]
254,4    6      178     0.006799874 26163  Q  WS 24064 + 256 [dd]
254,4    6      179     0.006822302 26163  Q  WS 24320 + 256 [dd]
254,4    6      180     0.006834454 26163  C  WS 23296 + 256 [0]
254,4    6      181     0.006871848     0  C  WS 23552 + 256 [0]
254,4    6      182     0.006907873     0  C  WS 23808 + 256 [0]
254,4    6      183     0.006949581     0  C  WS 24064 + 256 [0]
254,4    6      184     0.006982060     0  C  WS 24320 + 256 [0]
254,4    6      185     0.007176171 26163  Q  WS 24576 + 256 [dd]
254,4    6      186     0.007208757 26163  Q  WS 24832 + 256 [dd]
254,4    6      187     0.007230660 26163  Q  WS 25088 + 256 [dd]
254,4    6      188     0.007256553 26163  Q  WS 25344 + 256 [dd]
254,4    6      189     0.007278580 26163  Q  WS 25600 + 256 [dd]
254,4    6      190     0.007291484 26163  C  WS 24576 + 256 [0]
254,4    6      191     0.007318901 26163  C  WS 24832 + 256 [0]
254,4    6      192     0.007323419 26163  Q  WS 25856 + 256 [dd]
254,4    6      193     0.007346681 26163  Q  WS 26112 + 256 [dd]
254,4    6      194     0.007362584 26163  C  WS 25088 + 256 [0]
254,4    6      195     0.007381820 26163  Q  WS 26368 + 256 [dd]
254,4    6      196     0.007403657 26163  C  WS 25344 + 256 [0]
254,4    6      197     0.007435484     0  C  WS 25600 + 256 [0]
254,4    6      198     0.007472464     0  C  WS 25856 + 256 [0]
254,4    6      199     0.007508769     0  C  WS 26112 + 256 [0]
254,4    6      200     0.007546547     0  C  WS 26368 + 256 [0]
254,4    6      201     0.007740592 26163  Q  WS 26624 + 256 [dd]
254,4    6      202     0.007773612 26163  Q  WS 26880 + 256 [dd]
254,4    6      203     0.007795305 26163  Q  WS 27136 + 256 [dd]
254,4    6      204     0.007821110 26163  Q  WS 27392 + 256 [dd]
254,4    6      205     0.007842529 26163  Q  WS 27648 + 256 [dd]
254,4    6      206     0.007849031 26163  C  WS 26624 + 256 [0]
254,4    6      207     0.007882322 26163  C  WS 26880 + 256 [0]
254,4    6      208     0.007887081 26163  Q  WS 27904 + 256 [dd]
254,4    6      209     0.007909936 26163  Q  WS 28160 + 256 [dd]
254,4    6      210     0.007921728 26163  C  WS 27136 + 256 [0]
254,4    6      211     0.007941012 26163  Q  WS 28416 + 256 [dd]
254,4    6      212     0.007963479 26163  C  WS 27392 + 256 [0]
254,4    6      213     0.007997061     0  C  WS 27648 + 256 [0]
254,4    6      214     0.008033369     0  C  WS 27904 + 256 [0]
254,4    6      215     0.008070804     0  C  WS 28160 + 256 [0]
254,4    6      216     0.008108020     0  C  WS 28416 + 256 [0]
254,4    6      217     0.008301881 26163  Q  WS 28672 + 256 [dd]
254,4    6      218     0.008334470 26163  Q  WS 28928 + 256 [dd]
254,4    6      219     0.008358308 26163  Q  WS 29184 + 256 [dd]
254,4    6      220     0.008383937 26163  Q  WS 29440 + 256 [dd]
254,4    6      221     0.008407822 26163  C  WS 28672 + 256 [0]
254,4    6      222     0.008415163 26163  Q  WS 29696 + 256 [dd]
254,4    6      223     0.008440274 26163  C  WS 28928 + 256 [0]
254,4    6      224     0.008450592 26163  Q  WS 29952 + 256 [dd]
254,4    6      225     0.008473291 26163  Q  WS 30208 + 256 [dd]
254,4    6      226     0.008477317 26163  C  WS 29184 + 256 [0]
254,4    6      227     0.008503310 26163  Q  WS 30464 + 256 [dd]
254,4    6      228     0.008518818 26163  C  WS 29440 + 256 [0]
254,4    6      229     0.008557696     0  C  WS 29696 + 256 [0]
254,4    6      230     0.008594458     0  C  WS 29952 + 256 [0]
254,4    6      231     0.008633741     0  C  WS 30208 + 256 [0]
254,4    6      232     0.008666737     0  C  WS 30464 + 256 [0]
254,4    6      233     0.008860972 26163  Q  WS 30720 + 256 [dd]
254,4    6      234     0.008894056 26163  Q  WS 30976 + 256 [dd]
254,4    6      235     0.008916420 26163  Q  WS 31232 + 256 [dd]
254,4    6      236     0.008942687 26163  Q  WS 31488 + 256 [dd]
254,4    6      237     0.008967324 26163  C  WS 30720 + 256 [0]
254,4    6      238     0.008974063 26163  Q  WS 31744 + 256 [dd]
254,4    6      239     0.008999034 26163  C  WS 30976 + 256 [0]
254,4    6      240     0.009008377 26163  Q  WS 32000 + 256 [dd]
254,4    6      241     0.009031577 26163  Q  WS 32256 + 256 [dd]
254,4    6      242     0.009037367 26163  C  WS 31232 + 256 [0]
254,4    6      243     0.009062545 26163  Q  WS 32512 + 256 [dd]
254,4    6      244     0.009077992 26163  C  WS 31488 + 256 [0]
254,4    6      245     0.009114113     0  C  WS 31744 + 256 [0]
254,4    6      246     0.009150191     0  C  WS 32000 + 256 [0]
254,4    6      247     0.009188050     0  C  WS 32256 + 256 [0]
254,4    6      248     0.009224034     0  C  WS 32512 + 256 [0]
254,4    6      249     0.009418192 26163  Q  WS 32768 + 256 [dd]
254,4    6      250     0.009451556 26163  Q  WS 33024 + 256 [dd]
254,4    6      251     0.009474418 26163  Q  WS 33280 + 256 [dd]
254,4    6      252     0.009500672 26163  Q  WS 33536 + 256 [dd]
254,4    6      253     0.009523116 26163  C  WS 32768 + 256 [0]
254,4    6      254     0.009532526 26163  Q  WS 33792 + 256 [dd]
254,4    6      255     0.009554747 26163  C  WS 33024 + 256 [0]
254,4    6      256     0.009567187 26163  Q  WS 34048 + 256 [dd]
254,4    6      257     0.009590013 26163  Q  WS 34304 + 256 [dd]
254,4    6      258     0.009601674 26163  C  WS 33280 + 256 [0]
254,4    6      259     0.009621836 26163  Q  WS 34560 + 256 [dd]
254,4    6      260     0.009640889 26163  C  WS 33536 + 256 [0]
254,4    6      261     0.009678798     0  C  WS 33792 + 256 [0]
254,4    6      262     0.009717171     0  C  WS 34048 + 256 [0]
254,4    6      263     0.009755377     0  C  WS 34304 + 256 [0]
254,4    6      264     0.009789042     0  C  WS 34560 + 256 [0]
254,4    6      265     0.009983040 26163  Q  WS 34816 + 256 [dd]
254,4    6      266     0.010046655 26163  Q  WS 35072 + 256 [dd]
254,4    6      267     0.010062825 26163  Q  WS 35328 + 256 [dd]
254,4    6      268     0.010080734 26163  Q  WS 35584 + 256 [dd]
254,4    6      269     0.010094783 26163  Q  WS 35840 + 256 [dd]
254,4    6      270     0.010111201 26163  C  WS 34816 + 256 [0]
254,4    6      271     0.010120633 26163  Q  WS 36096 + 256 [dd]
254,4    6      272     0.010137634 26163  C  WS 35072 + 256 [0]
254,4    6      273     0.010144763 26163  Q  WS 36352 + 256 [dd]
254,4    6      274     0.010160988 26163  Q  WS 36608 + 256 [dd]
254,4    6      275     0.010194648     0  C  WS 35328 + 256 [0]
254,4    6      276     0.010237315     0  C  WS 35584 + 256 [0]
254,4    6      277     0.010274712     0  C  WS 35840 + 256 [0]
254,4    6      278     0.010310950     0  C  WS 36096 + 256 [0]
254,4    6      279     0.010348110     0  C  WS 36352 + 256 [0]
254,4    6      280     0.010385447     0  C  WS 36608 + 256 [0]
254,4    6      281     0.010531636 26163  Q  WS 36864 + 256 [dd]
254,4    6      282     0.010553605 26163  Q  WS 37120 + 256 [dd]
254,4    6      283     0.010569131 26163  Q  WS 37376 + 256 [dd]
254,4    6      284     0.010586439 26163  Q  WS 37632 + 256 [dd]
254,4    6      285     0.010600319 26163  Q  WS 37888 + 256 [dd]
254,4    6      286     0.010617801 26163  Q  WS 38144 + 256 [dd]
254,4    6      287     0.010632618 26163  C  WS 36864 + 256 [0]
254,4    6      288     0.010646566 26163  Q  WS 38400 + 256 [dd]
254,4    6      289     0.010661478 26163  Q  WS 38656 + 256 [dd]
254,4    6      290     0.010666766 26163  C  WS 37120 + 256 [0]
254,4    6      291     0.010713471     0  C  WS 37376 + 256 [0]
254,4    6      292     0.010750648     0  C  WS 37632 + 256 [0]
254,4    6      293     0.010784059     0  C  WS 37888 + 256 [0]
254,4    6      294     0.010823321     0  C  WS 38144 + 256 [0]
254,4    6      295     0.010862086     0  C  WS 38400 + 256 [0]
254,4    6      296     0.010921215     0  C  WS 38656 + 256 [0]
254,4    6      297     0.011074801 26163  Q  WS 38912 + 256 [dd]
254,4    6      298     0.011096515 26163  Q  WS 39168 + 256 [dd]
254,4    6      299     0.011111220 26163  Q  WS 39424 + 256 [dd]
254,4    6      300     0.011128078 26163  Q  WS 39680 + 256 [dd]
254,4    6      301     0.011142380 26163  Q  WS 39936 + 256 [dd]
254,4    6      302     0.011159478 26163  Q  WS 40192 + 256 [dd]
254,4    6      303     0.011175986 26163  C  WS 38912 + 256 [0]
254,4    6      304     0.011182834 26163  Q  WS 40448 + 256 [dd]
254,4    6      305     0.011198105 26163  Q  WS 40704 + 256 [dd]
254,4    6      306     0.011206700 26163  C  WS 39168 + 256 [0]
254,4    6      307     0.011259547     0  C  WS 39424 + 256 [0]
254,4    6      308     0.011293189     0  C  WS 39680 + 256 [0]
254,4    6      309     0.011330833     0  C  WS 39936 + 256 [0]
254,4    6      310     0.011368304     0  C  WS 40192 + 256 [0]
254,4    6      311     0.011404024     0  C  WS 40448 + 256 [0]
254,4    6      312     0.011441642     0  C  WS 40704 + 256 [0]
254,4    6      313     0.011586375 26163  Q  WS 40960 + 256 [dd]
254,4    6      314     0.011608462 26163  Q  WS 41216 + 256 [dd]
254,4    6      315     0.011623433 26163  Q  WS 41472 + 256 [dd]
254,4    6      316     0.011640241 26163  Q  WS 41728 + 256 [dd]
254,4    6      317     0.011654391 26163  Q  WS 41984 + 256 [dd]
254,4    6      318     0.011671094 26163  Q  WS 42240 + 256 [dd]
254,4    6      319     0.011687431 26163  C  WS 40960 + 256 [0]
254,4    6      320     0.011693878 26163  Q  WS 42496 + 256 [dd]
254,4    6      321     0.011709227 26163  Q  WS 42752 + 256 [dd]
254,4    6      322     0.011720195 26163  C  WS 41216 + 256 [0]
254,4    6      323     0.011769418     0  C  WS 41472 + 256 [0]
254,4    6      324     0.011804654     0  C  WS 41728 + 256 [0]
254,4    6      325     0.011845881     0  C  WS 41984 + 256 [0]
254,4    6      326     0.011879850     0  C  WS 42240 + 256 [0]
254,4    6      327     0.011917707     0  C  WS 42496 + 256 [0]
254,4    6      328     0.011976090     0  C  WS 42752 + 256 [0]
254,4    6      329     0.012130319 26163  Q  WS 43008 + 256 [dd]
254,4    6      330     0.012152141 26163  Q  WS 43264 + 256 [dd]
254,4    6      331     0.012167154 26163  Q  WS 43520 + 256 [dd]
254,4    6      332     0.012184385 26163  Q  WS 43776 + 256 [dd]
254,4    6      333     0.012198907 26163  Q  WS 44032 + 256 [dd]
254,4    6      334     0.012216497 26163  Q  WS 44288 + 256 [dd]
254,4    6      335     0.012232555 26163  C  WS 43008 + 256 [0]
254,4    6      336     0.012239428 26163  Q  WS 44544 + 256 [dd]
254,4    6      337     0.012254741 26163  Q  WS 44800 + 256 [dd]
254,4    6      338     0.012262961 26163  C  WS 43264 + 256 [0]
254,4    6      339     0.012313356     0  C  WS 43520 + 256 [0]
254,4    6      340     0.012351813     0  C  WS 43776 + 256 [0]
254,4    6      341     0.012390373     0  C  WS 44032 + 256 [0]
254,4    6      342     0.012425325     0  C  WS 44288 + 256 [0]
254,4    6      343     0.012464724     0  C  WS 44544 + 256 [0]
254,4    6      344     0.012500431     0  C  WS 44800 + 256 [0]
254,4    6      345     0.012645078 26163  Q  WS 45056 + 256 [dd]
254,4    6      346     0.012666878 26163  Q  WS 45312 + 256 [dd]
254,4    6      347     0.012681697 26163  Q  WS 45568 + 256 [dd]
254,4    6      348     0.012698810 26163  Q  WS 45824 + 256 [dd]
254,4    6      349     0.012713102 26163  Q  WS 46080 + 256 [dd]
254,4    6      350     0.012729949 26163  Q  WS 46336 + 256 [dd]
254,4    6      351     0.012747261 26163  C  WS 45056 + 256 [0]
254,4    6      352     0.012753062 26163  Q  WS 46592 + 256 [dd]
254,4    6      353     0.012768367 26163  Q  WS 46848 + 256 [dd]
254,4    6      354     0.012778163 26163  C  WS 45312 + 256 [0]
254,4    6      355     0.012827184     0  C  WS 45568 + 256 [0]
254,4    6      356     0.012864919     0  C  WS 45824 + 256 [0]
254,4    6      357     0.012902473     0  C  WS 46080 + 256 [0]
254,4    6      358     0.012940546     0  C  WS 46336 + 256 [0]
254,4    6      359     0.012977944     0  C  WS 46592 + 256 [0]
254,4    6      360     0.013034618     0  C  WS 46848 + 256 [0]
254,4    6      361     0.013188649 26163  Q  WS 47104 + 256 [dd]
254,4    6      362     0.013210547 26163  Q  WS 47360 + 256 [dd]
254,4    6      363     0.013225482 26163  Q  WS 47616 + 256 [dd]
254,4    6      364     0.013242528 26163  Q  WS 47872 + 256 [dd]
254,4    6      365     0.013256741 26163  Q  WS 48128 + 256 [dd]
254,4    6      366     0.013273261 26163  Q  WS 48384 + 256 [dd]
254,4    6      367     0.013288861 26163  Q  WS 48640 + 256 [dd]
254,4    6      368     0.013301597 26163  C  WS 47104 + 256 [0]
254,4    6      369     0.013315064 26163  Q  WS 48896 + 256 [dd]
254,4    6      370     0.013331060     0  C  WS 47360 + 256 [0]
254,4    6      371     0.013373835     0  C  WS 47616 + 256 [0]
254,4    6      372     0.013437757     0  C  WS 47872 + 256 [0]
254,4    6      373     0.013453782     0  C  WS 48128 + 256 [0]
254,4    6      374     0.013516680     0  C  WS 48384 + 256 [0]
254,4    6      375     0.013550330     0  C  WS 48640 + 256 [0]
254,4    6      376     0.013593629     0  C  WS 48896 + 256 [0]
254,4    6      377     0.013740353 26163  Q  WS 49152 + 256 [dd]
254,4    6      378     0.013761896 26163  Q  WS 49408 + 256 [dd]
254,4    6      379     0.013776825 26163  Q  WS 49664 + 256 [dd]
254,4    6      380     0.013794441 26163  Q  WS 49920 + 256 [dd]
254,4    6      381     0.013810114 26163  Q  WS 50176 + 256 [dd]
254,4    6      382     0.013827204 26163  Q  WS 50432 + 256 [dd]
254,4    6      383     0.013841572 26163  Q  WS 50688 + 256 [dd]
254,4    6      384     0.013846373 26163  C  WS 49152 + 256 [0]
254,4    6      385     0.013864700 26163  Q  WS 50944 + 256 [dd]
254,4    6      386     0.013877284 26163  C  WS 49408 + 256 [0]
254,4    6      387     0.013928388     0  C  WS 49664 + 256 [0]
254,4    6      388     0.013977190     0  C  WS 49920 + 256 [0]
254,4    6      389     0.013998716     0  C  WS 50176 + 256 [0]
254,4    6      390     0.014041189     0  C  WS 50432 + 256 [0]
254,4    6      391     0.014099019     0  C  WS 50688 + 256 [0]
254,4    6      392     0.014129527     0  C  WS 50944 + 256 [0]
254,4    6      393     0.014275012 26163  Q  WS 51200 + 256 [dd]
254,4    6      394     0.014296903 26163  Q  WS 51456 + 256 [dd]
254,4    6      395     0.014311612 26163  Q  WS 51712 + 256 [dd]
254,4    6      396     0.014329008 26163  Q  WS 51968 + 256 [dd]
254,4    6      397     0.014343785 26163  Q  WS 52224 + 256 [dd]
254,4    6      398     0.014360544 26163  Q  WS 52480 + 256 [dd]
254,4    6      399     0.014375245 26163  Q  WS 52736 + 256 [dd]
254,4    6      400     0.014380120 26163  C  WS 51200 + 256 [0]
254,4    6      401     0.014398394 26163  Q  WS 52992 + 256 [dd]
254,4    6      402     0.014414610     0  C  WS 51456 + 256 [0]
254,4    6      403     0.014458877     0  C  WS 51712 + 256 [0]
254,4    6      404     0.014501784     0  C  WS 51968 + 256 [0]
254,4    6      405     0.014536084     0  C  WS 52224 + 256 [0]
254,4    6      406     0.014575079     0  C  WS 52480 + 256 [0]
254,4    6      407     0.014611056     0  C  WS 52736 + 256 [0]
254,4    6      408     0.014648995     0  C  WS 52992 + 256 [0]
254,4    6      409     0.014795198 26163  Q  WS 53248 + 256 [dd]
254,4    6      410     0.014816866 26163  Q  WS 53504 + 256 [dd]
254,4    6      411     0.014831801 26163  Q  WS 53760 + 256 [dd]
254,4    6      412     0.014848969 26163  Q  WS 54016 + 256 [dd]
254,4    6      413     0.014864696 26163  Q  WS 54272 + 256 [dd]
254,4    6      414     0.014881321 26163  Q  WS 54528 + 256 [dd]
254,4    6      415     0.014896556 26163  C  WS 53248 + 256 [0]
254,4    6      416     0.014903326 26163  Q  WS 54784 + 256 [dd]
254,4    6      417     0.014918483 26163  Q  WS 55040 + 256 [dd]
254,4    6      418     0.014931050 26163  C  WS 53504 + 256 [0]
254,4    6      419     0.014981138     0  C  WS 53760 + 256 [0]
254,4    6      420     0.015012732     0  C  WS 54016 + 256 [0]
254,4    6      421     0.015049825     0  C  WS 54272 + 256 [0]
254,4    6      422     0.015087878     0  C  WS 54528 + 256 [0]
254,4    6      423     0.015124537     0  C  WS 54784 + 256 [0]
254,4    6      424     0.015161860     0  C  WS 55040 + 256 [0]
254,4    6      425     0.015305938 26163  Q  WS 55296 + 256 [dd]
254,4    6      426     0.015327390 26163  Q  WS 55552 + 256 [dd]
254,4    6      427     0.015342392 26163  Q  WS 55808 + 256 [dd]
254,4    6      428     0.015359227 26163  Q  WS 56064 + 256 [dd]
254,4    6      429     0.015374156 26163  Q  WS 56320 + 256 [dd]
254,4    6      430     0.015391073 26163  Q  WS 56576 + 256 [dd]
254,4    6      431     0.015406637 26163  C  WS 55296 + 256 [0]
254,4    6      432     0.015413529 26163  Q  WS 56832 + 256 [dd]
254,4    6      433     0.015428823 26163  Q  WS 57088 + 256 [dd]
254,4    6      434     0.015438595 26163  C  WS 55552 + 256 [0]
254,4    6      435     0.015491608     0  C  WS 55808 + 256 [0]
254,4    6      436     0.015523663     0  C  WS 56064 + 256 [0]
254,4    6      437     0.015560512     0  C  WS 56320 + 256 [0]
254,4    6      438     0.015598478     0  C  WS 56576 + 256 [0]
254,4    6      439     0.015635811     0  C  WS 56832 + 256 [0]
254,4    6      440     0.015672370     0  C  WS 57088 + 256 [0]
254,4    6      441     0.015816063 26163  Q  WS 57344 + 256 [dd]
254,4    6      442     0.015837810 26163  Q  WS 57600 + 256 [dd]
254,4    6      443     0.015852551 26163  Q  WS 57856 + 256 [dd]
254,4    6      444     0.015870876 26163  Q  WS 58112 + 256 [dd]
254,4    6      445     0.015885516 26163  Q  WS 58368 + 256 [dd]
254,4    6      446     0.015902732 26163  Q  WS 58624 + 256 [dd]
254,4    6      447     0.015914322 26163  C  WS 57344 + 256 [0]
254,4    6      448     0.015928158 26163  Q  WS 58880 + 256 [dd]
254,4    6      449     0.015944092 26163  C  WS 57600 + 256 [0]
254,4    6      450     0.015950129 26163  Q  WS 59136 + 256 [dd]
254,4    6      451     0.015999157     0  C  WS 57856 + 256 [0]
254,4    6      452     0.016030864     0  C  WS 58112 + 256 [0]
254,4    6      453     0.016067961     0  C  WS 58368 + 256 [0]
254,4    6      454     0.016104680     0  C  WS 58624 + 256 [0]
254,4    6      455     0.016142358     0  C  WS 58880 + 256 [0]
254,4    6      456     0.016179101     0  C  WS 59136 + 256 [0]
254,4    6      457     0.016322521 26163  Q  WS 59392 + 256 [dd]
254,4    6      458     0.016344477 26163  Q  WS 59648 + 256 [dd]
254,4    6      459     0.016359518 26163  Q  WS 59904 + 256 [dd]
254,4    6      460     0.016376255 26163  Q  WS 60160 + 256 [dd]
254,4    6      461     0.016390334 26163  Q  WS 60416 + 256 [dd]
254,4    6      462     0.016407308 26163  Q  WS 60672 + 256 [dd]
254,4    6      463     0.016425860 26163  C  WS 59392 + 256 [0]
254,4    6      464     0.016430239 26163  Q  WS 60928 + 256 [dd]
254,4    6      465     0.016445594 26163  Q  WS 61184 + 256 [dd]
254,4    6      466     0.016456560 26163  C  WS 59648 + 256 [0]
254,4    6      467     0.016507345     0  C  WS 59904 + 256 [0]
254,4    6      468     0.016544542     0  C  WS 60160 + 256 [0]
254,4    6      469     0.016579911     0  C  WS 60416 + 256 [0]
254,4    6      470     0.016618107     0  C  WS 60672 + 256 [0]
254,4    6      471     0.016657459     0  C  WS 60928 + 256 [0]
254,4    6      472     0.016713883     0  C  WS 61184 + 256 [0]
254,4    6      473     0.016868351 26163  Q  WS 61440 + 256 [dd]
254,4    6      474     0.016890171 26163  Q  WS 61696 + 256 [dd]
254,4    6      475     0.016904464 26163  Q  WS 61952 + 256 [dd]
254,4    6      476     0.016921445 26163  Q  WS 62208 + 256 [dd]
254,4    6      477     0.016935785 26163  Q  WS 62464 + 256 [dd]
254,4    6      478     0.016952980 26163  Q  WS 62720 + 256 [dd]
254,4    6      479     0.016966172 26163  C  WS 61440 + 256 [0]
254,4    6      480     0.016980018 26163  Q  WS 62976 + 256 [dd]
254,4    6      481     0.016995621 26163  C  WS 61696 + 256 [0]
254,4    6      482     0.017001616 26163  Q  WS 63232 + 256 [dd]
254,4    6      483     0.017055285     0  C  WS 61952 + 256 [0]
254,4    6      484     0.017080447     0  C  WS 62208 + 256 [0]
254,4    6      485     0.017119277     0  C  WS 62464 + 256 [0]
254,4    6      486     0.017184670     0  C  WS 62720 + 256 [0]
254,4    6      487     0.017213496     0  C  WS 62976 + 256 [0]
254,4    6      488     0.017253414     0  C  WS 63232 + 256 [0]
254,4    6      489     0.017377782 26163  Q  WS 63488 + 256 [dd]
254,4    6      490     0.017399415 26163  Q  WS 63744 + 256 [dd]
254,4    6      491     0.017414289 26163  Q  WS 64000 + 256 [dd]
254,4    6      492     0.017431248 26163  Q  WS 64256 + 256 [dd]
254,4    6      493     0.017445430 26163  Q  WS 64512 + 256 [dd]
254,4    6      494     0.017463352 26163  Q  WS 64768 + 256 [dd]
254,4    6      495     0.017479809 26163  C  WS 63488 + 256 [0]
254,4    6      496     0.017486501 26163  Q  WS 65024 + 256 [dd]
254,4    6      497     0.017501866 26163  Q  WS 65280 + 256 [dd]
254,4    6      498     0.017510190 26163  C  WS 63744 + 256 [0]
254,4    6      499     0.017562685     0  C  WS 64000 + 256 [0]
254,4    6      500     0.017595821     0  C  WS 64256 + 256 [0]
254,4    6      501     0.017634890     0  C  WS 64512 + 256 [0]
254,4    6      502     0.017670503     0  C  WS 64768 + 256 [0]
254,4    6      503     0.017709237     0  C  WS 65024 + 256 [0]
254,4    6      504     0.017745081     0  C  WS 65280 + 256 [0]
254,4    6      505     0.017869366 26163  Q  WS 65536 + 256 [dd]
254,4    6      506     0.017890020 26163  Q  WS 65792 + 256 [dd]
254,4    6      507     0.017903600 26163  Q  WS 66048 + 256 [dd]
254,4    6      508     0.017919633 26163  Q  WS 66304 + 256 [dd]
254,4    6      509     0.017933154 26163  Q  WS 66560 + 256 [dd]
254,4    6      510     0.017948820 26163  Q  WS 66816 + 256 [dd]
254,4    6      511     0.017961701 26163  Q  WS 67072 + 256 [dd]
254,4    6      512     0.017971827 26163  C  WS 65536 + 256 [0]
254,4    6      513     0.017984498 26163  Q  WS 67328 + 256 [dd]
254,4    6      514     0.018004338     0  C  WS 65792 + 256 [0]
254,4    6      515     0.018049734     0  C  WS 66048 + 256 [0]
254,4    6      516     0.018104333     0  C  WS 66304 + 256 [0]
254,4    6      517     0.018129792     0  C  WS 66560 + 256 [0]
254,4    6      518     0.018169020     0  C  WS 66816 + 256 [0]
254,4    6      519     0.018204433     0  C  WS 67072 + 256 [0]
254,4    6      520     0.018242469     0  C  WS 67328 + 256 [0]
254,4    6      521     0.018387443 26163  Q  WS 67584 + 256 [dd]
254,4    6      522     0.018408496 26163  Q  WS 67840 + 256 [dd]
254,4    6      523     0.018421813 26163  Q  WS 68096 + 256 [dd]
254,4    6      524     0.018437221 26163  Q  WS 68352 + 256 [dd]
254,4    6      525     0.018450734 26163  Q  WS 68608 + 256 [dd]
254,4    6      526     0.018467005 26163  Q  WS 68864 + 256 [dd]
254,4    6      527     0.018480245 26163  Q  WS 69120 + 256 [dd]
254,4    6      528     0.018489877 26163  C  WS 67584 + 256 [0]
254,4    6      529     0.018502668 26163  Q  WS 69376 + 256 [dd]
254,4    6      530     0.018519906     0  C  WS 67840 + 256 [0]
254,4    6      531     0.018564932     0  C  WS 68096 + 256 [0]
254,4    6      532     0.018608220     0  C  WS 68352 + 256 [0]
254,4    6      533     0.018643259     0  C  WS 68608 + 256 [0]
254,4    6      534     0.018687299     0  C  WS 68864 + 256 [0]
254,4    6      535     0.018721843     0  C  WS 69120 + 256 [0]
254,4    6      536     0.018757312     0  C  WS 69376 + 256 [0]
254,4    6      537     0.018903721 26163  Q  WS 69632 + 256 [dd]
254,4    6      538     0.018924703 26163  Q  WS 69888 + 256 [dd]
254,4    6      539     0.018938551 26163  Q  WS 70144 + 256 [dd]
254,4    6      540     0.018954307 26163  Q  WS 70400 + 256 [dd]
254,4    6      541     0.018967733 26163  Q  WS 70656 + 256 [dd]
254,4    6      542     0.018983141 26163  Q  WS 70912 + 256 [dd]
254,4    6      543     0.018995774 26163  Q  WS 71168 + 256 [dd]
254,4    6      544     0.019012254 26163  C  WS 69632 + 256 [0]
254,4    6      545     0.019018697 26163  Q  WS 71424 + 256 [dd]
254,4    6      546     0.019039902     0  C  WS 69888 + 256 [0]
254,4    6      547     0.019084219     0  C  WS 70144 + 256 [0]
254,4    6      548     0.019139497     0  C  WS 70400 + 256 [0]
254,4    6      549     0.019159813     0  C  WS 70656 + 256 [0]
254,4    6      550     0.019204284     0  C  WS 70912 + 256 [0]
254,4    6      551     0.019237451     0  C  WS 71168 + 256 [0]
254,4    6      552     0.019276673     0  C  WS 71424 + 256 [0]
254,4    6      553     0.019421466 26163  Q  WS 71680 + 256 [dd]
254,4    6      554     0.019442251 26163  Q  WS 71936 + 256 [dd]
254,4    6      555     0.019455572 26163  Q  WS 72192 + 256 [dd]
254,4    6      556     0.019471096 26163  Q  WS 72448 + 256 [dd]
254,4    6      557     0.019483986 26163  Q  WS 72704 + 256 [dd]
254,4    6      558     0.019500337 26163  Q  WS 72960 + 256 [dd]
254,4    6      559     0.019512890 26163  Q  WS 73216 + 256 [dd]
254,4    6      560     0.019521639 26163  C  WS 71680 + 256 [0]
254,4    6      561     0.019534148 26163  Q  WS 73472 + 256 [dd]
254,4    6      562     0.019551060     0  C  WS 71936 + 256 [0]
254,4    6      563     0.019595023     0  C  WS 72192 + 256 [0]
254,4    6      564     0.019641546     0  C  WS 72448 + 256 [0]
254,4    6      565     0.019678617     0  C  WS 72704 + 256 [0]
254,4    6      566     0.019742040     0  C  WS 72960 + 256 [0]
254,4    6      567     0.019769119     0  C  WS 73216 + 256 [0]
254,4    6      568     0.019808558     0  C  WS 73472 + 256 [0]
254,4    6      569     0.019954101 26163  Q  WS 73728 + 256 [dd]
254,4    6      570     0.019975137 26163  Q  WS 73984 + 256 [dd]
254,4    6      571     0.019988523 26163  Q  WS 74240 + 256 [dd]
254,4    6      572     0.020005417 26163  Q  WS 74496 + 256 [dd]
254,4    6      573     0.020018746 26163  Q  WS 74752 + 256 [dd]
254,4    6      574     0.020033850 26163  Q  WS 75008 + 256 [dd]
254,4    6      575     0.020046979 26163  Q  WS 75264 + 256 [dd]
254,4    6      576     0.020058196 26163  C  WS 73728 + 256 [0]
254,4    6      577     0.020071065 26163  Q  WS 75520 + 256 [dd]
254,4    6      578     0.020090037     0  C  WS 73984 + 256 [0]
254,4    6      579     0.020138048     0  C  WS 74240 + 256 [0]
254,4    6      580     0.020174751     0  C  WS 74496 + 256 [0]
254,4    6      581     0.020212282     0  C  WS 74752 + 256 [0]
254,4    6      582     0.020249121     0  C  WS 75008 + 256 [0]
254,4    6      583     0.020286225     0  C  WS 75264 + 256 [0]
254,4    6      584     0.020323402     0  C  WS 75520 + 256 [0]
254,4    6      585     0.020468849 26163  Q  WS 75776 + 256 [dd]
254,4    6      586     0.020490006 26163  Q  WS 76032 + 256 [dd]
254,4    6      587     0.020503337 26163  Q  WS 76288 + 256 [dd]
254,4    6      588     0.020518730 26163  Q  WS 76544 + 256 [dd]
254,4    6      589     0.020531745 26163  Q  WS 76800 + 256 [dd]
254,4    6      590     0.020547539 26163  Q  WS 77056 + 256 [dd]
254,4    6      591     0.020560706 26163  Q  WS 77312 + 256 [dd]
254,4    6      592     0.020571631 26163  C  WS 75776 + 256 [0]
254,4    6      593     0.020584017 26163  Q  WS 77568 + 256 [dd]
254,4    6      594     0.020602255     0  C  WS 76032 + 256 [0]
254,4    6      595     0.020652664     0  C  WS 76288 + 256 [0]
254,4    6      596     0.020688645     0  C  WS 76544 + 256 [0]
254,4    6      597     0.020726674     0  C  WS 76800 + 256 [0]
254,4    6      598     0.020765750     0  C  WS 77056 + 256 [0]
254,4    6      599     0.020807610     0  C  WS 77312 + 256 [0]
254,4    6      600     0.020852727     0  C  WS 77568 + 256 [0]
254,4    6      601     0.020998741 26163  Q  WS 77824 + 256 [dd]
254,4    6      602     0.021019319 26163  Q  WS 78080 + 256 [dd]
254,4    6      603     0.021032828 26163  Q  WS 78336 + 256 [dd]
254,4    6      604     0.021048755 26163  Q  WS 78592 + 256 [dd]
254,4    6      605     0.021062629 26163  Q  WS 78848 + 256 [dd]
254,4    6      606     0.021077961 26163  Q  WS 79104 + 256 [dd]
254,4    6      607     0.021090541 26163  Q  WS 79360 + 256 [dd]
254,4    6      608     0.021102218 26163  C  WS 77824 + 256 [0]
254,4    6      609     0.021114886 26163  Q  WS 79616 + 256 [dd]
254,4    6      610     0.021133574     0  C  WS 78080 + 256 [0]
254,4    6      611     0.021178872     0  C  WS 78336 + 256 [0]
254,4    6      612     0.021215465     0  C  WS 78592 + 256 [0]
254,4    6      613     0.021254469     0  C  WS 78848 + 256 [0]
254,4    6      614     0.021293547     0  C  WS 79104 + 256 [0]
254,4    6      615     0.021331760     0  C  WS 79360 + 256 [0]
254,4    6      616     0.021368123     0  C  WS 79616 + 256 [0]
254,4    6      617     0.021493627 26163  Q  WS 79872 + 256 [dd]
254,4    6      618     0.021514143 26163  Q  WS 80128 + 256 [dd]
254,4    6      619     0.021527499 26163  Q  WS 80384 + 256 [dd]
254,4    6      620     0.021543139 26163  Q  WS 80640 + 256 [dd]
254,4    6      621     0.021556087 26163  Q  WS 80896 + 256 [dd]
254,4    6      622     0.021571378 26163  Q  WS 81152 + 256 [dd]
254,4    6      623     0.021585096 26163  Q  WS 81408 + 256 [dd]
254,4    6      624     0.021598771 26163  C  WS 79872 + 256 [0]
254,4    6      625     0.021611292 26163  Q  WS 81664 + 256 [dd]
254,4    6      626     0.021627924     0  C  WS 80128 + 256 [0]
254,4    6      627     0.021673172     0  C  WS 80384 + 256 [0]
254,4    6      628     0.021720451     0  C  WS 80640 + 256 [0]
254,4    6      629     0.021754093     0  C  WS 80896 + 256 [0]
254,4    6      630     0.021793228     0  C  WS 81152 + 256 [0]
254,4    6      631     0.021830144     0  C  WS 81408 + 256 [0]
254,4    6      632     0.021886999     0  C  WS 81664 + 256 [0]
254,4    6      633     0.022056669 26163  Q  WS 81920 + 256 [dd]
254,4    6      634     0.022077439 26163  Q  WS 82176 + 256 [dd]
254,4    6      635     0.022090847 26163  Q  WS 82432 + 256 [dd]
254,4    6      636     0.022107234 26163  Q  WS 82688 + 256 [dd]
254,4    6      637     0.022120865 26163  Q  WS 82944 + 256 [dd]
254,4    6      638     0.022135815 26163  Q  WS 83200 + 256 [dd]
254,4    6      639     0.022148939 26163  Q  WS 83456 + 256 [dd]
254,4    6      640     0.022158966 26163  C  WS 81920 + 256 [0]
254,4    6      641     0.022171436 26163  Q  WS 83712 + 256 [dd]
254,4    6      642     0.022188494     0  C  WS 82176 + 256 [0]
254,4    6      643     0.022230205     0  C  WS 82432 + 256 [0]
254,4    6      644     0.022277741     0  C  WS 82688 + 256 [0]
254,4    6      645     0.022310360     0  C  WS 82944 + 256 [0]
254,4    6      646     0.022349162     0  C  WS 83200 + 256 [0]
254,4    6      647     0.022408067     0  C  WS 83456 + 256 [0]
254,4    6      648     0.022439170     0  C  WS 83712 + 256 [0]
254,4    6      649     0.022583111 26163  Q  WS 83968 + 256 [dd]
254,4    6      650     0.022603873 26163  Q  WS 84224 + 256 [dd]
254,4    6      651     0.022617323 26163  Q  WS 84480 + 256 [dd]
254,4    6      652     0.022632794 26163  Q  WS 84736 + 256 [dd]
254,4    6      653     0.022645826 26163  Q  WS 84992 + 256 [dd]
254,4    6      654     0.022661383 26163  Q  WS 85248 + 256 [dd]
254,4    6      655     0.022674886 26163  Q  WS 85504 + 256 [dd]
254,4    6      656     0.022687442 26163  C  WS 83968 + 256 [0]
254,4    6      657     0.022700204 26163  Q  WS 85760 + 256 [dd]
254,4    6      658     0.022717036     0  C  WS 84224 + 256 [0]
254,4    6      659     0.022764463     0  C  WS 84480 + 256 [0]
254,4    6      660     0.022802836     0  C  WS 84736 + 256 [0]
254,4    6      661     0.022840584     0  C  WS 84992 + 256 [0]
254,4    6      662     0.022878694     0  C  WS 85248 + 256 [0]
254,4    6      663     0.022916248     0  C  WS 85504 + 256 [0]
254,4    6      664     0.022953475     0  C  WS 85760 + 256 [0]
254,4    6      665     0.023100053 26163  Q  WS 86016 + 256 [dd]
254,4    6      666     0.023120832 26163  Q  WS 86272 + 256 [dd]
254,4    6      667     0.023134446 26163  Q  WS 86528 + 256 [dd]
254,4    6      668     0.023150179 26163  Q  WS 86784 + 256 [dd]
254,4    6      669     0.023163245 26163  Q  WS 87040 + 256 [dd]
254,4    6      670     0.023178752 26163  Q  WS 87296 + 256 [dd]
254,4    6      671     0.023191860 26163  Q  WS 87552 + 256 [dd]
254,4    6      672     0.023198246 26163  C  WS 86016 + 256 [0]
254,4    6      673     0.023214447 26163  Q  WS 87808 + 256 [dd]
254,4    6      674     0.023228629     0  C  WS 86272 + 256 [0]
254,4    6      675     0.023270782     0  C  WS 86528 + 256 [0]
254,4    6      676     0.023318645     0  C  WS 86784 + 256 [0]
254,4    6      677     0.023351542     0  C  WS 87040 + 256 [0]
254,4    6      678     0.023390072     0  C  WS 87296 + 256 [0]
254,4    6      679     0.023431907     0  C  WS 87552 + 256 [0]
254,4    6      680     0.023464219     0  C  WS 87808 + 256 [0]
254,4    6      681     0.023609358 26163  Q  WS 88064 + 256 [dd]
254,4    6      682     0.023630202 26163  Q  WS 88320 + 256 [dd]
254,4    6      683     0.023643991 26163  Q  WS 88576 + 256 [dd]
254,4    6      684     0.023659775 26163  Q  WS 88832 + 256 [dd]
254,4    6      685     0.023672289 26163  Q  WS 89088 + 256 [dd]
254,4    6      686     0.023688533 26163  Q  WS 89344 + 256 [dd]
254,4    6      687     0.023700999 26163  Q  WS 89600 + 256 [dd]
254,4    6      688     0.023710667 26163  C  WS 88064 + 256 [0]
254,4    6      689     0.023722954 26163  Q  WS 89856 + 256 [dd]
254,4    6      690     0.023740810     0  C  WS 88320 + 256 [0]
254,4    6      691     0.023785449     0  C  WS 88576 + 256 [0]
254,4    6      692     0.023827461     0  C  WS 88832 + 256 [0]
254,4    6      693     0.023865712     0  C  WS 89088 + 256 [0]
254,4    6      694     0.023924807     0  C  WS 89344 + 256 [0]
254,4    6      695     0.023955452     0  C  WS 89600 + 256 [0]
254,4    6      696     0.023994580     0  C  WS 89856 + 256 [0]
254,4    6      697     0.024141185 26163  Q  WS 90112 + 256 [dd]
254,4    6      698     0.024162272 26163  Q  WS 90368 + 256 [dd]
254,4    6      699     0.024176068 26163  Q  WS 90624 + 256 [dd]
254,4    6      700     0.024191841 26163  Q  WS 90880 + 256 [dd]
254,4    6      701     0.024204708 26163  Q  WS 91136 + 256 [dd]
254,4    6      702     0.024219976 26163  Q  WS 91392 + 256 [dd]
254,4    6      703     0.024233063 26163  Q  WS 91648 + 256 [dd]
254,4    6      704     0.024243632 26163  C  WS 90112 + 256 [0]
254,4    6      705     0.024255963 26163  Q  WS 91904 + 256 [dd]
254,4    6      706     0.024272472     0  C  WS 90368 + 256 [0]
254,4    6      707     0.024314250     0  C  WS 90624 + 256 [0]
254,4    6      708     0.024374797     0  C  WS 90880 + 256 [0]
254,4    6      709     0.024394060     0  C  WS 91136 + 256 [0]
254,4    6      710     0.024439073     0  C  WS 91392 + 256 [0]
254,4    6      711     0.024477015     0  C  WS 91648 + 256 [0]
254,4    6      712     0.024532597     0  C  WS 91904 + 256 [0]
254,4    6      713     0.024688404 26163  Q  WS 92160 + 256 [dd]
254,4    6      714     0.024709054 26163  Q  WS 92416 + 256 [dd]
254,4    6      715     0.024722603 26163  Q  WS 92672 + 256 [dd]
254,4    6      716     0.024738557 26163  Q  WS 92928 + 256 [dd]
254,4    6      717     0.024751372 26163  Q  WS 93184 + 256 [dd]
254,4    6      718     0.024766271 26163  Q  WS 93440 + 256 [dd]
254,4    6      719     0.024779368 26163  Q  WS 93696 + 256 [dd]
254,4    6      720     0.024791359 26163  C  WS 92160 + 256 [0]
254,4    6      721     0.024805547 26163  Q  WS 93952 + 256 [dd]
254,4    6      722     0.024820398     0  C  WS 92416 + 256 [0]
254,4    6      723     0.024865665     0  C  WS 92672 + 256 [0]
254,4    6      724     0.024908119     0  C  WS 92928 + 256 [0]
254,4    6      725     0.024942750     0  C  WS 93184 + 256 [0]
254,4    6      726     0.024981724     0  C  WS 93440 + 256 [0]
254,4    6      727     0.025016826     0  C  WS 93696 + 256 [0]
254,4    6      728     0.025054705     0  C  WS 93952 + 256 [0]
254,4    6      729     0.025199813 26163  Q  WS 94208 + 256 [dd]
254,4    6      730     0.025220944 26163  Q  WS 94464 + 256 [dd]
254,4    6      731     0.025234318 26163  Q  WS 94720 + 256 [dd]
254,4    6      732     0.025250268 26163  Q  WS 94976 + 256 [dd]
254,4    6      733     0.025263625 26163  Q  WS 95232 + 256 [dd]
254,4    6      734     0.025278978 26163  Q  WS 95488 + 256 [dd]
254,4    6      735     0.025292303 26163  Q  WS 95744 + 256 [dd]
254,4    6      736     0.025306522 26163  C  WS 94208 + 256 [0]
254,4    6      737     0.025312763 26163  Q  WS 96000 + 256 [dd]
254,4    6      738     0.025338493     0  C  WS 94464 + 256 [0]
254,4    6      739     0.025380853     0  C  WS 94720 + 256 [0]
254,4    6      740     0.025432526     0  C  WS 94976 + 256 [0]
254,4    6      741     0.025465753     0  C  WS 95232 + 256 [0]
254,4    6      742     0.025503167     0  C  WS 95488 + 256 [0]
254,4    6      743     0.025540695     0  C  WS 95744 + 256 [0]
254,4    6      744     0.025577658     0  C  WS 96000 + 256 [0]
254,4    6      745     0.025723129 26163  Q  WS 96256 + 256 [dd]
254,4    6      746     0.025744216 26163  Q  WS 96512 + 256 [dd]
254,4    6      747     0.025757655 26163  Q  WS 96768 + 256 [dd]
254,4    6      748     0.025773576 26163  Q  WS 97024 + 256 [dd]
254,4    6      749     0.025786352 26163  Q  WS 97280 + 256 [dd]
254,4    6      750     0.025801532 26163  Q  WS 97536 + 256 [dd]
254,4    6      751     0.025813867 26163  Q  WS 97792 + 256 [dd]
254,4    6      752     0.025828302 26163  C  WS 96256 + 256 [0]
254,4    6      753     0.025833758 26163  Q  WS 98048 + 256 [dd]
254,4    6      754     0.025860851     0  C  WS 96512 + 256 [0]
254,4    6      755     0.025904763     0  C  WS 96768 + 256 [0]
254,4    6      756     0.025954857     0  C  WS 97024 + 256 [0]
254,4    6      757     0.025987393     0  C  WS 97280 + 256 [0]
254,4    6      758     0.026027113     0  C  WS 97536 + 256 [0]
254,4    6      759     0.026063558     0  C  WS 97792 + 256 [0]
254,4    6      760     0.026101387     0  C  WS 98048 + 256 [0]
254,4    6      761     0.026227369 26163  Q  WS 98304 + 256 [dd]
254,4    6      762     0.026247749 26163  Q  WS 98560 + 256 [dd]
254,4    6      763     0.026260772 26163  Q  WS 98816 + 256 [dd]
254,4    6      764     0.026275969 26163  Q  WS 99072 + 256 [dd]
254,4    6      765     0.026289336 26163  Q  WS 99328 + 256 [dd]
254,4    6      766     0.026304896 26163  Q  WS 99584 + 256 [dd]
254,4    6      767     0.026318432 26163  Q  WS 99840 + 256 [dd]
254,4    6      768     0.026332751 26163  C  WS 98304 + 256 [0]
254,4    6      769     0.026339293 26163  Q  WS 100096 + 256 [dd]
254,4    6      770     0.026363993     0  C  WS 98560 + 256 [0]
254,4    6      771     0.026408697     0  C  WS 98816 + 256 [0]
254,4    6      772     0.026457000     0  C  WS 99072 + 256 [0]
254,4    6      773     0.026490786     0  C  WS 99328 + 256 [0]
254,4    6      774     0.026529871     0  C  WS 99584 + 256 [0]
254,4    6      775     0.026564926     0  C  WS 99840 + 256 [0]
254,4    6      776     0.026602951     0  C  WS 100096 + 256 [0]
254,4    6      777     0.026747744 26163  Q  WS 100352 + 256 [dd]
254,4    6      778     0.026768136 26163  Q  WS 100608 + 256 [dd]
254,4    6      779     0.026781826 26163  Q  WS 100864 + 256 [dd]
254,4    6      780     0.026797718 26163  Q  WS 101120 + 256 [dd]
254,4    6      781     0.026810855 26163  Q  WS 101376 + 256 [dd]
254,4    6      782     0.026826486 26163  Q  WS 101632 + 256 [dd]
254,4    6      783     0.026839225 26163  Q  WS 101888 + 256 [dd]
254,4    6      784     0.026854816 26163  C  WS 100352 + 256 [0]
254,4    6      785     0.026859799 26163  Q  WS 102144 + 256 [dd]
254,4    6      786     0.026887749     0  C  WS 100608 + 256 [0]
254,4    6      787     0.026931737     0  C  WS 100864 + 256 [0]
254,4    6      788     0.026971306     0  C  WS 101120 + 256 [0]
254,4    6      789     0.027006398     0  C  WS 101376 + 256 [0]
254,4    6      790     0.027045289     0  C  WS 101632 + 256 [0]
254,4    6      791     0.027082976     0  C  WS 101888 + 256 [0]
254,4    6      792     0.027141329     0  C  WS 102144 + 256 [0]
CPU6 (dm-4):
 Reads Queued:           0,        0KiB  Writes Queued:         392,    
50176KiB
 Read Dispatches:        0,        0KiB  Write Dispatches:        0,        
0KiB
 Reads Requeued:         0               Writes Requeued:         0
 Reads Completed:        0,        0KiB  Writes Completed:      400,    
51200KiB
 Read Merges:            0,        0KiB  Write Merges:            0,        
0KiB
 Read depth:             0               Write depth:             0
 IO unplugs:             0               Timer unplugs:           0
CPU19 (dm-4):
 Reads Queued:           0,        0KiB  Writes Queued:           8,     
1024KiB
 Read Dispatches:        0,        0KiB  Write Dispatches:        0,        
0KiB
 Reads Requeued:         0               Writes Requeued:         0
 Reads Completed:        0,        0KiB  Writes Completed:        0,        
0KiB
 Read Merges:            0,        0KiB  Write Merges:            0,        
0KiB
 Read depth:             0               Write depth:             0
 IO unplugs:             0               Timer unplugs:           0

Total (dm-4):
 Reads Queued:           0,        0KiB  Writes Queued:         400,    
51200KiB
 Read Dispatches:        0,        0KiB  Write Dispatches:        0,        
0KiB
 Reads Requeued:         0               Writes Requeued:         0
 Reads Completed:        0,        0KiB  Writes Completed:      400,    
51200KiB
 Read Merges:            0,        0KiB  Write Merges:            0,        
0KiB
 IO unplugs:             0               Timer unplugs:           0

Throughput (R/W): 0KiB/s / 1896296KiB/s
Events (dm-4): 800 entries
Skips: 0 forward (0 -   0.0%)



More information about the drbd-user mailing list