[DRBD-user] performance issues DRBD8.3.1 on Serveraid 8k

Robert.Koeppl at knapp.com Robert.Koeppl at knapp.com
Fri Jul 17 10:23:15 CEST 2009

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Good morning!

I am experiencing some troubling performance issues un one of my clusters.
Hardware: 
IBM 3650 16GB RAM, 2xQuadcore Xeon 5450 at 3GHz
ServeRaid 8k. 6x 2,5" SAS 136GB 10kRPM Harddisks dedicated for DRDB as 
RAID 10
256MB Chache, readahead and Write  Cache activated. Stripe Size 256 KB
Interlink over two intel 1Gbit optical NICs, bonded in mode 1

OS:
SLES 10 SP2, 64 bit, Kernel 2.6.16.60-33-smp x86_64
DRBD 8.3.1 compiled from source on that machines.

Oracle 10.2.0.4 running 2 different SIDs at the same time

There are 17 DRBD-Devices running on top of LVM,, the LVM resides on 
/dev/sdb, which is the RAID10 Arraiy mentioned above.

The large Number of devices results from the whish of our DBA to have each 
folder on a different Filesystem and synced independently. Although this 
is far from optimal from a performance view it is fast enough on our other 
systems that have similar setups.

As long as DRBD is running standalone or waiting for connection the system 
runs fine. 
iostat -x of the underlying device gives the following:

Linux 2.6.16.60-0.33-smp (k1327kc1)     16.07.2009

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           0,76    0,00    0,20    0,64    0,00   98,40

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz 
avgqu-sz   await  svctm  %util
sdb              38,13    37,31   17,20   16,22   985,46  1124,75    63,13 
    0,65   19,34   3,00  10,04

iostat -x of the drbd devices gives

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           0,12    0,00    0,06    0,00    0,00   99,81

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz 
avgqu-sz   await  svctm  %util
drbd0             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd1             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd2             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd3             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd4             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd5             0,00     0,00   10,00    8,50   128,00    80,00    11,24 
    0,02    1,08   0,43   0,80
drbd6             0,00     0,00    0,50    8,50    16,00    80,00    10,67 
    0,02    2,00   0,67   0,60
drbd7             0,00     0,00    0,50    8,50    16,00    80,00    10,67 
    0,02    2,00   0,67   0,60
drbd8             0,00     0,00    0,00    1,50     0,00    11,00     7,33 
    0,00    1,33   1,33   0,20
drbd9             0,00     0,00    0,00    1,50     0,00    11,00     7,33 
    0,00    1,33   1,33   0,20
drbd10            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd11            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd12            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd13            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd14            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd15            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd16            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd17            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           0,37    0,00    0,12    0,00    0,00   99,50

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz 
avgqu-sz   await  svctm  %util
drbd0             0,00     0,00    0,00    4,48     0,00    35,82     8,00 
    0,00    0,44   0,44   0,20
drbd1             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd2             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd3             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd4             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd5             0,00     0,00    9,45    5,97   111,44    47,76    10,32 
    0,02    1,42   0,39   0,60
drbd6             0,00     0,00    0,50    5,97    15,92    47,76     9,85 
    0,02    3,69   1,23   0,80
drbd7             0,00     0,00    0,50    5,97    15,92    47,76     9,85 
    0,02    3,38   0,92   0,60
drbd8             0,00     0,00    0,00    2,49     0,00    10,95     4,40 
    0,00    0,00   0,00   0,00
drbd9             0,00     0,00    0,00    2,49     0,00    10,95     4,40 
    0,00    0,00   0,00   0,00
drbd10            0,00     0,00    0,00    0,50     0,00     7,96    16,00 
    0,00    4,00   4,00   0,20
drbd11            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd12            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd13            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd14            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd15            0,00     0,00    0,00    3,98     0,00    31,84     8,00 
    0,00    0,00   0,00   0,00
drbd16            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd17            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00

sometimes peak values are a bit higher, but well within reasonalbe 
boundaries. whzich meand await somewhere up to 30 or 40 ms

if DRBD is connected this changes dramatically:

this is th master side:
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           0,12    0,00    0,12   24,81    0,00   74,94

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz 
avgqu-sz   await  svctm  %util
sda               0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
sdb               6,00     6,00    4,50   10,00   144,00   188,00    22,90 
    0,01    0,41   0,14   0,20
dm-0              0,00     0,00    0,00    1,50     0,00     6,00     4,00 
    0,00    0,00   0,00   0,00
dm-1              0,00     0,00    0,00    1,50     0,00     6,00     4,00 
    0,00    0,00   0,00   0,00
dm-2              0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-3              0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-4              0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-5              0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-6              0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-7              0,00     0,00    9,50    5,00   112,00    64,00    12,14 
    0,00    0,14   0,14   0,20
dm-8              0,00     0,00    0,50    3,00    16,00    48,00    18,29 
    0,00    0,57   0,57   0,20
dm-9              0,00     0,00    0,50    3,00    16,00    48,00    18,29 
    0,00    0,57   0,57   0,20
dm-10             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-11             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-12             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-13             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-14             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
dm-15             0,00     0,00    0,00    1,50     0,00    12,00     8,00 
    0,00    0,00   0,00   0,00
dm-16             0,00     0,00    0,00    0,50     0,00     4,00     8,00 
    0,00    0,00   0,00   0,00
dm-17             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd0             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,48    0,00   0,00  48,20
drbd1             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,51    0,00   0,00  51,20
drbd2             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd3             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd4             0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd5             0,00     0,00    9,50    5,00   112,00    64,00    12,14 
    3,62  356,69  66,62  96,60
drbd6             0,00     0,00    0,50    3,00    16,00    48,00    18,29 
    3,22 1417,71 217,71  76,20
drbd7             0,00     0,00    0,50    3,00    16,00    48,00    18,29 
    3,50 1497,71 225,71  79,00
drbd8             0,00     0,00    0,00    1,50     0,00     6,00     4,00 
    0,72  482,67 381,33  57,20
drbd9             0,00     0,00    0,00    1,50     0,00     6,00     4,00 
    0,78  520,00 400,00  60,00
drbd10            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd11            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd12            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd13            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd14            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00
drbd15            0,00     0,00    0,00    0,50     0,00     4,00     8,00 
    2,34 7988,00 1256,00  62,80
drbd16            0,00     0,00    0,00    1,50     0,00    12,00     8,00 
    1,18  900,00 610,67  91,60
drbd17            0,00     0,00    0,00    0,00     0,00     0,00     0,00 
    0,00    0,00   0,00   0,00


this is on the slave node:

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           0,19    0,00    0,00    0,13    0,00   99,69

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz 
avgqu-sz   await  svctm  %util
sdb               0,00    13,00    0,00   14,00     0,00   272,50    19,46 
    5,49  483,14  71,29  99,80

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           1,19    0,00    1,56    5,87    0,00   91,38

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz 
avgqu-sz   await  svctm  %util
sdb               0,00     6,00    0,00   10,50     0,00   148,00    14,10 
    4,94  343,81  92,19  96,80

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           0,37    0,00    4,80    4,86    0,00   89,96

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz 
avgqu-sz   await  svctm  %util
sdb               0,00    40,80    0,00   14,43     0,00   514,93    35,69 
    3,10  307,31  54,07  78,01


This renders the system completely useless.

Here is the drbd.conf:

global {usage-count no;}
resource r0 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

  disk {
        no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd0;
    disk       /dev/mapper/storage-home;
    address    192.168.0.102:7788;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd0;
    disk       /dev/mapper/storage-home;
    address    192.168.0.103:7788;
    meta-disk  internal;
  }
}


resource r1 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
        no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd1;
    disk       /dev/mapper/storage-optKiSoft;
    address    192.168.0.102:7789;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd1;
    disk       /dev/mapper/storage-optKiSoft;
    address    192.168.0.103:7789;
    meta-disk  internal;
  }
}


resource r2 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

 

  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd2;
    disk       /dev/mapper/storage-optoracle;
    address    192.168.0.102:7790;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd2;
    disk       /dev/mapper/storage-optoracle;
    address    192.168.0.103:7790;
    meta-disk  internal;
  }
}


resource r3 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

 

  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd3;
    disk       /dev/mapper/storage-oradbsystem;
    address    192.168.0.102:7791;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd3;
    disk       /dev/mapper/storage-oradbsystem;
    address    192.168.0.103:7791;
    meta-disk  internal;
  }
}


resource r4 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd4;
    disk       /dev/mapper/storage-oradbrb;
    address    192.168.0.102:7792;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd4;
    disk       /dev/mapper/storage-oradbrb;
    address    192.168.0.103:7792;
    meta-disk  internal;
  }
}


resource r5 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd5;
    disk       /dev/mapper/storage-oradbctrl1;
    address    192.168.0.102:7793;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd5;
    disk       /dev/mapper/storage-oradbctrl1;
    address    192.168.0.103:7793;
    meta-disk  internal;
  }
}


resource r6 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

 

  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd6;
    disk       /dev/mapper/storage-oradbctrl2;
    address    192.168.0.102:7794;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd6;
    disk       /dev/mapper/storage-oradbctrl2;
    address    192.168.0.103:7794;
    meta-disk  internal;
  }
}
resource r7 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

 

  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd7;
    disk       /dev/mapper/storage-oradbctrl3;
    address    192.168.0.102:7795;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd7;
    disk       /dev/mapper/storage-oradbctrl3;
    address    192.168.0.103:7795;
    meta-disk  internal;
  }
}
resource r8 {

handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;



  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }

    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }

   net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }

  syncer {
   rate 100M;
   al-extents 3833;
  }

  on k1327kc1 {
    device     /dev/drbd8;
    disk       /dev/mapper/storage-log1;
    address    192.168.0.102:7796;
    meta-disk  internal;
  }

  on k1327kc2 {
    device     /dev/drbd8;
    disk       /dev/mapper/storage-log1;
    address    192.168.0.103:7796;
    meta-disk  internal;
  }
}
resource r9 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd9;
    disk       /dev/mapper/storage-log2;
    address    192.168.0.102:7797;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd9;
    disk       /dev/mapper/storage-log2;
    address    192.168.0.103:7797;
    meta-disk  internal;
  }
}
resource r10 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
   syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd10;
    disk       /dev/mapper/storage-oradbdata;
    address    192.168.0.102:7798;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd10;
    disk       /dev/mapper/storage-oradbdata;
    address    192.168.0.103:7798;
    meta-disk  internal;
  }
}
resource r11 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd11;
    disk       /dev/mapper/storage-oradbind;
    address    192.168.0.102:7799;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd11;
    disk       /dev/mapper/storage-oradbind;
    address    192.168.0.103:7799;
    meta-disk  internal;
  }
}
resource r12 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd12;
    disk       /dev/mapper/storage-oradbtemp;
    address    192.168.0.102:7800;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd12;
    disk       /dev/mapper/storage-oradbtemp;
    address    192.168.0.103:7800;
    meta-disk  internal;
  }
}

resource r13 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;

  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd13;
    disk       /dev/mapper/storage-oradbredoarchive;
    address    192.168.0.102:7802;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd13;
    disk       /dev/mapper/storage-oradbredoarchive;
    address    192.168.0.103:7802;
    meta-disk  internal;
  }
}
resource r14 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd14;
    disk       /dev/mapper/storage-oradbbackup;
    address    192.168.0.102:7803;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd14;
    disk       /dev/mapper/storage-oradbbackup;
    address    192.168.0.103:7803;
    meta-disk  internal;
  }
}
resource r15 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
    syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd15;
    disk       /dev/mapper/storage-varlogKiSoft;
    address    192.168.0.102:7804;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd15;
    disk       /dev/mapper/storage-varlogKiSoft;
    address    192.168.0.103:7804;
    meta-disk  internal;
  }
}
resource r16 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd16;
    disk       /dev/mapper/storage-varlogoracle;
    address    192.168.0.102:7805;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd16;
    disk       /dev/mapper/storage-varlogoracle;
    address    192.168.0.103:7805;
    meta-disk  internal;
  }
}
resource r17 {
handlers {
        outdate-peer 
"/usr/lib64/heartbeat/drbd-peer-outdater";pri-on-incon-degr "echo '!DRBD! 
pri on incon-degr' | wall ; sleep 60 ; halt -f";
    }
  protocol C;
 
  startup {
    wfc-timeout 0; degr-wfc-timeout 120;    # 2 minutes.
  }
    disk {
no-disk-flushes;
        no-md-flushes;
        fencing resource-only;
    on-io-error   detach;
  }
  net {
ping-int 2;
ping-timeout 1;
connect-int 2;
timeout 3;
max-buffers 8192;
  }
  syncer {
   rate 100M;
   al-extents 3833;
  }
  on k1327kc1 {
    device     /dev/drbd17;
    disk       /dev/mapper/storage-srvwww;
    address    192.168.0.102:7806;
    meta-disk  internal;
  }
  on k1327kc2 {
    device     /dev/drbd17;
    disk       /dev/mapper/storage-srvwww;
    address    192.168.0.103:7806;
    meta-disk  internal;
  }
}



Mit freundlichen Grüßen / Best regards,
 
Robert Köppl
System Administration
-------------------------------------------------------
Phone: +43 3842 805-910
Fax: +43 3842 805-500 
robert.koeppl@@knapp.com 
www.KNAPP.com 
-------------------------------------------------------
KNAPP Systemintegration GmbH 
Waltenbachstrasse 9 
8700 Leoben, Austria 
-------------------------------------------------------
Commercial register number: FN 138870x
Commercial register court: Leoben
-------------------------------------------------------
The information in this e-mail (including any attachment) is confidential 
and intended to be for the use of the addressee(s) only. If you have 
received the e-mail by mistake, any disclosure, copy, distribution or use 
of the contents of the e-mail is prohibited, and you must delete the 
e-mail from your system. As e-mail can be changed electronically KNAPP 
assumes no responsibility for any alteration to this e-mail or its 
attachments. KNAPP has taken every reasonable precaution to ensure that 
any attachment to this e-mail has been swept for virus. However, KNAPP 
does not accept any liability for damage sustained as a result of such 
attachment being virus infected and strongly recommend that you carry out 
your own virus check before opening any attachment.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20090717/2633bbda/attachment.htm>


More information about the drbd-user mailing list