Primary syslog after running drbdadm connect r0 on the secondary: Apr 15 12:46:16 prodnfs01primary kernel: [1240660.879266] block drbd0: Handshake successful: Agreed network protocol version 91 Apr 15 12:46:16 prodnfs01primary kernel: [1240660.879534] block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC Apr 15 12:46:16 prodnfs01primary kernel: [1240660.879542] block drbd0: conn( WFConnection -> WFReportParams ) Apr 15 12:46:16 prodnfs01primary kernel: [1240661.302444] block drbd0: Starting asender thread (from drbd0_receiver [1770]) Apr 15 12:46:16 prodnfs01primary kernel: [1240661.302622] block drbd0: data-integrity-alg: Apr 15 12:46:16 prodnfs01primary kernel: [1240661.308630] block drbd0: drbd_sync_handshake: Apr 15 12:46:16 prodnfs01primary kernel: [1240661.308634] block drbd0: self EE86661DE67C1341:4FD003BA3FBCEBA4:7A3A1385752EFBA3:115EBDCF7E81C7CB bits:8259 flags:0 Apr 15 12:46:16 prodnfs01primary kernel: [1240661.308637] block drbd0: peer 4FD003BA3FBCEBA4:0000000000000000:F4F6CF7D77167502:8DF8F5D4415DCF65 bits:408 flags:0 Apr 15 12:46:16 prodnfs01primary kernel: [1240661.308640] block drbd0: uuid_compare()=1 by rule 70 Apr 15 12:46:16 prodnfs01primary kernel: [1240661.308642] block drbd0: Becoming sync source due to disk states. Apr 15 12:46:16 prodnfs01primary kernel: [1240661.308668] block drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) Apr 15 12:46:18 prodnfs01primary kernel: [1240663.600986] block drbd0: conn( WFBitMapS -> SyncSource ) Apr 15 12:46:18 prodnfs01primary kernel: [1240663.601008] block drbd0: Began resync as SyncSource (will sync 33044 KB [8261 bits set]). Apr 15 12:46:20 prodnfs01primary kernel: [1240665.050422] block drbd0: 190 messages suppressed in /var/lib/dkms/drbd8/8.3.7/build/drbd/drbd_receiver.c:4249. Apr 15 12:46:20 prodnfs01primary kernel: [1240665.050426] block drbd0: Got NegAck packet. Peer is in troubles? Apr 15 12:46:20 prodnfs01primary kernel: [1240665.050436] block drbd0: Got NegAck packet. Peer is in troubles? Apr 15 12:46:20 prodnfs01primary kernel: [1240665.050450] block drbd0: Got NegAck packet. Peer is in troubles? Apr 15 12:46:20 prodnfs01primary kernel: [1240665.050455] block drbd0: Got NegAck packet. Peer is in troubles? Apr 15 12:46:20 prodnfs01primary kernel: [1240665.050459] block drbd0: Got NegAck packet. Peer is in troubles? Apr 15 12:46:35 prodnfs01primary kernel: [1240680.114623] block drbd0: Resync done (total 16 sec; paused 0 sec; 2064 K/sec) Apr 15 12:46:35 prodnfs01primary kernel: [1240680.114627] block drbd0: 408 failed blocks Apr 15 12:46:35 prodnfs01primary kernel: [1240680.114633] block drbd0: conn( SyncSource -> Connected ) Apr 15 12:46:35 prodnfs01primary kernel: [1240680.114638] block drbd0: cs:Connected rs_left=408 > rs_total=0 (rs_failed 0) Apr 15 12:46:35 prodnfs01primary kernel: [1240680.115671] block drbd0: cs:Connected rs_left=408 > rs_total=0 (rs_failed 0) Apr 15 12:46:35 prodnfs01primary kernel: [1240680.115760] block drbd0: cs:Connected rs_left=408 > rs_total=0 (rs_failed 0) Secondary syslog after running drbdadm connect r0 on the secondary: Apr 15 12:46:15 prodnfs01secondary kernel: [1239881.403495] block drbd0: conn( StandAlone -> Unconnected ) Apr 15 12:46:15 prodnfs01secondary kernel: [1239881.403518] block drbd0: Starting receiver thread (from drbd0_worker [32621]) Apr 15 12:46:15 prodnfs01secondary kernel: [1239881.403747] block drbd0: receiver (re)started Apr 15 12:46:15 prodnfs01secondary kernel: [1239881.403754] block drbd0: conn( Unconnected -> WFConnection ) Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.502378] block drbd0: Handshake successful: Agreed network protocol version 91 Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.502591] block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.502597] block drbd0: conn( WFConnection -> WFReportParams ) Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.502743] block drbd0: Starting asender thread (from drbd0_receiver [1089]) Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.926007] block drbd0: data-integrity-alg: Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.926020] block drbd0: drbd_sync_handshake: Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.926025] block drbd0: self 4FD003BA3FBCEBA4:0000000000000000:F4F6CF7D77167502:8DF8F5D4415DCF65 bits:408 flags:0 Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.926029] block drbd0: peer EE86661DE67C1341:4FD003BA3FBCEBA4:7A3A1385752EFBA3:115EBDCF7E81C7CB bits:8259 flags:0 Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.926033] block drbd0: uuid_compare()=-1 by rule 50 Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.926035] block drbd0: Becoming sync target due to disk states. Apr 15 12:46:16 prodnfs01secondary kernel: [1239881.926040] block drbd0: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate ) Apr 15 12:46:18 prodnfs01secondary kernel: [1239884.217030] block drbd0: conn( WFBitMapT -> WFSyncUUID ) Apr 15 12:46:18 prodnfs01secondary kernel: [1239884.224098] block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0 Apr 15 12:46:18 prodnfs01secondary kernel: [1239884.226739] block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0 exit code 0 (0x0) Apr 15 12:46:18 prodnfs01secondary kernel: [1239884.226745] block drbd0: conn( WFSyncUUID -> SyncTarget ) Apr 15 12:46:18 prodnfs01secondary kernel: [1239884.226752] block drbd0: Began resync as SyncTarget (will sync 33044 KB [8261 bits set]). Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.514751] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.514756] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.514760] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.514765] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.514770] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5f 58 00 00 a8 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.518314] block drbd0: write: error=-5 s=527480280s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.518317] __ratelimit: 185 callbacks suppressed Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.525954] block drbd0: write: error=-5 s=527480288s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.535285] block drbd0: write: error=-5 s=527480296s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.546361] block drbd0: write: error=-5 s=527480304s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.559189] block drbd0: write: error=-5 s=527480312s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.573759] block drbd0: write: error=-5 s=527480320s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.590082] block drbd0: write: error=-5 s=527480328s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.608137] block drbd0: write: error=-5 s=527480336s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.627947] block drbd0: write: error=-5 s=527480344s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.649519] block drbd0: write: error=-5 s=527480352s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672849] block drbd0: write: error=-5 s=527480360s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672853] block drbd0: write: error=-5 s=527480368s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672856] block drbd0: write: error=-5 s=527480376s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672859] block drbd0: write: error=-5 s=527480384s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672863] block drbd0: write: error=-5 s=527480392s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672866] block drbd0: write: error=-5 s=527480400s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672869] block drbd0: write: error=-5 s=527480408s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672874] block drbd0: write: error=-5 s=527480416s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672880] block drbd0: write: error=-5 s=527480424s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672886] block drbd0: write: error=-5 s=527480432s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672893] block drbd0: write: error=-5 s=527480440s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672922] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672924] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672927] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672931] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.672936] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 58 00 01 a0 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685368] block drbd0: write: error=-5 s=527479768s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685374] block drbd0: write: error=-5 s=527479776s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685377] block drbd0: write: error=-5 s=527479784s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685380] block drbd0: write: error=-5 s=527479792s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685383] block drbd0: write: error=-5 s=527479800s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685386] block drbd0: write: error=-5 s=527479808s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685389] block drbd0: write: error=-5 s=527479816s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685392] block drbd0: write: error=-5 s=527479824s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685395] block drbd0: write: error=-5 s=527479832s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685398] block drbd0: write: error=-5 s=527479840s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685401] block drbd0: write: error=-5 s=527479848s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685405] block drbd0: write: error=-5 s=527479856s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685408] block drbd0: write: error=-5 s=527479864s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685411] block drbd0: write: error=-5 s=527479872s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685414] block drbd0: write: error=-5 s=527479880s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685417] block drbd0: write: error=-5 s=527479888s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685420] block drbd0: write: error=-5 s=527479896s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685423] block drbd0: write: error=-5 s=527479904s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685426] block drbd0: write: error=-5 s=527479912s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685429] block drbd0: write: error=-5 s=527479920s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685432] block drbd0: write: error=-5 s=527479928s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685435] block drbd0: write: error=-5 s=527479936s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685438] block drbd0: write: error=-5 s=527479944s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685441] block drbd0: write: error=-5 s=527479952s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685448] block drbd0: write: error=-5 s=527479960s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685454] block drbd0: write: error=-5 s=527479968s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685460] block drbd0: write: error=-5 s=527479976s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685467] block drbd0: write: error=-5 s=527479984s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685474] block drbd0: write: error=-5 s=527479992s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685480] block drbd0: write: error=-5 s=527480000s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685487] block drbd0: write: error=-5 s=527480008s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685493] block drbd0: write: error=-5 s=527480016s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685499] block drbd0: write: error=-5 s=527480024s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685506] block drbd0: write: error=-5 s=527480032s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685513] block drbd0: write: error=-5 s=527480040s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685519] block drbd0: write: error=-5 s=527480048s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685526] block drbd0: write: error=-5 s=527480056s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685533] block drbd0: write: error=-5 s=527480064s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685539] block drbd0: write: error=-5 s=527480072s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685546] block drbd0: write: error=-5 s=527480080s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685552] block drbd0: write: error=-5 s=527480088s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685558] block drbd0: write: error=-5 s=527480096s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685565] block drbd0: write: error=-5 s=527480104s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685572] block drbd0: write: error=-5 s=527480112s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685579] block drbd0: write: error=-5 s=527480120s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685585] block drbd0: write: error=-5 s=527480128s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685592] block drbd0: write: error=-5 s=527480136s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685599] block drbd0: write: error=-5 s=527480144s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685605] block drbd0: write: error=-5 s=527480152s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685612] block drbd0: write: error=-5 s=527480160s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685619] block drbd0: write: error=-5 s=527480168s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685625] block drbd0: write: error=-5 s=527480176s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685637] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685641] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685650] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685659] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.685669] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5e f8 00 00 60 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698013] block drbd0: write: error=-5 s=527480184s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698018] block drbd0: write: error=-5 s=527480192s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698021] block drbd0: write: error=-5 s=527480200s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698024] block drbd0: write: error=-5 s=527480208s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698027] block drbd0: write: error=-5 s=527480216s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698030] block drbd0: write: error=-5 s=527480224s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698033] block drbd0: write: error=-5 s=527480232s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698037] block drbd0: write: error=-5 s=527480240s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698039] block drbd0: write: error=-5 s=527480248s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698050] block drbd0: write: error=-5 s=527480256s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698061] block drbd0: write: error=-5 s=527480264s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698070] block drbd0: write: error=-5 s=527480272s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698097] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698110] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698129] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698143] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.698153] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a 88 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.710501] block drbd0: write: error=-5 s=527479048s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.710510] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.710512] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.710515] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.710518] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.710523] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a 90 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.722949] block drbd0: write: error=-5 s=527479056s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.722957] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.722959] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.722962] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.722966] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.722970] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a 98 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.735426] block drbd0: write: error=-5 s=527479064s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.735435] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.735437] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.735441] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.735444] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.735449] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a a0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.747852] block drbd0: write: error=-5 s=527479072s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.747861] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.747863] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.747866] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.747870] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.747874] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a a8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.760291] block drbd0: write: error=-5 s=527479080s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.760299] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.760301] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.760304] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.760308] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.760312] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a b0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.772339] block drbd0: write: error=-5 s=527479088s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.772347] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.772349] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.772352] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.772356] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.772360] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a b8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.784117] block drbd0: write: error=-5 s=527479096s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.784126] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.784128] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.784131] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.784135] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.784139] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a c0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.795689] block drbd0: write: error=-5 s=527479104s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.795697] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.795699] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.795702] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.795706] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.795710] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a c8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.806838] block drbd0: write: error=-5 s=527479112s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.806847] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.806849] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.806852] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.806855] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.806860] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a d0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.817563] block drbd0: write: error=-5 s=527479120s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.817572] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.817574] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.817577] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.817581] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.817585] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a d8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.827892] block drbd0: write: error=-5 s=527479128s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.827900] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.827902] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.827905] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.827909] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.827913] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a e0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.837840] block drbd0: write: error=-5 s=527479136s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.837850] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.837852] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.837855] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.837859] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.837863] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a e8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.847359] block drbd0: write: error=-5 s=527479144s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.847368] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.847370] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.847373] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.847377] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.847381] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a f0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.856454] block drbd0: write: error=-5 s=527479152s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.856462] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.856464] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.856467] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.856471] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.856475] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5a f8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.865145] block drbd0: write: error=-5 s=527479160s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.865153] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.865155] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.865158] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.865162] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.865166] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 00 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.873525] block drbd0: write: error=-5 s=527479168s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.873533] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.873535] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.873538] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.873542] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.873546] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 08 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.881348] block drbd0: write: error=-5 s=527479176s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.881355] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.881356] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.881360] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.881363] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.881367] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 10 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.888804] block drbd0: write: error=-5 s=527479184s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.888812] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.888814] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.888817] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.888820] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.888824] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 18 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.895778] block drbd0: write: error=-5 s=527479192s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.895787] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.895789] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.895792] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.895796] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.895800] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 20 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.902355] block drbd0: write: error=-5 s=527479200s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.902363] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.902365] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.902368] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.902372] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.902377] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 28 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.908492] block drbd0: write: error=-5 s=527479208s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.908499] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.908501] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.908504] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.908508] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.908512] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 30 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.914203] block drbd0: write: error=-5 s=527479216s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.914212] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.914214] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.914217] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.914221] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.914225] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 38 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.919480] block drbd0: write: error=-5 s=527479224s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.919487] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.919489] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.919492] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.919495] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.919500] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 40 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.924332] block drbd0: write: error=-5 s=527479232s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.924340] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.924342] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.924345] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.924349] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.924353] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 48 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.928747] block drbd0: write: error=-5 s=527479240s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.928754] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.928756] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.928759] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.928762] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.928766] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 50 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.932789] block drbd0: write: error=-5 s=527479248s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.932800] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.932802] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.932805] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.932809] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.932813] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 59 58 00 01 30 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936350] block drbd0: write: error=-5 s=527478744s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936355] block drbd0: write: error=-5 s=527478752s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936358] block drbd0: write: error=-5 s=527478760s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936362] block drbd0: write: error=-5 s=527478768s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936365] block drbd0: write: error=-5 s=527478776s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936368] block drbd0: write: error=-5 s=527478784s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936371] block drbd0: write: error=-5 s=527478792s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936374] block drbd0: write: error=-5 s=527478800s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936377] block drbd0: write: error=-5 s=527478808s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936380] block drbd0: write: error=-5 s=527478816s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936383] block drbd0: write: error=-5 s=527478824s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936388] block drbd0: write: error=-5 s=527478832s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936391] block drbd0: write: error=-5 s=527478840s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936394] block drbd0: write: error=-5 s=527478848s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936397] block drbd0: write: error=-5 s=527478856s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936400] block drbd0: write: error=-5 s=527478864s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936403] block drbd0: write: error=-5 s=527478872s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936406] block drbd0: write: error=-5 s=527478880s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936409] block drbd0: write: error=-5 s=527478888s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936412] block drbd0: write: error=-5 s=527478896s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936415] block drbd0: write: error=-5 s=527478904s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936418] block drbd0: write: error=-5 s=527478912s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936422] block drbd0: write: error=-5 s=527478920s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936425] block drbd0: write: error=-5 s=527478928s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936428] block drbd0: write: error=-5 s=527478936s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936431] block drbd0: write: error=-5 s=527478944s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936434] block drbd0: write: error=-5 s=527478952s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936437] block drbd0: write: error=-5 s=527478960s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936440] block drbd0: write: error=-5 s=527478968s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936443] block drbd0: write: error=-5 s=527478976s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936446] block drbd0: write: error=-5 s=527478984s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936450] block drbd0: write: error=-5 s=527478992s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936453] block drbd0: write: error=-5 s=527479000s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936456] block drbd0: write: error=-5 s=527479008s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936459] block drbd0: write: error=-5 s=527479016s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936462] block drbd0: write: error=-5 s=527479024s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936466] block drbd0: write: error=-5 s=527479032s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936469] block drbd0: write: error=-5 s=527479040s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936480] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936482] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936485] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936488] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.936493] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 58 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.939663] block drbd0: write: error=-5 s=527479256s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.939671] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.939673] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.939676] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.939679] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.939683] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 60 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.942860] block drbd0: write: error=-5 s=527479264s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.942868] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.942870] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.942873] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.942877] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.942881] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 68 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.946044] block drbd0: write: error=-5 s=527479272s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.946052] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.946053] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.946056] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.946060] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.946064] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 70 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.949221] block drbd0: write: error=-5 s=527479280s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.949228] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.949230] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.949233] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.949237] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.949241] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 78 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.952408] block drbd0: write: error=-5 s=527479288s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.952416] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.952418] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.952421] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.952425] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.952429] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 80 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.955582] block drbd0: write: error=-5 s=527479296s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.955588] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.955590] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.955593] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.955597] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.955601] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 88 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.958752] block drbd0: write: error=-5 s=527479304s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.958759] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.958761] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.958764] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.958768] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.958772] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 90 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.961931] block drbd0: write: error=-5 s=527479312s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.961939] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.961941] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.961944] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.961948] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.961952] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b 98 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.965067] block drbd0: write: error=-5 s=527479320s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.965077] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.965080] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.965084] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.965089] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.965095] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b a0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.968213] block drbd0: write: error=-5 s=527479328s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.968223] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.968226] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.968231] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.968236] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.968241] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b a8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.971362] block drbd0: write: error=-5 s=527479336s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.971375] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.971378] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.971382] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.971388] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.971394] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b b0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.974506] block drbd0: write: error=-5 s=527479344s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.974516] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.974519] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.974524] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.974529] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.974535] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b b8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.977643] block drbd0: write: error=-5 s=527479352s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.977653] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.977656] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.977660] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.977666] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.977672] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b c0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.980747] block drbd0: write: error=-5 s=527479360s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.980758] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.980761] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.980765] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.980771] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.980777] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b c8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.983867] block drbd0: write: error=-5 s=527479368s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.983877] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.983880] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.983884] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.983889] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.983895] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b d0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.986938] block drbd0: write: error=-5 s=527479376s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.986948] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.986951] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.986955] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.986961] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.986966] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b d8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.990002] block drbd0: write: error=-5 s=527479384s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.990012] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.990016] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.990020] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.990025] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.990031] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b e0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.993132] block drbd0: write: error=-5 s=527479392s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.993142] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.993145] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.993149] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.993154] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.993160] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b e8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.996194] block drbd0: write: error=-5 s=527479400s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.996205] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.996208] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.996212] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.996217] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.996223] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b f0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.999255] block drbd0: write: error=-5 s=527479408s Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.999265] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.999268] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.999273] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.999278] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239885.999284] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5b f8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.002355] block drbd0: write: error=-5 s=527479416s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.002370] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.002374] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.002378] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.002384] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.002391] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 00 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.005460] block drbd0: write: error=-5 s=527479424s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.005471] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.005474] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.005478] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.005483] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.005489] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 08 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.008588] block drbd0: write: error=-5 s=527479432s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.008598] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.008601] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.008605] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.008611] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.008616] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 10 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.011725] block drbd0: write: error=-5 s=527479440s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.011735] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.011738] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.011743] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.011748] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.011754] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 18 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.014854] block drbd0: write: error=-5 s=527479448s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.014864] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.014867] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.014871] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.014876] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.014882] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 20 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.017980] block drbd0: write: error=-5 s=527479456s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.017990] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.017993] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.017998] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.018003] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.018009] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 28 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.021102] block drbd0: write: error=-5 s=527479464s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.021112] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.021114] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.021119] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.021124] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.021130] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 30 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.024237] block drbd0: write: error=-5 s=527479472s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.024247] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.024250] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.024255] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.024260] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.024266] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 38 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.027361] block drbd0: write: error=-5 s=527479480s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.027371] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.027374] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.027378] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.027383] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.027389] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 40 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.030484] block drbd0: write: error=-5 s=527479488s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.030494] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.030497] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.030502] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.030507] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.030513] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 48 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.033622] block drbd0: write: error=-5 s=527479496s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.033633] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.033635] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.033640] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.033645] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.033651] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 50 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.036743] block drbd0: write: error=-5 s=527479504s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.036753] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.036756] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.036761] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.036766] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.036772] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 58 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.039863] block drbd0: write: error=-5 s=527479512s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.039874] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.039877] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.039881] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.039887] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.039893] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 60 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.042995] block drbd0: write: error=-5 s=527479520s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.043005] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.043008] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.043012] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.043018] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.043024] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 68 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.046118] block drbd0: write: error=-5 s=527479528s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.046128] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.046131] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.046136] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.046141] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.046146] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 70 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.049241] block drbd0: write: error=-5 s=527479536s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.049251] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.049254] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.049259] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.049264] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.049270] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 78 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.052376] block drbd0: write: error=-5 s=527479544s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.052386] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.052389] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.052394] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.052399] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.052405] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 80 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.055499] block drbd0: write: error=-5 s=527479552s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.055509] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.055512] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.055517] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.055522] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.055528] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 88 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.058623] block drbd0: write: error=-5 s=527479560s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.058633] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.058636] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.058641] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.058646] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.058652] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 90 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.061765] block drbd0: write: error=-5 s=527479568s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.061775] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.061778] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.061782] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.061788] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.061794] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c 98 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.064892] block drbd0: write: error=-5 s=527479576s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.064903] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.064905] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.064910] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.064915] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.064921] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c a0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.068024] block drbd0: write: error=-5 s=527479584s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.068034] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.068037] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.068041] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.068047] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.068052] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c a8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.071152] block drbd0: write: error=-5 s=527479592s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.071163] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.071165] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.071170] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.071175] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.071187] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c b0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.074260] block drbd0: write: error=-5 s=527479600s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.074271] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.074274] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.074278] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.074284] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.074289] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c b8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.077356] block drbd0: write: error=-5 s=527479608s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.077366] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.077369] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.077373] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.077378] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.077384] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c c0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.080448] block drbd0: write: error=-5 s=527479616s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.080460] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.080463] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.080467] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.080472] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.080478] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c c8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.083553] block drbd0: write: error=-5 s=527479624s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.083563] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.083566] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.083570] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.083576] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.083582] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c d0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.086648] block drbd0: write: error=-5 s=527479632s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.086659] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.086662] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.086666] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.086671] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.086677] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c d8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.089742] block drbd0: write: error=-5 s=527479640s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.089753] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.089756] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.089760] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.089765] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.089771] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c e0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.092851] block drbd0: write: error=-5 s=527479648s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.092861] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.092864] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.092868] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.092873] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.092879] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c e8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.095939] block drbd0: write: error=-5 s=527479656s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.095949] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.095952] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.095956] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.095961] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.095967] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c f0 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.098996] block drbd0: write: error=-5 s=527479664s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.099006] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.099009] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.099014] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.099019] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.099025] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5c f8 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.102069] block drbd0: write: error=-5 s=527479672s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.102079] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.102082] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.102086] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.102091] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.102098] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 00 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.105157] block drbd0: write: error=-5 s=527479680s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.105167] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.105170] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.105175] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.105180] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.105186] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 08 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.108252] block drbd0: write: error=-5 s=527479688s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.108263] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.108266] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.108270] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.108276] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.108281] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 10 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.111388] block drbd0: write: error=-5 s=527479696s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.111399] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.111402] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.111406] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.111412] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.111418] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 18 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.114515] block drbd0: write: error=-5 s=527479704s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.114525] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.114528] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.114532] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.114538] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.114543] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 20 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.117640] block drbd0: write: error=-5 s=527479712s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.117650] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.117653] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.117658] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.117663] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.117669] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 28 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.120767] block drbd0: write: error=-5 s=527479720s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.120777] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.120780] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.120785] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.120790] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.120796] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 30 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.123905] block drbd0: write: error=-5 s=527479728s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.123914] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.123916] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.123919] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.123923] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.123927] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 38 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.127019] block drbd0: write: error=-5 s=527479736s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.127026] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.127028] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.127031] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.127035] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.127039] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 40 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.130128] block drbd0: write: error=-5 s=527479744s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.130135] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.130137] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.130140] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.130143] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.130147] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 48 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.133250] block drbd0: write: error=-5 s=527479752s Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.133258] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.133260] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.133263] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.133267] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.133271] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 1f 80 5d 50 00 00 08 00 Apr 15 12:46:20 prodnfs01secondary kernel: [1239886.136362] block drbd0: write: error=-5 s=527479760s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.791675] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.791680] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.791684] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.791689] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.791694] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 23 4f d9 e8 00 02 00 00 Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794814] block drbd0: write: error=-5 s=591409256s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794821] block drbd0: write: error=-5 s=591409264s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794825] block drbd0: write: error=-5 s=591409272s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794828] block drbd0: write: error=-5 s=591409280s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794831] block drbd0: write: error=-5 s=591409288s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794834] block drbd0: write: error=-5 s=591409296s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794837] block drbd0: write: error=-5 s=591409304s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794840] block drbd0: write: error=-5 s=591409312s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794843] block drbd0: write: error=-5 s=591409320s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794846] block drbd0: write: error=-5 s=591409328s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794849] block drbd0: write: error=-5 s=591409336s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794852] block drbd0: write: error=-5 s=591409344s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794855] block drbd0: write: error=-5 s=591409352s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794858] block drbd0: write: error=-5 s=591409360s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794861] block drbd0: write: error=-5 s=591409368s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794864] block drbd0: write: error=-5 s=591409376s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794867] block drbd0: write: error=-5 s=591409384s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794870] block drbd0: write: error=-5 s=591409392s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794873] block drbd0: write: error=-5 s=591409400s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794876] block drbd0: write: error=-5 s=591409408s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794879] block drbd0: write: error=-5 s=591409416s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794882] block drbd0: write: error=-5 s=591409424s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794885] block drbd0: write: error=-5 s=591409432s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794888] block drbd0: write: error=-5 s=591409440s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794891] block drbd0: write: error=-5 s=591409448s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794894] block drbd0: write: error=-5 s=591409456s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794897] block drbd0: write: error=-5 s=591409464s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794901] block drbd0: write: error=-5 s=591409472s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794904] block drbd0: write: error=-5 s=591409480s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794907] block drbd0: write: error=-5 s=591409488s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794910] block drbd0: write: error=-5 s=591409496s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794913] block drbd0: write: error=-5 s=591409504s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794916] block drbd0: write: error=-5 s=591409512s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794919] block drbd0: write: error=-5 s=591409520s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794922] block drbd0: write: error=-5 s=591409528s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794925] block drbd0: write: error=-5 s=591409536s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794928] block drbd0: write: error=-5 s=591409544s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794931] block drbd0: write: error=-5 s=591409552s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794934] block drbd0: write: error=-5 s=591409560s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794937] block drbd0: write: error=-5 s=591409568s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794940] block drbd0: write: error=-5 s=591409576s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794943] block drbd0: write: error=-5 s=591409584s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794946] block drbd0: write: error=-5 s=591409592s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794949] block drbd0: write: error=-5 s=591409600s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794952] block drbd0: write: error=-5 s=591409608s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794955] block drbd0: write: error=-5 s=591409616s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794958] block drbd0: write: error=-5 s=591409624s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794961] block drbd0: write: error=-5 s=591409632s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794965] block drbd0: write: error=-5 s=591409640s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794968] block drbd0: write: error=-5 s=591409648s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794971] block drbd0: write: error=-5 s=591409656s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794974] block drbd0: write: error=-5 s=591409664s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794977] block drbd0: write: error=-5 s=591409672s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794980] block drbd0: write: error=-5 s=591409680s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794983] block drbd0: write: error=-5 s=591409688s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794987] block drbd0: write: error=-5 s=591409696s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794990] block drbd0: write: error=-5 s=591409704s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794993] block drbd0: write: error=-5 s=591409712s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794996] block drbd0: write: error=-5 s=591409720s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.794999] block drbd0: write: error=-5 s=591409728s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.795002] block drbd0: write: error=-5 s=591409736s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.795005] block drbd0: write: error=-5 s=591409744s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.795008] block drbd0: write: error=-5 s=591409752s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.795011] block drbd0: write: error=-5 s=591409760s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.865436] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.865440] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.865444] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.865448] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.865453] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 23 4f db e8 00 02 00 00 Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868581] block drbd0: write: error=-5 s=591409768s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868588] block drbd0: write: error=-5 s=591409776s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868592] block drbd0: write: error=-5 s=591409784s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868595] block drbd0: write: error=-5 s=591409792s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868598] block drbd0: write: error=-5 s=591409800s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868601] block drbd0: write: error=-5 s=591409808s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868604] block drbd0: write: error=-5 s=591409816s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868607] block drbd0: write: error=-5 s=591409824s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868610] block drbd0: write: error=-5 s=591409832s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868613] block drbd0: write: error=-5 s=591409840s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868616] block drbd0: write: error=-5 s=591409848s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868619] block drbd0: write: error=-5 s=591409856s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868622] block drbd0: write: error=-5 s=591409864s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868625] block drbd0: write: error=-5 s=591409872s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868628] block drbd0: write: error=-5 s=591409880s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868631] block drbd0: write: error=-5 s=591409888s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868634] block drbd0: write: error=-5 s=591409896s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868637] block drbd0: write: error=-5 s=591409904s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868640] block drbd0: write: error=-5 s=591409912s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868643] block drbd0: write: error=-5 s=591409920s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868646] block drbd0: write: error=-5 s=591409928s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868649] block drbd0: write: error=-5 s=591409936s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868652] block drbd0: write: error=-5 s=591409944s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868655] block drbd0: write: error=-5 s=591409952s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868659] block drbd0: write: error=-5 s=591409960s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868662] block drbd0: write: error=-5 s=591409968s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868665] block drbd0: write: error=-5 s=591409976s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868668] block drbd0: write: error=-5 s=591409984s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868671] block drbd0: write: error=-5 s=591409992s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868674] block drbd0: write: error=-5 s=591410000s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868677] block drbd0: write: error=-5 s=591410008s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868680] block drbd0: write: error=-5 s=591410016s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868683] block drbd0: write: error=-5 s=591410024s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868686] block drbd0: write: error=-5 s=591410032s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868689] block drbd0: write: error=-5 s=591410040s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868692] block drbd0: write: error=-5 s=591410048s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868695] block drbd0: write: error=-5 s=591410056s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868698] block drbd0: write: error=-5 s=591410064s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868701] block drbd0: write: error=-5 s=591410072s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868704] block drbd0: write: error=-5 s=591410080s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868707] block drbd0: write: error=-5 s=591410088s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868710] block drbd0: write: error=-5 s=591410096s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868713] block drbd0: write: error=-5 s=591410104s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868716] block drbd0: write: error=-5 s=591410112s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868719] block drbd0: write: error=-5 s=591410120s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868722] block drbd0: write: error=-5 s=591410128s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868725] block drbd0: write: error=-5 s=591410136s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868728] block drbd0: write: error=-5 s=591410144s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868731] block drbd0: write: error=-5 s=591410152s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868734] block drbd0: write: error=-5 s=591410160s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868737] block drbd0: write: error=-5 s=591410168s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868740] block drbd0: write: error=-5 s=591410176s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868743] block drbd0: write: error=-5 s=591410184s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868746] block drbd0: write: error=-5 s=591410192s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868749] block drbd0: write: error=-5 s=591410200s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868752] block drbd0: write: error=-5 s=591410208s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868755] block drbd0: write: error=-5 s=591410216s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868758] block drbd0: write: error=-5 s=591410224s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868761] block drbd0: write: error=-5 s=591410232s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868764] block drbd0: write: error=-5 s=591410240s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868767] block drbd0: write: error=-5 s=591410248s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868770] block drbd0: write: error=-5 s=591410256s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868773] block drbd0: write: error=-5 s=591410264s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868776] block drbd0: write: error=-5 s=591410272s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868784] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868785] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868789] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868792] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.868797] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 23 4f dd e8 00 00 18 00 Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.871923] block drbd0: write: error=-5 s=591410280s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.871928] block drbd0: write: error=-5 s=591410288s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.871931] block drbd0: write: error=-5 s=591410296s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.902993] sd 4:0:0:0: [sdc] Unhandled sense code Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.902997] sd 4:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.903000] sd 4:0:0:0: [sdc] Sense Key : Hardware Error [current] Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.903004] sd 4:0:0:0: [sdc] Add. Sense: Internal target failure Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.903009] sd 4:0:0:0: [sdc] CDB: Write(10): 2a 00 23 4f d7 e8 00 02 00 00 Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906187] block drbd0: write: error=-5 s=591408744s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906195] block drbd0: write: error=-5 s=591408752s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906198] block drbd0: write: error=-5 s=591408760s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906201] block drbd0: write: error=-5 s=591408768s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906204] block drbd0: write: error=-5 s=591408776s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906207] block drbd0: write: error=-5 s=591408784s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906210] block drbd0: write: error=-5 s=591408792s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906213] block drbd0: write: error=-5 s=591408800s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906216] block drbd0: write: error=-5 s=591408808s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906219] block drbd0: write: error=-5 s=591408816s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906222] block drbd0: write: error=-5 s=591408824s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906225] block drbd0: write: error=-5 s=591408832s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906228] block drbd0: write: error=-5 s=591408840s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906231] block drbd0: write: error=-5 s=591408848s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906234] block drbd0: write: error=-5 s=591408856s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906237] block drbd0: write: error=-5 s=591408864s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906240] block drbd0: write: error=-5 s=591408872s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906243] block drbd0: write: error=-5 s=591408880s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906246] block drbd0: write: error=-5 s=591408888s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906249] block drbd0: write: error=-5 s=591408896s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906252] block drbd0: write: error=-5 s=591408904s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906255] block drbd0: write: error=-5 s=591408912s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906258] block drbd0: write: error=-5 s=591408920s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906261] block drbd0: write: error=-5 s=591408928s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906264] block drbd0: write: error=-5 s=591408936s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906267] block drbd0: write: error=-5 s=591408944s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906275] block drbd0: write: error=-5 s=591408952s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906278] block drbd0: write: error=-5 s=591408960s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906281] block drbd0: write: error=-5 s=591408968s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906284] block drbd0: write: error=-5 s=591408976s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906287] block drbd0: write: error=-5 s=591408984s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906290] block drbd0: write: error=-5 s=591408992s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906293] block drbd0: write: error=-5 s=591409000s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906296] block drbd0: write: error=-5 s=591409008s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906299] block drbd0: write: error=-5 s=591409016s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906302] block drbd0: write: error=-5 s=591409024s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906305] block drbd0: write: error=-5 s=591409032s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906308] block drbd0: write: error=-5 s=591409040s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906311] block drbd0: write: error=-5 s=591409048s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906314] block drbd0: write: error=-5 s=591409056s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906317] block drbd0: write: error=-5 s=591409064s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906320] block drbd0: write: error=-5 s=591409072s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906323] block drbd0: write: error=-5 s=591409080s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906326] block drbd0: write: error=-5 s=591409088s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906329] block drbd0: write: error=-5 s=591409096s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906332] block drbd0: write: error=-5 s=591409104s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906335] block drbd0: write: error=-5 s=591409112s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906338] block drbd0: write: error=-5 s=591409120s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906341] block drbd0: write: error=-5 s=591409128s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906351] block drbd0: write: error=-5 s=591409136s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906354] block drbd0: write: error=-5 s=591409144s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906357] block drbd0: write: error=-5 s=591409152s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906360] block drbd0: write: error=-5 s=591409160s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906363] block drbd0: write: error=-5 s=591409168s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906366] block drbd0: write: error=-5 s=591409176s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906370] block drbd0: write: error=-5 s=591409184s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906373] block drbd0: write: error=-5 s=591409192s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906376] block drbd0: write: error=-5 s=591409200s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906379] block drbd0: write: error=-5 s=591409208s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906382] block drbd0: write: error=-5 s=591409216s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906385] block drbd0: write: error=-5 s=591409224s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906388] block drbd0: write: error=-5 s=591409232s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906391] block drbd0: write: error=-5 s=591409240s Apr 15 12:46:21 prodnfs01secondary kernel: [1239886.906395] block drbd0: write: error=-5 s=591409248s Apr 15 12:46:35 prodnfs01secondary kernel: [1239900.737155] block drbd0: Resync done (total 16 sec; paused 0 sec; 2064 K/sec) Apr 15 12:46:35 prodnfs01secondary kernel: [1239900.737159] block drbd0: 408 failed blocks Apr 15 12:46:35 prodnfs01secondary kernel: [1239900.737165] block drbd0: conn( SyncTarget -> Connected ) Apr 15 12:46:35 prodnfs01secondary kernel: [1239900.737172] block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0 Apr 15 12:46:35 prodnfs01secondary kernel: [1239900.739684] block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0 exit code 0 (0x0) Apr 15 12:46:35 prodnfs01secondary kernel: [1239900.739689] block drbd0: cs:Connected rs_left=408 > rs_total=0 (rs_failed 0)