Daofeng Li
2015-06-16 16:12:18 UTC
Dear list,
I was trying to relocating my storage from 1 server to another, the old one
has aoe driver version 81 installed, the new has 85 installed, I see this
error message on the new system only. Is there a way to fix them? Thanks a
lot.
Jun 15 17:11:01 cluster kernel: [ 1243.965424] end_request: I/O error,
dev etherd/e50.23, sector 1953523728
Jun 15 17:11:01 cluster kernel: [ 1243.965436] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1243.965440] end_request: I/O error,
dev etherd/e52.23, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1243.965443] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1243.965445] end_request: I/O error,
dev etherd/e52.23, sector 528
Jun 15 17:11:01 cluster kernel: [ 1243.965447] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1243.965449] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.126390] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.126395] end_request: I/O error,
dev etherd/e50.23, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1244.177397] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.177401] end_request: I/O error,
dev etherd/e50.23, sector 528
Jun 15 17:11:01 cluster kernel: [ 1244.226678] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.226681] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.226697] end_request: I/O error,
dev etherd/e52.22, sector 1953523728
Jun 15 17:11:01 cluster kernel: [ 1244.274831] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.274834] end_request: I/O error,
dev etherd/e52.22, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1244.321528] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.321531] end_request: I/O error,
dev etherd/e52.22, sector 528
Jun 15 17:11:01 cluster kernel: [ 1244.366733] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.366736] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.366760] end_request: I/O error,
dev etherd/e50.22, sector 1953523728
Jun 15 17:11:01 cluster kernel: [ 1244.410629] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.410633] end_request: I/O error,
dev etherd/e50.22, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1244.453077] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453082] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453084] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453100] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453104] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453107] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453109] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453116] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453121] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453125] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453127] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453133] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453145] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453156] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453163] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453190] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453200] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453219] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453222] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453230] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453235] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453239] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453241] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453249] aoe: device 52.18 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453260] aoe: device 52.18 is not up
y aoe-stat command actually told the system could found the disks:
# aoe-stat
e50.0 1000.204GB em1 8704 up
e50.10 1000.204GB em1 8704 up
e50.1 1000.204GB em1 8704 up
e50.11 1000.204GB em1 8704 up
e50.12 1000.204GB em1 8704 up
e50.13 1000.204GB em1 8704 up
e50.14 1000.204GB em1 8704 up
e50.15 1000.204GB em1 8704 up
e50.16 1000.204GB em1 8704 up
e50.17 1000.204GB em1 8704 up
e50.18 1000.204GB em1 8704 up
e50.19 1000.204GB em1 8704 up
e50.20 1000.204GB em1 8704 up
e50.2 1000.204GB em1 8704 up
e50.21 1000.204GB em1 8704 up
e50.22 1000.204GB em1 8704 up
e50.23 1000.204GB em1 8704 up
e50.3 1000.204GB em1 8704 up
e50.4 1000.204GB em1 8704 up
e50.5 1000.204GB em1 8704 up
e50.6 1000.204GB em1 8704 up
e50.7 1000.204GB em1 8704 up
e50.8 1000.204GB em1 8704 up
e50.9 1000.204GB em1 8704 up
e52.0 1000.204GB em1 8704 up
e52.10 1000.204GB em1 8704 up
e52.1 1000.204GB em1 8704 up
e52.11 1000.204GB em1 8704 up
e52.12 1000.204GB em1 8704 up
e52.13 1000.204GB em1 8704 up
e52.14 1000.204GB em1 8704 up
e52.15 1000.204GB em1 8704 up
e52.16 1000.204GB em1 8704 up
e52.17 1000.204GB em1 8704 up
e52.18 1000.204GB em1 8704 up
e52.19 1000.204GB em1 8704 up
e52.20 1000.204GB em1 8704 up
e52.2 1000.204GB em1 8704 up
e52.21 1000.204GB em1 8704 up
e52.22 1000.204GB em1 8704 up
e52.23 1000.204GB em1 8704 up
e52.3 1000.204GB em1 8704 up
e52.4 1000.204GB em1 8704 up
e52.5 1000.204GB em1 8704 up
e52.6 1000.204GB em1 8704 up
e52.7 1000.204GB em1 8704 up
e52.8 1000.204GB em1 8704 up
e52.9 1000.204GB em1 8704 up
network, system and driver information:
***@cluster:/home/d# ifconfig
em1 Link encap:Ethernet HWaddr 5c:f9:dd:b9:48:a8
inet addr:10.200.0.20 Bcast:10.200.0.255 Mask:255.255.255.0
inet6 addr: fe80::5ef9:ddff:feb9:48a8/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
RX packets:392548 errors:0 dropped:337 overruns:0 frame:0
TX packets:311526 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:164961826 (164.9 MB) TX bytes:20663984 (20.6 MB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:1325 errors:0 dropped:0 overruns:0 frame:0
TX packets:1325 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:23850 (23.8 KB) TX bytes:23850 (23.8 KB)
***@cluster:/home/d# uname -a
Linux cluster 3.13.0-32-generic #57-Ubuntu SMP Tue Jul 15 03:51:08 UTC 2014
x86_64 x86_64 x86_64 GNU/Linux
***@cluster:/home/d# aoe-version
aoetools: 36
installed aoe driver: 85
running aoe driver: 85
Daofeng
I was trying to relocating my storage from 1 server to another, the old one
has aoe driver version 81 installed, the new has 85 installed, I see this
error message on the new system only. Is there a way to fix them? Thanks a
lot.
Jun 15 17:11:01 cluster kernel: [ 1243.965424] end_request: I/O error,
dev etherd/e50.23, sector 1953523728
Jun 15 17:11:01 cluster kernel: [ 1243.965436] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1243.965440] end_request: I/O error,
dev etherd/e52.23, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1243.965443] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1243.965445] end_request: I/O error,
dev etherd/e52.23, sector 528
Jun 15 17:11:01 cluster kernel: [ 1243.965447] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1243.965449] aoe: device 52.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.126390] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.126395] end_request: I/O error,
dev etherd/e50.23, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1244.177397] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.177401] end_request: I/O error,
dev etherd/e50.23, sector 528
Jun 15 17:11:01 cluster kernel: [ 1244.226678] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.226681] aoe: device 50.23 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.226697] end_request: I/O error,
dev etherd/e52.22, sector 1953523728
Jun 15 17:11:01 cluster kernel: [ 1244.274831] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.274834] end_request: I/O error,
dev etherd/e52.22, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1244.321528] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.321531] end_request: I/O error,
dev etherd/e52.22, sector 528
Jun 15 17:11:01 cluster kernel: [ 1244.366733] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.366736] aoe: device 52.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.366760] end_request: I/O error,
dev etherd/e50.22, sector 1953523728
Jun 15 17:11:01 cluster kernel: [ 1244.410629] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.410633] end_request: I/O error,
dev etherd/e50.22, sector 1953524240
Jun 15 17:11:01 cluster kernel: [ 1244.453077] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453082] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453084] aoe: device 50.22 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453100] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453104] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453107] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453109] aoe: device 52.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453116] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453121] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453125] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453127] aoe: device 50.21 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453133] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453145] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453156] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453163] aoe: device 52.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453190] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453200] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453219] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453222] aoe: device 50.20 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453230] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453235] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453239] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453241] aoe: device 52.19 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453249] aoe: device 52.18 is not up
Jun 15 17:11:01 cluster kernel: [ 1244.453260] aoe: device 52.18 is not up
y aoe-stat command actually told the system could found the disks:
# aoe-stat
e50.0 1000.204GB em1 8704 up
e50.10 1000.204GB em1 8704 up
e50.1 1000.204GB em1 8704 up
e50.11 1000.204GB em1 8704 up
e50.12 1000.204GB em1 8704 up
e50.13 1000.204GB em1 8704 up
e50.14 1000.204GB em1 8704 up
e50.15 1000.204GB em1 8704 up
e50.16 1000.204GB em1 8704 up
e50.17 1000.204GB em1 8704 up
e50.18 1000.204GB em1 8704 up
e50.19 1000.204GB em1 8704 up
e50.20 1000.204GB em1 8704 up
e50.2 1000.204GB em1 8704 up
e50.21 1000.204GB em1 8704 up
e50.22 1000.204GB em1 8704 up
e50.23 1000.204GB em1 8704 up
e50.3 1000.204GB em1 8704 up
e50.4 1000.204GB em1 8704 up
e50.5 1000.204GB em1 8704 up
e50.6 1000.204GB em1 8704 up
e50.7 1000.204GB em1 8704 up
e50.8 1000.204GB em1 8704 up
e50.9 1000.204GB em1 8704 up
e52.0 1000.204GB em1 8704 up
e52.10 1000.204GB em1 8704 up
e52.1 1000.204GB em1 8704 up
e52.11 1000.204GB em1 8704 up
e52.12 1000.204GB em1 8704 up
e52.13 1000.204GB em1 8704 up
e52.14 1000.204GB em1 8704 up
e52.15 1000.204GB em1 8704 up
e52.16 1000.204GB em1 8704 up
e52.17 1000.204GB em1 8704 up
e52.18 1000.204GB em1 8704 up
e52.19 1000.204GB em1 8704 up
e52.20 1000.204GB em1 8704 up
e52.2 1000.204GB em1 8704 up
e52.21 1000.204GB em1 8704 up
e52.22 1000.204GB em1 8704 up
e52.23 1000.204GB em1 8704 up
e52.3 1000.204GB em1 8704 up
e52.4 1000.204GB em1 8704 up
e52.5 1000.204GB em1 8704 up
e52.6 1000.204GB em1 8704 up
e52.7 1000.204GB em1 8704 up
e52.8 1000.204GB em1 8704 up
e52.9 1000.204GB em1 8704 up
network, system and driver information:
***@cluster:/home/d# ifconfig
em1 Link encap:Ethernet HWaddr 5c:f9:dd:b9:48:a8
inet addr:10.200.0.20 Bcast:10.200.0.255 Mask:255.255.255.0
inet6 addr: fe80::5ef9:ddff:feb9:48a8/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
RX packets:392548 errors:0 dropped:337 overruns:0 frame:0
TX packets:311526 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:164961826 (164.9 MB) TX bytes:20663984 (20.6 MB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:1325 errors:0 dropped:0 overruns:0 frame:0
TX packets:1325 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:23850 (23.8 KB) TX bytes:23850 (23.8 KB)
***@cluster:/home/d# uname -a
Linux cluster 3.13.0-32-generic #57-Ubuntu SMP Tue Jul 15 03:51:08 UTC 2014
x86_64 x86_64 x86_64 GNU/Linux
***@cluster:/home/d# aoe-version
aoetools: 36
installed aoe driver: 85
running aoe driver: 85
Daofeng