2006年1月11日水曜日

Xen panic


MLog上でMovableTypeのrebuild allを実行すると、cgiの時間がかかりすぎてInternal Server Errorになることは頻繁に発生していたけど、とうとうPanicで落ちた(^^;



ちなみに本BlogもMLogXen 3.0.0上のDebian/Sargeで動いている。



xm console で仮想マシンを除くと、Panic Messageを見ることが出来たので、貼り付けておこう。






hobby:/home/shibata# xm list
Name ID Mem(MiB) VCPUs State Time(s)
Domain-0 0 1058 2 r----- 137148.1
hixen 5 768 1 r----- 93908.4
hobby:/home/shibata# xm console 5
Linux version 2.6.12.6-xenU (xenod@freefall.cl.cam.ac.uk) (gcc version 3.3.3 20040412 (Red Hat Linux 3.3.3-7)) #1 SMP Sun Dec 4 22:29:04 GMT 2005
BIOS-provided physical RAM map:
Xen: 0000000000000000 - 0000000030000000 (usable)
0MB HIGHMEM available.
776MB LOWMEM available.
IRQ lockup detection disabled
Built 1 zonelists
Kernel command line: ip=192.168.0.113:1.2.3.4:192.168.0.250:255.255.255.0:hixen:eth0:off root=/dev/hdc2 rw 2
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 65536 bytes)
Xen reported: 2394.150 MHz processor.
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
vmalloc area: f1000000-fb7fe000, maxmem 34000000
Memory: 774528k/794624k available (1733k kernel code, 11532k reserved, 538k data, 136k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Mount-cache hash table entries: 512
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... disabled
Brought up 1 CPUs
NET: Registered protocol family 16
Brought up 1 CPUs
xen_mem: Initialising balloon driver.
Grant table initialized
Initializing Cryptographic API
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize
Xen virtual console successfully installed as tty1
Event-channel device installed.
netfront: Initialising virtual ethernet driver.
NET: Registered protocol family 2
Registering block device major 22
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
NET: Registered protocol family 1
NET: Registered protocol family 17
IP-Config: Complete:
device=eth0, addr=192.168.0.113, mask=255.255.255.0, gw=192.168.0.250,
host=hixen, domain=, nis-domain=(none),
bootserver=1.2.3.4, rootserver=1.2.3.4, rootpath=
kjournald starting. Commit interval 5 seconds
EXT3 FS on hdc2, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
VFS: Mounted root (ext3 filesystem).
Freeing unused kernel memory: 136k freed
INIT: version 2.86 booting
Activating swap.
Adding 1004020k swap on /dev/hdc1. Priority:-1 extents:1
Checking root file system...
fsck 1.37 (21-Mar-2005)
/dev/hdc2: clean, 35420/3662848 files, 1123406/7325640 blocks
EXT3 FS on hdc2, internal journal
System time was Fri Dec 23 18:21:43 UTC 2005.
Setting the System Clock using the Hardware Clock as reference...
System Clock set. System local time is now Fri Dec 23 18:21:48 UTC 2005.
Cleaning up ifupdown...done.
Checking all file systems...
fsck 1.37 (21-Mar-2005)
Setting kernel variables ...
... done.
Mounting local filesystems...
Cleaning /tmp /var/run /var/lock.
Running 0dns-down to make sure resolv.conf is ok...done.
Setting up networking...done.
Setting up IP spoofing protection: rp_filter.
Configuring network interfaces...SIOCADDRT: File exists
Failed to bring up eth0.
done.
Starting portmap daemon: portmap.
Setting the System Clock using the Hardware Clock as reference...
System Clock set. Local time: Fri Dec 23 18:21:53 UTC 2005
Initializing random number generator...done.
Recovering nvi editor sessions... done.
Setting up X server socket directory /tmp/.X11-unix...done.
Setting up ICE socket directory /tmp/.ICE-unix...done.
INIT: Entering runlevel: 2
Starting system log daemon: syslogd.
Starting kernel log daemon: klogd.
Starting portmap daemon: portmap.
Starting internet superserver: inetd.
Starting MySQL database server: mysqld.
Checking for crashed MySQL tables in the background.
Exporting directories for NFS kernel daemon...done.
Starting NFS kernel daemon: nfsdStarting mail transport agent: Postfix.
Starting OpenBSD Secure Shell server: sshd.
Starting NFS common utilities: statd.
Starting ProFTPD ftp daemon: proftpd.
Starting deferred execution scheduler: atd.
Starting periodic command scheduler: cron.
Starting web server: Apache2.
INIT: no more processes left in this runlevel
nfs warning: mount version older than kernel
nfs warning: mount version older than kernel
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
lockd_up: makesock failed, error=-5
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
printk: 3 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 712 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 848 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 272 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 166 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 705 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 615 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 517 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 341 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 643 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 284 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 345 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 338 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 860 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 189 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 803 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 172 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 291 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 265 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 178 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 471 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 627 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 626 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 59 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 266 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 10 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 48 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 38 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 61 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 27 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 44609 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 37594 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 490 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 538 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 659 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 106 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
lockd_down: no lockd running.
nfs warning: mount version older than kernel
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
lockd_up: no pid, 2 users??
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
lockd_up: no pid, 2 users??
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
lockd_up: no pid, 2 users??
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
Unable to handle kernel paging request at virtual address d2644000
printing eip:
c0144dac
*pde = ma 6207b067 pa 00047067
*pte = ma 66530000 pa 11104000
Oops: 0002 [#1]
SMP
Modules linked in:
CPU: 0
EIP: 0061:[] Not tainted VLI
EFLAGS: 00010296 (2.6.12.6-xenU)
EIP is at buffered_rmqueue+0x16c/0x260
eax: 00000000 ebx: 00000001 ecx: 00000400 edx: d2644000
esi: c124c880 edi: d2644000 ebp: 00000000 esp: c5051b88
ds: 007b es: 007b ss: 0069
Process mt.cgi (pid: 25743, threadinfo=c5050000 task=c9f88a20)
Stack: c124c880 00000003 00000000 00000000 000080d2 c5050000 c124c880 c0305400
00000000 00000000 000080d2 c0145357 c0305400 00000000 00000012 00000000
00000000 00000000 00000000 00000000 c9f88a20 00000010 c0306020 00000000
Call Trace:
[] __alloc_pages+0x407/0x430
[] do_anonymous_page+0xd3/0x230
[] do_no_page+0x64/0x410
[] do_no_page+0x64/0x410
[] pte_alloc_map+0x49/0x1f0
[] handle_mm_fault+0xf6/0x1e0
[] do_page_fault+0x1dc/0x68f
[] try_to_wake_up+0x2a2/0x2f0
[] activate_task+0x90/0xb0
[] autoremove_wake_function+0x2f/0x60
[] __do_page_cache_readahead+0xb1/0x1a0
[] do_page_fault+0x0/0x68f
[] error_code+0x2b/0x30
[] file_read_actor+0x20/0xf0
[] do_generic_mapping_read+0x409/0x620
[] __generic_file_aio_read+0x202/0x240
[] file_read_actor+0x0/0xf0
[] link_path_walk+0x5c/0x110
[] generic_file_aio_read+0x5b/0xb0
[] do_sync_read+0xb7/0xf0
[] vma_link+0x60/0xf0
[] autoremove_wake_function+0x0/0x60
[] old_mmap+0xd7/0x110
[] vfs_read+0xae/0x130
[] sys_read+0x51/0x80
[] syscall_call+0x7/0xb
Code: 5a 85 db 7e 4a 8b 74 24 18 31 ed 8d 74 26 00 89 34 24 b8 03 00 00 00 89 44 24 04 e8 4f 1c fd ff 89 c2 89 c7 b9 00 04 00 00 89 e8 ab 89 14 24 b8 03 00 00 00 83 c6 20 89 44 24 04 e8 8e 1c fd
<6>note: mt.cgi[25743] exited with preempt_count 1
printk: 33 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 86 messages suppressed.
Received packet needs 8 bytes more headroom.
Unable to handle kernel paging request at virtual address 98393bc0
printing eip:
c01e3bab
*pde = ma 00000000 pa 55555000
Oops: 0002 [#2]
SMP
Modules linked in:
CPU: 0
EIP: 0061:[] Not tainted VLI
EFLAGS: 00010282 (2.6.12.6-xenU)
EIP is at journal_put_journal_head+0xb/0x110
eax: 00000000 ebx: 98393bc0 ecx: daac0000 edx: daac0000
esi: daac0000 edi: c066ba00 ebp: c066bac0 esp: d2463e08
ds: 007b es: 007b ss: 0069
Process mysqld (pid: 6945, threadinfo=d2462000 task=d866ea20)
Stack: e87179fc 00000004 cebfa598 cebfa62c 00000024 cfeecb0c c01dcf29 daac0000
00000000 c016738b cfeecb3c d2463e40 c066ba14 00000001 cfeecb0c cfeecb0c
00001000 cfeecb0c c01dd1df c066ba00 cfeecb0c d55b1764 c11c2880 d55b1764
Call Trace:
[] journal_unmap_buffer+0xa9/0x2e0
[] try_to_free_buffers+0x6b/0xe0
[] journal_invalidatepage+0x7f/0x170
[] ext3_invalidatepage+0x3b/0x40
[] do_invalidatepage+0x27/0x30
[] truncate_complete_page+0x76/0xb0
[] truncate_inode_pages+0xdc/0x2f0
[] ext3_mark_iloc_dirty+0x29/0x40
[] generic_delete_inode+0xea/0x130
[] _atomic_dec_and_lock+0x31/0x50
[] iput+0x63/0xb0
[] sys_unlink+0xd6/0x130
[] sys_close+0x6d/0x90
[] syscall_call+0x7/0xb
Code: 24 08 89 44 24 04 e8 35 b2 f3 ff e8 20 64 f2 ff c7 04 24 8d 84 2d c0 e8 c4 a8 f3 ff 8d 74 26 00 53 83 ec 14 8b 54 24 1c 8b 1a 90 <0f> ba 2b 14 19 c0 85 c0 74 24 8d 74 26 00 8d bc 27 00 00 00 00



誰か、解析して(^^;


0 件のコメント:

コメントを投稿