[Click] oops on click-uninstall

Beyers Cronje bcronje at gmail.com
Fri Feb 16 09:06:10 EST 2007 

Last update for the day :) I reverted back to 2.6.16.13 and a previous
version of click that used to work fine on this same server and still
crashing :S I'm baffled..

Here's the messages I got this time:

[root at crovanto2850 click]# click-uninstall

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: Oops: 0002 [#1]

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: SMP

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: CPU:    1

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: EIP is at put_filesystem+0x1f/0x35

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: eax: 6b6b6ceb   ebx: 7be0c344   ecx: 00000000
edx: 6b6b6b6b

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: esi: 7be0c308   edi: f61fac98   ebp: f4c7bf08
esp: f4c7bf08

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: ds: 007b   es: 007b   ss: 0068

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: Process click-uninstall (pid: 14454,
threadinfo=f4c7a000 task=7bd9c330)

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:21 2007 ...
crovanto2850 kernel: Stack: <0>f4c7bf1c 78164c27 7be0c308 afff02f8
f4c7a000 f4c7bf2c 78178c3c f4c7bf4c

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:        7844eab4 f4c7bf38 7816b275 00000000
f4c7bfa4 781799f2 00000002 7be0c308

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:        afff02f8 f40be600 afff02f8 00000016
40000003 f4c7bf70 00000001 00000001

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel: Call Trace:

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78103c8a>] show_stack_log_lvl+0xb9/0x103

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78103e66>] show_registers+0x192/0x228

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78104135>] die+0x10f/0x21e

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78318061>] do_page_fault+0x1e1/0x600

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78103773>] error_code+0x4f/0x54

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78164c27>] deactivate_super+0x89/0x95

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78178c3c>] mntput_no_expire+0x44/0x74

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<7816b275>] path_release_on_umount+0x15/0x18

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<781799f2>] sys_umount+0x3a/0x267

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78179c38>] sys_oldumount+0x19/0x1b

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel:  [<78102bd5>] syscall_call+0x7/0xb

Message from syslogd at crovanto2850 at Fri Feb 16 16:04:22 2007 ...
crovanto2850 kernel: Code: 5d c3 0f 0b 65 01 af 27 33 78 eb dc 55 89
e5 8b 50 10 85 d2 74 1c b8 00 e0 ff ff 21 e0 8b 40 10 c1 e0 07 05 00
01 00 00 8d 04 02 <ff> 08 83 3a 02 74 02 5d c3 8b 82 08 11 00 00 e8 47
e5 f9 ff 5d

Cheers

Beyers


On 2/16/07, Beyers Cronje <bcronje at gmail.com> wrote:
> OK, an update, after turning on lock debugging I get the following
> syslog message, seems like the problems actually starts with mounting
> clickfs...
>
> The click config used was just a simple 'Idle;'. Server crashed after
> click-uninstall.
>
> Eddie, any idea ?
>
> Feb 16 14:11:14 crovanto2850 kernel: click: starting router thread pid
> 10201 (f5de206c)
> Feb 16 14:11:14 crovanto2850 kernel: BUG: key f5729374 not in .data!
> Feb 16 14:11:14 crovanto2850 kernel: BUG: warning at
> kernel/lockdep.c:1954/lockdep_init_map()
> Feb 16 14:11:14 crovanto2850 kernel:  [<c0104cbd>] dump_trace+0x1d2/0x1ea
> Feb 16 14:11:14 crovanto2850 kernel:  [<c0104cef>]
> show_trace_log_lvl+0x1a/0x30
> Feb 16 14:11:14 crovanto2850 kernel:  [<c0105086>] show_trace+0x12/0x14
> Feb 16 14:11:14 crovanto2850 kernel:  [<c01050a1>] dump_stack+0x19/0x1b
> Feb 16 14:11:14 crovanto2850 kernel:  [<c0135218>]
> lockdep_init_map+0x1b4/0x3ba
> Feb 16 14:11:14 crovanto2850 kernel:  [<c016899a>] sget+0x13e/0x322
> Feb 16 14:11:14 crovanto2850 kernel:  [<c0168ba2>] get_sb_single+0x24/0x92
> Feb 16 14:11:14 crovanto2850 kernel:  [<faf8da13>]
> click_get_sb+0x1d/0x24 [click]
> Feb 16 14:11:14 crovanto2850 kernel:  [<c01683ad>] vfs_kern_mount+0x93/0x114
> Feb 16 14:11:14 crovanto2850 kernel:  [<c0168476>] do_kern_mount+0x30/0x43
> Feb 16 14:11:14 crovanto2850 kernel:  [<c017c38f>] do_mount+0x28a/0x654
> Feb 16 14:11:14 crovanto2850 kernel:  [<c017c7c8>] sys_mount+0x6f/0xa9
> Feb 16 14:11:14 crovanto2850 kernel:  [<c0103b85>]
> sysenter_past_esp+0x56/0x8d
> Feb 16 14:11:14 crovanto2850 kernel:  [<b7fe7410>] 0xb7fe7410
> Feb 16 14:11:14 crovanto2850 kernel:  =======================
> Feb 16 14:11:18 crovanto2850 kernel: click: stopping router thread pid 10201
>
>
>
> On 2/16/07, Beyers Cronje <bcronje at gmail.com> wrote:
> > Hi guys,
> >
> > This is a start on an attempt to narrow down crashes on
> > click-uninstall with proclikefs. It seems I can reproduce this crash
> > now. Unfortunately I dont have a console connection to the server so
> > I'm left with what's reported in syslog. The one time I did have
> > console access it seemed the offending function was -
> > proclikefs_put_super
> >
> > Currently running 2.6.19.2, last night's Click CVS version, e1000-7.x
> > polling driver. Unfortunately the click 2.6.19.2 patch does not patch
> > files enabled by CONFIG_LOCKDEP, I will correct this and enable full
> > spinlock debugging.
> >
> > As a start this is what was logged in syslog:
> >
> > Feb 16 10:38:46 crovanto2850 kernel: Slab corruption: start=edc229d0,
> len=64
> > Feb 16 10:38:46 crovanto2850 kernel: Redzone: 0x5a2cf071/0x5a2cf071.
> > Feb 16 10:38:46 crovanto2850 kernel: Last user:
> > [<fae85a1e>](_ZdaPv+0x6a/0x9a [click])
> > Feb 16 10:38:46 crovanto2850 kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 64 81 7f f4
> > Feb 16 10:38:46 crovanto2850 kernel: Prev obj: start=edc22984, len=64
> > Feb 16 10:38:46 crovanto2850 kernel: Redzone: 0x170fc2a5/0x170fc2a5.
> > Feb 16 10:38:46 crovanto2850 kernel: Last user:
> > [<fae85ec1>](_Znwj+0x21/0x70 [click])
> > Feb 16 10:38:46 crovanto2850 kernel: 000: 7f 3f ff ff 58 58 58 69 10
> > 00 00 00 d4 e5 ea ed
> > Feb 16 10:38:46 crovanto2850 kernel: 010: 30 fc ed ee 01 00 00 00 20
> > 00 00 00 14 00 00 00
> > Feb 16 10:38:46 crovanto2850 kernel: Next obj: start=edc22a1c, len=64
> > Feb 16 10:38:46 crovanto2850 kernel: Redzone: 0x5a2cf071/0x5a2cf071.
> > Feb 16 10:38:46 crovanto2850 kernel: Last user:
> > [<fae85b3c>](click_lfree+0x22/0x24 [click])
> > Feb 16 10:38:46 crovanto2850 kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 6b 6b 6b 6b
> > Feb 16 10:38:46 crovanto2850 kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 6b 6b 6b 6b
> > Feb 16 10:40:40 crovanto2850 kernel: e1000_poll_off
> > Feb 16 10:40:40 crovanto2850 kernel: Slab corruption: start=edc229d0,
> len=64
> > Feb 16 10:40:40 crovanto2850 kernel: Redzone: 0x5a2cf071/0x5a2cf071.
> > Feb 16 10:40:40 crovanto2850 kernel: Last user:
> > [<fae858de>](_ZdlPv+0x6a/0x9a [click])
> > Feb 16 10:40:40 crovanto2850 kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 90 db 8d f0
> > Feb 16 10:40:40 crovanto2850 kernel: Prev obj: start=edc22984, len=64
> > Feb 16 10:40:40 crovanto2850 kernel: Redzone: 0x5a2cf071/0x5a2cf071.
> > Feb 16 10:40:40 crovanto2850 kernel: Last user:
> > [<c01a1981>](free_rb_tree_fname+0x41/0x82)
> > Feb 16 10:40:40 crovanto2850 kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 6b 6b 6b 6b
> > Feb 16 10:40:40 crovanto2850 kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 6b 6b 6b 6b
> > Feb 16 10:40:40 crovanto2850 kernel: Next obj: start=edc22a1c, len=64
> > Feb 16 10:40:40 crovanto2850 kernel: Redzone: 0x5a2cf071/0x5a2cf071.
> > Feb 16 10:40:40 crovanto2850 kernel: Last user:
> > [<fae858de>](_ZdlPv+0x6a/0x9a [click])
> > Feb 16 10:40:40 crovanto2850 kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 6b 6b 6b 6b
> > Feb 16 10:40:40 crovanto2850 kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b
> > 6b 6b 6b 6b 6b 6b 6b
> > Feb 16 10:40:40 crovanto2850 kernel: device eth2 left promiscuous mode
> > Feb 16 10:40:40 crovanto2850 kernel: click: stopping router thread pid
> 14206
> > Feb 16 10:40:40 crovanto2850 kernel: poll fb05c3a0: 680928/1952766090
> > freed, 661510/1857091501 allocated
> > Feb 16 10:40:40 crovanto2850 kernel: click module exiting
> > Feb 16 10:40:41 crovanto2850 kernel: list_del corruption. prev->next
> > should be f5dac820, but was 6b6b6b6b
> >
> > Cheers
> >
> > Beyers
> >
>

More information about the click mailing list