Firebug will by default use up memory to log all network requests (this is already being addressed in Firebug 1.1/1.2). So I'd try browsing with Firebug disabled (disable it from the extensions manager).

Also - try out Firefox 3 Beta 2 (Firebug 1.1b10 works with it) - memory footprint has been a big focus for this release.