windows pagfile utilization

[djoefish]

Could anyone help me with this?

I am running some memory intensive computations with python on XP, and
was running out of memory when the pagefile got full (~2g)...so I reset
the windows pagefile to 4g (maximum allowed).

My program still crashes at 2g (according to the task manager). Do I
need to inform python that the pagefile has a new size? How do I check
that python is utilizing the full pagefile?

thanks,

djoefish

[Richard Brodie]

"djoefish" <dj******@gmail .comwrote in message
news:11******** *************@p 79g2000cwp.goog legroups.com...

My program still crashes at 2g (according to the task manager). Do I
need to inform python that the pagefile has a new size? How do I check
that python is utilizing the full pagefile?

It won't. You'll hit the 2Gb user virtual address space limit first.

[Tim Chase]

Not page/swap -- by default Windows only gives 2GB to

applications for data; the rest is held for shared OS kernel
usage.

Is it just me or does this seem ludicrous? If I had a bunch of
re$ource$ and I employed someone to manage them for me, would I
find it acceptable that they consume half of the re$ource$ for
their own use just to manage the other half of my re$ource$?

"Thanks for putting 4 gigs of ram in your machine. How about I
let you use 2 of 'em while I underutilize the other 2 gigs?"

Sounds silly, IMHO.

-tkc

[djoefish]

I guess that means that I shouldn't waste my money bumping my RAM up
from 1g to 2g? What about Linux? Are there constraints there too?
djoefish

[Richard Brodie]

"Tim Chase" <py*********@ti m.thechases.com wrote in message
news:ma******** *************** *************** **@python.org.. .

"Thanks for putting 4 gigs of ram in your machine. How about I let you use 2 of 'em
while I underutilize the other 2 gigs?"

Sounds silly, IMHO.

Well, for a lot of scenarios, it's going to be the 2GB limit on system
space that is more of an issue. It's 2GB per process for user space,
whereas your whole filesystem cache, for example, is likely to have
to fit into that 2GB system space.

Having said that, tweaking the limit to 3GB, say, is a bit like rearranging
the deckchairs on the Titanic. DEC was doing much the same with big iron
VAX machines in '93. If you need that much space today, just use a 64-bit
system and get over it, unless you really are locked in.