Hi,
I am pickling big graphs of data and running into this problem:
[...]
File "/usr/lib/python2.2/pickle.py", line 225, in save
f(self, object)
File "/usr/lib/python2.2/pickle.py", line 414, in save_list
save(element)
File "/usr/lib/python2.2/pickle.py", line 219, in save
self.save_reduce(callable, arg_tup, state)
File "/usr/lib/python2.2/pickle.py", line 249, in save_reduce
save(state)
File "/usr/lib/python2.2/pickle.py", line 225, in save
f(self, object)
File "/usr/lib/python2.2/pickle.py", line 447, in save_dict
save(value)
File "/usr/lib/python2.2/pickle.py", line 219, in save
self.save_reduce(callable, arg_tup, state)
File "/usr/lib/python2.2/pickle.py", line 245, in save_reduce
save(arg_tup)
File "/usr/lib/python2.2/pickle.py", line 225, in save
f(self, object)
File "/usr/lib/python2.2/pickle.py", line 374, in save_tuple
save(element)
File "/usr/lib/python2.2/pickle.py", line 225, in save
f(self, object)
File "/usr/lib/python2.2/pickle.py", line 405, in save_list
write(self.put(memo_len))
RuntimeError: maximum recursion depth exceeded
However, it works when i try the smallest examples and use
sys.setrecursionlimit(4000)
This seems like a limitation in the pickling code. Yes?
The data is perhaps better off in some kind of DB designed for
massively interconnected objects. Any suggestions? ZODB ?
BTW, the data is path searching info for a game, and takes 1-2Mb of memory.
Thankyou,
Simon Burton. 1 5054
At 11:29 AM +1100 3/11/03, Simon Burton wrote: Hi,
I am pickling big graphs of data and running into this problem:
[...] File "/usr/lib/python2.2/pickle.py", line 225, in save f(self, object) File "/usr/lib/python2.2/pickle.py", line 414, in save_list save(element)
....
File "/usr/lib/python2.2/pickle.py", line 225, in save f(self, object) File "/usr/lib/python2.2/pickle.py", line 405, in save_list write(self.put(memo_len)) RuntimeError: maximum recursion depth exceeded
However, it works when i try the smallest examples and use sys.setrecursionlimit(4000)
This seems like a limitation in the pickling code. Yes?
I would suspect that you have a loop in your definitions, eg. A
imports B, and B imports A, particularly since you're trying small
examples, and they're still exceeding the recursion depth.
Hope that helps,
Anthony
--
----------------------------------------------------
HyPEraCtiVE? HeY, WhO aRE YoU cALliNg HypERaCtIve?! aB*****@wEStNeT.cOm.aU
---------------------------------------------------- This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: Bill Loren |
last post by:
Hi ppl,
Trying to substitute some html tags within a big html file using RE ended up
with the "RuntimeError: maximum recursion limit exceeded" message.
Any idea why that might happen and how...
|
by: Georgy Pruss |
last post by:
Sometimes I get this error.
E.g.
>>> sum = lambda n: n<=1 or n+sum(n-1) # just to illustrate the error
>>> sum(999)
499500
>>> sum(1000)
............
RuntimeError: maximum recursion depth...
|
by: Christian Tismer |
last post by:
Martin v. Löwis wrote:
> "Mark Hahn" <mark@hahnca.com> writes:
>
>
>>I don't understand how this could happen with pickle. Isn't it supposed to
>>stop when it runs into an object it has...
|
by: Sujit Marar |
last post by:
When I run on Webware(Python application Server),
there is a web Page that has a "Cancel" button , When
I press the Cancel button , I get the following error
based on the following code snippet...
|
by: Michael Hohn |
last post by:
Hi,
under python 2.2, the pickle/unpickle sequence incorrectly restores
a larger data structure I have.
Under Python 2.3, these structures now give an explicit exception from...
|
by: andrewfelch |
last post by:
Hello all,
I'm using the metaclass trick for automatic reloading of class member
functions, found at: http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/160164
My problem is that if I
1)...
|
by: Victor Lin |
last post by:
Hi,
I encounter a problem with pickle.
I download a html from:
...
|
by: globalrev |
last post by:
i received an error maximum recursion depth when processing large
amounts of data.
i dont know exactly how many recursive calls i made but id assume
50000 or so.
is there a definitie limit...
|
by: mark starnes |
last post by:
Hi everyone, this is my first post to this group, so please be gentle.
I've written a class which, when I attempt to pickle, gives the error:
*** RuntimeError: maximum recursion depth exceeded...
|
by: ryjfgjl |
last post by:
ExcelToDatabase: batch import excel into database automatically...
|
by: isladogs |
last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM).
In this month's session, we are pleased to welcome back...
|
by: isladogs |
last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM).
In this month's session, we are pleased to welcome back...
|
by: jfyes |
last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
|
by: ArrayDB |
last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
|
by: PapaRatzi |
last post by:
Hello,
I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
|
by: CloudSolutions |
last post by:
Introduction:
For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
|
by: Defcon1945 |
last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
|
by: Faith0G |
last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
| |