pickle - recursion - stack size limit - MS windows

Andy Leszczynski

I need to pickle quite complex objects and first limitation was default
200 for the recursion. sys.setrecursionlimit helped, but still bigger
objects fail to be pickled because of XP stack size limitation.

Any idea how to get around the problem ...

A.

Nov 5 '05 #1

Subscribe Post Reply

3327

Christian Tismer

Andy Leszczynski wrote:

I need to pickle quite complex objects and first limitation was default
200 for the recursion. sys.setrecursionlimit helped, but still bigger
objects fail to be pickled because of XP stack size limitation.

Any idea how to get around the problem ...

If you can live with Python 2.3 at the moment (2.4.2 support is
expected after PyCon 2006 the latest), you can just use Stackless
Python. It is not limited by stack size and also includes
a version of cPickle that is unlimited.

cheers -- chris

--
Christian Tismer :^) <mailto:ti****@stackless.com>
tismerysoft GmbH : Have a break! Take a ride on Python's
Johannes-Niemeyer-Weg 9A : *Starship* http://starship.python.net/
14109 Berlin : PGP key -> http://wwwkeys.pgp.net/
work +49 30 802 86 56 mobile +49 173 24 18 776 fax +49 30 80 90 57 05
PGP 0x57F3BF04 9064 F4E1 D754 C2FF 1619 305B C09C 5A3B 57F3 BF04
whom do you want to sponsor today? http://www.stackless.com/

Dec 9 '05 #2

by: Georgy Pruss | last post by:

Sometimes I get this error. E.g. >>> sum = lambda n: n<=1 or n+sum(n-1) # just to illustrate the error >>> sum(999) 499500 >>> sum(1000) ............ RuntimeError: maximum recursion depth...

Python

No limit! (was: pickle complexity limit?)

by: Christian Tismer | last post by:

Martin v. Löwis wrote: > "Mark Hahn" <mark@hahnca.com> writes: > > >>I don't understand how this could happen with pickle. Isn't it supposed to >>stop when it runs into an object it has...

Python

Recursion elimination

by: Lorenzo Villari | last post by:

I've tried to transform this into a not recursive version but without luck... #include <stdio.h> void countdown(int p) { int x;

C / C++

is there problem that "has to" use recursion

by: paulw | last post by:

Hi Please give problems that "HAS TO" to use recursion (recursive calls to itself.) Preferrably real world examples, not knights tour. I'm thinking about eliminating the use of stack... ...

C / C++

maximum possible recursion

by: yogee | last post by:

Hi, I want to know if we have any limit for calling any function recoursively. If there is any, On what parameters this limit depends? and is it different for .net 1.0, 1.1 and 2.0? Thank you,...

.NET Framework

Recursion limit of pickle?

by: Victor Lin | last post by:

Hi, I encounter a problem with pickle. I download a html from: ...

Python

maximum recursion depth?

by: globalrev | last post by:

i received an error maximum recursion depth when processing large amounts of data. i dont know exactly how many recursive calls i made but id assume 50000 or so. is there a definitie limit...

Python

Javascript recursion limit

by: Jeff Bigham | last post by:

So, it appears that Javascript has a recursion limit of about 1000 levels on FF, maybe less/more on other browsers. Should such deep recursion then generally be avoided in Javascript?...

Javascript

is it tail recursion

by: Muzammil | last post by:

int harmonic(int n) { if (n=1) { return 1; } else { return harmonic(n-1)+1/n; } } can any help me ??

C / C++

Cloud Servers without Credit Card and Email Registration: A Simpler Way to Get on the Cloud

by: CloudSolutions | last post by:

Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...

General

Access Europe: Command bars, the Access Shortcut Tool and a simple Audit Log - Wed 3 April

by: isladogs | last post by:

The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...

General

One-click Importing Excel Data into a*Database

by: ryjfgjl | last post by:

In our work, we often need to import Excel data into databases (such as MySQL, SQL Server, Oracle) for data analysis and processing. Usually, we use database tools like Navicat or the Excel import...

Microsoft Excel

Easy Steps to Fix "Canon Printer Won't Connect to WiFi Network"

by: taylorcarr | last post by:

A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...

General

Basic Javascript concepts

by: aa123db | last post by:

Variable and constants Use var or let for variables and const fror constants. Var foo ='bar'; Let foo ='bar';const baz ='bar'; Functions function $name$ ($parameters$) { } ...

Javascript

Batch import of multiple excel files into the database

by: ryjfgjl | last post by:

If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...

Data Management

Migrating Website to Cloud - Emmanuel Katto

by: emmanuelkatto | last post by:

Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel

General

Navigating the Data Structures and Algorithms (DSA)

by: BarryA | last post by:

What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...

Algorithms / Advanced Math

How to build RAID in BIOS?

by: Hystou | last post by:

There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...

Computer Hardware

pickle - recursion - stack size limit - MS windows

Similar topics